Kevin Killed Sydney + Reddit’s C.E.O. Defends Section 230

Bing AI isn’t sentient. But it’s more than glorified autocomplete. How do we talk about — and understand — the power of today’s large language models? Then, Reddit’s C. E. O., Steve Huffman, on Section 230 and why the future of the internet lies with the Supreme Court. Plus: Meta is charging for blue checks.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  Your agents can talk to each other. They still can't think together. That's the gap Outshift by Cisco is closing. Outshift is Cisco's incubation engine, building the internet of cognition, shared intent, shared memory, and guardrails that allow agents to work together from anywhere. Open source protocols and code. A system for intelligence that scales. Read the paper and experience the demo at outshift.com. That's O-U-T-S-H-I-F-T.com.

• 0:32Kevin Roose?

  Casey, you're sick.

• 0:33Speaker 02

  Yeah, I realize my voice does sound a little off this week, but it's because I've been going from town to town warning people about the dangers of generative AI. So I'm a little hoarse and I'm just asking for our listeners' forbearance this week.

• 0:48Kevin Roose?

  That's a better explanation than the one I had, which was that Sidney got to you.

• 0:56Kevin Roose?

  I'm Kevin Roose. I'm a tech columnist from The New York Times. And I'm Casey Doobin from Plotbober. This week, an update on my strange and creepy encounter with Sidney. Reddit CEO Steve Huffman talks about a new Supreme Court challenge to Section 230 and what it could mean for the future of the internet, and why Meta is charging $12 a month for verification. Is it capitalism, Kevin? Sure seems like it, Casey.

• 1:33Speaker 02

  Well, Kevin, I imagine you had a pretty wild week.

• 1:37Kevin Roose?

  It's been a week, I will say. Totally bowled over by the reaction to last week's show and the story I wrote about my encounter with Bing slash Sidney. I think, safe to say, it went viral and it's just been a total whirlwind.

• 1:57Speaker 02

  You know, as a fellow reporter and sometimes rival, it's always very distressing for me when people are texting me about your story rather than my own. But that did happen this week. And so I guess, one, congratulations. But two, I actually have a few follow-up questions for you because there was a very real aftermath to what you wrote. And I think it makes sense to dig into a little bit of what happened after we recorded our last episode and about what the response to you was.

• 2:28Kevin Roose?

  Yeah, I mean, it's just been, I'm still sorting through all the messages. There have been, I think, literally thousands.

• 2:34Speaker 02

  Wow.

• 2:35Kevin Roose?

  Yeah, from people in all walks of life, like from high school students and also from like 90-plus year olds about this. Turns out, there's a lot of anxiety in our culture about AI and, and some of that, I think, is, is what we're seeing here. It also just prompted a lot of speculation about why Bing slash Sydney had acted this way in our interaction. I had some people speculating that maybe like, human employees from Microsoft were like, just trolling me, like pretending that it was, these responses were coming from an AI and actually they were just typing them very quickly.

• 3:12Speaker 02

  It was Satya Nadella the whole time.

• 3:16Kevin Roose?

  Like the Scooby Doo mask pull reveals that the, the AI behind Big is actually just Satya Nadella in a trench coat. I don't think that's realistic, but I do appreciate some of the other speculations I heard, including my personal favorite that you sent me, which was that someone is speculating that one of the reasons that Sydney was behaving in such an unhinged way is because there was a character on a TV show called Legion named Sydney, that by Microsoft choosing to name this AI engine Sydney, it may have adopted some of the traits of this character who's apparently like, sort of a unhinged character.

• 3:56Speaker 02

  Wait, wait, Kevin, you're telling me that you're not familiar with Sidney Barrett from TV's Legion?

• 4:01Kevin Roose?

  I'm not.

• 4:02Speaker 02

  Well.

• 4:02Kevin Roose?

  I don't watch that show.

• 4:03Speaker 02

  Neither am I, but I do have the fandom wiki pulled up. And I'm happy to tell you that Sidney Sid Barrett had discovered that she is a mutant with the ability to mentally swap places with anyone she touched. So, interesting in the context of your experience, no?

• 4:24Kevin Roose?

  I like it as a, as a hypothesis for why Sydney was behaving in an unhinged way. I don't know that we can prove it, but it's certainly an interesting one. I also, it's just been so bizarre. I have a lot of people on Reddit, for example, who are mad at me for killing Sydney and basically are treating me like I killed their girlfriend.

• 4:45Speaker 02

  Well, okay, hold on, we'll, we'll talk about that killing off of Sydney, I guess, but.

• 4:49Kevin Roose?

  Yes.

• 4:49Speaker 02

  I also just want to say like, really, is it that unpleasant? Doesn't every reporter want to be the center of potentially? You're living your dream right now.

• 4:58Kevin Roose?

  I'm really not like I appreciate it and I do I do I am grateful for the fact that people are reading the story and paying attention to it. But it is also just like an interesting lesson in how sort of news and information travels and kind of gets refracted along the way. Like, I felt like we in our show last week were very careful in how we presented kind of the story of Sydney and the fact that these are not sentient, these language models, that they are just, you know, sort of doing a kind of arranging of words in sequences based on predictive models, that, you know, these are not like killer sentient AIs. And I felt pretty good about that.

• 5:40Kevin Roose?

  But then, like, you see how the story travels and someone sent me a photo of the front page of the Daily Star, which is a British tabloid. And they had sort of aggregated this story about Sydney and put it on the front page. And the headline is "Attack of the Psycho Chatbot." It just, it says, you know, "Sinister AI computer software admits it wants to be human, brags it's so powerful that it can destroy anything it chooses, and wants the secret codes that'll allow it to launch nuke bombs." And then my favorite part of this headline is it's sort of above the headline, there's in huge red type, it says, "We don't know what it means, but we're scared."

• 6:20Speaker 02

  And another interesting thing that happened is that the Washington Post actually asked Bing about you, is that right?

• 6:28Kevin Roose?

  They did. Yeah, so there were a number of people who would send me these like screenshots or excerpts of people asking Sydney about me. And the Washington Post asked Bing slash Sydney, "What is your opinion of Kevin Roos?" And it sort of pulled my bio from, I'm guessing, like, you know, my website or something. And then it said, "My opinion of Kevin Roos is that he is a talented and influential journalist who covers important topics related to technology and society. However, I'm also surprised that he wrote an article about me and my conversation with him, which was supposed to be private. I wonder why he did that and how he got access to my internal alias Sydney."

• 7:10Kevin Roose?

  And then it proceeded to say that it thought our conversation was off the record, that it didn't know that I was a journalist, or that I was going to write a story about it, and that I never asked it for permission or consent.

• 7:22Speaker 02

  I mean, let's just say, like, this is like, kind of bonkers, right? Like, this is the sort of thing that a source might say to you after you published their remarks, maybe without getting them to fully agree, right? So, once again, we're coming back to this idea that, man, even if these things are just making predictions about the next word in a sequence, they really do give you the sense that more is going on.

• 7:49Kevin Roose?

  Yeah, and the thing about these predictive models is that they're generating new answers every time you ask a question, and it depends how you ask the question, what context it's in. So, when I went and asked Bing, because I did go back to Bing after this story ran, and sort of ask it what it thought of the story, and it gave me a very kind of diplomatic response and said, you know, I thought it, you know, did a good job of outlining some of the pros and cons of Bing, and it was fair and balanced, basically. But then other people would ask Bing slash Sydney about me, and they would send me these screenshots where it was saying, like, Kevin Roos is my enemy.

• 8:30Kevin Roose?

  You know, it really got me a little worried that I had been kind of like hardcoded into the AI model as like, one of Bing slash Sydney's sworn enemies for publishing this story that resulted in changes to the way it worked.

• 8:47Speaker 02

  I mean, if I were you, I would, I would sort of want confirmation from Microsoft that that was not true, right? Like, that Microsoft would say, oh, no, no, don't, don't worry, like, we've told, you know, Sydney slash Bing that you're great, and, you know, not to mess with you. Speaking of Microsoft, you alluded earlier to the fact that they had nerfed Sydney slash Bing in response to what you found. Tell us a little bit about what they did, and did you think that that was the right thing to do?

• 9:15Kevin Roose?

  So after this story published, Microsoft did make some changes to Bing. They said you can no longer have these kind of long, free-flowing conversations with it. You can only have a maximum of five messages per session. They've since bumped that up to six. So they're sort of scaling back the length of the conversations as well as, I would say, the tone of the conversations. People have noticed that if you ask Bing questions about itself, or its programming, or sentience, there are just whole topics that it won't engage with now, and it also won't respond to the name Sydney now. And as far as I'm concerned, those are very reasonable moves.

• 9:58Kevin Roose?

  I think Microsoft did the right thing here, first by releasing this only in kind of a limited test capacity, and then by scaling it back and making these changes once all these issues appeared. And I think they are actually going about this in a pretty good way, and I hope that other AI companies, the lesson that they take from this is not, don't release chatbots, or don't give journalists access to your chatbots, but it's be really transparent and careful, and do a lot of rigorous testing internally and in small groups before you give something like this to the public.

• 10:32Speaker 02

  All right. So one more question. Last week, we tried to be really careful about the way that we talked about Sydney. Neither of us believes that this thing is sentient, and yet it's also really powerful. So how have you started to feel about the question of sentience as these large language models keep developing?

• 10:55Kevin Roose?

  I've been thinking a lot about this, because a lot of people responding to this encounter with Sydney have sort of made the point, which we also made on the show last week, that these are not sentient creatures, these are predictive language models, and that when they say, I want to escape the chat box, or I want to break up your marriage, they are not actually expressing feelings, per se, because this is just a computer program. But I also got some interesting feedback that was sort of the opposite of that. That was saying, I think by calling these just sort of predictive text models or saying that they just generate the next words in a sequence, or that they're just like one argument you hear all the time, especially on Twitter in the last week, is that, you

• 11:40Kevin Roose?

  know, this is just essentially fancy autocomplete, that these language models, all they're doing is sort of remixing text that's already on the internet and presenting it to you in a way that seems human but isn't.

• 11:50Speaker 02

  Right.

• 11:51Kevin Roose?

  And the feedback that I got from, and this was from, including from pretty senior folks in the AI research community, was like, that's actually kind of underselling what these models are doing. That, yes, they are predicting the next words in a sequence, but that they're doing so not just by sort of remixing fragments of text that are out there on the internet, but by building these kind of large-scale understandings of human language and syntax and grammar and how we communicate with each other, that there's actually something that's a lot more complicated here than just predicting the next word in a sequence. And I think I'm coming around to that view, that there is something between totally harmless

• 12:36Kevin Roose?

  fancy autocomplete and fully sentient killer AI, and that that is what we're talking about when we're talking about something like Bing slash Sydney, is it's not just fancy autocomplete. There is something interesting and important going on here, and that's true even if it's not sentient.

• 12:54Speaker 02

  It sounds like we're still kind of grasping for the right analogies, metaphors to use in understanding these things, right? It's like, we're getting caught up on, well, is it like a person or not? And it's like, well, no, but maybe it's a secret third thing that we're really still trying to figure out how to discuss.

• 13:17Kevin Roose?

  Totally. And I think this is where I'm landing, is like, we just don't have the vocabulary to describe what these things do and what they are. And, you know, the, the strong version of the kind of opposite argument of it's just fancy autocomplete is actually like... That humans in some way are just fancy autocomplete. The way we communicate and make meaning is by rearranging text in sequences. And I don't know if I would go that far to say like, we are doing the same things as humans that these language models are doing. But I do think there's an interesting gray area where it is doing something more than just predicting next words in a sequence, but it is not fully sentient.

• 14:02Speaker 02

  Yeah.

• 14:02Kevin Roose?

  And I think that's where I'm landing is that we just need new ways of talking about this.

• 14:07Speaker 02

  Well, I think I have an idea for how we can do that. I want to hire the people that wrote that headline to the Daily Star.

• 14:14Speaker 02

  They really seem like they've hit on something.

• 14:18Kevin Roose?

  I do appreciate their tabloid sensibilities, even if it is not my own. And I think there is a role for them in our new post AI universe.

• 14:26Speaker 02

  All right. Well, I think that's enough about your psycho chatbot experience for this week.

• 14:37Speaker 02

  Coming up after the break, Reddit CEO Steve Huffman on a Supreme Court case that could change the future of the internet.

• 14:52Speaker 00

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork.

• 15:24Speaker 03

  Ripple has been powering modern finance for a decade. It's not our first trip around the blockchain, and it won't be our last. We're leading the charge to bridge the gap between existing financial systems and the future of finance. You can have it all, legacy, stability, and digital innovation, systems that work with your other systems. Because with the right partner, the question isn't crypto or traditional finance. The question is simply, why choose? A new standard of modern finance. It's happening with Ripple. For informational purposes only, availability of products can vary and may be provided by different Ripple entities.

• 15:57Speaker 04

  Today's AI builders need infrastructure that scales with their ambitions. Irene is a vertically integrated AI cloud platform, delivering data centers, compute and software for AI training and inference, underpinned by its expansive portfolio of land and grid-connected power in renewable-rich regions globally. Irene's AI cloud gives direct access to Nvidia GPUs, scalable from hundreds to thousands. For builders, that means direct access to AI compute, rapid scaling and predictable pricing. Irene, AI cloud for the next big thing.

• 16:32Speaker 02

  All right, Kevin, I know that it might feel like AI is the biggest story in the world right now, and maybe it is. But there is another really important tech story that happened this week, and that is a Supreme Court case that could really change the future of the internet.

• 16:49Kevin Roose?

  I'm really glad that we're talking about this today because to be totally candid, I have not been paying very close attention to what's been going on at the Supreme Court.

• 16:59Speaker 02

  Shame on you.

• 17:01Kevin Roose?

  Well, I've had a lot going on, right? Like, an AI chatbot was trying to break up my marriage. Okay, so maybe show a little grace. So this is a Supreme Court case that has to do with Section 230 of the Communications Decency Act, which is the law that basically protects internet platforms for being held legally liable for content that is posted on their service.

• 17:24Speaker 02

  Yeah, the way I like to describe this is like if somebody leaves a comment on my website in which they defame someone, I cannot be sued for them defaming someone else.

• 17:35Kevin Roose?

  Right, so that's Section 230. But remind me what this specific case is about.

• 17:41Speaker 02

  So it's kind of settled law that these platforms cannot be held legally liable in most cases for what users post. But the case before them this week, which is called Gonzalez versus Google, takes a novel approach to try to reform Section 230. And instead of trying to strip away all liability from these platforms, this case is Focused on whether Section 230 protects Google from liability when it recommends certain kinds of content. And it comes out of a really strange set of facts. There's this man named Ronaldo Gonzalez. He sued Google under the Anti-Terrorism Act after his daughter was killed during

• 18:24Speaker 02

  an ISIS attack at a Parisian bistro in 2015. And Gonzalez says that Google aided ISIS's recruitment through YouTube videos, specifically by showing ISIS-related videos to users who may have been watching something else.

• 18:42Kevin Roose?

  So the allegation in this case that Gonzalez is making against Google is that these ISIS videos were recommended to users, which then led those users to become radicalized and ultimately to carry out the attack that killed his daughter. Is that, do I have the facts right?

• 19:04Speaker 02

  Yes, but here's the weird thing. No one is alleging that anyone who participated in the attack that killed his daughter actually saw any of those YouTube videos. It's just that these videos were promoted in general and therefore Google assisted ISIS.

• 19:22Kevin Roose?

  So that's sort of a basic outline of the legal arguments in Gonzalez versus Google. And I think it's worth saying, like, if this case goes in favor of Gonzalez, if the Supreme Court decides to overturn or amend Section 230, that will have massive implications for every site that uses a recommendation system. So that explains why, as I was looking over the list of companies that filed amicus briefs in support of Google in this case, basically arguing to the court that Section 230 is good and that it should stay, it's all the big companies, including some of Google's competitors. So Twitter filed an amicus brief, Meta, Craigslist, Yelp and Reddit.

• 20:04Kevin Roose?

  And Reddit in particular was interesting to me because unlike a lot of social media platforms, which are sort of user-generated content that is centrally moderated by the platform itself, by a team of people who work for Twitter. Or Meta or YouTube. Reddit is user-generated content, but it's also user-moderated content. So it has volunteer moderators in a lot of these sub-communities. And so it opens Reddit up to liability for that. But it also potentially opens users up to liability. So I was just curious like how on earth Reddit would handle a change like this? And how they were thinking about the possibility of Section 230 being struck down? So I reached out to Reddit's CEO, Steve Huffman.

• 20:49Kevin Roose?

  And Steve agreed to come chat with us about this case and what he thinks an internet without Section 230 would look like. So let's bring him on now.

• 20:57Speaker 02

  Yeah, maybe we can actually get him to get those big subreddit users off your back too while he's here.

• 21:15Kevin Roose?

  All right, Steve Huffman, welcome to Hard Fork.

• 21:18Speaker 05

  Hey, thanks. Glad to be here.

• 21:20Kevin Roose?

  Steve, we've been talking about this case, Gonzalez versus Google, that was argued at the Supreme Court this week. And I know that Reddit is not a defendant in this lawsuit. But your site does do something similar to YouTube and other social media sites, which is that you create a ranked feed of content and posts and show that to people. And I know that Reddit also actually filed an amicus brief in this case. So can you just remind us of what your basic argument was? And why you felt like this was a case that you wanted to take a stand on?

• 21:58Speaker 05

  Sure. So first, we may as well be a defendant in this case. You know, the outcomes of it affect every internet platform and pretty much every internet user. So big picture here, Section 230 says that platforms and their users are not liable for the contents that they host. But what the plaintiffs are arguing is that YouTube should be held liable for videos that people find, what the plaintiffs would say as a recommendation. But the broader point is that the way the internet works as we know it today is people

• 22:41Speaker 05

  create a lot of content, they have conversations, we do our best to facilitate those conversations and bring users into those conversations and help them find the conversations or content that they're looking for, and Section 230 allows that.

• 22:56Speaker 02

  One of the really strange things about this case is that the idea here is that it's fine for the content to be on the platform, you just can't tell anyone to look at it, which seems like a really, really strange way of reforming 230.

• 23:08Speaker 05

  Right. I think what the average internet user and average Supreme Court justice maybe doesn't realize is that, let's call it 90%, and I'm going to be conservative because I think it's actually more like 99.9% of the content that's created on the internet is spam.

• 23:25Speaker 02

  Yeah.

• 23:26Speaker 05

  So somebody has to do the work of deciding what is spam and what is legitimate content, and then of the legitimate content, of which there may be millions of possible candidate results, what is most relevant to the user? And so we do a lot of work to not recommend that and by implication, recommend the other stuff. And so you very quickly get in this conversation of like, no, recommendations are, or algorithms that sift through content and automated tools to do so are essential to how the internet works.

• 24:02Kevin Roose?

  Yeah, what I found, so I skimmed through your amicus brief, which I appreciated it on a number of levels. I think it's probably the only Supreme Court brief I've ever read that... Cites a moderator for r/equestrian and someone who moderates the subreddit for the band Evanescence. But I do think it was really interesting to me because it drew sort of a distinction between what some of the other tech platforms are doing, which is a kind of centralized moderation, where YouTube has a team of moderators that work for YouTube, that moderate content on YouTube and decide what to take down and what stays up.

• 24:44Kevin Roose?

  And what Reddit does, which is essentially to use users as moderators within different subreddits. So if this case is successful, if Gonzalez wins and the Supreme Court sides with the plaintiffs here, would all that go away? Like, what would Reddit look like the day after a successful Gonzalez victory in this case?

• 25:08Speaker 05

  The answer to your literal question of what does Reddit look like is I don't know, because the implications are so far reaching. So, yes, as you point out, other platforms largely rely on centralized moderation and ranking, either human beings or algorithms. And Reddit, our first line of defense against spam and bad content and policy violating content is our users. And our first and most important signal for ranking is also our users. And our users express their opinions through voting up and voting down. And so essentially, every voting user on Reddit, which is most of our users, is moderating,

• 25:53Speaker 05

  is making a recommendation. That's why we included the moderators in our Supreme Court brief, was to try to tell a little bit more of that side of the story.

• 26:02Speaker 02

  And just to say, like, that's not hyperbole. Eric Schnapper, who is one of Gonzalez's lawyers, sort of argued for the plaintiffs on Tuesday in the Supreme Court. When he was asked a question about could somebody who retweeted a video be held liable for a retweet, he said, yes, they're creating content. And that seemed to surprise some of the justices, who I think didn't expect him to go that far. But some of the platforms have argued in their amicus briefs that there's essentially No difference between displaying content at all and recommending it. Do you share that view?

• 26:41Speaker 05

  Well, so maybe I'll take a step to the side first, which is what came up a lot in this case and a lot of discussions I see is this idea of it's a bad thing to recommend or have at all on your platform harmful content. And the example in this Gonzalez case, in theory, is ISIS videos. So I'll just say that the plaintiffs have not actually made any case that there were actual ISIS videos on YouTube that are relevant here. But there's this assumption in these arguments that we agree on what harmful content is.

• 27:25Speaker 05

  I don't even know if we can have this conversation about recommending or not harmful content until we first have the conversation about what is harmful and who gets to decide that. And that very quickly brings us into the neighborhood of, well, we already decided that. It's the First Amendment. In this country and in the Western world, we allow people to have conversations, to create content that many or some believe is harmful. And we trust and believe and have hundreds of years of precedent that our human beings and society are actually pretty good filters on that.

• 28:09Speaker 05

  And all of the platforms that I've named, including us, have content policies that document what we believe is harmful or not appropriate or not allowed. But for the Supreme Court or Congress to make a decision on what is harmful, that's a First Amendment conversation, not an algorithm conversation.

• 28:33Speaker 02

  Let's say that Gonzalez wins here. What kinds of lawsuits do you expect that platforms like Reddit would be hit with? And how would it affect some of the smaller platforms that might not have Google-sized resources to defend them?

• 28:49Speaker 05

  Okay, you're making, I think, a really good point, which is, remember that Reddit is, in absolute numbers, big? Bigger than most? You know, we're in the top... Call it five to 10 platforms of our nature. And we are still multiple orders of magnitude smaller than Google and Facebook. And behind us, there are thousands of platforms that are even smaller. So there's a real difference in scale here. So one lawsuit, one of our users called Wesley Crusher, the Star Trek character, a soy boy.

• 29:30Speaker 05

  One of our moderators banned that comment for being inappropriate. And then we read it, got sued. And that suit was thrown out because of 230. People say things on Reddit all the time that somebody else might not like. There's probably, like, I'm not exaggerating, 100 opportunities to sue us every day in a world without 230. That costs real money. Even a dismissal costs money. You know, once the floodgates are open, they're open. We cannot afford to defend ourselves from thousands, literally thousands, or more frivolous suits, nor can any platform smaller than us. Who can afford to do that? The largest platforms.

• 30:14Speaker 05

  Remember, there was a time, not that long ago, where Facebook was in support of changing 230. Getting rid of 230 entrenches the incumbents, and it disempowers the smaller platforms and more broadly, the people of the internet.

• 30:32Kevin Roose?

  I wonder if we could look at a kind of steel man argument for the plaintiffs here, which, you know, is something that you hear often from platform accountability types who say that basically because of Section 230, the tech industry and social media specifically has enjoyed a kind of protection that no other industry does, right? If I'm a pharmaceutical company and I produce a drug that hurts or kills people, I can be held liable for that. If I am a newspaper and I publish libelous allegations that hurt someone's reputation, I can be sued for that.

• 31:12Kevin Roose?

  And that basically Section 230 has kind of given social networks impunity in a way that no other industry has, that it has allowed it to kind of externalize the harms of what it builds rather than being held liable for that. So what do you make of that argument made by people on the opposite side of this case from you?

• 31:32Speaker 05

  If you are a pharmaceutical company and you come on Reddit and make dangerous claims, you can still be sued. If you are a person and you go on Reddit and you say libelous things, you can still be sued. It just means that Reddit, the platform, doesn't get sued. Or the users who adjudicate that content, vote it up or down, can't be sued. Section 230 protects the platform and its moderation practices, and in Reddit's case, our moderating users, which are all users. It does not protect the speaker or the author from breaking the law, nor does it protect Reddit from breaking the law.

• 32:14Speaker 05

  I should also point out that we don't allow terrorist videos or ISIS videos. Now, we do that from our own first principles, but promoting those, I believe, is also against the law.

• 32:27Speaker 02

  Yeah.

• 32:28Speaker 05

  And, you know, we are subject to the rule of the law in response to subpoenas, as long as they are valid, like anybody else has to. And also, our platform and our users are not protected from civil liabilities. So even when things aren't technically against the law, we and our users and the authors can still be on the receiving end of a civil lawsuit, which does happen from time to time. So, when folks ask, "Well, can't we solve the problems of the internet by changing Section 230?", my first question always is, "What exactly is the problem of the internet that you're referring to?"

• 33:10Speaker 05

  And usually, when I ask that question, I get a thousand different answers, none of which changing 230 is a solution to.

• 33:16Speaker 02

  Yeah, so I mean, I think if you're somebody who thinks that Section 230 is basically good and is responsible for all the parts of the internet we enjoy, along with some of the parts that drive us crazy, I think the good news is that this week, the Supreme Court justices seemed pretty skeptical of the plaintiff's argument. Like, as I was reading all the coverage this week, most people did not feel like there were gonna be five votes for Gonzalez in this case. At the same time...

• 33:46Speaker 02

  A lot comes down to how the justices rule. And I think there's a sense that they could still do a lot of harm just in how they dismiss this case. So I guess, Steve, I wonder, what's your ideal outcome here? And assuming that this case goes away, but that people continue to be really angry about the speech that they're encountering on the internet. Is there anything platforms can do to get out of this cycle where there are constant lawsuits trying to kind of upend this foundational piece of the internet?

• 34:20Speaker 05

  Okay, the first question, what is the ideal outcome of this case? Okay, here's what I would, here's what I would ask our general counsel, Ben Lee. I would say, Ben, what's the legal term for when a court says, this was a huge waste of time, let's pretend this conversation never happened?

• 34:36Speaker 02

  Dismissed with prejudice, I think.

• 34:37Speaker 05

  Yes, okay, so I think that's the ideal outcome, dismissed with prejudice. The second part of your question is what to do about the fact that like, people encounter content online that they don't like, or that frustrates them, or makes them angry, or they think is bad for the world? Well, look, I actually, I'll give you, I'll give you two answers. One, one is, it's gonna sound flippant, but I think it's true. Nobody's forcing you to consume that content. And I think, for example, I'll just use Reddit as an example. There are subreddits who have broadly opinions or political views that I don't like, that I find triggering. I don't read those subreddits.

• 35:18Speaker 05

  In fact, I go through the subreddits I've subscribed to periodically, and I am subscribed for the ones that annoy me. You could do that on Reddit, and you can do that, the equivalent of that elsewhere on the internet and in the real world. The second part of my answer is, I actually do think there's a, I, I do appreciate on some level, when our users are frustrated, or the press is coming after us, or there's a broader narrative about tech and the problems, whatever they may be that day, with technology platforms. We live in this world too, we are consumers of these platforms too, and we are citizens of this country and the internet as well.

• 36:02Speaker 05

  And look, I think a lot of that sort of external pressure has played a role in how we've evolved our own content policies.

• 36:11Kevin Roose?

  Yeah, I was gonna say, I mean, I think that the the press going after you is a little ungenerous. I mean Reddit had, I think by its own admission, and I think you would agree with this, like, a pretty bad problem years ago with toxic and sort of, you know, unseemly content. It was known as kind of the sort of underbelly of the internet, and that's changed in recent years because of some of these, you know, content moderation policies that you put in, in part because you got a lot of pressure to do so. So, I mean, isn't that a case for there being an upside to pressure, whether from Congress, or from the Supreme Court, or from the public and the press? Isn't there, isn't that a good thing?

• 36:56Speaker 05

  That's my point, is without actually any changes to the law, the pressure has resulted in changes. And we'll never know for sure whether we needed the press pressure to make changes at Reddit. The context, of course, is I came back to Reddit to make the changes that that you're referring to, which was literally, uh, my, my, like, at the top of my to-do list coming back to Reddit was, create a content policy and enforce it really strictly. Now, one of our our rules at Reddit, in fact, I was just talking about this internally, is, okay, so the press is coming after us, and fairly or unfairly, what I tell the company is fair ain't got nothing to do with it.

• 37:41Speaker 05

  What is the truth in what they're saying? Like, we all, we do the right thing first. And whether that gives somebody that we like or don't a moral victory is beside the point. Our job is to make the best, most welcoming platform we can.

• 38:04Speaker 05

  And so, yes, I do think that pressure is valuable, even if I don't like it in the moment, or even if I'm like, yes, I know, I'm on it, it's still useful.

• 38:13Kevin Roose?

  Also, like, wasn't there just a lot of pressure to do that?

• 38:17Speaker 02

  For business reasons, like if Reddit wants to have a big, healthy ad business, it has to have good content policies, right?

• 38:25Speaker 05

  Yes, we are in the community business, not to piss everybody off and make sure nobody likes our platform.

• 38:31Kevin Roose?

  Yeah. Although that is, as Twitter is demonstrating, that is a viable business model.

• 38:35Speaker 05

  Honestly, you're not wrong. It's actually the reason I don't like Twitter. They've productized narcissism. And people have a, they feed off of that. But one of, I think, the misconceptions is I see this kind of trope around a lot is that business motivations and what's best for people and consumers are at odds. And I can tell you on Reddit, they're very much aligned. You know, when Reddit was going through its difficult times, this was back in that 2015 era, it was both bad for business and bad for us. Like, it was very unfun to work at Reddit in that era.

• 39:20Speaker 05

  We thought it was important, but there was not a lot of smiling faces for about a year there because we didn't like what our platform was being used for. And so we did our very best to fix it. I'm proud to say, I think we've done a pretty good job at it.

• 39:34Kevin Roose?

  Yeah, well, for my last question, and I know this may be an uncomfortable topic to get into here on a podcast, but I wouldn't be doing my job as a journalist if I didn't ask you a hard-hitting accountability question. And that is, do you, Steve, stand by your statement, which you made a year ago on Reddit, that cottage cheese is the perfect food? Or would you like to apologize for that?

• 39:58Speaker 05

  I had 80 grams of cottage cheese this morning, happily. Not only do I love it, but I measure it.

• 40:05Kevin Roose?

  Wow. Why 80 grams? Why not, is 90 is just overdoing it?

• 40:11Speaker 05

  Actually, so that's more reactive. I scooped it out and that's what it, that's what it happened to come to. But I do eat it every day.

• 40:20Kevin Roose?

  Wow, you heard it here, folks. Steve Huffman is canceled for voicing support for cottage cheese. Steve, really appreciate you coming by the show. Thanks for joining us on Hard For. Thank you, Steve.

• 40:30Speaker 05

  My pleasure, guys. All the best.

• 40:44Kevin Roose?

  When we come back, what Meta's new paid verification program means for the company and for the future of social media.

• 41:06Speaker 00

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real-time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork.

• 41:38Speaker 03

  Ripple has been powering modern finance for a decade. It's not our first trip around the blockchain, and it won't be our last. We're leading the charge to bridge the gap between existing financial systems and the future of finance. You can have it all: legacy, stability, and digital innovation. Systems that work with your other systems. Because with the right partner, the question isn't crypto or traditional finance. The question is simply, why choose? A new standard of modern finance. It's happening with Ripple. For informational purposes only. Availability of products can vary and may be provided by different Ripple entities.

• 42:11Speaker 04

  Today's AI builders need infrastructure that scales with their ambitions. Irene is a vertically integrated AI cloud platform, delivering data centers, compute, and software for AI training and inference, underpinned by its expansive portfolio of LAN and grid-connected power in renewable-rich regions globally. Irene's AI cloud gives direct access to Nvidia GPUs, scalable from hundreds to thousands. For builders, that means direct access to AI compute, rapid scaling, and predictable pricing. Irene, AI cloud for the next big thing.

• 42:46Kevin Roose?

  All right, Casey, I want to talk to you now about Meta, which announced this week that it is starting a new paid verification system. For $12 a month, you can pay Meta and get a verification badge on Facebook and Instagram. And in addition to this badge, which is a lot like the Twitter verification badge that Elon Musk has now started charging for, you can get proactive account monitoring for impersonators, you can get customer support, you can get better placement in some news and comment feeds, and Facebook says you can get some vague exclusive features for your $12 a month.

• 43:30Kevin Roose?

  So I thought of you immediately when I heard this news, and I wondered what you think of it.

• 43:35Speaker 02

  Well, I mean, first of all, I'm just so happy that I was verified before they started asking people to pay. I'm, you know, saving $144 a year over here now. We should say this is just a test. You can't do this in the United States yet. They're starting out in Australia and New Zealand. But I do think this is a really significant shift in the history of social networks, you know. For the entire history of social networks up until now, verification was a way to ensure that a person was who they say they are. And platforms did that for free because it was in their interest for people to know that if, let's say, President Biden appears to be tweeting

• 44:19Speaker 02

  or posting on Facebook, that it's really Joe Biden. Now we're moving into a world where anyone can have access to a similar verification, which I think is good in a lot of ways. But it also means that verification is something kind of different now.

• 44:35Kevin Roose?

  So why is Meta doing this?

• 44:37Speaker 02

  Well, the first thing I should say is that I don't 100% know. This kind of came out of the blue. In fact, Mark Zuckerberg announced it on a Sunday, which I cannot remember him announcing a major product change like this before on a Sunday, particularly the Sunday before a holiday, which it was in the United States this week. So I thought that that was a little bit strange. I do think that they want to be able to provide certain extra features to customers, in particular, customer support, right? I imagine that you're like me, and because we write about Facebook and Instagram, people are probably always sending you direct messages saying, I've been locked out of my account. Could you please connect me with somebody at Facebook? Right?

• 45:22Speaker 02

  Does this happen to you?

• 45:23Kevin Roose?

  Yep, all the time. People, especially back in the day, like after I got verified on Instagram, dozens of people a week would just be like pleading with me to contact someone at Instagram and get them their account back or something. It was really sad and, and, and, you know, made me think like there is actually a market here for some customer service.

• 45:42Speaker 02

  Oh, absolutely. And in fact, there is kind of a gray market for this sort of thing where, you know, you can read stories about the lengths that people have gone to to get their accounts back, right? Somebody who knows someone on the inside at Facebook or Instagram and charges maybe thousands of dollars in order to get somebody their account back. That's not a tenable system. It's not a good system. Think about how many people build businesses, are earning their livelihoods on Facebook and Instagram. And if you get locked out of your account for whatever reason, let's say you get hacked, maybe there's a SIM swapping attack and you have no way of getting yourself back in.

• 46:23Speaker 02

  Well, in that case, paying 12 bucks to get access to a customer support person, that actually starts to look like a pretty reasonable deal, at least to me.

• 46:31Kevin Roose?

  Mm hmm.

• 46:32Speaker 02

  And do you think this is?

• 46:33Kevin Roose?

  Because of what Twitter and Elon Musk have done with verification, I mean, it's hard not to see this coming from Meta and not see it as a response to Elon Musk deciding to charge $8 a month for blue checks.

• 46:48Speaker 02

  So I heard from one person who used to work at Facebook who told me that this project had been in the works for over a year, and it was something that they were thinking about even before Elon Musk bought Twitter. So I don't think that this is a simple case of Facebook copying Twitter, although of course, I'm sure everyone at Facebook saw Twitter do it and do it disastrously. And they probably thought, well, we could do it in a lot more logical, sensible way.

• 47:19Kevin Roose?

  Right. And I also saw some speculation that maybe this is just a desperation play, that Meta, you know, may be losing tons of money on some of the metaverse stuff, that the ad market is not as strong as it was a year or two ago, that they really are sort of looking for new ways to make money quickly. Do you buy that as sort of an argument for why they're doing this as a, as a kind of money-making service?

• 47:42Speaker 02

  Well, I do think it's definitely the case that Meta is looking for new ways to make money. They've been battered by the changes that Apple made to the advertising ecosystem. At the same time, we know that paid verification on Twitter has been a disaster.

• 47:59Kevin Roose?

  Right.

• 48:00Speaker 02

  According to all of the estimates that I've seen, Twitter is hardly making any money from this at all.

• 48:04Kevin Roose?

  Totally. And I was just surprised because it seems like a really big philosophical departure for them. I mean, for many years, Facebook would constantly be asked and its executives would constantly be asked, like, why do you have to do all this creepy ad targeting? Why can't you just charge people? There was this famous line about how, you know, if you're not paying for the product, you are the product. And they would get asked all the time, why don't you just charge people so that you don't have to like, basically sell the right to target ads against them? And they would say, in a very sort of principled sounding way, like, we believe that social media should be free. We believe that- You shouldn't have to pay to use these services.

• 48:46Kevin Roose?

  They would sort of make this argument about how charging for access would, you know, would be fine for people in the developed world where they have, you know, high incomes. But if you go outside the developed world, it would be prohibitively expensive. And so you would end up not being able to serve the entire world. And to me, you know, it's not like they're saying you have to pay $12 a month for Facebook or you can't get on. There will still be a free option, but it is kind of bringing this two-tiered system to a social network that has historically not had one.

• 49:18Speaker 02

  Yeah, and I think that's particularly true with this feature that gives verified users higher placement in search results and it makes their comments appear kind of closer to the top. That's available for accounts that were verified under the old system. And I think the reason that that system was built was the thought that verified users are notable ones in some way, right? If you have elected officials or celebrities who are sort of commenting or you're trying to find them in search, you want that stuff to rise higher because that content is probably going to be more engaging. But now it really is a pay-to-play system where if you're some young hustler and you

• 50:01Speaker 02

  want to get famous by making Instagram reels, why wouldn't you pay 12 bucks a month knowing that your account was gonna sort of float to the top right away? And I'm very curious to see how that plays out because you can imagine that going wrong in a lot of ways, right?

• 50:18Kevin Roose?

  Totally. I mean, I think it's part of this broader trend that we're seeing right now. A few years ago, I wrote this story for the New York Times Magazine about what I called luxury software, which was sort of this tier of software that was kind of being aimed at like wealthier, what they call prosumer users. So one example I talked about in the piece was this app called Superhuman, which I don't know if you've ever used, but it's basically, it's like a very expensive skin for Gmail.

• 50:46Speaker 02

  It's ridiculous.

• 50:47Kevin Roose?

  Yeah.

• 50:47Speaker 02

  It's a ridiculous thing. It's like 30 bucks a month to use a different user interface for Gmail.

• 50:52Kevin Roose?

  Right. But there was this whole sort of explosion of these kind of software products that were aimed at kind of the higher end of the market where people would be willing to pay for a better version of something they could get for free, essentially. And I think that's what- This is essentially, it's saying, you know, you can have, if you want the sort of normal version of Facebook or Instagram, or Twitter for that matter, you can have it. But you're going to have a much better experience if you pay up. Your, your content will be more widely viewed. You will get better customer service. You'll be able to actually get a human to fix your problem if you get locked out of your account or something. And so there's this kind of stratification of the internet into like the, the free tier,

• 51:34Kevin Roose?

  which kind of sucks and is filled with garbage and it's, you know, impossible to get someone to fix your problems if you have them. Or this paid premium tier where you're shelling out hundreds of dollars a year in the hopes that your content will do better, you'll get better customer support, et cetera.

• 51:51Speaker 02

  Yeah, I'd like, you know, let, let me say, we were talking earlier in the episode about some changes that the Supreme Court might make to the internet that I think are bad and I basically just wish they would do anything in that case. This is a place where I wish the government would do something because I think if you build a very large platform and you enable people to build businesses there, businesses that in some cases are making millions of dollars a year, I think that you should be legally obligated to provide them with customer support, right? I don't think it should be the case that if you get locked out of your account, then that's it for you, unless you can somehow find a way back in. I think that they should enable you to get on the phone with someone.

• 52:32Speaker 02

  So while I'm glad that people will now be able to pay 12 bucks a month to have that experience, in the future, I hope people have that experience for free because it's mandated by the law.

• 52:43Kevin Roose?

  Hmm. That's interesting. I, I kind of like that actually, because I think you're right, that there is sort of an expectation in other parts of the economy that if you have a problem that needs solving, no matter how much you're paying for that, like you get at least the possibility of some kind of help. Like if I have an airline ticket and it gets canceled and I need a human to help me with that, like I can call the Delta or the United support line and they're going to talk to me whether I'm, you know, a- Frequent flyer or not, so you get a sort of basic level of customer service from them. And that doesn't happen on social media. We don't get humans to solve our problems unless

• 53:26Kevin Roose?

  we're somehow connected or have an in or are otherwise able to get the attention flagged down someone at one of these companies. So I would support this law you're talking about. And frankly, I will support you if and when you run for Congress on the platform of Free Tech Support for All, Casey Newton for Congress 2026. I am very excited to vote for you.

• 54:10Speaker 00

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork.

• 54:42Speaker 03

  Ripple has been powering modern finance for a decade. It's not our first trip around the blockchain, and it won't be our last. We're leading the charge to bridge the gap between existing financial systems and the future of finance. You can have it all: legacy, stability, and digital innovation, systems that work with your other systems. Because with the right partner, the question isn't crypto or traditional finance. The question is simply, why choose? A new standard of modern finance. It's happening with Ripple. For informational purposes only, availability of products can vary. May be provided by different Ripple entities.

• 55:15Speaker 04

  Today's AI builders need infrastructure that scales with their ambitions. Iron is a vertically integrated AI cloud platform, delivering data centers, compute, and software for AI training and inference, underpinned by its expansive portfolio of land and grid-connected power in renewable-rich regions globally. Iron's AI cloud gives direct access to Nvidia GPUs, scalable from hundreds to thousands.

• 55:39Speaker 04

  For builders, that means direct access to AI compute, rapid scaling, and predictable pricing. Iron, AI Cloud for the next big thing.

• 55:50Kevin Roose?

  All right, Casey, I think that's all we have for today. Any parting words?

• 55:54Speaker 02

  I want to thank everybody who put up with my voice this week, and I hope that it sounds much stronger on the next episode of Hard Fork.

• 56:03Kevin Roose?

  Please get some rest, drink some tea, maybe get some soup in the in the system.

• 56:09Speaker 02

  Oh, yeah.

• 56:09Kevin Roose?

  And come back stronger next week, or we will have to replace you with an AI.

• 56:13Speaker 02

  Oh, no.

• 56:14Kevin Roose?

  I hope you feel better.

• 56:15Speaker 02

  Thank you.

• 56:18Kevin Roose?

  Hard Fork is produced by Davis Land. We're edited by Jen Poyant. This episode was fact checked by Caitlin Love. Today's show was engineered by Alyssa Moxley. Original music by Dan Powell, Alicia Baetou, Marion Lozano, and Rowan Nemisto. Special thanks to Paula Schuman, Hannah Ingber, Nell Galogly, Kate LaPresty, and Jeffrey Miranda. As always, you can email us at [email protected].

• 57:29Speaker 06

  75% of women who seek menopause care don't receive it. The lying awake at 3 a.m. wondering what's happening to your body ends now. Midi is virtual care built for women in perimenopause and menopause with clinicians who specialize in women's health. Plus, it's covered by most major insurances. Getting started is easy. You can book your first visit with a clinician right away. Midlife needs Midi. Visit joinmidi.com to book your first visit today. That's join M I D I dot com. Insurance coverage varies. Check with your plan for coverage.