Pod Insights Decoder Facebook’s Oversight Board has upheld the Trump ban. What’s next? About this episode Nilay Patel talks with Kate Klonick, a law professor at St. John’s University Law School and one of the foremost chroniclers of Facebook’s moderation efforts.
Kate has been researching and studying Facebook’s Oversight Board from its inception: she embedded with the board as it was forming to write a definitive piece for The New Yorker called “Inside the Making of Facebook’s Supreme Court.”
Nilay and Kate discuss the Oversight Board’s recent decision to uphold Facebook’s ban on Donald Trump and what the decision means for the future of policy and moderation on Facebook and other social media platforms.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
Transcript 10,445 words · 8 speakers
0:00 Speaker 00 Real innovation is powered by real people. This is AMEX Corporate. Trusted experts, smarter technology, 24/7 dedicated support from day one to answer questions, help set up policies and approvals, and consult on spend capacity as your business needs evolve. Plus, on-demand resources help level up operations at every stage. That's the trusted service you've come to expect. Built to simplify, designed to scale. This is AMEX Corporate.
0:33 Speaker 01 This episode is brought to you by Michelob Ultra. Good times mean competitions between you and your friends, like seeing who can throw some pigskin the farthest or rush the field the fastest. Winner gets an Ultra. Because it's not just a superior-like beer, it's also giving fans superior access to their favorite sporting events. Superior is worth playing for. Visit michelobultra.com/superioraccess to enter. Enjoy responsibly. Copyright 2026 Anheuser-Busch InBev Michelob Ultra Beer, St. Louis, Missouri.
1:02 Speaker 02 Hello and welcome to Decoder. I'm Neelai Patel, editor-in-chief of The Verge, and Decoder is my show about big ideas and other problems. Today, we're focused on one of the most complicated problems of all: content moderation. If you're a Decoder listener, you know that content moderation seems to come up in almost every episode. The question of how platform companies decide what to leave up and what to take down is messy, controversial, and extremely political. And if something on the internet is messy, controversial, and political, you know that Facebook will be at the bleeding edge of it. Last year, the company announced it would start sending difficult moderation problems to a new entity it calls the Oversight Board. That's a committee made up of lawyers, politicians, and speech experts
1:45 Speaker 02 that rules on whether specific content takedowns on Facebook are appropriate or not. That board just got its first big test last week as it issued a decision about whether former President Trump's indefinite ban from Facebook platforms would stay in place. And the decision? Well, the decision was to kick it all back to Facebook. The board said Facebook didn't have an actual policy in place for it to review and that Facebook should write one and send that back to the board in six months. In the meantime, Trump remains banned from the platform. So what does that all mean? What is the Facebook Oversight Board? What are its powers? And how is it even independent from Facebook itself? You've probably heard people call the Board the Supreme Court of Facebook. Is that the right way to think about it?
2:29 Speaker 02 Will every platform require a moderation court like this in the future? Or is this just another way for Facebook to exert influence over the Internet? This is a big new experiment, and the Trump decision is a big moment for that experiment. To help figure it all out, I asked Kate Klonick, a law professor at St. John's University Law School, to join the show. Kate has been researching and studying the Oversight Board from the start. She embedded with the Board as it was forming to write a definitive piece for The New Yorker called "Inside the Making of Facebook's Supreme Court." Kate and I talked about what the Board is and isn't, what its powers are, and what this Trump decision means for the Board's authority in the future. And we talked a lot about what it means for private companies to have things that look and feel like legal systems.
3:12 Speaker 02 If you step back, it is bonkers to think that any company needs to fund something that looks like a Supreme Court. But Facebook is that big and that globally powerful. So here we are. One note, you're going to hear me mention a Supreme Court case called Marbury versus Madison. That's the very famous case from early in this country's history, where the Supreme Court basically gave itself the power to invalidate laws passed by Congress. Oh, and you might pick up that I sound nervous here and there. That is because I always, always get nervous talking to law professors. I feel like I'm back in my one-L days every time, so bear with me. Okay, Kate Klonick from St. John's University Law School.
3:52 Speaker 02 Here we go. Kate Klonick here, a law professor at St. John's University Law School. You are also one of the foremost chroniclers of Facebook's moderation efforts. Welcome to Decoder.
4:16 Speaker 03 Thank you so much for having me.
4:17 Speaker 02 We're talking the day after the Facebook Oversight Board released a big decision about whether Facebook was correct to indefinitely ban Donald Trump from its platform. There's a lot of concepts in that sentence alone. Let's start with the Facebook Oversight Board itself. You, in February, you published a long piece in The New Yorker called Inside the Making of Facebook's Supreme Court, which detailed the process by which Facebook conceived of having an oversight board, literally the meetings and the software they used to create this board virtually during a pandemic. This decision feels like the first big moment for that board. What is the Facebook Oversight Board?
4:56 Speaker 03 Yeah, we still don't know exactly. I know it's like the worst answer ever to turn out, but I think it's, I think it's the right one. We can talk about how it's been talked about, and I think that that's going to lead us to kind of what we saw yesterday and how, what we can kind of make of this opinion. So in November of 2018, Mark Zuckerberg announced that he was going to set up this, what had been kind of colloquially joked about and called like the Supreme Court of Facebook. This idea that they were going to start running certain types of content moderation decisions. Once they had finished being appealed internally at Facebook, they would make it possible to appeal to an outside,
5:36 Speaker 03 independent oversight board. And the question was, how the hell do you set that up? You have a pretty fundamental principal agent problem right off the bat. And then how do you set that up? What is it make you do? And how do you kind of make this work? When, when you're talking about public rights of freedom of expression and international human rights law, which is where the conversation was and still is to some degree, and you're talking about a private corporation, how do you make something have teeth? How do you make it legitimate? How do you make it independent? All of these questions were very open and on the table. And so about six months after that kind of announcement from Zuckerberg, I started following inside Facebook, the government and strategic initiatives
6:21 Speaker 03 team, which was the team that had basically been tasked under Nick Clegg to come up with this solution to what exactly this board was going to be and how they were going to solve all of this, these institution building problems. And so I started following that and I ended up doing that for 18 months, watching as they wrote their documents and figured out what they were going to do. And there's a lot of stuff to unpack just on what they, how they did make decisions. And so I'm happy to kind of go over the basic framework of how they solve the problem of independence, because I think one of the biggest things that we kind of don't know about the board is what it is and like what it is indebted to for Facebook and what makes it plausibly independent.
7:06 Speaker 02 Let's step back for one second. So Facebook is a huge company. They operate a massive platform, several massive platforms around the world. Their content moderation decisions have an enormous impact on people, on culture, on democracy. They wander into speech issues at a global scale where a team of people in the United States cannot plausibly understand it, speech issues in other countries that Facebook runs into at scale. Some of those things, you brought up human rights law, some of those things directly lead to horrible outcomes like genocides, literally with Facebook. Mark Zuckerberg is kind of unaccountable to the shareholders of Facebook, the corporate structure. So it's a very unique company.
7:48 Speaker 02 He owns a majority of the voting shares, so he fundamentally cannot be removed as CEO. And so his solution is, I'm going to set up a different thing to hold Facebook accountable and to review our content moderation decisions. And it sounds like what you're saying, the first problem is, how do you create that thing to be independent? And how do you pay for it in a way that maintains its independence?
8:08 Speaker 03 Yes, exactly.
8:09 Speaker 02 How do they solve that problem?
8:11 Speaker 03 Well, that problem was kind of interesting. So they decided to set up a Delaware Trust Corporation. They set up a Delaware Trust Corporation in October of 2019. And then the next day, they arranged for that trust corporation to serve the Oversight Board LLC, which is a limited liability corporation. The entire purpose of the trustees and the entire purpose of the trust was to administer $130 million irrevocable grant that Facebook gave and then snipped the purse strings from to this trust. It's not an endowment. This is like an important distinction because they cannot actually, the trustees can't invest the money. There's no investment committee. It's specifically not allowed. It's not enough money to be able to endow it.
8:53 Speaker 03 It is enough money to probably have it run for five to six years. And then it is contemplated that there will be an endowment. So there is the question of like, well, if they really do go at Facebook and really do hold Facebook accountable in some way, they are running the risk of like having their funding cut off. But in the short term, six years feels like a long time. And this is what they were charged to do. So we're seeing what the board is doing. But this is basically how it works. All of the board members in the administration are basically employees of the LLC and which is itself controlled by the trustees. So that's kind of like, that's how this kind of breaks down from a business standpoint. It was a fairly elegant solution.
9:36 Speaker 03 The trust documents are pretty interesting to read if you're into that kind of thing, which I wasn't, but I had to do anyway. So I think there actually is for right now, for the next five to six years, I think there is a fair amount of financial independence. We'll see what happens four years down the road.
9:51 Speaker 02 Who's on the oversight board? We keep talking about it like it's a court. I don't know if that's correct. I want to get there, but they have some people who are making decisions and writing opinions and disagreeing. Who are those people?
10:03 Speaker 03 Right now, the board is four co-chairs with a total of 20 members that all are basically hearing cases related to user appeals that come out of Facebook on content moderation or things that Facebook itself kicks to the board to review, like the Trump suspension. So those kind of 20 individuals are, it's a pretty illustrious group of people. There's a Nobel Peace Prize lawyer, former prime minister of Denmark, former editor in chief of The Guardian, former circuit court judge, a former Supreme Court clerk and Columbia law professor, not to mention a ton of other people that are just experts in human rights law and lawyers and freedom of expression in their own right.
10:46 Speaker 03 So it's a pretty well-staffed group that has a lot of experience, both with institution building and freedom of expression and international human rights.
10:55 Speaker 02 So for the Trump decision, did all of them hear it in vote? Or was it a small group? I mean, normal courts, you go to the appeals court. They have a lot of judges, but first three of them hear it, right?
11:06 Speaker 03 Yeah, usually. So that's, that's precisely what happens here. So the process around hearing cases is a five person randomly selected anonymous panel. Here's the case. And then right now, how they basically have this working, because some of these things were not laid out in the bylaws and it's up to the board to decide them on its own, is basically that they, right now, the panel is writing up a draft of whatever it is that they determine is the right solution to the problem after they kind of arrange, collect facts and ask people for more opinions and read all the briefs and everything else. And then they start circulating that and a majority of the full board has to approve the final decision. And that was basically exactly how it worked for the Trump case.
11:51 Speaker 02 One thing that strikes me about the Trump decision is that it is anonymous. There's frequent reference to the minority and how the minority would have judged things differently. We don't know who's in the minority. We don't know how big the minority is.
12:06 Speaker 03 We don't know how big, but it can't be bigger than nine people, right?
12:09 Speaker 02 Sure. Yeah, I mean, but that's, it's a pretty big range from one to nine. And then that's all fine. So it's pretty anonymous. And then the members of the oversight board are like out in the world. They're doing interviews with Axios. They're doing interviews at the Aspen Institute. They're publishing their own blog posts about this decision. I just can't quite understand what part of it is supposed to be anonymous and why? And what part of this is really public?
12:36 Speaker 03 Yeah, no one knows. That's a great question. All day yesterday, I was like, kind of a little shocked, all of the different types of thoughts and collective pronouns that were being used when people were talking. One of the main reasons to have anonymity on a panel like this is that anonymity gives you a certain amount of intellectual privacy. You know, the idea that you're not going to be publicly ashamed for being in the minority is pretty key. The other thing is that the, these people That are on the board are all over the world. And a lot of the cases that they are touching on possibly pose really very real
13:17 Speaker 03 security risks to them should their names be attached to kind of the outcomes. And so that was another consideration for when all of this was being discussed about whether they should be anonymous or not. What we didn't know was whether there were going to be dissents. And so what's super interesting here is that there's no dissents. There is one decision and then they've decided to fold kind of the idea of a dissent or a concurrence into these kind of notions of a minority of the panel, a paragraph that says like, the minority of the panel felt differently about the reasonings for this. So that would be one thing if it was, you know, just getting read from the bench and that's all you heard about it. And you let the reasoning of the opinion or the decision stand on its own, but you didn't. You then had everyone kind of off tweeting all of their thoughts about like everything
14:01 Speaker 03 and talking and doing. And I think that that's one of the things that I even asked one of the people who came on my show that day, I was like, what's going on? Like if this is a court, like you wouldn't be doing a TV hit like to talk about like what you, the conversation was like in chambers, that would be like totally verboten. So it is kind of like, well, are you a court? Cause this sounds a lot like a court, but now you're not exactly comporting yourself as a court.
14:29 Speaker 02 Yeah. And even, I don't know, the Supreme Court doesn't say, our big decision in this massive policy issue is coming out tomorrow at 9:00 AM. Everybody get ready and then queue up its press hits. I keep coming back to that question. Is this a, is it a court? Right? I mean, we've all called it this Facebook Supreme Court. It seems right, sort of conceptually. Facebook has difficult decisions to make. It doesn't seem to want to make them or be accountable for them. So it's going to kick them over to this other place. They will take the hit and Facebook will. Presumably do what they say, but if you're going to be that kind of institution, there's just like a part of it where that's not how courts actually act. But just conceptually, I can't tell if this is a court or not.
15:13 Speaker 03 Yeah, I think they're there with you. I think they're still deciding what they wanted to do. So for example, I mean, just to kind of like put it right on the nose. They talked to me, a number of the board members, unconditioned of anonymity, talked to me for the New Yorker piece, explaining some of their first decisions and how they had reasoned through them and what they had thought. That was a level of access that a court would not usually grant to a reporter or anything else. And after that, they decided not to do that anymore. So there are changes that they're kind of, they're making to their policy. It's not set in stone. But I think that there's been a theory that I've heard a lot of people wondering, well, this is an incredibly well reasoned and rigorous legal opinion.
15:57 Speaker 03 So this is most definitely seeming like a court. But the way that it's being talked about by the people who are making this decision is not quite the same as what we expect to see out of courts that traditionally we have seen in, you know, the United States.
16:13 Speaker 02 What is the board's power over Facebook? What can the board make Facebook do specifically if it's unhappy with how Facebook is acting?
16:22 Speaker 03 So the power that the board has over Facebook is incredibly narrow, but it is a small devolution of power that I've always argued is actually a lot bigger than it seems. For right now, for content that is removed or kept up on Facebook, the board, after a user has appealed it internally at Facebook, they can take that appeal and give it to the board. And if the board hears their case and makes a determination overturning Facebook's decision to keep down the content or put it back up. And it's only content, like single object content. It's not even pages, right? That was a special thing that the board considered for Trump. Users can't appeal their page takedowns right now.
17:04 Speaker 03 Facebook has agreed to adhere to whatever the board's decision is on that specific piece of content. So my specific piece of content, my picture of my dog that gets accidentally removed from Facebook and the oversight board says it has to go back up. That has to go back up, but like if you had also posted a picture of my dog and gotten taken down, they have no obligation to restore your content. They have said that they will make efforts to restore similar content, but they've no promise. This is, that's it.
17:31 Speaker 02 That's very narrow.
17:32 Speaker 03 It's super narrow.
17:33 Speaker 02 They're not actually saying whether the policies are right or wrong. They're saying whether the enforcement policies are right or wrong.
17:38 Speaker 03 Yes, but there is one other thing that they have obligated themselves to do, which is that when the Oversight Board makes public policy recommendations, Facebook has obligated itself to respond within 30 days to the Oversight Board's policy recommendations. And whether they have been implemented or not, how they have been implemented, or if they weren't implemented, why not? And this is this form of like weak form review, something that like Harvard Law Professor Mark Tishon kind of puts it this way, that is like the court calling on basically the executive, the legislative body to kind of come back in and fix their problem and then report back as to like how they ended up doing that. And so that is
18:21 Speaker 03 actually also a pretty important reputational pressure that the board can put on Facebook.
18:26 Speaker 02 So this leads kind of right into this decision. The simplest way of understanding this decision is the Capitol riots happened, Trump posted a bunch of videos and posts that ostensibly encouraged people to stop acting badly at the Capitol, kind of supported it, pretty messy actually, in terms of just a straight interpretation of what Trump meant to have happen because of these videos and posts. Facebook takes them down, he tries again, they take them down and say, you're indefinitely banned from Facebook. This is the 6th and the 7th of January, a very chaotic time in America. All the other platforms are doing the same thing. Facebook then says, well, we got this board. We're going to kick the indefinite ban of Trump to the board to see if that was the right decision. And
19:09 Speaker 02 the board comes back and it, I would just, they say, fine, that's, it's fine for you to have indefinitely banned him. We're not going to write a policy for you on indefinite bans. Also, you have no policy on indefinite bans. And they seem very unhappy with Facebook. There's actually a tone to me in this decision that's like, don't put this on us.
19:27 Speaker 03 Yeah.
19:28 Speaker 02 You know, I think you could read that and come back to us in six months with a real decision and we'll tell you what to do. And that reads to me as kind of asserting its authority in a way, but it's also really, really narrow and kind of punts the issue.
19:43 Speaker 03 I think it punts almost not at all, actually.
19:46 Speaker 02 Okay.
19:46 Speaker 03 I think that that's been one of the worst takes that's come out of this. It's not punting the issue at all because the issue's coming back. What they're saying is we're not going to carry water for you, Facebook. How I think about it is this, that one of the conceptions of what this, as we're talking about, what is this board? Is it a court? What is it? One of the questions is like, what type of level of court is it going to be? If it's a trial court, then it's like, then it's a fact finding body and it like, does all of this work? And maybe it makes statutory interpretations of rules. Or is it more like a Supreme Court or Court of Appeals Court, which is going to actually review the law? And whether the law matched the facts of the thing. And what we see out of this decision is they are doing all three.
20:30 Speaker 03 I want to just hit on this really quickly. You talk about the fact that they like, kind of lay out the events of like the sixth and the seventh of January? And that those were really hectic, crazy times. Do you know like how, what a gift it is to have like a cogent, rigorous, well researched record? Of everything that we know happened on the front end, but matching that with Facebook going on the record in the back end of what it was doing? And how they were doing this, like for the last 20, 15 years, like we've only had people like leak stuff out of the companies to tell us this type of thing. There has been no process for this. It was like a breath of fresh air to like have that to resource going forward. But that's kind of a trial court type of hat.
21:14 Speaker 03 And so then they kind of get into this appellate court type of hat and they're like, no, we're not a legislature for you. And our mandate is to see what your rules are and whether or not they're consistent with your values and international human rights standards. And if you don't have a rule, we can't do that. And we're not going to make one for you because that's not our job. And we know what you'd like us to do. We'd like us to basically make this somebody else's problem for you, but we're not going to do that. And we resent that you would even ask us. And I just thought it was a powerful, powerful response, really rooted in the rule of law and procedure. Instead of getting sucked into the vortex
21:57 Speaker 03 of intractable online speech problems and the definition of newsreel-ness and public figures and things like that is never going to get you anywhere.
22:05 Speaker 02 Let me push back on that. I find myself really wondering what the limit of authority for this oversight board is. And I think they punted specifically because they said, you need to come up with a proportionate response to Trump's actions and come back to us in six months with that response based on a new rule. Which sounds like someone's got to reinstate Trump to Facebook, and it's not going to be us. We're telling you that indefinite ban is not acceptable. There's no rule that says indefinite bans exist. But we're not going to tell you the term of indefinite ban. The temptation to say that the board claimed for itself a greater authority by not making a decision is like very high. I see a lot of lawyers making that comparison
22:49 Speaker 02 to Marbury versus Madison at the Supreme Court. Like, there's this big historical parallel that seems very tempting. But here, just like narrowly, it's they didn't want to be the ones to put Trump back on Facebook.
23:01 Speaker 03 Yeah, I think that that's probably also right. So here's what I'll say about what the term proportionality means in an international human rights context, which is basically, I'm not sure that like, the idea of proportionality is that you have some type of like ability to atone for your punishment, or you have some type of kind of proportionate response to whatever it is of the underlying problematic act that you've committed. And so it's not clear to me. It is possible to have a permanent suspension of someone's freedom of expression on a platform or ability to be on a platform and have it ever be consistent with international human rights standards.
23:44 Speaker 03 Like, a permanent suspension is basically de facto disproportionate.
23:51 Speaker 03 But I think that it's a good argument because I do think that maybe you're right. But they want that type of finality of that decision. They want Facebook to have said that, that that's what's at stake. And they don't want to have to say it for them. And like, maybe it's like punting the issue because they don't want to deal with it. But they're going to have to deal with it one way or the other. But, you know, when this comes back.
24:11 Speaker 02 But this is where I think that the wishy-washy issue really gets me. Shouldn't they have said, you gotta unban him until you come up with a rule that would properly ban him as opposed to this just like reflexive reaction to something bad's happening and he's making it worse and we're going to turn him off?
24:28 Speaker 03 Yes, but I think that it's so messy. But this is almost an interesting question of administrative law, which is that they defer to the decision of the underlying body. Right? And so like, they agreed that they made the right decision at the time to take him down. And like, it's not clear that enough time has passed that that problem of imminence or dangerous organization affiliation or lording dangerous organizations are past. And so that was the other part was like, well, we can't make that decision. You have to do that. That part was the puntiest of all of it, I think. You were right. They could have basically reached some type of determination that was the opposite around the ban. And that part, they absolutely did kind of put it back on Facebook to, to do something one way or the other.
25:15 Speaker 02 We're going to take a quick break, but when we return, we'll discuss whether legal frameworks should be applied to Facebook and other platforms at all.
25:27 Speaker 01 This episode is brought to you by Michelob Ultra. Good times mean competitions between you and your friends, like seeing who can throw some pigskin the farthest or rush the field the fastest. Winner gets an ultra. Because it's not just a superior light beer, it's also giving fans superior access to their favorite sporting events. Superior is worth playing for. Visit michelobultra.com/superioraccess to enter. Enjoy responsibly. Copyright 2026 Anheuser Busch InBev Michelob Ultra Beer, St. Louis, Missouri.
25:56 Speaker 04 Flowing ad budget on metrics that look great till the CFO sees them. That's bull spend and marketers are calling it out in dashboard confessions.
26:05 Speaker 05 I remember telling my boss, it'll be good for the brand when leads were slow. Yeah, it it wasn't.
26:13 Speaker 04 Cut the bull spend. LinkedIn lets you target by company, job title and more. Advertise on LinkedIn. Spend $250 on your first campaign and get a $250 credit. Go to LinkedIn.com slash campaign. Terms and conditions apply.
26:28 Speaker 02 We're back with Kate Kwanick.
26:32 Speaker 02 One of the things that really came up in this decision a lot was the board asked Facebook, have you ever applied this exception called the newsworthiness exception to Trump? Where he's doing something that breaks the rules, but because he's the president and he's newsworthy, you're giving him a pass. And everyone assumed that Facebook, this was their justification. And Facebook said, no, we've never applied the newsworthiness exception, which A, I know you have some strong feelings about newsworthiness as a concept, but B, that is a big surprise.
27:02 Speaker 03 It's not a surprise because I don't think that they're lying. I think that they didn't technically apply their newsworthy exception to Trump. Trump is instead on a special list of newsworthy people.
27:15 Speaker 03 It's a different standard. And so they didn't lie. They're just like, kind of, they have different rules for different types of people, for people that are high profile, who people who have certain numbers of followers. We've known this for a long time. We've never had access to this list. We don't know how it's administered. We don't know like what goes into deciding content that those individuals say necessarily. And so this is like, this is one of the best parts of this is kind of, you have to tell us how this all works because this doesn't make sense to us and it seems like you made it up as you went along. And so this isn't a standard at all. And so we can't even review it. I think that this is great because, I mean, I've written, I wrote a paper in 2018 called Facebook v. Sullivan, which kind of like was supposed to be a little play on like New
28:00 Speaker 03 York Times v. Sullivan, which established the public figure and newsworthiness kind of considerations in First Amendment law. And it toyed with this idea of like, well, how are they defining, how are they possibly defining newsworthiness in public figures? And I talked to a number of former policy people that had left the company in 2013 specifically around this newsworthiness question because they thought that this was an intractable standard that could never be consistently applied and was always going to be a question of newsworthy to who. And that was always going to be a group of people in Silicon Valley, and that was bullshit. And then a group of people that ended up being the winners that just wanted to use it as a, as a way
28:41 Speaker 03 to just kind of like ad hoc make determinations on a case by case basis. I love that it's coming up and that this is something that the board raised because I think it's just absolutely fascinating.
28:51 Speaker 02 That special list that Trump was on, we, we don't know how like how big it is, right? But Trump, his, his relationship to Facebook and to Twitter, he's always sort of gotten his own space, right? And it's always been nuclear to moderate Trump in any way, shape or form until it crossed the threshold of January 6th. Is this decision from the board saying you can't have those kinds of soft exceptions anymore? You have to treat everybody the same? Or is it, if you're going to have exceptions, you have to be clear about them?
29:21 Speaker 03 I would say the latter, but I don't know. They might say that it does not comport with international human rights law and like principles of law to have two different sets of speech rules for people.
29:32 Speaker 02 Even if you're the President of the United States?
29:33 Speaker 03 Even if you're the President of the United States. Or they might say that you are allowed to have different classes of type of things, but you have to be consistent about what classes people are in. And you have to like tell us what it means to be put into this class. And so like, one of the things that I wrote about with some of my research is at some point, they used to define public figures by the number of like Google hits you had, or like the number of times you showed up in Google News. And like, they would use Google to determine whether or not someone was a public figure, or a combination of that and how many people followed you on the platform. But these are standards that are, they, they changed all the time. I have no idea where that standard is now because we've had no transparency into, into how it changed or like where it's gotten to. And so, I don't know, it's just, I am excited for this conversation to have gotten
30:16 Speaker 03 to such a sophisticated place, finally, after, you know, the last 10 years of nonsense. And I'm really looking forward to it.
30:23 Speaker 02 There's just a part of this where Facebook gets to pretend it's the most important thing in the world all the time. And it's created this board. And here we are talking about it as though it's a Supreme Court. And sort of right next door is Twitter and they're like, yeah, we're just banning the guy. He's gone. Like, we're not telling you if he's ever coming back. Maybe he'll never come back. Like, you're just never gonna know. And there's no process by which Trump or any of his team can appeal that decision. Because Twitter is a private company. It's their platform. They can do what they want. Facebook is trying to create this other thing that provides moral, legal, spiritual justification for a snap decision. I just
31:05 Speaker 02 can't tell if that is correct, or whether it's fundamentally distracting, or whether everyone should have a giant oversight board.
31:15 Speaker 03 Yeah. I mean, and I think that all of those things are the things to be thinking about. I think that that's all I've been thinking about for the last two years, but I've been by myself.
31:25 Speaker 02 That's why I want to talk to you.
31:26 Speaker 03 This is so much nicer than just like sitting in like my apartment staring at my dog, being like, why won't you tell me what to do about the Facebook oversight board? So I think that that's completely correct. So the way that I think about this is that Facebook has basically chosen a path of governance. They are in, and so is Twitter, in an intractable kind of situation in which they are forced to make these terrible content moderation decisions that govern and have a huge like public ramifications and that compromise human rights, like freedom of expression and safety. And at the same time, they're privately held companies. And that they're privately held companies that operate
32:08 Speaker 03 transnationally and in the exchange of information. And so they are basically, they are a pretty big deal. They're pretty much outside in strength and power, outside the ability of any one country to shut them down everywhere. Like, no, not even the United States could shut down Facebook or Twitter everywhere. They could shut it down in the United States briefly if they kind of really wanted to, but that's about it. And so I think that this is like, you kind of have to galaxy brain yourself a little bit and make yourself go to a new place of like, what is the world going to look like if entities like this exist and they're Governing public rights and we need to kind of figure out a way to democratize or
32:50 Speaker 03 hold accountable private companies governing public rights. Especially when those public rights like freedom of expression are rights that you have traditionally accepted from government control. Because governments are traditionally bad at telling us what to do with our speech and dangerous when they tell us what to do with their speech. So it's like hard to make government the solution to this either. And so I think that Facebook chose a governance path with like the Oversight Board. And I think that they hoped that they would be shoving off these substantive decisions. What we saw yesterday was that that didn't work out quite the way that they thought, or at least it isn't so far. I mean, there's a couple of things that could happen out of this. The Oversight Board could be a total distraction. We never get anywhere with it.
33:33 Speaker 03 It gets disbanded in five years or whatever. But at least it was a pretty noble experiment and gave us kind of a new valence or a way of thinking about how to solve some of these problems. The other thing is that it could take hold and the idea of people being entitled to boards like this or being able to avail themselves of boards like this becomes something that is either mandated and regulated by governments. Right now, Canada is contemplating mandating the creation of Oversight Boards within their country for these speech platforms. Or it's something that the public simply demands of these speech platforms and they have to kind of put them in place themselves. And Twitter gets forced into it because it becomes kind of the next wave of kind of
34:18 Speaker 03 how we deal with with platforms. I have no idea. I think about this all the time, but I think that at least for now, it looks like the Oversight Board is pretty serious. It really could have been people taking their checks and rubber stamping Facebook's decisions and it could have been nothing. But a 40-page decision that cites to international human rights law and outs Facebook for not answering questions that were posed to it after it created this board to begin with, I think that this is a pretty serious, well, right now, it looks like a pretty serious group and decision.
34:54 Speaker 02 So the board submits a bunch of questions to Facebook as part of its Trump decision-making process. Facebook just says, "We're not going to answer seven of your questions." Is Facebook allowed to just not answer the board's questions?
35:06 Speaker 03 Uh, see, like, I love this. This is like, people, my students are being like, "Is this legal? Can this, can they do this?" Like, and I'm like, "Anything is like, legal or not legal until like, someone tells you not to do it." Like, I don't, can they do this? Like, well, they just did, and like, I don't know what we do to stop them. I mean, what we do to stop them is the board tells them they can, and the board did that as much as they could, and they made it public, and it's not been well-received that they didn't answer those questions. And I think that there is probably definitely a number of people at Facebook right now that are panicked over how to kind of move forward with more requests from the board in the future.
35:48 Speaker 03 But if you think about it from the perspective of, if a government was called before a court to answer questions, and the government said, "I'm really sorry, court, we can't tell you," it just wouldn't fly. You'd be in contempt of court. Like, that's like, the end of that. I think that the interesting thing here is that it ends up being a real question of, like, legal realism and public pressure and reputation for the company. Like, how bad it was going to look if they spent $130 million in two years and 20 brilliant people's time to do this, and then they don't pay any attention to it?
36:24 Speaker 02 One of the things that strikes me, as you kind of describe that process, is the United States Supreme Court likes to say that it makes very narrow decisions, but it actually has sweeping authority over American public life, right? Should our schools be segregated or not? The Supreme Court said not. And they kind of make these decisions that have sweeping impact over our lives, and they actually kind of restructure society. The board's power here is limited to, "Well, you took something down, but you should put it back up." And it seemed like in this decision, they want the additional power to say, "How does your algorithm work?" What do you see your algorithm promoting
37:04 Speaker 02 or disincentivizing or otherwise modifying in the conversation it has on Facebook? And how does your business model plug into that algorithm and have you make decisions about it? And they just don't have that power. And it seems like they really want it.
37:19 Speaker 03 Completely. I also got that out of the opinion. I also got that I was in the House of Lords testifying about the Oversight Board with Alan Ruspinger, who's on the board, a former editor in chief of The Guardian. He basically said that in his House of Lords testimony was that they were coming after the algorithm. And I was like, that's interesting. That's like not, that wasn't in the charter. And so it was kind of foreshadowed, but I saw that in the opinion as well. And I think that it's really interesting. And I think that it is absolutely the right question because as Jack Balkin says, is the crown jewels of how all of this works and what the real power source of Facebook is. I know for a fact, because I've read the founding documents so many times that it is
38:03 Speaker 03 not contemplated at all that they'll have any type of visibility into that. But I've always argued that like, that doesn't mean anything. Like that, like just for the same reasons you're talking about it not being legal, there's no reason that they can't use their public pressure and authority and sway, which is really all that they it is, is like to start asking these hard questions. And this was always, I think that this is pretty soon to do it, but I think that it's great that they're going in that direction.
38:31 Speaker 02 We're going to take one more break. When we return, I'll ask Kate what she thinks will happen with the Trump decision and more importantly, what the future of Oversight Boards as a whole might look like.
38:44 Speaker 01 This episode is brought to you by Michelob Ultra. Good times mean competitions between you and your friends, like seeing who can throw some pigskin the farthest or rush the field the fastest. Winner gets an Ultra because it's not just a superior like beer. It's also giving fans superior access to their favorite sporting events. Superior is worth playing for. Visit michelobultra.com/superioraccess to enter. Enjoy responsibly. Copyright 2026 Anheuser Busch InBev Michelob Ultra Beer, St. Louis, Missouri.
39:12 Speaker 04 Flowing ad budget on metrics that look great till the CFO sees them. That's bull spend and marketers are calling it out in dashboard confessions.
39:22 Speaker 05 I remember telling my boss, it'll be good for the brand when leads were slow. Yeah, it wasn't.
39:29 Speaker 04 Cut the bull spend. LinkedIn lets you target by company, job title and more. Advertise on LinkedIn. Spend $250 on your first campaign and get a $250 credit. Go to LinkedIn.com/campaign. Terms and conditions apply.
39:45 Speaker 02 We're back with Decoder.
39:48 Speaker 02 You know, the connection between maybe five years from now, every company will want an oversight board or governments will demand that you have such a contraption connected to your company. But if your expertise and your precedent is all about Facebook's algorithm, then how on earth can you connect that to TikTok or connect that to YouTube, which have wildly different business models, wildly different algorithmic inputs and outputs?
40:14 Speaker 03 Oh, you don't. And I would actually say that that would be the worst possible outcome is to have one oversight board.
40:21 Speaker 02 Well, I think this one kind of wants to be the one oversight board. They don't even call themselves the Facebook Oversight Board. They're just the Oversight Board.
40:28 Speaker 03 That's true. I thought that that was weird. And I honestly, you want to know why I think that they did that? I think that they all are so like, the name Facebook is so toxic that like, I think that they don't want to be associated with it by name. And I don't think that they want to have power over all of the different platforms. And so this is something I wrote about in the Yale Law Journal article that I went into, which is the different ways that this could play out. And one of the ways is that basically the trust corporation that I mentioned before, that Twitter dumps $130 million into that and forms their own oversight board, right? To apply Twitter's Terms of Service and Twitter's community standards to whatever it is that Twitter wants to set those at, right?
41:13 Speaker 03 Or Twitter makes its own, which is just as easy, I think, Twitter makes its own trust and its own oversight board and endows that and does their own thing. And finally, the last thing is like, I think it would be terrible for freedom of expression globally if we started to have one set of like merged standards that came together that were all the same industry standard and that you couldn't have nudity on one platform and no nudity on another platform, or something like that, if that's what you decided. I think the differentiation is key to like preserving freedom of expression. But I think that you're exactly right. That's one of the things that is was specifically contemplated by Zuckerberg when he started to create these documents.
41:56 Speaker 02 Right. I think he said, well, maybe someday other companies will use our board.
42:00 Speaker 03 I mean, he literally made the documents so that you could like Ctrl F replace all Facebook for Twitter. Like they're, they're, they're really meant to be like usable, like breakouts, like for other companies.
42:12 Speaker 02 I mostly agree with you that it would be bad to have one weird, public quasi-private entity controlling all speech in America. It just seems bad on its face. On the flip side, there's just an enormous amount of instability in like people's expectations of what they can do on services. The First Amendment kind of means that it's a free for all, which is good. The government can't make speech regulations, but the idea that Twitter will take something down and Facebook won't and YouTube will demonetize a creator for doing pranks that are too dangerous. And TikTok, like people accuse TikTok, like literally the algorithm of TikTok of being racist all the time. I hear from the audience all the time that I don't know what's going to happen, right?
42:56 Speaker 02 Like where are the rules these platforms have to abide by from a baseline? And I think that's how you get to, you know, this like very popular sort of political posturing that we should just impose the First Amendment and they've got to do the whatever the First Amendment says, which is somewhat nonsensical.
43:14 Speaker 03 It's not somewhat. It is like literally like nonsense gobbledygook. Makes sense.
43:19 Speaker 02 But I under I'm like very sympathetic to where that comes from. Right. That you're going to go seek out some other authority that has this like spiritual place in American life. And then you have everyone has to just do that. Okay, like I I understand the impulse. But I can't. I don't know how to square it with. These are different companies with different roles. Different algorithms. And yeah, Twitter wants to be a little looser with its nudity standards than Facebook. That is actually a good thing for speech in America.
43:49 Speaker 03 I understand the impulse. I'm gonna be really mean about people for a second.
43:55 Speaker 02 Let's do it.
43:57 Speaker 03 I understand the impulse to stop to turn off your brain and take the easiest possible solution that gives you like absolutely meaningless results and won't have any type of procedural like fairness over time. Sure, like that seems great. Like we did that with newsworthiness. Newsworthiness is a circularly defined concept that people rely on all the time. It actually means nothing. And it's time we finally started talking about that. And just because Supreme Court uses the language and circularly defines it still doesn't mean that it's not a problem philosophically to rely on that for a standard to police people's speech on. I really do understand the notion that people want there to be some answer out there that is going to solve this problem.
44:41 Speaker 03 But here's the thing, you just were talking about this in the US and the First Amendment. Facebook's global user base is 7% in the US. Mostly it's everywhere else. This isn't even other people's standards. Facebook talks about itself as a community. It's not a community. It is like a couple billion communities all overlapping on top of each other that have almost like nothing in like they have nothing that necessarily binds them together. A community is defined by a group of individuals that have a shared sense of norms and values and responsibilities. And there's no global community that can even agree on whether we should allow female
45:23 Speaker 03 breasts online, let alone whether or not to allow, you know, when a Mexican cartel Has like a beheading, whether or not to like let someone put that on a platform, or whether it's too violent, or it's gore, or whether we should do something in between. This is one of the other things that I'm excited about about this decision is because I think it starts to go to a place that is so much more useful and rigorous than how we've been having this conversation for the last 10, 15 years, which is that we are, it is time to stop letting people make these like, oh, he's a public figure. Oh, he's a political figure. Oh, he's newsworthy, like types of arguments and stop there. It's time to get to the next
46:06 Speaker 03 level and dig deeper and figure out what it is we value and mean by that. And to your point about all this stuff about like TikTok being racist, Twitter making like arbitrary decisions, all of this stuff, those have grounded intuitive roots in procedural justice and the rule of law that we can start to tie some of these things back to. And if we could start to have procedures around some of this stuff, then once we apply the substantive rules, they won't seem so arbitrary and capricious. And these companies won't seem so unaccountable.
46:36 Speaker 02 What's interesting about that is we keep coming back to laws and courts, which are fundamentally governmental functions and powers. There's, at least in this country, there's just not a way to have a speech court like that. So these all have to be corporate powers and enforcement mechanisms. At least here in America in 2021, I cannot see everyone coming together and agreeing that this corporation, this LLC, has the power over speech on one of the largest platforms and that its decisions are going to carry the psychic weight of a Supreme Court decision.
47:11 Speaker 03 Well, I mean, like to your point, like pretty much like the US courts like have passed the buck on this all the time. I mean, this is the same, they don't make decisions on substantive nature of viewpoint discrimination. They just say there can or cannot be viewpoint discrimination. And this is how we're going to determine this. I think that what you're going to see is that Facebook's going to still get to substantively decide what its policies are, but they're just going to have to be fair and consistent and proportionate in how they. Enforce them. And that right now, that is the biggest hurdle that people who have worked around content moderation are the most upset about, or is not that like Trump comes up or comes down when he incites violence, or like laws, a dangerous org. It's that there is a different
47:54 Speaker 03 rule for you and for me and for Trump and for Alex Jones, and that we don't know what any of those decisions are, any of those rules are. People are constantly having unfair outcomes. I think it was like a 80% error rate on content moderation decisions. Like, I just like, that's nuts. Like, can we just like, work on getting that lower for a while? Like, never mind keeping, like, Trump down? Like, that's a lot of people that are censored. At the end of the day, this is really about just establishing some procedures. The substantive decisions, you're right, everyone's going to fight about them. No one's going to be happy about them. There's lots of laws people don't agree with now, too. But they feel protected by the fact that there's transparency and
48:35 Speaker 03 accountability of how they're enforced. Well, kind of, depending on, you know, depending on plenty of other systemic things. But that's kind of something that I think that we can get into once we have this baseline.
48:48 Speaker 02 You mentioned the error rate of moderation decisions. Connect this spectrum for me. We've done a lot of coverage of individual moderators at Facebook, and their working conditions and how they feel, and the fact that they have fundamentally bad jobs and often get PTSD afterwards. How should a contractor working in a Facebook moderation shop feel about the Oversight Board? What is the relationship that they should have? And what is the relationship they have now?
49:14 Speaker 03 Oh, I think that they should be very excited about this. And in fact, one of the most interesting series of calls I got yesterday, or texts that I got yesterday from people that were inside the company, inside Facebook, were from people at the, as I would call it, in the factory floor, or in the policy shop, that were very happy because they had agitated for these types of changes for a long time, and felt like this gave them the clout and authority that they needed to put forward this, like, rigorous new agenda, and not have, like, a series of, trying to rework the same Terrible ad hoc rules. And so I think that that's going to filter down to content moderators and their job being easier.
49:55 Speaker 03 I will say that like, I think that it continues to be something that we need to talk about. And the fact that we are outsourcing this labor in this way. And that we are like, we're using individuals to cleanse things. And we still talk about it like there is this, you talk about the algorithm, both either from like data that we're getting, people are generating from even being on the site and where their eyeballs are going, to people making the content moderation decisions. I think that the, probably the algorithm is less sophisticated than we think.
50:27 Speaker 02 Inside of Facebook, one thing that we've heard a lot about is the content moderation shop is connected to their political operation shop, that the lobbyists of Facebook are the people who write the rules for, for speech on Facebook. And that is deeply problematic. That's like gestured at in this opinion, but they've now kicked it back to that same shop, which, you know, is just faced any number of controversies over the years. Is that something that just like Facebook needs to change to make all of this more credible?
50:57 Speaker 03 I've heard that they're starting to. I've heard that some other people who have heard this, so this is like getting deep into a kind of hearsay and like just kind of rumor mill of inside, inside Silicon Valley. But I think that they are definitely wanting to devolve product and policy more distinctly. I think that that's been, been happening for a while. And I think the Oversight Board is a huge part of that. But I think that also that they are trying to get away from the idea that Joel Kaplan is in charge of so much and doing so much and trying to put more onto Nick Clegg. And I think that like the New York Times article that came out today is like kind of part of that. I think that there is a, a desire to kind of set Nick up more for being, you know, a policy head. I think that's maybe it's too little, too late, but I have no idea.
51:41 Speaker 02 So we're looking at this whole sweep of the Oversight Board being created, this big decision being referred to it, it asserting itself and saying, no, you actually have to make a policy, kicking it back to Facebook, six months, they'll send it back to the Oversight Board. What should regular Facebook users be looking for next from this process?
52:02 Speaker 03 One of the things that's been lost in all of the nonsense around Trump, and honestly, I know that people are like, the Oversight Board is a distraction. And I feel like Trump is a distraction. Trump is a distraction. I mean, for always and for all time, he has been a distraction from so much, but also from Modi and from Bolsonaro and all of the other leaders that are still in power that are threatening and still on Facebook. I think that this is just one moment. So I think the next thing that users can expect is that whatever happens coming out of this next six months is going to have a huge impact on other types of world beaters. The other thing I was going to say is that one of the things that's been lost in all of the emphasis on the Trump suspension is that in the last couple of weeks, Facebook
52:47 Speaker 03 actually had implemented something that they had promised to do for eventually, but we were never knew how soon or when, which was to start putting their decisions to keep up content that had been flagged by other users into the jurisdiction of the board on appeal. So this means that like, if I find something that you said offensive and I flag it to Facebook as being, you know, lauding dangerous organizations or inciting violence and they say, no, it's fine. We decided to leave it up. I can now appeal that decision. And I think that that's a huge deal because it puts the board into both the role of being
53:27 Speaker 03 watchers of the censors and being this now being the censors themselves, basically being like, no, that speech is too harmful. It has to come down. And I think that that's actually going to be a really weird thing for a lot of these people to do, because I think a lot of these people are used to being like, no, that has to go back up it for the sake of freedom of expression. I think it's going to be a lot harder to take down people, certain people's speech when it's harmful.
53:55 Speaker 02 Yeah. And I think you actually see that in the Trump decision where as I keep referencing the minority, they keep saying the minority would have gone farther.
54:03 Speaker 03 Yep.
54:04 Speaker 02 That balance to me seems incredibly fascinating. Kate, I suspect we're going to have you back on the show a lot as the Facebook Oversight Board continues, I don't know, its metamorphosis into something incredible. Thank you so much for being on the show.
54:17 Speaker 03 Thank you so much for having me. It was really, well, it was really fun.
54:24 Speaker 02 Thank you again to Kate Klonick for taking the time to talk today and thank you for tuning in. I hope you enjoyed it. As always, I'd love to hear what you think of the show. You can email us at [email protected] or hit me up directly. I'm at Reckless on Twitter. If you like Decoder, please share it with your friends and subscribe wherever you get your podcasts. Decoder is a production of The Verge and part of the Vox Media Podcast Network. Today's episode was produced by Liam James, Alexander Charles Adams, and Andrew Moreno. Our music is by Breakmaster Solander. We'll see you next time.
54:56 Speaker 06 This week, it pays extra to be a MyLowe's Rewards member. Through October 14, members get $10 MyLowe's money when you spend $200 or more on an eligible purchase during MyLowe's Money Days. Also using your MyLowe's Rewards credit card? Even better, that's an additional $20 MyLowe's money. Use it to save on your next Lowe's haul. Exclusions, restrictions, and more terms apply. See Lowe's.com/Mylowe'sMoneyDays for details. MyLowe's money expires 30 days after issuance. Subject to change. Credit offer subject to credit approval.
55:25 Speaker 07 I work here. You know, that thing you have to wake up for every day. I know, I've made things a little difficult in the past. Okay, a lot difficult, but I got some help from UKG, and finally, I understand. Now I'm making work work better. I've even got AI agents helping me find new ways to help you, your people, and your business. Because when work works, everything works. UKG, HR, Pay, and Workforce Management.
Previous How Shopify’s network of small businesses can take on Amazon Next Ford CEO Jim Farley on building the electric F-150 — and reinventing Ford Page updated October 26, 2026 · transcript and summary are machine-generated