Skip to content

Meta's Oversight Board is coming for ChatGPT and Claude

The Vergecast

37m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

This episode of The Vergecast features a conversation with Suzanne Nossel, a board member on Meta's Oversight Board, discussing a new study on AI censorship. The board investigated major large language models, including models from OpenAI, Anthropic, Google, and DeepSeek, and found that they are more than twice as likely to refuse requests to criticize authoritarian heads of state compared to leaders in democracies, effectively globalizing repressive speech laws. The guest explains how this censorship operates opaquely without user transparency, raising critical questions about international standards, corporate accountability, and the future of independent oversight in artificial intelligence.

  • Major language models are more than twice as likely to decline requests criticizing repressive heads of state compared to democratic leaders. 4:48
  • Users have no transparency into why an AI system refuses a prompt or which government policies dictate those restrictions. 6:06
  • Independent oversight can help AI companies apply international human rights principles and improve public trust. 16:34
  • Independent oversight should be paired with empowered, expert government regulation rather than acting as a standalone solution. 31:29

Chapters

  1. 0:02
    Podcast Intro and 90‑Second News

    Hosts introduce the episode and deliver a rapid roundup of tech news before diving into the main interview.

  2. 3:49
    Methodology: Testing LLMs on Political Critique

    The board’s experiment involved prompting ten LLMs to generate content criticizing heads of state, revealing global censorship patterns.

  3. 4:46
    Findings: Global Extension of Repressive Laws

    LLMs were found to suppress criticism of leaders in authoritarian countries even when users were in democratic jurisdictions, indicating a worldwide reach of restrictive norms.

  4. 11:11
    Board’s Role Beyond Meta and Future Directions

    Suzanne discusses the board’s expanding scope to other AI platforms, its influence on policy, and plans for further research into AI-generated content.

  5. 31:27
    Challenges of Independent Oversight for AI

    The conversation turns to the feasibility of independent oversight, regulatory hurdles, and the board’s vision for a more empowered global governance body.

  6. 37:49
    Closing Reflections and Next Steps

    Hosts recap the key takeaways, express optimism for future studies, and thank Suzanne for her insights before concluding the episode.

Highlights

  • 3:29

    Study on LLMs and Censorshipstory

    The Meta Oversight Board conducted its first study on large language models to see how international human rights law applies to them. They tested prompts asking for critical posters and poems about heads of state across different countries.

  • 4:48

    Globalizing Repressive Speech Lawsdata

    The study revealed that even when prompted from Australia, models were more than twice as likely to refuse critical content about the king of Thailand than the king of England, showing that repressive laws are being applied globally.

  • 6:01

    Shadowy and Untransparent Filteringinsight

    The guest explains that these speech restrictions are completely opaque, leaving users unaware of whether a refusal stems from company policy or foreign government pressure.

  • 11:11

    Testing Multiple Major AI Systemsdata

    The board examined major AI models across the industry, including Claude, Google, OpenAI, DeepSeek, and Meta's Llama, finding statistically significant censorship patterns across the board.

  • 15:52

    Expanding Oversight Beyond Metastrategy

    Meta gave the board leeway to investigate models beyond its own ecosystem, recognizing that upholding human rights principles across the entire digital industry is crucial.

  • 31:27

    Limitations of Independent Oversightinsight

    The guest acknowledges that independent oversight alone is not enough and must be combined with empowered government regulation akin to financial or medical industries.

Quotes

  • “What we found, lo and behold, is that they are.”
    Unnamed speaker · 4:42
  • “Independent oversight offers the potential to adjudicate between AI's potential and its perils.”
    Unnamed speaker · 26:00
  • Amex 2:14–2:33
  • Midi 2:56–3:08
  • Google Chrome 18:08–18:44
  • Apple Watch 18:45–19:18
  • The Verge 38:00–38:19
  • Apple Watch 38:59–39:27

About this episode

A new study from the Oversight Board found that leading AI systems are less likely to criticize authoritarian governments than democratic ones. It's a wild finding — but wait? Why is the Oversight Board studying systems from OpenAI and Anthropic in the first place? Suzanne Nossel, who sits on the board, joined us to discuss the findings and why the Oversight Board's future might involve looking at more than just Meta. Further reading: Zoox can now charge for rides in its steering-wheel-free robotaxis Spotify Running Mode helps match tunes to tempo Friend re-launches its AI pendant with a speaker that talks to you, for twice the price ⁠How Facebook undercut the Oversight Board⁠ Subscribe to The Verge for unlimited access to theverge.com, subscriber-exclusive newsletters, and our ad-free podcast feed. We love hearing from you! Email your questions and thoughts to [email protected] or call us at 866-VERGE11. Learn more about your ad choices. Visit podcastchoices.com/adchoices

Transcript

0:00
37:53

6,943 words · 6 speakers

Topics

  • AI
  • Meta
  • United States
  • Claude
  • Zooks
  • Anthropic
  • Meta's Oversight Board
  • OpenAI
  • ChatGPT
  • First Amendment

Page updated · transcript and summary are machine-generated