Skip to content

A.I. Safety Is So Back + Mythos Mayhem with Nikesh Arora + Hot Mess Express

Hard Fork

1h 13m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

The hosts discuss the Trump administration's sharp reversal on AI safety, from dismissing it as doomer fearmongering to reportedly considering pre-release government review of new models. They attribute the shift to Claude Mythos, Anthropic's model that found novel code vulnerabilities at scale, and trace the internal turf war between the Center for AI Standards and Innovation and the intelligence community. The incoherence is highlighted by the administration simultaneously inviting Jensen Huang to sell chips to China while trying to block Chinese access to Mythos.

Palo Alto Networks CEO Nikesh Arora describes using Mythos to audit his own systems, finding 26 critical exploits covering 75 issues—five to seven times the normal baseline. He explains that Mythos runs in an 'ultra mode' enabling longer compute persistence and effective daisy-chaining of vulnerabilities, and that the time from breach to data extraction has shrunk from days to minutes. Arora argues attackers hold a structural advantage since they need only one success while defenders must be right 100% of the time, and identifies non-tech businesses like hospitals as most vulnerable.

The Hot Mess Express covers Venmo making transactions private by default, Amazon employees gaming token metrics, students booing a commencement speaker, Dua Lipa's $15 million Samsung lawsuit, GameStop's rejected $55 billion eBay bid, and Grindr's Madonna ad that accidentally outed users.

  • The Trump administration's AI safety posture shifted primarily because Claude Mythos demonstrated the ability to find novel code vulnerabilities at scale, making the previous 'let it rip' approach untenable. 6:25
  • Palo Alto Networks found 26 critical exploits covering 75 issues using AI models, five to seven times their normal baseline, and expects other organizations to face similar vulnerability debt cleansing. 30:51
  • Attackers hold a structural advantage over defenders because they only need one successful exploit while defenders must be right 100% of the time, making current AI models more useful to bad actors. 42:15
  • Non-tech businesses like hospitals and small manufacturers are most at risk from AI-powered cyber attacks because technology is only a small fraction of their core operations and they lack dedicated security teams. 43:26
  • Nikesh Arora argues that AI will not reduce cybersecurity headcount but will fill the technological backlog that companies have been unable to address due to insufficient staffing. 51:34

Highlights

  • 5:00

    Overton Window Shifts on AI Regulationinsight

    Kevin Roose notes that during the Biden era, Republicans called pre-release AI testing 'communist' and anti-innovation, but within a couple of years the same faction is reportedly considering exactly that.

  • 9:46

    Pentagon Simultaneously Removes and Installs Anthropicstory

    Casey Newton points out that while the Pentagon is in court arguing to remove Anthropic as a supply chain risk, it is simultaneously implementing Mythos to scan for vulnerabilities.

  • 29:48

    Breach Time Shrinks From Days to Minutesdata

    Nikesh Arora explains that the time from an initial breach to extracting crown jewels has shrunk from days to minutes, forcing defense infrastructure designed for days to be overhauled for real-time response.

  • 30:36

    26 Critical Exploits Found in Own Codebasedata

    Palo Alto Networks disclosed 26 critical exploits covering 75 issues after running Mythos against their own codebase, compared to a typical baseline of under five in the same period.

  • 39:53

    90-Day Disclosure Window Is Deadinsight

    Casey Newton asks Arora whether the 90-day responsible disclosure window is dead, noting that in an AI-assisted scenario someone could gain initial access and exfiltrate data within 25 minutes.

  • 42:15

    Attackers Need Only One Successinsight

    Arora argues the fight is structurally unbalanced: defenders must be right 100% of the time while attackers only need one successful exploit, making current models more useful to bad actors.

  • 44:43

    Mythos Ultra Mode Enables Daisy Chaininginsight

    Arora explains that Mythos runs in 'ultra mode,' a compute-consumptive mode allowing the model to persist much longer than standard flash mode, enabling more effective daisy-chaining of vulnerabilities.

  • 58:46

    Amazon Employees Game Token Metricsstory

    Amazon employees are using the company's in-house MeshClaw product to generate unnecessary AI activity to inflate their token consumption metrics, a textbook case of Goodhart's Law in action.

About this episode

After several years of dismissing A. I. safety as doomer fear-mongering, parts of the Trump administration now seem ready to support regulation.

Transcript

0:00
1:13:37

14,074 words · 7 speakers

Topics

  • AI Safety
  • AI Regulation
  • Cybersecurity
  • Claude Mythos
  • Trump Administration
  • Vulnerability Disclosure
  • AI Policy

Page updated · transcript and summary are machine-generated