
Written by a model from the transcript; not yet reviewed.
Gary Marcus, AI skeptic and NYU professor, argues on Prof G Markets that large language models are fundamentally unreliable next-token predictors that fake understanding rather than achieve it. He traces the field's decline from intellectual curiosity to money-driven hype, noting that hallucinations have not gone away despite promises from Microsoft's Mustafa Suleyman and Reid Hoffman in 2023. Marcus contends the entire economy is over-attributing intelligence to LLMs, comparing the situation to the 1960s Eliza effect where people over-attribute intelligence to machines.
On the financial side, Marcus and Ed Elson discuss OpenAI's $21 billion operating loss last year, with Marcus calling OpenAI "the WeWork of AI." He argues that because all major companies build essentially the same next-token prediction technology, they face a price war with no differentiation. He identifies multiple threats: more efficient architectures could disintermediate them, customers aren't finding productivity returns in studies, and the "token maxing" era has ended. Marcus sees Anthropic as the stronger company but acknowledges the overall business model remains unproven.
The episode also covers Anthropic's Mythos model, which Marcus says is real but oversold—a wake-up call for cybersecurity rather than an existential threat. He discusses the regulatory shift from the Trump administration's initial "no regulation" stance to voluntary pre-release checks, arguing the Overton window has shifted from whether to regulate to how to regulate.
LLMs Are Next-Token Predictorsinsight
Marcus explains that LLMs are literally built to predict the next token in a sequence. They can approximate human speech when trained on the internet, but the approximation is superficial and breaks down outside the training regime.
The Hallucination Bet That Never Happenedstory
Marcus recounts offering Reid Hoffman $100,000 in 2023 to bet that hallucinations would go away in a few months. Hoffman never responded, and by 2026 hallucinations remain unsolved.
Economy Hinging on Over-Attributioninsight
Marcus argues the entire economy is betting trillions of dollars on machines that are not actually intelligent in the ways people assume, because the people placing those bets lack the cognitive science background to evaluate them properly.
Mythos: Real but Oversoldinsight
Marcus says Mythos is partly a different architecture with a harness directing cybersecurity investigations. It can exploit weaker systems but won't break into well-secured infrastructure like Google or banks. It's a wake-up call, not Lex Luthor's magic hacking system.
OpenAI Burning $2 Billion Monthlydata
Ed Elson confirms OpenAI lost $21 billion on operating profit last year, roughly $2 billion per month. Marcus notes that every time a user uses the product, the company loses money.
Token Maxing and the Token Apocalypseinsight
Marcus describes a month-long era where companies like Amazon rewarded employees for using the most AI tokens via leaderboards. When studies showed no real productivity gains, the practice collapsed into what he calls the token apocalypse.
OpenAI as the WeWork of AIinsight
Marcus says he's been warning since November 2023 that OpenAI will be the WeWork of AI. He notes that Anthropic has the same product at the same valuation but is burning less money and gaining market share.
The AGI Myth and Explore vs Exploitinsight
Marcus says the current myth is that generative AI is close to AGI. He argues the US is completely in exploit mode on LLMs rather than exploring other approaches to intelligence, risking being left behind like Betamax.
Ed Elson is joined by Gary Marcus to discuss why he’s concerned about the fact that we’re all-in on AI. They explore why he argues generative AI is inherently unreliable, whether the concerns surrounding Anthropic's Mythos model are justified, how policymakers should approach AI regulation, and the biggest misconception about the technology that he believes needs to be corrected. Gary Marcus is a leading voice in artificial intelligence, author, and professor at NYU Stern. Subscribe to the Prof G Markets Youtube Channel Check out our latest Prof G Markets newsletter Follow Prof G Markets on Instagram Follow Ed on Instagram, X and Substack Follow Scott on Instagram Send us your questions or comments by emailing [email protected] Learn more about your ad choices. Visit podcastchoices.com/adchoices
11,098 words · 17 speakers
Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.
Page updated · transcript and summary are machine-generated