Skip to content

Can AI predict the future?

If You're Listening

25m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

This episode explores whether frozen-in-time artificial intelligence models can be used to predict future events by testing them against historical scenarios where the outcome is already known. The host examines how AI models, because their training data cuts off at a specific point, act like the character in the film Memento, unable to form new memories after training. By feeding simulated intelligence dossiers and military plans into these models without internet access, the host discovers that AI excels at extrapolating the structural outcomes of complex systems, such as military conflicts, because they have digested vast amounts of doctrine and expert analysis. However, they perform poorly when predicting human choices, elections, sports, or financial markets, where outcomes depend on genuine chance or erratic human decisions. Ultimately, while billions are spent on AI infrastructure, leaders who rely purely on gut instinct rather than expert analysis may find little use for AI's cautious, evidence-based assessments.

  • Recognize that AI models cannot learn new information after their training cutoff date and revert to their baseline knowledge once a conversation ends. 4:20
  • Test predictive capabilities by freezing an AI model's context and feeding it past battle plans to assess structural outcomes. 11:54
  • Avoid using AI models to forecast sports, financial markets, or elections, as they struggle with events driven by genuine chance or human decision-making. 21:08
  • Expect AI to provide cautious, conservative assessments that highlight negative ramifications rather than validating high-risk political gambles. 24:15

Chapters

  1. 0:00
    Podcast Intro and AI Experiment Overview

    The host introduces the podcast and explains his months-long experiment using AI to gather information for the show.

  2. 0:51
    AI’s Limitations in Real-Time Updates

    The host discusses how AI models are frozen after training and cannot learn new events unless re-trained.

  3. 12:29
    Simulating Operation Epic Fury with AI

    The host sets up a simulated battle plan for Trump’s Operation Epic Fury and queries AI models for outcome likelihoods.

  4. 17:44
    AI Accuracy on Iran War Predictions

    AI models correctly predict many aspects of the Iran war, outperforming human expectations in some cases.

  5. 18:26
    AI Performance on Sports and Markets

    The host tests AI predictions on sports finals and financial markets, finding poor accuracy and highlighting limitations.

  6. 20:00
    AI’s Struggles with Human Political Decisions

    AI fails to accurately forecast political outcomes like the UK Prime Minister’s tenure, showing bias toward recent events.

  7. 22:03
    AI’s Insight into Trump’s Decision-Making

    The host contrasts AI’s knowledge of military doctrine with Trump’s gut-driven decision to launch Operation Epic Fury.

  8. 23:02
    Broader Implications of AI in Governance

    Discussion of the U.S. AI spending boom, the irony of AI’s potential, and the president’s reliance on gut over data.

  9. 24:59
    Closing Thoughts and Future Episodes

    The host wraps up, mentions upcoming content about Canada, and signs off.

Highlights

  • 3:42

    AI Models Frozen in Timeinsight

    The host explains that after the training step concludes, AI models cannot learn anything new and remain frozen in the past like the character in the movie Memento.

  • 4:59

    Using AI for Future Predictionsstrategy

    The host realizes an opportunity: by using frozen AI models, we can ask them to predict things and assess their accuracy from our perspective in the future.

  • 7:47

    Tehran Traffic Cameras Hackedstory

    Israeli intelligence reportedly hacked thousands of traffic cameras across Tehran, giving them full access to monitor Iranian officials and the Supreme Leader's security detail.

  • 9:14

    Netanyahu in the Situation Roomdata

    Jonathan Swan notes that Israeli Prime Minister Netanyahu's visit to the White House Situation Room to present regime change scenarios was unprecedented in American history.

  • 17:44

    AI Accuracy on Military Conflictdata

    When fed simulated dossiers based on Operation Epic Fury, three frozen AI models correctly answered 12 out of 14 predictive questions about the conflict's aftermath.

  • 21:15

    Failure in Predicting Human Choiceinsight

    The models performed poorly on sports, financial indexes, and British politics because anything requiring a human decision or genuine chance causes them to default to recency bias.

  • 22:41

    Massive AI Infrastructure Spendingdata

    More than two percent of American GDP is going toward AI development in 2026, with OpenAI committing 1.4 trillion dollars to build required data centers.

Quotes

  • “AI is like Guy Pearce in that movie. Its memory is stuck at the end of its training process.”
    Matt Bevan · 4:13
  • “Its ability to predict what has ended up happening in Iran is spookily good.”
    Matt Bevan · 5:56
  • “They all picked which companies would be the top five most valuable in the world by the end of June.”
    Matt Bevan · 19:11
  • “The US is spending a much higher proportion of its income on data centers than it did on the Apollo program and the Manhattan Project.”
    Matt Bevan · 23:02

About this episode

The US-Israel war with Iran. The UK leadership kerfuffle. Who’d finish the top of the ladder in the AFL. At the start of 2026 none of these things would have felt all that predictable. But as Matt experiments with AI stuck in the recent past, he finds computers have gotten good at predicting certain kinds of futures — and he investigates what that means for us, and for Donald Trump. Follow If You're Listening on the ABC Listen app https://radio.abc.net.au/help/apps. Check out our series on YouTube: https://www.youtube.com/playlist?list=PLDTPrMoGHssAfgMMS3L5LpLNFMNp1U_Nq

Transcript

0:00
25:35

3,942 words · 15 speakers

Topics

  • Iran
  • AI models
  • Oil
  • Operation Epic Fury
  • Israel
  • Tehran
  • Memento
  • Pasteur Street
  • Bitcoin
  • Gold

Page updated · transcript and summary are machine-generated