Dario vs Jensen on Open Weights, OpenAI & Anthropic in DC, Xi Exports AI to Global South | EP #275

The mates discuss Dario vs. Jensen's open vs. closed AI debate, OpenAI and Anthropic teaming up to lobby in DC, and Kimi K3's global expansion. Get access to metatrends 10+ years before anyone else - https://qr.diamandis.com/metatrends Peter H. Diamandis, MD, is the Founder of XPRIZE, Singularity University, ZeroG, and A360 Salim Ismail is the founder of Open ExO, a GP at Exponential Venture Capital/The Organizational Singularity Fund and a sought after global speaker and thought leader. Dave Blundin is the founder & GP of Link Ventures Dr. Alexander Wissner-Gross is a computer scientist and founder of Reified – My companies: Apply to Dave's and my new fund:https://qr.diamandis.com/linkventureslanding Go to Blitzy to book a free demo and start building today: https://qr.diamandis.com/blitzy Your body is incredibly good at hiding disease. Schedule a call with Fountain Life to add healthy decades to your life, and to learn more about their Memberships: https://www.fountainlife.com/peter _ Connect with Peter: X Instagram Substack Website Xprize A360 Connect with Dave: Web X LinkedIn Instagram TikTok Connect with Salim: LinkedIn X Join Salim’s 10X Shift Subscribe to Salim’s YouTube channel Exponential Venture Capital Connect with Alex Website LinkedIn X Email Substack Spotify Threads Listen to MOONSHOTS: Apple YouTube – *Recorded on July 28, 2026 *The views expressed by me and all guests are personal opinions and do not constitute Financial, Medical, or Legal advice. Learn more about your ad choices. Visit megaphone.fm/adchoices

• 0:00Speaker 00

  A couple of days ago, Jensen Huang, CEO of Nvidia, he says the world needs both frontier closed models and frontier open models. Anthropic was silent for three days and there was a lot of conversation. Where is Anthropic in this conversation?

• 0:13Speaker 01

  All Dario has to say is.

• 0:14Speaker 00

  OpenAI and Anthropic, who have been two rivals for the longest time, they've been pushing for the same agenda, a federal review process for the most powerful models.

• 0:24Speaker 02

  Aiming enforcement at intelligence is like thought policing. Police what the AIs are doing, not what they're thinking or how smart they are.

• 0:32Speaker 00

  Global AI diplomacy is coming. China's leader, Xi Jinping, is wielding AI as a tool of statecraft, using it as leverage in China's diplomacy across the global south.

• 0:43Speaker 03

  I can't stress this enough. The whole power of the US is its open and very broad innovation ecosystem. If they close up the open model policy.

• 0:53Speaker 04

  Now that's a moonshot, ladies and gentlemen.

• 0:57Speaker 00

  Welcome to Moonshots, everyone. The number one podcast on all things AI and exponential. Your front row seat to the coming singularity, actually to the singularity which is now.

• 1:09Speaker 01

  To the president. Why do you keep saying that, Peter?

• 1:12Speaker 00

  I know.

• 1:13Speaker 01

  It's right here, right now, maybe in our rearview mirror.

• 1:15Speaker 00

  Well, no, it's, we're on the curve. We are on the curve and we are climbing at a hyper exponential. I'm here with a fantastic four, my magnificent moonshot mates, AWG, DB2, and Saleem. I'm Peter Diamandis, your host. And I'm telling you, this week is proof that we're in the midst of a supersonic tsunami. So buckle in. As always, our mission here at Moonshots is to keep you informed, keep you up to date on exactly what's happened, and most importantly, keep you optimistic about the extraordinary world we're building. And I don't know, Gents, if you saw the tweets going back and forth in the comments of Sam and Elon that were currently living in the singularity, I think they finally caught on.

• 1:54Speaker 01

  I think they're finally watching our podcast.

• 1:56Speaker 00

  Yeah, they've been listening.

• 1:58Speaker 01

  But on a delay of a few months, like, we got it there first.

• 2:02Speaker 00

  Yeah, for sure, for sure.

• 2:03Speaker 03

  I did hear one thing today that was interesting. I'm at the KPMG tech symposium, where I come pretty much every year these days. Peter, you were here with me last year. They had the chief security officer of Anthropic speaking. And he said, we might hit, we're gonna hit AGI in two to three years. And he gave a reasonable thing definition. So I wanted to go up and say, hey, challenge you on that one, but I didn't get.

• 2:28Speaker 01

  Did you write it down? Did you bring it?

• 2:30Speaker 03

  I did, I did write down what he said.

• 2:32Speaker 00

  Actually, you should just say, we hit AGI a few years ago. You know, let's put Alex up against him. Anyway, so, you know, just a quick message to our beloved listeners. If you're a fan of Moonshots and this program resonates with you, you're clearly one of us. So please, please, please, take a moment now and hit the subscribe button and join us on this adventure through the singularity. It's just gonna speed up and our mission is to deliver to you the best we can. A lot to report this week, a lot to discuss, you know, a lot of intrigue from the Frontier Labs. We're gonna be speaking about Jensen Huang's mission to create an open, secure AI alliance. We'll discuss Anthropic's past position and Dario's new position on open source.

• 3:15Speaker 00

  News today that Anthropic and OpenAI are supposedly teaming up in Washington for the lobbying efforts. We'll dive into Claude 5 and AWG will give us all the metrics. And the release of Kimi K3 yesterday on Hugging Face. And then the successful launch of Starship 13. And we'll close with Elon's comments on a post-capitalist world. Gotta love Elon. You know, he does not disappoint at all. So, a lot to unpack. Let's buckle in. You guys ready for this?

• 3:43Speaker 01

  Absolutely.

• 3:44Speaker 00

  My little enthusiasm here, gentlemen.

• 3:47Speaker 01

  Amaze, amaze, amaze.

• 3:49Speaker 00

  Amaze, amaze, yes. All right. So, let's kick off this episode with a fight that's framed the entire week, which is open source versus closed source. A couple of days ago, Jensen Huang, CEO of Nvidia, posted his first ever tweet. I mean, he's been on X for the longest time, has never tweeted. His first tweet, what was it? It was a letter on why open models matter. And it's been signed by 77 companies thus far. Jensen writes that open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. He says the world needs both frontier closed models and frontier open models. He then goes on to launch the open, secure AI alliance.

• 4:33Speaker 00

  We're gonna talk about that. In his letter, Jensen recalls a story that we reported on last week about Hugging Face experiencing an intrusive agent that logged on 17,000 actions, escalated its privileges, harvested credentials, and moved across all of Hugging Face's clusters. The closed AI models, GPT-5.6 and Claude Fable, that Hugging Face tried to use to hunt down what was going on, blocked them. It blocked their forensic teams. And they had to turn to an open weight frontier model, GLM 2.5. We discussed that last week, to help Hugging Face find to contain the intrusion. So, Jensen's thesis in his tweet is that attackers have frontier AI, so defenders

• 5:15Speaker 00

  need frontier AI ecosystems. We saw Sam Altman jump in on this, saying OpenAI wants to have the US leading in both open source and proprietary models. But Anthropic was silent for three days and there was a lot of conversation. Where is Anthropic in this conversation? You know, historically, they've been opposed to open source for a number of reasons. So yesterday, Dario finally responded, saying he rejects the claim that Anthropic wants only open, doesn't want open weight models. In his word, Anthropic has never advocated for a ban on open weight models. There's a lot of videos showing that he was sure hinting at that. But Dario reframed the competition, reframed this debate, saying that the real issue is

• 5:59Speaker 00

  not open versus closed, it's whether authoritarian states, i.e. China, can reach the AI frontier. Dario's sharpest disagreement with Jensen is belief that open weight models could be attackers. Dario's central thesis is that biology is the issue. Sufficient capable models could weaponize pandemic-scale pathogens. And it's worth noting that Dario, probably of all the Frontier Labs CEOs, is probably the most steeped in biology. He has a PhD in biophysics from Princeton, and he recently acquired a biotech company called Coefficient Bio. So, rather than ban, what is Dario proposing? Three things.

• 6:42Speaker 00

  One, block advanced chips and chip-making equipment from reaching China. I'm sure that Jensen doesn't necessarily like that one. Crack down on industrial-scale model distillation and require safety testing for all powerful models, open and closed. So, let's dive in this. Dave, I'm curious, you know, one of the things we talked about before is if, if Dario really wanted levels of safety, he would put forward KYC requirements or crack down on mass distillation of Claude models, but we haven't seen that. Your thoughts, my friend?

• 7:17Speaker 01

  Well, I mean, right out of the gate, the, the argument, as you laid it out, is perfectly articulated. But if Jensen says, look, cyber threats can be defended with AI, and therefore, open weights can defend against open weights within cyber threats, all Dario has to say is, okay, bioweapon. I have a sufficiently advanced, how is my AI gonna defend me from a bioweapon? You can't argue against, but I'm thoroughly convinced. Yeah. Well, Dario, I am 100% convinced is speaking his mind without an agenda. I'm not 100% sure about anybody else in this debate, but Dario is a brilliant guy, laying it out exactly the way he sees it, even at the expense of his own valuation.

• 8:00Speaker 01

  Everybody online is saying, no, no, no, he wants closed weights because he has a competitive advantage, and if nobody else can get access, they'll have to pay him. True, but I don't think that's his motivation. I think he genuinely got into this industry long before there was any money in it.

• 8:15Speaker 00

  I believe you.

• 8:16Speaker 01

  Yeah, no, well, I'm good, I'm good.

• 8:18Speaker 00

  I know, I do, I do believe you that, I think so, but it's interesting that, you know, Anthropic has gone from the most beloved, safety-conscious company out there to being just raked over the coals over the last couple of days, this last week.

• 8:34Speaker 01

  Yeah, isn't that funny? Well, but you know, if you, if you say the same thing about Sam and everybody and Elon, you know, you go from darling to goat in a heartbeat in this world. So it seems to be the common trajectory. As soon as you're too big, everybody's like finding ways to just poke at you.

• 8:47Speaker 00

  Alex. Yeah, be careful on the way up, because you're gonna get slammed on the way back down. Alex, thoughts here?

• 8:53Speaker 02

  I think after a number of years of detente between the infrastructure layer, that is to say GPU and lower layer of the stack, and the model layer, that is to say, the OpenAI and Anthropic and other.

• 9:09Speaker 02

  Model provider at that layer. I think we're seeing the beginnings of, if not open war, then at least cold war between them. The first rule, if you're an aggregator in business, is commoditize your complements. And Nvidia has been very stealthy, if you will, very polite, very diplomatic about their desire to commoditize the model layer. They've struck agreements, including what some have argued are circular wash sale type agreements with the data centers, providing compute for OpenAI and Anthropic and others. And now I think this is turning into open warfare, where really the question is, where

• 9:52Speaker 02

  do the profits accumulate in the superintelligence stack? Are they going to accumulate at the GPU level, in which case Nvidia wins? And Nvidia wins by popularizing open weight models that can't capture value at a higher level in the stack? Or does it live at the model layer, in which case we see proliferation of duopoly or oligopoly high-profit margin model providers, Anthropic reportedly high-profit? Or does it live elsewhere? And I think due to the competition, and quite frankly, due to the outstanding success at the frontier of what until recently looked like an OpenAI Anthropic duopoly, I think we're seeing the GPU Nvidia layer fire back.

• 10:35Speaker 02

  What I don't quite understand is why Nvidia isn't working more aggressively to commoditize or commodify the layer of the stack beneath them. Whereas, why isn't Nvidia aggressively financing, say, TSMC Samsung competitors? Why isn't Elon doing it and not Nvidia? That one's a head scratcher for me. They really should be as aggressively pushing like a secure, open fabrication initiative, just like for one layer beneath versus one layer above.

• 11:03Speaker 01

  So love, so love to brainstorm on that for a whole episode. You know, I know the answer is that if he is doing it, he has to be doing it very, very secretly, because you cannot irritate TSMC for even a minute. They're so in control of the world right now. But if you're gonna, you know, Elon is the one guy who's overtly said, I'm gonna build the TerraFab, I'm gonna build something, but he's fearless. But any rational person has to be afraid of irritating TSMC. So if he's doing it, he's gotta do it so secretly and so stealthily. I don't think he's actually doing it, because it's hard to contain that. But that is a really great question, Alex. I would love to riff on that sometime for like an hour.

• 11:39Speaker 00

  What do you think of the open, secure AI alliance that Jensen proposed?

• 11:42Speaker 02

  It reminds me, if you think back, so we're in 2026. It reminds me, do you remember in 1998, when Eric Raymond and Bruce Perens founded the Open Source Initiative, OSI? It reminds me just of that. Like, I think if I look at the historic arc of commercial versus open source AI models, I think we're at a point in this arc that's roughly analogous to where Microsoft was in the late 90s, where they just totally dominated the future light cone of software. And it was open source, in sort of a case of history rhyming, open source that came from outside the US, like Linux came from Finland.

• 12:25Speaker 02

  Yeah, sure, Richard Stallman and FSF came from Cambridge, Massachusetts, but Linux, which really was the nucleation event arguably for open source, came from Finland and was popularized with an American open blank initiative, parallels there. And in combination with the antitrust verdict against Microsoft, that helped to unlock the future light cone for just about everyone else afterwards. So I think there are interesting historic parallels.

• 12:51Speaker 00

  Saleem, last week you said something got a lot of love in the comment, was that intelligence wants to be free. I mean, the whole open source movement is sort of the abundance thesis writ large, right? Your thoughts?

• 13:04Speaker 03

  Yeah, completely. You know, I like this open, secure AI alliance, whatever the name is, because Jensen is reframing open weights from a security vulnerability to being a security capability, because this whole alliance is very EXO. If you put together a community of people, they will be able to defend in a very powerful way, because if the attackers have access to open models and have powerful AI, the defenders can't have, have only access to a closed model that they don't understand the outputs. They have to be able to inspect it, et cetera. So this is a great approach for some of that. And to Alex's point, this is exactly the same transition as the open source software

• 13:46Speaker 03

  transition, and everybody wins in open source except for the closed people.

• 13:50Speaker 00

  Yeah, and Nvidia wins by supporting everything. I mean--

• 13:56Speaker 03

  Yeah, there's a clear--

• 13:58Speaker 02

  Remember who ultimately, back in the 90s and early 2000s, one of the biggest supporters for open source was IBM? Because at the hardware layer and the services layer, they benefited from the commoditization of software. Same here, always, if you're an aggregator, you commoditize your complement.

• 14:13Speaker 03

  I've referenced this before, but it's worth bearing again. In 1995, IBM polled all the CIOs of the Fortune 500, and someone said, how many of you use open source in your tech stack? 95% said, no, we don't use open source, we're a closed shop. Then they went to the sysadmins and asked, how many of you use open source? And 95% said yes. And so IBM made a major bet on open source, which turned out to be a massive success. It also showed you that the CIOs had no idea what was going on in their enterprises.

• 14:41Speaker 00

  Yeah.

• 14:42Speaker 01

  Well, that's all business strategy, and I think Jensen's talking business strategy in this alliance. But we already knew Alex Karp is working with Jensen to build a monster enterprise open source model that is, you know, on a frontier level, so that enterprises can control their own AI and then use the Palantir application layer to manage it and use Jensen's chips to run it. So that's great business strategy. It doesn't answer the question of bioweapons, you know? It's like, this is how our business wins. I get it.

• 15:12Speaker 03

  There is one answer, there's a precedent to the bioweapons thing. You know, we, we had the head of innovation of one of the three-letter agencies at Singularity once, and we asked them directly, how do you think about the threat with open source? And somebody could engineer a virus. He actually had a really amazing answer. He said, when you have something like nuclear weapons, and you know how many there are, where they are, you put eyes on it, right? When there's a distributed capability, what they've been doing is actively funding the ecosystems and opening them up and making them more open, because it's much easier to spot bad actors. And that was a very smart way of going about it. I have much more respect for them than I thought I would coming out of it.

• 15:54Speaker 03

  Something dodgy is gonna be, come out and be visible much more early than if you tried to close it up.

• 16:00Speaker 02

  I also don't, don't buy the biosafety argument. I mean, I know that's a favorite hobby horse of some frontier labs to emphasize biosafety. I don't buy biosafety as an argument for several reasons. One, you can just go out on the internet and find things. Two, you can just go, without being specific, you can just go do things in the world that are dangerous already. Three, I'm not even sure you need frontier AI to discover new ways to do dangerous things in various disciplines.

• 16:30Speaker 03

  Great point.

• 16:31Speaker 02

  And four, there are already models out there that are quite capable with their biological knowledge. So I, I think like biosafety, again, history rhyming, do you remember how Microsoft in the late 90s made all of these fear, uncertainty and doubt arguments for how anyone who was touching open source, oh, you'll get viruses, oh, you'll be subject to IP lawsuits? They came up with 10 different arguments for why open source was too dangerous to use in the enterprise, and they all ended up being wrong. In fact, perversely, ironically, open source ended up being safer than closed source.

• 17:07Speaker 03

  Yes.

• 17:08Speaker 00

  Interesting.

• 17:09Speaker 03

  In this, in this, in this situation, Nvidia is really well positioned, because they win whether it's open source or closed source or both, because--

• 17:18Speaker 02

  That's the whole point, right? They're commoditizing their complements, and they need a proliferation of open source competitors.

• 17:24Speaker 01

  Yeah, the argument, though, with open source, you're basically saying, look, if everybody's looking at the source code, if there's anything evil in there, somebody will see it, everyone should be looking at the source code. Here you're saying, okay, with open weight models, everyone should be looking at the weights and see if there's anything evil in there. The weights are not used, they're used to build other things. You don't run the weights, you know, and you use the weights to create a bioweapon. You use the weights to create, you know, a regular conventional bomb that goes off when a specific person is walking by. So the weights are not a self-contained piece of open source, they're a tool to build other things. So that analogy doesn't, doesn't hold.

• 18:01Speaker 00

  Can you add some positive things in what the weights will do, like, you know, write us on it, or get your job--

• 18:06Speaker 01

  Well, cure all disease and give us infinite longevity. I mean, this is the greatest thing that's ever happened to mankind. But you can't just throw it out there to every terrorist in the world and say, here, you can have it too.

• 18:16Speaker 00

  Listen, I'm just reminding everybody, you know, our, our amygdala is on overdrive right now. You know, our brain is wired to give 10 times more attention to negative muse than positive muse, and that's what we've seen. We saw both Sam and Dario talk about job loss and talk about the dangers in all of this. And, you know, part of it is the regulatory capture that we'll talk about in a minute, and part of it is getting attention and coming as the savior. And they both flipped their scripts on this.

• 18:46Speaker 01

  Yeah, I think, I think there's an opportunity to contain it at the weights level and open source, but there's also a better opportunity to monitor the actual data centers and just have a clear reporting, global transparency on what's running where.

• 18:59Speaker 00

  But what about a KYC solution? What about knowing who's using the model?

• 19:03Speaker 03

  Can't, can't do it.

• 19:04Speaker 00

  Why not, Saleem?

• 19:05Speaker 03

  You can't do it. It's too easy to bypass. Look, Chinese companies have shadow companies in Singapore doing things that they want. It's very difficult to try and police all this.

• 19:15Speaker 02

  Alex, do you think it could be? Yeah, of course you can do KYC. I mean, we can do better than KYC. If we're going to be in a world awash with superintelligence, let's allocate some of the superintelligence to policing the other superintelligence. Defensive coscaling is the answer.

• 19:29Speaker 00

  Yeah.

• 19:29Speaker 01

  Totally right. But it requires transparency. Like, as soon as you throw it out there as open weights, the defensive coscaling will work really well if the police AI can see the danger AI.

• 19:40Speaker 02

  Sure.

• 19:41Speaker 01

  So you need that transparency layer. So as soon as you throw it out there as open source, that's fine. But now you have to crack down on the install and the compute. Where is it running? And so the new danger is it could be running in a basement somewhere and no one would know.

• 19:54Speaker 00

  Until it takes action, right? And then we need to have, you know, real world defenses against those actions. And we all know that both OpenAI and Anthropic have models far better than they're showing us, right? And our next story is going to talk about that. Both of them are going to DC probably to unveil what GPT-6 looks like or what the follow-on to Mythos looks like. And the government's going to have access to those as a white hat defender. Saleem?

• 20:24Speaker 03

  I just want to make one more comment on Dario here. I do agree with you, I agree with Dave, that his intent is probably clear. But there's a very, right now, the safety argument and the economic self-interest are very overlapped and hard to separate. This is, they're facing, both Anthropic and OpenAI are facing a very aggressive innovator's dilemma response. Cheaper alternatives are overcoming very close to your capability. And that's a very unpleasant place to be if you're an industry leader.

• 20:53Speaker 00

  Yeah, I looked it up on the secondaries. Anthropic dropped 13% after K3 was announced about $230 billion. It's nice to lose $230 billion on someone's tweet.

• 21:05Speaker 03

  I would have done much more, yeah.

• 21:07Speaker 00

  Yeah. So let's go to our next story, which is related. OpenAI and Anthropic, who have been two rivals for the longest time, have teamed up in Washington on lobbying. According to the information, they've been working on the same back channels ahead of a Trump administration August 1st deadline, and Alex, I'll ask you to explain in a moment what that deadline is, to finalize rules on frontier models. They've been pushing for the same agenda, a federal review process for the most powerful models, a voluntary 30-day government look into the release of anything with serious cyber or national security capabilities, and a framework that would force their competitors, Meta and XAI and all the frontier startups, to play by those same rules. So the question we're chewing

• 21:51Speaker 00

  on today is whether AI needs guardrails and who gets to set them up and who gets locked out. This is a potential regulatory moat as a defense layer for Anthropic and OpenAI. Alex, you want to take this one?

• 22:06Speaker 02

  Yeah. Maybe let me point out the cliche, more superficial analysis, which is that the frontier labs are maybe to some extent talking out of both sides of their mouths. This has been widely reported, that they're publicly supporting open source privately, throwing in all sorts of monkey wrenches into the regulatory gears in order to derail any prospect of a free and open, open source, open weight future, telling privately lawmakers and politicians, well, they're unsafe for a variety of reasons, or they need to be the, I think the cleverest angle is just regulate them like you regulate the closed

• 22:50Speaker 02

  weight models, subject them to the same safety standards. I think that's too clever by half in some sense, because they're not the same models. From a deployment perspective, which is half the battle, deploying an open weight model has a very different deployment situation than access via gated API to a closed weight model. So I think that's sort of the obvious story. Slightly less obvious story may be where the enforcement happens. What's the right bottleneck for defensive coscaling to work? And I think one of the more interesting bottlenecks, or let's say comparative advantages that we've seen over the past few months, hasn't been quite reported this way, for defensive coscaling is just simply a matter

• 23:35Speaker 02

  of time. If the good guys, however you want to construe that, have access to the strongest models just a little bit ahead of everyone else, inclusive of the bad guys, in an era of recursive self-improvement, what historically might have looked like only marginal advantages turn into enormous advantages. If the next generation model suddenly generates step function leaps in terms of their capabilities, then even just a period of a couple of months or one month could make all the difference in the world. So

• 24:07Speaker 00

  This is the recursive self-improvement argument as well.

• 24:11Speaker 02

  It is, it is the, well, it's the regulation of RSI argument. The second point also, I continue to think enforcement is being leveled at the wrong part of the stack. Fundamentally, aiming enforcement at intelligence is like thought policing, but for the AIs, not for the humans. I'd much, much rather see enforcement leveled at the action layer. Police what the AIs are doing or being used to do, not what they're thinking or how smart they are.

• 24:39Speaker 00

  You know, I've been thinking a bunch about the conversations going on. If we have incredibly powerful open weight models, how do the top frontier labs make money? How do they survive against, you know, this onslaught of free? And the way I think about it, and I'd love your feedback, guys, is like a four-layer cake. So layer one is the top layers, call it the wild stallions inside of OpenAI and Anthropic, right? Unreleased brilliant AIs, you can think of it as GPT-6. You don't let it out. You keep it to yourself. You use it for breakthroughs in material sciences, biology, building new businesses. This is what you and I have discussed, AWG and solve everything. These models are going to create

• 25:23Speaker 00

  you trillions of dollars in other, you know, adjacent spaces, longevity, material sciences, energy, et cetera. So that's the first layer. The most advanced models you use for yourself. The second layer is the models on the predator frontier, right? These are, this is GPT-5.6 Saul, this is Fable 5. People will still pay for that a little bit better than Kimi K3, right? So you'll make money, you know, providing the just next best model to people just above the open weight models. Layer three here is the open source models. And everyone gets to use them. They're good enough. They are fully commoditized. They're powering

• 26:08Speaker 00

  everything else. And then layer four, and we've talked about this before, is the fact that we have companies like Google, Meta, and X who have entire ecosystems, right? And they make their money on the application layer. So Meta has 3.5 billion active users using Muse Spark 1.1. When I'm inside WhatsApp or whatever, I'm not thinking what model am I using. The WhatsApp answer is my questions. Google has 2 billion active users using Gemini, and this is before they get on Apple. And then OpenAI has about a billion on chat. So the fourth layer is they make their money when they provide their models to their communities.

• 26:49Speaker 00

  Yes? No?

• 26:50Speaker 02

  I think, I mean, reading, Peter, I think your narrative, what I heard you say, you were almost narrating the cost frontier of capabilities versus cost, starting from the upper right hand, going to the lower left hand, through different business models. I think it's an interesting narrative, but my bet, as with so many other things in life, everything follows power laws in the end. So I think just saying, well, there are these four, or there are these N business models, in all likelihood, one of the business models is going to account for 80-plus percent of all of the free cash flow and all of the profits. And so I think just saying, well, there are these multiple business models is probably unrealistic. There's probably going to be just one business model that runs away with most of the profits.

• 27:35Speaker 00

  My point being, don't cry for the closed source companies. They have plenty of ways to make money, even in a world of

• 27:40Speaker 02

  Why would we cry for them? I mean, my goodness, like, two or three months ago, we're crying for everyone else who was going to be displaced, all of the labor, the service jobs that are being displaced by the frontier models. Now we're crying for the frontier labs? Cry for everyone.

• 27:55Speaker 00

  Saleem?

• 27:56Speaker 03

  I think, I think there's a layer zero in your stack, Peter, which is the compute and power. And I think

• 28:02Speaker 00

  Sure.

• 28:04Speaker 03

  The infrastructure layer, right?

• 28:05Speaker 00

  I guess the frontier, I guess the frontier labs, as in with SpaceX AI, will own that as well. And Google will own it.

• 28:13Speaker 03

  I think, I think that, I think over time, as you get more and more powerful free models, the value will accrue there because it depends where the bottleneck is. And it's clear that's where the bottleneck is. For me, when I look at this, what's happening with Anthropic and OpenAI, this is regulatory capture in real time. Every major industry has tried to do this. The railroads did it, the banks did it, the telco did it, the big tech did it. And now they're trying to do it to kind of set up the guardrails to then decide, A, to keep the government at bay, but also to keep other folks at bay. And so it's right there. And that has economic consequences. I don't think they'll succeed because the open weight models are moving so quickly, but it's a worth try if you're there.

• 28:52Speaker 00

  I don't know if you saw Dave Freberg's comments on this. He had a beautiful soliloquy in which he said, you know, in the 90s, Netscape tried to own the server and the browser, the whole stack. And then Mozilla came out with Firefox, Firefox and browsers went in for free. And then all of the value shifted to the application layer, Google, Amazon, and so forth. And I think potentially that's the same thing here. And if that's the case, then the fear about OpenAI and Anthropic running away with the show gets ameliorated.

• 29:25Speaker 01

  Well, I think that's exactly right. I think actually it's going to go up and down per Alex's prior comment. Where, right now, you know, you got five, $10 trillion locked up in the labs with their models. And the chip companies that don't actually make the chips, so Nvidia and AMD, et cetera. But underneath the chip companies that don't actually make chips, you have the fabs, who are largely overlooked, TSMC, Intel, Samsung.

• 29:51Speaker 00

  And they've been skyrocketing.

• 29:52Speaker 01

  And then the new TerraFab. They, that's where the value is.

• 29:55Speaker 02

  And the memory companies, memory too.

• 29:56Speaker 01

  Yeah, so it's going down. And as you said, Peter, it's also going up to the use cases. So I'm almost positive that if you look five years in the future, there'll be many, many multi-hundred-billion-dollar robotics companies, biotech companies, other entertainment companies that don't exist today, that have used AI to have a hugely impactful either user base if it's entertainment, drug portfolio if it's biotech, or robotics line, you know, all the, in fact, all that stuff is incredibly sustainable. What did I just overlook? Oh, the foundation model companies and the chipless chip companies. But, so there, that's why there's so much turbulence right now. The stocks are going up and down like yo-yos.

• 30:39Speaker 01

  Because no one's sure if they're actually going to have sustainable value in the end, as everything moves to the, kind of the, you know, the upper and lower layers.

• 30:45Speaker 00

  But the entire ecosystem moves up and to the right, right? And this is where Elon comes in. When saying, you know, our GDP is going to double-digit growth and then triple-digit growth. Let's go back to the original story, OpenAI and Anthropic teaming up in Washington, DC. I mean, this is a regulatory capture story. Any thoughts on that?

• 31:05Speaker 02

  I, I, I think this, the, the open source, again, I've mentioned this now on two prior occasions, that the Chinese Communist Party coming to rescue American capitalism from itself. I'm not a fan of regulatory capture or the duopoly scenario that we would have found ourselves in. I hope that the regulators, the applicable regulators, are able to see now the, the vocal majority are interested in keeping the model layer competitive. And are not interested in FUD, reminiscent of the late 90s, directed at open weight models, even if the strongest ones do happen to originate from China. I think that's the only way we all win.

• 31:47Speaker 00

  What's FUD, Alex?

• 31:48Speaker 02

  Fear, uncertainty, and doubt. FUD.

• 31:50Speaker 00

  Okay, thank you, thank you.

• 31:52Speaker 01

  Honestly, though, I really think it's not a regulatory capture move. I think both guys are genuinely trying to create a safe and secure future world. Because, because remember, Sam is not even a shareholder in OpenAI. He, yes, he runs it. Yes, it's his lifeblood. He has 400 vertical company investments that are overjoyed that Kimi K3 came out. All of our portfolio companies are overjoyed that they have access to Kimi K3. Blitzy was over the moon. This is the biggest boon in, so, and you know, that's where Sam's economic upside is. But yet, he's still going to DC to say, "Look, we gotta have some rules. This is, this is going to get out of hand." So I don't think they're out there to try and drive up their stock price. I think both guys are out there to try and make the world safe.

• 32:36Speaker 00

  Then why just them? Why isn't it everybody else? Why isn't it a summit to talk about the rules?

• 32:42Speaker 01

  Well, who, who is everybody else? Because there's only so many people that will let in.

• 32:47Speaker 00

  And Google. I mean, there are a few other players in the mix here.

• 32:51Speaker 03

  Yeah. I'd like to make a slightly tangential point here. I want to echo what Jensen Huang said, which is, he said, made the point that open models will make the US stronger. Because you're building an ecosystem. Because you have universities, you have startups, you've got defense contractors, hospitals. As Dave said, everybody, all the, everybody, every company's thrilled to bits. You have an open-source model that's this powerful with open weights, you can go manipulate those weights. And they're all, when you have the whole ecosystem, open beats closed, always. So this is the faster, the better.

• 33:24Speaker 00

  That was one of the thesis of our, our book together, the EXO, open always beats closed.

• 33:27Speaker 03

  Yeah, over time.

• 33:29Speaker 00

  I mean, it, it is amazing that we're living in this incredible demonetization world of intelligence, right? It's just falling through the floor. It's like 99.95% cheaper over the last three and a half years, I looked at the, at the numbers.

• 33:44Speaker 03

  And I think Alex makes a really important point. You don't try and regulate open versus closed, you try and regulate the capability.

• 33:52Speaker 00

  Yeah.

• 33:52Speaker 02

  And then the actions and the, and the outcomes. And I, I just, for the life of me, I don't understand why we're shedding any tears for the profit margins of a couple of frontier labs. This is what intelligence, too cheap to meter, is supposed to look like. Intelligence is supposed to get cheaper, and capitalism is doing its thing and creating competition and driving profit to zero. This is what we want to happen.

• 34:15Speaker 00

  And full disclosure, I don't own any of OpenAI or any Anthropic, so I'm not shedding tears for that. I don't think any of us do. Do you, Dave?

• 34:26Speaker 01

  Uh, not that I know of, but I have a lot of indirect stuff.

• 34:30Speaker 00

  And Alex, I know you just own the index, so you're set.

• 34:32Speaker 02

  Just indices.

• 34:33Speaker 00

  Yeah. All right, let's go to our next story, and it's one we just, we sort of started discussing. Yesterday, July 27th, Kimi K3 went live for a global download on Hugging Face, a frontier-adjacent open-weight model that anyone, anywhere on the planet, can download for free. No API key, no gatekeeper, no revocation switch. You know, once these weights are downloaded 10,000 times, they are free. There's no undo button. Kimi K3's official Hugging Face repository showed 2,500 downloads in the first two hours. And the research I did shows about 100,000 downloads in the last 24 hours. I, I downloaded it. Dave, Alex, it's both you.

• 35:14Speaker 01

  Funny, funny story on that, Peter, because we, we had a whole bunch of polling agents that were pinging it every 15 seconds, because I was worried that it would not, you know, that it would go away.

• 35:24Speaker 00

  Yeah, so was I.

• 35:25Speaker 01

  So I didn't realize a bunch of our companies also were doing the same thing. So of those 2,500 downloads, we had dozens of them from here. But mine went through with no trouble. But right before it came out, the whole page went to a 404 error.

• 35:37Speaker 00

  I saw that.

• 35:37Speaker 01

  And, yeah, did you see that? And I was like, "Oh my God, the White House intervened." This is, this is not actually going to happen. Because, because I've been telling everybody, I think this is the biggest turning point in human history. Like, you have an AI capable of self-improvement now, out in the wild, that anyone can use.

• 35:54Speaker 00

  On your machine, right.

• 35:55Speaker 01

  On your machine. This is massive. And I, I just feel like it may get, not get documented in the history books that way. It may be the outcomes of this that get documented, but this is really the moment in the history of humanity that I think is so pivotal, and was yesterday. But anyway, downloaded just fine. I got it up and running on my own dedicated GPUs on Modal. And it took less than an hour to get a fully functioning Kimi thinking and working 24 by 7. It's a little pricey, but it's, you know, it's like 55 bucks an hour on Modal to run it full throttle. But you can prop up 100 instances, like, in two minutes now, if you want to, just, just through voice prompting. You don't have to have any technical skill at all. You can just go to Modal, ask it to install Kimi K3,

• 36:37Speaker 01

  download it from Hugging Face, and start talking to you, and you're up and running in no time. It's, it's mind-blowing.

• 36:43Speaker 00

  Alex, your thoughts?

• 36:44Speaker 02

  I looked at the architecture. The architecture, now that this is actually open-source slash open-weight, is pretty interesting. The, the most interesting thing I saw in the architecture, position embeddings are gone. This was one of the, the most critical elements of the original transformer architecture. It's gone. It's literally called NOPE, that no position embeddings, nope. And it, it's interesting, you ask, like, how on earth is a model like this that has a million tokens of context supposed to know what it's looking at without context embeddings? You look a little bit more closely, the attention mechanism, Kimi Delta Attention, KDA, is, is basically a mini recurrent neural network at the attention layer.

• 37:27Speaker 02

  And there's a little bit of positional information or positional awareness smuggling going in via their attention mechanism. But otherwise, like, global position embeddings, gone. And my, my takeaway from looking at the architecture is, if you look at the original vanilla transformer from Attention's All You Need, and then you compare it with the sorts of, this is arguably, probably, the frontier-est of open-weight, open-source models that we have available right now. So it's pretty instructive for a, a mere civilian to look at how it's architected, because this is the most capable open architecture model, I think, that most of humanity now has access to.

• 38:09Speaker 02

  Position embeddings seem like they're going out of the way. And more broadly, I, I think we're seeing almost a, a ship of Theseus architecturally, if, if you will, where the original transformer architecture, you can still recognize the outlines of transformer, but piece by piece of all of the original elements, the attention mechanism, the position embedding, the layers, the residual streams, all of that, the sparsity, all, all of the original components that made the transformer the transformer are getting swapped out for better versions. And so if, if you follow the path of continuous improvement, it looks like the same architecture. And even if you, if you squint at it, you'd still recognize, okay, it's like multi-layer, something that is attention-y.

• 38:53Speaker 02

  But if you look at the fine details, the frontier models now, to the extent that say this is indicative of what's actually being used inside OpenAI or Anthropic, if you look at the fine details, they're relatively unrecognizable relative to the original transformer, which I think is interesting.

• 39:09Speaker 00

  Do you think the US lab will, will end up replicating it? Should we say, stealing that approach?

• 39:15Speaker 02

  Oh, God, yeah. It's, it's open source, so I, I don't know what license or, you know, IP is associated with a particular architecture. But of course, they're looking at it, yeah.

• 39:23Speaker 00

  Yeah.

• 39:24Speaker 01

  Well, the, the NOPE thing, too, you know, rope is just sort of random positionally, it's rotating.

• 39:29Speaker 02

  Rotational position embedding.

• 39:31Speaker 01

  But it's sort of like, if I have a million token context, it's giving as much weight to something I said a million words ago, which is like hundreds and thousands of pages ago. I said something, and you're still thinking about it just as much as what I'm saying right now? People don't work that way. That's nuts. So when they got rid of rope, they put in NOPE, but NOPE actually has this fading memory now. So something I said a long time ago gets less weight than something that's more recent, obviously. Like, that's so obvious, like, but that's the beauty of open source. Some guy in China can say, "This is freaking obvious. Let me try it." "Oh my gosh, it works." Of course, the other AI labs are going to adopt that immediately. It's just, it's just flat-out better. The, the other thing that's really blowing my mind is the attention layers,

• 40:15Speaker 01

  you don't need them later in the thought process. So when you get to layer 100, 120, you can actually eliminate intention entirely and get almost the exact same result out the other end.

• 40:27Speaker 00

  But faster.

• 40:28Speaker 01

  What, but faster. But what happened there historically is the, the people who invented the original transformer algorithm just put a for next loop around it. Because they're just, you know, we're writing code by hand back then. It's really hard to try and make different, you know, different logic layer by layer.

• 40:44Speaker 02

  It was simpler. I mean, in defense of the original attention is all you need team, the original vanilla transformer was just alternating attention and dense linear layers because it's simple.

• 40:53Speaker 01

  It's simple. It's simple. And also with that few layers, you're really focused on just getting the text to mean anything. Now you've got deep thought. It's just so cool.

• 41:03Speaker 03

  I've got a couple of comments and a big announcement. Comments. A model that you can control locally is way more valuable than a marginally smarter model that you have to access through somebody's API, right?

• 41:17Speaker 01

  Yep.

• 41:18Speaker 03

  So organizations now can fine tune their proprietary knowledge around it, put it into secure environments and totally avoid sending any sense of information to the cloud. This is going to be huge for regulated industries and sovereign applications and all sorts of stuff. So remember, Peter, a few weeks ago, we did this, we announced this pilot for the organizational scene. We had almost 400 applicants. We picked 10s who are running the pilot with them. What the launch of this, I think is this is one of the biggest things we'll ever see from a business and application perspective. So we're launching a new program for 30 companies because the big question every company is asking is what's my AI strategy?

• 42:02Speaker 03

  And it should be, what do I do on Monday? So we're going to answer that question and we're going to help people weekly just start implementing and rewriting their organizations on the edge. So we're accepting 30 companies into this. We'll put a link below.

• 42:14Speaker 01

  Where do they go to learn more about it?

• 42:18Speaker 03

  Go to openexo.com. We'll have a link there and we're going to give preference to the folks that applied to the original pilot because they were first. And we're going to take a chunk of people and then just start helping to rewrite themselves. Because we did another round of calculations and the original premise we had is if you rewrite your company in an AI native way, you should end up with what 100x performance than you had before.

• 42:44Speaker 01

  100x. This is going to be a goldmine for you, Saleem, because nobody up until Kimmy really cared about speed in any corporate environment. They're all like, oh, this stuff is super cheap. You know, we'll just use it. We're not doing much with it anyway. So then everyone starts token maxing. All of a sudden, people are looking at their corporation and they're saying, oh, my God, my token costs are actually going to be bigger than my payroll by the end of the year. And then if I forecast out two years from now, my token costs are 10 times my payroll. Speed does matter.

• 43:15Speaker 03

  Yeah, but now.

• 43:15Speaker 01

  But there's an easy, easy 10x and maybe 100x, like Saleem is saying, just by tuning it to what your business needs. Get rid of all the cruft. Use these new streamlined models. Tune it to just what you're trying to achieve. You're looking at 10 to 100x. And so now every corporation needs to figure out their strategy and Saleem's business is going to be like, sold out.

• 43:34Speaker 00

  Will you still come on the podcast when that happens?

• 43:37Speaker 03

  We will still come on the podcast because thank God we've got our community of 50,000 people that can help with all this. If I had to help, I'd, you know, I'd be bald in two seconds. Oh, wait. But the, what we're doing with the CEOs is saying, okay, let's pick one process that's going to help you radically increase revenue and take one workflow that'll help you radically reduce cost, right? That gets everybody excited and rebuild that native and then do more and just start moving things over. And so we're super excited about where things go.

• 44:02Speaker 01

  Franchise it, Saleem, so all our podcast listeners can start a branch of VEXO.

• 44:06Speaker 03

  Well, that's what our community is all about.

• 44:08Speaker 01

  Oh, is it? Okay.

• 44:09Speaker 03

  Yeah, everybody in our community is an independent contractor. We have no consultants on staff.

• 44:14Speaker 04

  This episode is brought to you by Blitzy, autonomous software development with infinite code context. Blitzy uses thousands of specialized AI agents that think for hours to understand enterprise scale code bases with millions of lines of code. Engineers start every development sprint with the Blitzy platform, bringing in their development requirements. The Blitzy platform provides a plan, then generates and precompiles code for each task. Blitzy delivers 80% or more of the development work autonomously while providing a guide for the final 20% of human development work required to complete the sprint. Enterprises

• 44:54Speaker 04

  are achieving a 5x engineering velocity increase when incorporating Blitzy as their pre IDE development tool, pairing it with their coding copilot of choice to bring an AI native SDLC into their org. Ready to 5x your engineering velocity? Visit blitzy.com to schedule a demo and start building with Blitzy today.

• 45:18Speaker 00

  This is the moment AWG has been waiting for. It's the discussion on Claude Opus 5. So right in the middle of all of this, Anthropic shipped Claude Opus 5. This is their fourth Claude 5 generation release and it approaches the frontier intelligence of Fable 5 at half the price. It becomes the new default for Claude Max priced at $5 per million token input and $25 per million output tokens, unchanged from Opus 4.8. You know, I made the switch immediately on Skippy for myself. Anthropic calls it the most aligned Opus model yet and their strongest model for scientific research. I'm going to go

• 45:58Speaker 00

  to the slides now, Alex, and walk us through what this means. How strong is Opus 5 and how excited are you about it?

• 46:08Speaker 02

  I'm somewhat excited. I'm not over the moon. I'm not as over the moon as I was about Fable 5 becoming available. Fable 5 is incredible. Opus 5, I think it demonstrates, if you look at the benchmarks, so look at the benchmarks, for those who aren't looking, I would say the benchmarks, the evals that demonstrate the strongest performance, and I don't think this is a coincidence, for example, Arc AGI 3, which is focused on the ability to solve interactive visual problems that humans find easy, but AIs have historically found hard. It went from 1.5 at Opus 4.8 up to 30.2%, which is, as of this moment, last

• 46:51Speaker 02

  I was tracking, the highest official score from a baseline model on the Arc AGI 3 challenge. It's a visual code intensive challenge. Something else that's intensive, developing front-end software. My overall whiff from using Opus 5 quite a bit is there was maybe mild optimization toward front-end development and anything that touches the nexus of vision and code historically, including with Fable 5. If you ask it to generate an image of something, you ask it to generate a chart, it does moderately well. I think with Opus 5, just trying to read between the lines of capability changes that I see, I think

• 47:34Speaker 02

  Anthropic is attempting to, given that the Opus series and Claude in general doesn't do image generation, they're trying to lean in a bit to some of the gaps at the intersection between code gen and vision. And I think in, for uses of mine, I still, honestly, I still prefer Fable 5, even though it's more expensive. And even though if you look at, say, the artificial analysis intelligence index, if you look at their overall chart of performance versus cost per task, if, according to that chart, Fable 5 is below the frontier, it's slightly below Opus 5 in terms of their capabilities and a lot

• 48:16Speaker 02

  more expensive. Despite all of that, for day-to-day usage, when I use Claude, I still prefer Fable 5. But I'm very glad for one thing about Opus 5, which is it doesn't shut you down as frequently if you ask anything that it misconstrues as being a question about biology or a question about cyber attacks.

• 48:34Speaker 01

  So Alex, I have the exact same experience, 100%, the exact same experience. But then I look at these benchmarks, there's a whole bunch on these charts.

• 48:43Speaker 02

  Yeah.

• 48:43Speaker 01

  And they seem to tell a different story.

• 48:45Speaker 02

  Yes.

• 48:46Speaker 01

  How is that? How do you reconcile that?

• 48:48Speaker 02

  I'm a little bit scared of that there may have been some mild benchmarking here, that that's what I was politely gesturing at. These seem to be benchmarks that are involving code gen and/or imagery or vision and living at the intersection between them. Some of them, like if you look at humanity's last exam, there, granted, it's saturating anyway, but the performance improvements are a little bit milder. So for HLE, you see from Fable 5 with tools, 63.9%, a modest increase to 64.7% with tools with Opus 5,

• 49:28Speaker 02

  and actually a decrease without tools, which is also maybe a sign that there's been a bit of, again, not benchmarking because it's still, I've used it extensively. It's still very well-rounded. I don't want to accuse it of broad benchmarking. But it just, like, if you look at the drop relative to Fable 5 for legal or health or some other areas, obviously there was some sort of distillation. This is the type of distillation that is under the present regime, welcome and not disdained. So taking larger model and using it to teach a smaller model, a more cost-effective model. There was probably a lot of Fable 5

• 50:06Speaker 02

  or Fable series or Mythos series distillation down to achieve Opus 5. But the overall sort of distribution of tasks, definitely from interacting with it for a while, feels biased towards code gen and visual stuff and away from general capabilities outside that.

• 50:25Speaker 00

  So here's our next chart, agenda coding by effort level. You want to walk us through this?

• 50:30Speaker 02

  Yeah, so we're looking at everyone, at least in the industry's favorite form of scatter plot, so cost on the horizontal axis, performance on the vertical axis. And what this appears to show is that Opus 5 is both stronger in terms of absolute score and cheaper, that's the horizontal axis, than Fable 5 and Opus 4.8. And interestingly, it appears to be on the same cost performance frontier approximately as Sol. So that I think the subtext that we're supposed to get from seeing this chart from Anthropic is that this is, this should be read as a direct competitor for Sol, which is interesting

• 51:14Speaker 02

  and slightly, I think, unnerving, given that, again, Fable 5 anecdotally seems to give better performance.

• 51:21Speaker 00

  All right, let's go to our third chart here, novel problem solving by cost. And I love this.

• 51:27Speaker 02

  So this is just wild.

• 51:29Speaker 00

  Yeah, please.

• 51:30Speaker 02

  Yeah, so Arc AGI 3, again, is a challenge that is primarily focused on the ability to solve sort of animated voxel problems. Tetris, for example, if a person had never seen a game like Tetris before with a bunch of blocks moving around and you were trying to do well at Tetris, it's a rough analogy, but that's approximately what Arc AGI 3 is like, animated block world challenges. So what's really striking, and Dave, you and I have talked about various attempts by pure scaffolding layer parties to just completely saturate Arc AGI 3. According to the official rules, I think there are limitations on how much scaffolding

• 52:13Speaker 02

  you're allowed to get, and so this is just the raw model being injected in. But what's interesting, and what was, I think, especially striking in the Opus 5 performance, this is as relayed by the Arc Prize Foundation organizers, is that it was reasoning algebraically about the visual challenges. So it was handed a visual puzzle involving blocks, and it started to reason. This is, if you look at some of the founders of Arc AGI, of the Arc Prize, they will go on forever about how this is actually a prize that tests the ability to do what's called program synthesis, to write programs from scratch in response to new, to novel problems. And so stunningly, what Opus 5 was able to do was to take a visual problem with a bunch

• 52:58Speaker 02

  of, what to humans look like, objects, and it represented the objects algebraically in software and basically did math on the objects in order to solve the problem. This is the first time that any, to my knowledge, anyone's ever seen a frontier model ever do that.

• 53:14Speaker 00

  A novel approach that was not guided by anybody, this is its derivative of strategy for doing this.

• 53:19Speaker 02

  That is, unless Anthropic was benchmarking on Arc AGI 3.

• 53:24Speaker 00

  Okay.

• 53:25Speaker 01

  I think that scaffolding argument, though, is really, really important, because if it holds up, I tried to replicate it, you know, because you can get 98%, I guess, on Arc AGI 3 if you give it a reframing of the way it interprets the puzzle.

• 53:40Speaker 02

  Right.

• 53:41Speaker 01

  And if that holds up, that gives inspiration to a billion entrepreneurs who can take something like protein folding, or drug discovery, or mechanical design of robot arms, and say, Fable 5 can do this, or Opus 5 can do this, but I gave it a better way to think about the problem, and now I tripled its intelligence within that domain. So that, that opens the door for scaffolding improvements in all these domains like biotech, where if you can reframe it so the AI doesn't have to work as hard to understand what you're trying to achieve, and can maximize its, you know, its tokens and its parameter brain count, that is an entrepreneurial heaven. So I'm really hoping that result holds up. I tried to replicate it, I couldn't quite do it, I didn't work on it that hard, but

• 54:26Speaker 01

  I do believe it's possible. I asked, I don't know, did you get to the bottom of it? Is it real?

• 54:30Speaker 02

  I'm not certain, but the scaffolding advantage is very real, and I, my understanding is this is why Arc AGI 3 has certain rules regarding what can be submitted and what can't. But I think the elephant in this particular room, to your point, is that scaffolding adds an enormous amount of value at the moment, at any given point in time, over the baseline model. The other side of that is, the baseline capabilities tend to dissolve any scaffold. So today's scaffold is tomorrow's baseline capabilities.

• 54:57Speaker 01

  Well, I tell you, if that holds up, and I think you're right, I think it will, next semester, every university in the country should have a class called scaffolding, and everybody should have the opportunity to learn how to do this, because that is the power tool of all power tools for any entrepreneur. And so what is it now? It's coming up on August, you have 30 days to get your class curriculum together and launch it for next semester.

• 55:21Speaker 02

  With prompt engineering as a prerequisite.

• 55:23Speaker 00

  Alex, let's hit these next two charts and then watch the Call of Duty.

• 55:26Speaker 03

  Have a quick comment. Something I noticed was that 4.8 came out on May 28th, and 5.0 came out just now. So it's not that much of a better model, but the efficiency's gone up by twice as much. So we've seen a 2X, and we were saying 10-week doubling price performance for AI this year. It's eight weeks now.

• 55:49Speaker 00

  It's a model release every six days on average over the last three months.

• 55:52Speaker 03

  Yeah, this is incredible. The other thing I noticed was in the, in the grid, you've got different models that are becoming really good at different things, like legal, health, coding, et cetera, which I think will continue.

• 56:03Speaker 00

  Alex, these next two charts?

• 56:07Speaker 02

  Yeah, so this chart is interesting insofar as it seems to support the hypothesis that there might have been mild benchmarking on Arc AGI 3. So this is a chart by a third party that evaluated Opus 5 on an Arc AGI 3-like game involving similar genre, and discovered, actually, the performance jump was not material versus, say, Fable 5. So again, not quite sure what was going on with Arc AGI 3, but that was by far the most prominent increase that we saw from Opus 5. Interestingly, a benchmark that Anthropic did not highlight was frontier math, which

• 56:51Speaker 02

  is, I think, maybe in some sense, a better bellwether for advanced reasoning capabilities by the models. I had to check this independently, and actually, Opus 5 demonstrated inferior frontier math performance relative to Fable 5. So again, Fable 5, still my favorite Claude model.

• 57:08Speaker 00

  All right, last one here, the live leaderboard.

• 57:10Speaker 02

  Voxel Bench. So here, we see Opus 5 now earning third place, just behind Fable 5 on Voxel Bench. Again, visually intensive tasks, but at a much lower price. And interestingly, but perhaps unsurprisingly, Sol from OpenAI still carrying the lead on this. The reason why I'm not that surprised is visually intensive tasks are an area where I would naively expect OpenAI to be doing a better job, because they've continued to invest in image generation, whereas we've seen no generative image capabilities at all, shockingly, from Anthropic at all. They're busy maximizing the value, the revenue per token, which leads them to code and not to image generation.

• 57:53Speaker 00

  And I bet you're gonna see.

• 57:54Speaker 01

  As a practical matter, you know, anytime I'm doing something complicated, I'm working in Fable 5, working in Fable 5, getting a lot done, if I want to see an architecture diagram, I just take the entire thing and dump it over to GPT and say, make me my architecture diagram. Fable 5 is so bad at it, but if, you know, it does so much work for you, and you get confused very, very quickly, and you want to just see a simple visual summary of everything going on, it's just so bad. So, but, but GPT is amazing.

• 58:19Speaker 00

  My guess is Grok jumps to the top of this leaderboard and then this next release, I mean, Elon's been, been speaking about that. Speaking about imagery, this made a viral loop on X. This is Opus 5 recreating Call of Duty from a single prompt, call it a one-shot, if you would. Let me go ahead and hit play on this.

• 58:42Speaker 01

  Remember, these demos 30 days ago just looked like absolute garbage?

• 58:53Speaker 00

  Yeah, this is incredible.

• 58:54Speaker 01

  Look how much is, it's crazy, the rate of improvement.

• 58:56Speaker 02

  Well, what's amazing to me, I mean, this is sort of the converse, for those who can't see, this does look like Call of Duty. The converse of not having native image generation abilities in defense of Anthropic is that if you look at the entire physical world and you say, well, everything is just code, including code that generates photorealistic video games, then you say, you don't need native image generation abilities, you just need the ability to generate photorealistic 3D environments like Call of Duty, and you're all set.

• 59:27Speaker 01

  Huh. Yeah, the truth is in there somewhere. It's kind of in the middle, I think, but I think, I think really clearly Anthropic cares about recursive self-improvement purely and only. And so they'll build anything and train on anything.

• 59:40Speaker 00

  It's a race.

• 59:41Speaker 01

  That helps the, yeah, helps the AI.

• 59:43Speaker 00

  It's a race to ASI. So I think an important article that I just added for our listeners is, and while we're talking about Claude, I don't know if you heard the story, that a significant number of Claude chats were found publicly searchable on Google this past weekend. So a Reddit user discovered that by typing a search operator, site, colon, claude.ai/share into Google, it surfaced a long list of shared personal data, including, you know, personal health records, private documents, key names, and telephone numbers. Apparently, this originated from Claude's share chat feature, which allows users to

• 1:00:23Speaker 00

  share links of their Claude chats between, between friends via URLs. Did you track this, Alex?

• 1:00:32Speaker 02

  Yeah, I saw the story, and on the one hand, it's disappointing to see any, anything, any information that would be expected to be private find its way out into the public world, not a fan of that. On the other hand, I think there's sort of another side to the story, which is a feature that was intrinsically designed to be social in nature. Shocked, shocked to see gambling in this establishment, ultimately finding its way into the hands of other people. I think there are two sides that one can see here.

• 1:01:08Speaker 00

  Yeah, but I think one of the issues, one of the arguments, and we saw it on the rant a few episodes ago, is that when you're using these models, your competition is in some sense seeing your data and learning from your data. And it's something people need to understand. It's the argument for on-prem. Saleem?

• 1:01:27Speaker 03

  No, I just doubled down on the same thing. You've got to do your own, you've got to own your own proprietary data, and I think over time, people move everything to on-prem that's sensitive in any way.

• 1:01:40Speaker 00

  Dave, any comments on this before we move on?

• 1:01:44Speaker 01

  Nope.

• 1:01:44Speaker 00

  All right.

• 1:01:45Speaker 01

  I think it's just incredible, the rate of, the rate of change. Just, just go back and look at an episode from two or three weeks ago and look at the rate at which one shot can, can create things and the rate. Oh, I'll make one other comment. The holodeck, you know, our holodeck is up and running.

• 1:01:58Speaker 00

  I want to see it.

• 1:01:59Speaker 01

  You gotta come check it out, man. It went from like, okay, to mind blowing in just a couple of weeks for the exact same reason. You can one shot a world while you're, and the audio and the visual is so good.

• 1:02:09Speaker 03

  The fact that you can one shot, I think what this will do is, I don't think it affects the commercial games that much, but it allows you to do experimentation in an amazing way because the cost of experimentation just went to zero.

• 1:02:21Speaker 01

  Yeah.

• 1:02:22Speaker 03

  So you'll get so many more prototypes.

• 1:02:23Speaker 01

  That's where Jardis is coming so soon. Yeah, yeah, that, that entire, God, that Iron Man, the vision in that movie was so precious.

• 1:02:31Speaker 00

  Yes.

• 1:02:31Speaker 01

  But it's gonna be exactly like that and fun.

• 1:02:33Speaker 00

  I, I spoke to Jon Favreau today, the producer of Iron Man one and two, getting him to come to Moonshot's live. We've got amazing, amazing, yeah, yeah. Elon had introduced us. So let's move on to our next story. This was a story Alex said you'd wanted to raise here. So it's the idea, which is obvious, that, you know, global AI diplomacy is coming. So the Financial Times is reporting that China's leader, Xi Jinping, is wielding AI as a tool of statecraft, using it as leverage in China's diplomacy across the global south in a strategy that the Financial Times frames as Pax Silica. I love that. While Washington

• 1:03:14Speaker 00

  is debating open versus closed, Beijing is out in the world, country by country, exporting AI as an instrument of influence, offering models and infrastructure to developing world that wants to leapfrog what they currently have. AI is becoming an instrument of soft power. Whoever supplies the models and the infrastructure to developing world shapes the next few decades, I would say the next century of global alignment. So, you know, my concern is if the US over restricts, the developing world is simply going to adopt whatever frontier adjacent open models are there. Saleem, your thoughts?

• 1:03:52Speaker 03

  I can't stress this enough. The whole power of the US is its open and very broad innovation ecosystem. If you create a restrictive open model policy, it's gonna be strategically like a self-owned and shoot your own foot of an epic level because you're gonna protect a small number of domestic labs while giving the entire opening ecosystem, global south AI ecosystem to China. If you want leadership in an exponential era, it has to come from the largest network where everybody's using your tools for stuff, not protecting its strongest incumbent. Openness is not a, it's not a philosophical preference anymore. It's like

• 1:04:34Speaker 03

  a, it's the tool of soft power. And the US has already lost that in diplomacy and USAID and other stuff. If they close up the, the open model policy, it's gonna be really disastrous for the future.

• 1:04:46Speaker 00

  And I don't think they will. I mean, I think this is obvious. We're effectively splitting the, we're splitting the world into.

• 1:04:52Speaker 03

  We shouldn't be having the discussion though.

• 1:04:53Speaker 00

  Empires. Yeah, yeah. Alex?

• 1:04:57Speaker 01

  Well, there is, there is no, as of right now, there is no US-based option at all. You can take everything you just said and swap out the word model and put in fighter jet. Like, should we sell F-16s to XYZ country? It's a no-win question. Like, you have to pick and choose. But if we don't sell the F-16s, they'll buy Russian and Chinese fighters. And that'll support the creation of more of those fighters. Yeah, but you're also selling an F-16 to like, it's exactly the same problem. There's no easy answer to it. But right now, there is no US open source model to compete with the Chinese anyway, which is kind of sad.

• 1:05:32Speaker 00

  Alex, your thoughts?

• 1:05:33Speaker 02

  I, I, I think, so Pax Silica had already been announced by the US before China announced its own initiative. And China, of course, announced many years ago at this point, Xi Jinping announced Belt and Road Initiative. And there's a certain extent to which it's far more, I don't want to say insidious, but far more ultimately invasive and controlling if, if a foreign country, say, if a foreign country loans you a bunch of money to build a bridge, okay, so you default on the loan that has a certain outcome. Foreign corporate or foreign corporation that's basically under the thumb of a foreign government builds telecommunications equipment and deploys it to you. So now you have cell phones. The

• 1:06:18Speaker 02

  worst that they can do, they can spy on you and they can shut off your telecom infrastructure. Next level up. Foreign corporation that's, that's heavily involved with foreign government injects superintelligence into the veins and arteries of your country. Now it's not just listening to you or not just loaning money to you. Now it's thinking for you. And I, I think that's a far more vulnerable position for the so-called global south to be in, regardless of which block or sphere of influence it finds itself in. And I can only imagine that the, the long term, to the extent there is a long term in the middle of the singularity equilibrium point, is going to be pushing more, not just inference

• 1:07:01Speaker 02

  to the edge, which is what China, I think Chinese frontier labs would like with open weight models, pushing training to the edge. That I think is the equilibrium point. And curiously, I don't hear that many countries in the so-called global south agitating for domestically pre-trained models, but I do think that's where some sort of equilibrium could lie if there is to be an equilibrium.

• 1:07:25Speaker 03

  Can I tell a related story here?

• 1:07:28Speaker 00

  Please.

• 1:07:28Speaker 03

  A few years ago, I was talking to the prime minister of one of the smaller Asian countries and they had, their big city had tripled. They needed much more ports to be able to receive more containers for the big, huge population. And they just taken a half a billion dollar loan from the Chinese and were totally, totally mortgaged the future of the country. And I made the point that, look, drones are kind of doubling in their, every nine months in their price performance. If you waited a few years, you could have a drone pick up a container. You don't need a port. You could drone, you got four drones pick up in the corner of a container, which is average 20,000 pounds. And so you don't have to wait that long for drone doubling to get to a quarter of that weight. And then

• 1:08:13Speaker 03

  you just pick it up and put it on a flatbed truck or on a rail car and off you go. And they're like, damn, we just mortgaged the entire country because we didn't understand exponential thinking. And if you go back to what Alex just said, that goes up 10x when you outsource your thinking. And that's really dangerous. I think the safety and the security the future will be in these open weight bottles that give you back your sovereignty.

• 1:08:35Speaker 00

  Yeah. Talk to California about its high-speed rail when you talk about, yeah, let's not go there. All right. So big news this week for my fellow space cadets, a successful launch of Starship 13. SpaceX has confirmed launch and splashdown, an incredible, incredible trip it made for Starship 13, their largest vehicle to date. It accomplished a number of key firsts. Let's run through them. First, it deployed 20 operational Starlink V3 satellites. They were connected to, they were tested in part. And these are the satellites that are going to deliver us a half a gigabit to a gigabit connection speed every place on the planet. You're literally going to have more, a better connection from space than

• 1:09:17Speaker 00

  you have from, you know, your home wifi. They did an in-orbit relight of one of Starship's Raptor engines, critical for the upcoming Artemis missions, and a successful soft landing on the Indian Ocean with the vehicle remaining intact, which was extraordinary. And I'll watch two of the videos here. Let's share them because they're just fun. This is space porn. All right. Let's take a look at the launch first.

• 1:09:41Speaker 03

  It's important.

• 1:09:44Speaker 00

  You gotta love this drone footage from above the launch at Starbase.

• 1:09:51Speaker 01

  Space is big.

• 1:09:53Speaker 00

  This is such a, you know, it has a high degree of beauty.

• 1:09:57Speaker 01

  Oh, my God.

• 1:09:58Speaker 00

  So gorgeous.

• 1:09:59Speaker 01

  Yeah.

• 1:10:00Speaker 00

  I remember when I was with Elon and we're talking about, you know, the Starship for a stage and saying, it's the most contained energy that you can ever experience other than a nuclear explosion. All right. And, and very importantly, the landing, which was the big news on this particular mission. Let's take a look at this sequence.

• 1:10:17Speaker 05

  About 10 seconds away.

• 1:10:19Speaker 01

  I mean, look at that footage.

• 1:10:21Speaker 00

  Scarlet baby.

• 1:10:23Speaker 05

  Let's see if we can get this thing in the water.

• 1:10:26Speaker 01

  I got, I got the link from you guys. I was like, yeah, yeah, I'll check it out. And I was like, it was like, wow, I gotta watch this whole thing and then.

• 1:10:32Speaker 00

  Note the high res. Raptor engines.

• 1:10:37Speaker 01

  Look, can't you, the amount of stress, you can feel it, you know, from these, because you can see like things flexing and warping.

• 1:10:45Speaker 00

  Soft landing.

• 1:10:51Speaker 06

  And we're in the water.

• 1:10:53Speaker 00

  Floating in the water for full recovery.

• 1:10:56Speaker 06

  And it's a soft splashdown in the water.

• 1:11:00Speaker 01

  This is where they thought it would explode.

• 1:11:01Speaker 00

  Well, it has in all the predismissions. What happened there? It was so soft.

• 1:11:05Speaker 06

  That is a first.

• 1:11:06Speaker 00

  Well, it's got excess fuel.

• 1:11:09Speaker 01

  Yeah, and when it hits the water, you know, it punches little holes or whatever in the sides. So that's where it usually explodes.

• 1:11:14Speaker 00

  You know, what I'm excited about in particular is Elon tweeted that because the landing was so precise, that Flight 14, he's likely to capture the starship on the Megzilla device, right, the large chopsticks that come in and grab the vehicle. Yeah, so, I mean, that's a flight I want to go to Starbase to watch the return. It's going to be awesome. Let's take a second, just talk about the abundance story here. I mean, the cost of launch is plummeting. And let me just give you the numbers real quick. The space shuttle was roughly $54,000 per kilogram to orbit, right? So think about, you know, taking a gallon of water, of milk, to orbit, $54,000. Falcon 9 dropped it to about $2,000 to $3,000 per kilogram.

• 1:11:58Speaker 00

  And Starship's target, and Dave, you and I were discussing this with Elon back in our January podcast, it's between $10 to $100 per kilogram. I mean, just extraordinary.

• 1:12:10Speaker 01

  Well, it's also, it's inspiring, the amount of incredibly cool stuff that you can build now, specifically because all the feedback at control and all the remote, you know, intelligence is easy now, all of a sudden. You know, we saw the Unitree robots in the last podcast, and they're just beyond cool. And that robot that, you know, is plummeting down the side of the mountain with the wheels, like crazy cool. And then you got the, you know, the starships, just the amount of possibility is so exponentially bigger than it was just five years ago.

• 1:12:42Speaker 00

  And all the data is on Grok for building starships, which is extraordinary.

• 1:12:48Speaker 01

  Also, you know, I'm working on a photonic computer, you know, to run our new neural nets, and all the parts, it's actually giving me part numbers to order and saying, this vendor in Germany will make this lens for you in exactly this way. Can you, do you want me to write up the specs? Like, sure.

• 1:13:07Speaker 00

  Can you order it and build it for me too, please?

• 1:13:10Speaker 01

  I mean, literally, it'll arrive in boxes, I still have to open the boxes and assemble it.

• 1:13:15Speaker 00

  If you're an entrepreneur out there, and you've been looking for where to go build, I mean, building hardware, you know, Ben Horowitz, who's a friend of the pod, and we're going to have him back on the pod for one of these episodes, he's the co-founder of Andreessen Horowitz, you know, he wrote the book, you know, Hardware is Hard, or Effectively, and The Hard Things, was it The Hard Things About Hard Things? You know, and it used to be that building anything, and I built robots in high school and college, and it was tough. Now, you can 3D print parts, you can iterate rapidly. So if you're an entrepreneur looking for something to do in the world, you know, what's missing? What do you wish existed?

• 1:13:57Speaker 00

  And you can actually use these models to design it, order the parts, and start building.

• 1:14:04Speaker 01

  Yeah, I've got an incredibly cool robot that's getting the top of my pool. It just, it has eyes, and it finds leaves, and it just goes and picks them up. But I want someone to build one that dives to the bottom and just goes down, picks up whatever, an acorn, brings it up, throws it out of the pool. I bet you could vibe that up now, or just crank it up.

• 1:14:21Speaker 00

  Alex, if there's anybody who's as big a space enthusiast as I am, here it's you. I mean, did the flight bring tear to your eyes?

• 1:14:30Speaker 02

  I wasn't crying, but space is big, and I was delighted. Did you see, Peter, the views from the Starlink satellites that were posted later? Like, that was pure science fiction.

• 1:14:41Speaker 00

  Oh, my God, it was basically looking at Starship in orbit from the descending booster.

• 1:14:46Speaker 02

  From a distance, yeah. That was incredible. That's like something out of Star Trek or The Expanse. I was very impressed with that. I certainly hope that this Flight 13 ends up in a museum at some point, given the soft splashdown, this is a historic first. Hopefully, the SpaceX team will use this as an opportunity to get a good look at the heat shield, which is interesting. If you noticed, like, the drone feed the moment the splashdown happened, it was just zooming in on all of the heat tiles, looking for damage, trying to analyze the structure, presumably because the team was worried the whole thing might explode a few seconds later. So they were getting whatever footage of the heat shield that they could, while they had time, but now they're going to have a ton of time. So it's very exciting.

• 1:15:26Speaker 00

  Yeah, in the past, after the vehicle, after Starship, you know, detonated from the onboard fuel, and that was expected, you know, people say, oh, my God, it failed. No, it didn't fail, it did exactly what they expected it to do. They'd have to go diving and find pieces of it to try and reconstruct what happened. And the heat shield here, I mean, people need to understand the amount of energy being dissipated. These vehicles are traveling at 17,500 miles an hour in orbit, have to dissipate all that safely and come to a precise landing. It's insane. Saleem?

• 1:15:56Speaker 03

  I just love the fact, the ongoing flight after flight, he's viewing any kind of failure as information. And you don't get embarrassed by it, you take the data, you learn, and you do it way better next time, and nobody else does that.

• 1:16:10Speaker 00

  Yeah, it's exciting. We are, as Alex, you've said many times about the speedrun Star Trek, what an exciting time.

• 1:16:18Speaker 02

  Count on it.

• 1:16:19Speaker 00

  Yeah, I mean, the only thing better is if we discover that we have access to all the alien UFOs, and we can go to jump to light speed. All right, let's stay on the science theme. Our next story is in the world of brain-computer interface. Two stories this week. The first one comes out of Science Corporation. Full disclosure, it's one of my portfolio companies, I love this company. And it's restoring vision for the blind. The company is run by an amazing entrepreneur, Max Hodak. He's the past president of Neuralink, and someone who I've had on the abundance stage a number of times. Science announced that his first product, called Prima, P-R-I-M-A, I'm sure it's an acronym, has been approved for launch in Europe.

• 1:17:02Speaker 00

  So Prima is the first BCI device approved for restoring detailed vision in age-related macular degeneration that destroys a central vision of your retina. They just earned what's called a CE mark, which means it complies with European safety, health, and environmental requirements. Let me show an image of what this looks like, and we can talk about how it works. So here it is. What you see there is a pair of glasses that are capturing the image, and then they're beaming back the image via infrared to that little, call it, you know, rounded square that's sitting behind your retina.

• 1:17:46Speaker 00

  So the signal from that Prima implant behind your retina is turning it into electrical signals and giving it to the remaining retinal cells, and those then get transmitted to your optic nerve, to your visual cortex, and it basically restores your central vision. The amazing thing is the patients who've gone through this have experienced five lines of improvement on a standard eye chart after 12 months. So this is a godsend for so many people with macular degeneration. Any thoughts here, Alex?

• 1:18:23Speaker 02

  Yeah, so a few things. First of all, the overall setup is in the spirit of, as I've commented in the past, the singularity is essentially all sci-fi tropes happening everywhere all at once. This is reminiscent of an ocular implant from the Borg, quite literally. It has an external module that, for those who are watching, can see here, so an external camera that then captures the information, broadcasts in human invisible near IR to this chip that sits immediately behind the retina. It's interesting insofar as Max, who was, of course, basically running Neuralink previously, this is a much, even though the retina is part of the central nervous system, this

• 1:19:07Speaker 02

  is a move away from the brain. But Neuralink, which also has its own approach for curing blindness, called Blindsight, seems to primarily be focused on injecting less on the optic nerve, more just focused on direct brain stimulation, direct brain intervention. Yeah, it's interesting to me that Max, with this new venture of his, is sort of moving away from the brain, albeit still in the CNS. And I do think the farther, the further you get away from direct brain intervention and placement of electrodes, the easier it is to scale up mass-market consumer device.

• 1:19:50Speaker 02

  In this case, obviously, it's obviously surgery on the retina, but I'm very optimistic that advances in ultrasound, advances in wearables, a variety of other completely non-invasive advances will enable vision restoration without even needing to have retinal surgery in the next few years.

• 1:20:07Speaker 00

  You know, I wrote a chapter about Max and science in my book, Where Is Gods? And in particular, you know, giving vision back to the blind is biblical, right?

• 1:20:17Speaker 03

  It's huge.

• 1:20:18Speaker 00

  It's amazing.

• 1:20:19Speaker 03

  And God said, let there be splash.

• 1:20:21Speaker 00

  What he's doing...

• 1:20:23Speaker 00

  And so, you know, it's interesting, Prima as a product is his stage zero revenue generating engine. So one of the things that a lot of entrepreneurs do incorrectly is they jump straight to this, you know, massive moonshot that will take them, you know, hundreds of millions or billions of dollars to get to without generating early revenue. So Prima is the means by which he's creating early revenue. He has an amazing BCI approach. I can't say a lot about it, but he's basically growing neurons into the brain, which don't, you know, the issue with Neuralink and many of the BCI companies is their electrodes destroy

• 1:21:04Speaker 00

  thousands or hundreds of thousands of neurons when they're placed into the neocortex. But neurons actually can grow into the brain. So he's got an approach of an interface between electrical circuits and neurons and neurons growing into the brain and then, you know, wiring together and firing together. Hopefully he'll disclose it. It's been in animal models and his plan is to get to humans, but it's an incredible strategy for the BCI world. BCI's are super competitive at this point. There are folks trying approaches at the CNS level, at the peripheral nervous system, direct brain stimulation, wearables, ultrasound,

• 1:21:45Speaker 00

  FMRI. And I think ultimately, by ultimately, I mean on the five to 10 year timescale, we're going to see something of a shakeout and we're going to discover what are the most ergonomic ways to interface with the brain. So I really hope that for Max's sake, that brain, or that science rather, does well. And I for one would welcome some extra neurons. Yeah. He thinks of it as an extra, you know, the corpus callosum is what connects the right and left hemisphere of your brain. Imagine having a third hemisphere of your brain that actually is connected to the cloud. I mean, that's the way he described it. Exocortex. I want my exocortex. Yes. It's extraordinary. So Liam, you were saying?

• 1:22:25Speaker 03

  There are two things here that I found really interesting. One is the feedback loop, right? Once you have a feedback loop from sensory back into the brain, et cetera, it learns very quickly. And I think we can see that over and over again in some of these recursive inner loop type applications. The second thing that occurs to me, which goes to your comment, Peter, about business models, is when you have an exponential and it's hard to predict out where the endpoint is going to be, it's not that difficult to look out two, four, or five hops and say, what are the business models that may be enabled at each of those things? What are the use cases? So if you're an entrepreneur and you see a technology that's growing exponentially, now there's a dozen of them, you can pick your biggest passion, your favorite technology, look out where it's going, and then say,

• 1:23:09Speaker 03

  okay, at that price performance, what applications become enabled? And now you have a very viable roadmap for the future, exactly like the way Max is doing it. And that's going to be the future of companies and how they evolve.

• 1:23:20Speaker 01

  I really want to echo something Peter said there too about go to market strategy because, you know, if you look at the most valuable companies in the world, so like an Apple, Google, Meta, and you look at their very first day and their very first product, you know, the Apple one was a box of chips you needed to assemble yourself. And, and, you know, Meta, you know, was Facebook, it was, it was a little face

• 1:23:41Speaker 00

  At one university.

• 1:23:42Speaker 01

  Picture sharing thing at just Harvard. Yeah. And, and Google was a plugin to Yahoo. It's a little search plugin to Yahoo. They tried to sell themselves to Yahoo for a couple hundred million bucks and Yahoo's like, you're not worth anything near that.

• 1:23:53Speaker 00

  Yahoo was right. It's not worth anything near a hundred million.

• 1:23:58Speaker 01

  Yeah. But these really humble beginnings for go to market strategy because, you know, we talk a lot about, you know, starships landing in the ocean and people think, wow, I want to build a company that, you know, creates a new starship. But that's not how these things get started. You got to start with a go to market that actually gets you an initial revenue. And if you really study the outcomes, but trace back to the first six months, which not enough people do, like really study the details, the people, the characters, what exactly was that product? And then that starts you on the journey and you end up being Google, Apple.

• 1:24:27Speaker 00

  You know, we had Bill Gross on stage with us this past year at the Abundance Summit, and he's brilliant. And I love Bill. He's one of the most extraordinary entrepreneurs that's created more startups that have gone public or been acquired than I think anybody else, period. And he has a great video on DLD, also on TED, which he looked at, I think it was 50 companies in his portfolio that succeeded and 50 companies that failed. And he asked the question, why did they succeed? Was it because the CEO was smarter, trained at a, you know, exclusive Harvard or MIT? Was it because they had more money? Was it because, what was it? And his conclusion at the end is an important lesson for all the

• 1:25:11Speaker 00

  entrepreneurs listening. It was timing. It was the companies that were there at the right timing that were able to survive long enough to survive forever would intercept good luck. So classic examples are Uber and Airbnb had been tried before, but when they launched in 2008, it was just after the recession and people were looking to make money. They were willing to rent their bedroom out, willing to go and drive a car. You know, our darling here, SpaceX, I mean, you have to remember Elon in 2008 was effectively bankrupt. He had had three failures of Falcon 1, and the fourth one, which he scrambled to get money

• 1:25:55Speaker 00

  together, finally succeeded. And because the space shuttle had been shut down a couple of years earlier, there was a contract out and he won a billion dollar contract in the crew resupply from NASA, and that got him going. Timing is everything. So if you can have an early revenue stream for your company that allows you to stay in business and intercept good luck, that's one of the single most important things.

• 1:26:20Speaker 03

  Yeah, just survive.

• 1:26:21Speaker 01

  Elon was 18 years, 18 years from bankrupt to trillionaire.

• 1:26:26Speaker 00

  Amazing. But

• 1:26:27Speaker 01

  I mean, it took, yeah.

• 1:26:29Speaker 00

  Did you see his tweet?

• 1:26:30Speaker 01

  Yeah.

• 1:26:31Speaker 00

  Passed a trillionaire or whatever it was, former trillionaire.

• 1:26:33Speaker 03

  Little plug here.

• 1:26:35Speaker 00

  Yeah, please.

• 1:26:37Speaker 03

  I mentioned this earlier, but we talked just now about the feedback loops. John Hagel and I have come up with a framework where it allows you to measure luck. And so once you have that feedback loop, that becomes very powerful. Yeah, we'll bring him on sometime and talk through it. It'll be useful for the viewers.

• 1:26:53Speaker 00

  Everybody, welcome to the health section of Moonshots brought to you by Fountain Life. You know, we talk about AI on this Moonshot podcast all the time. One of the most important things AI is going to be able to do for you besides educating your kids and helping you with your taxes is making sure that you're living a healthy lifestyle, that you get a chance to get to 100 plus. I'm here today with Dr. Dawn Musalem, the Chief Medical Officer of Fountain Life and a part of my medical team. Dawn, a pleasure.

• 1:27:19Speaker 07

  Great to be here.

• 1:27:20Speaker 00

  You know, the thing that people are concerned about most about living to 100 or 120 is their cognitive abilities, making sure they don't have dementia. And the numbers about dementia are problematic. Can you share what you've learned?

• 1:27:35Speaker 07

  Such an important point. And you're right, at Fountain Life, our members, the number one thing people are most concerned about is losing their brain health, forgetting the name of their child, forgetting the face of their loved one. We know that when it comes to dementia, the conservative estimates are that 45% are entirely preventable. What was amazing is with the advanced testing we're doing at Fountain Life, one quarter of our members had advanced brain age.

• 1:28:00Speaker 00

  Wow.

• 1:28:01Speaker 07

  But what was really awesome is again, back to that prevention, when we partnered it with healthy living, this gives me chills, eating healthier, moving our bodies, sleep, optimizing sleep is so important. You know what we saw? We saw that we improved that brain age by 26%. That is a big, big number to show that the majority of those individuals were able actually to improve the brain age.

• 1:28:23Speaker 00

  And one of the things I love about Fountain is we're searching the world for the best therapeutics, the best approaches, and making sure we bring it to our members. So if having healthy brain function till 100, 120 is important to you, check out Fountain Life, go to fountainlife.com/peter. Make sure you become the CEO of your own health. All right, now back to the episode. Alex, this next story is one that you threw out and happy to talk about it. It's our second BCI story. This one's out of Neuralink. The company just shared a video of people living with paralysis controlling a powered wheelchair using nothing but their thoughts, no joystick, no hand controls, just intention, translated directly from the brain into the

• 1:29:03Speaker 00

  wheelchair's movements. I mean, think what this actually means. It's massive freedom. Let's roll the video and take a look at this because it's, it's a beautiful thing. And we'll talk about what comes next.

• 1:29:15Speaker 08

  Through our clinical trials, we've been working really hard to give the world a brain-computer interface powered wheelchair.

• 1:29:24Speaker 09

  It's designed for anyone with trouble controlling their wheelchair physically by translating their neural signals so they can control the wheelchair with their mind.

• 1:29:32Speaker 08

  What we've done here is we've developed a set of custom electronics to take cursor movements from a participant's imagined motions, translate them into analog signals, and use them to directly drive and control all the functionalities of the wheelchair.

• 1:29:46Speaker 09

  This is the wheelchair control app, and we built a custom UI for our users. I can now move my cursor up and slowly move the wheelchair forward, or turn to the side, left or right. And as I get more and more into the ring, it'll go faster and faster. Really, we built the system with safety in mind. As you can see here, if I let go, the cursor is slowly going back to the center. So that way, if a user ever becomes incapacitated, you know, they won't go driving directly to a wall, the cursor will allow them to go back to the center here.

• 1:30:18Speaker 00

  Alex, your thoughts and what comes next?

• 1:30:22Speaker 02

  Well, obviously, this is sort of a visual joystick via brain-computer interface. Where this goes, it's hard not to extrapolate this going to full bodily controls. Imagine giving people exoskeletons that they can control via BCI, paraplegics, quadriplegics, and basically restoring free autonomy in a physical world, all four limbs. I think that's pretty incredible. It's easy to extrapolate further than that. I think there's probably a sizable subpopulation in many countries. Certain folks would love mechas from anime,

• 1:31:01Speaker 02

  would be able to walk around in large robots, Sigourney Weaver, Aliens style, or maybe even, I mean, I think the end game for the motor cortex does look like some variant of partial brain uploading or something adjacent to that. Once we've fully decoded the motor cortex, we're in, I think, a stronger position to take some variant of human mind uploads, could just be behavioral uploads that are generated by pre-training foundation model off of large amounts, say, of fMRI or ultrasonic data, and being able to decode the motor cortex to perform useful functions in the world. That's a low bar. There are

• 1:31:45Speaker 02

  much higher bars that would be connectome-based. Something like that, I think we're going to see actually happen in the next five or so years, certainly by the end of this decade. And I think that's a major step toward, you know, in the short term, obviously, taking people who can't walk, giving them powers of locomotion. That's now-ish, but in the next few years, it's giving exoskeletons and ultimately human uploads.

• 1:32:09Speaker 00

  You know, my answer to that, AWG, is that Neuralink connects these individuals to an Optimus robot, right? And they see through the Optimus eyes and hear through the ears, and then they move.

• 1:32:22Speaker 02

  Avatar. Your vision is Avatar.

• 1:32:24Speaker 00

  It's effectively telepresence. You know, you can be anywhere. You can inhabit an Optimus in Japan if you're sitting there in Boston. I think that is definitively coming, probably over Starling. I mean, the singularity is here. This is insanely fun.

• 1:32:42Speaker 02

  There were a few, I mean, in addition to Avatar, there was, I'm blanking on the name of that other sci-fi movie, where people never left their homes and only went out and interacted with each other via these tele-robots. I think every sci-fi scenario plays out at once, and I can guarantee you, Peter, if the scenario that you're describing comes to pass, and probably will, we'll find some country, a few years from now, will be regulating the Hikiko Mori, if you will, who only stay inside their bedroom and only interact with the outside world via BCI to tele-robot.

• 1:33:18Speaker 00

  So crazy, so fun, and so liberating for so many people. All right, our final story before we go to our AMA here is regarding Elon's prediction that AI and robotics is going to make money irrelevant within a decade. By, you know, 2036, he said, that's his post-capitalist vision. It's a world of radical abundance in which scarcity no longer matters. Money no longer matters. You know, I talked about this with him when he was at the Abundance Summit this past year. Let's take a listen to this video, and then I really want to discuss this one, because it has people both excited and fearful. I want to address the fear there.

• 1:34:01Speaker 10

  Money won't matter in 2036.

• 1:34:03Speaker 11

  I'm not sure that the people who bought your shares think that money won't matter in 2036.

• 1:34:09Speaker 10

  What do you want money for? You want money for goods and services? Well, if that is so abundant that there's more, that the robots and AI are providing more goods and services than any human could possibly consume, what do you need money for in that case? I'll make a prediction, which is that deflation will be the issue, not inflation. Because as the output of goods and services increases, if the output of goods and services increases past the money supply, you will have deflation.

• 1:34:45Speaker 00

  I think it's totally ironic this was an interview by The Economist.

• 1:34:51Speaker 02

  Of the world's first trillionaires.

• 1:34:53Speaker 00

  Yeah. Gentlemen, thoughts? Saleem?

• 1:34:57Speaker 03

  You know, I think there's a couple of different threads here, right? Thread one is we're reaching abundance, and the cost of things will drop radically. But abundance in production doesn't mean you end up with abundance everywhere, because you could eliminate scarcity in ownership and access and location, and that would be amazing. But money's going to be relevant as long as you need an exchange mechanism. So as long as you need that to allocate stuff that's scarce, money as a means of exchange will stay. Let's remember there's three uses for money: means of exchange, unit of account, and store of value, right?

• 1:35:37Speaker 03

  And so this would hit store of value to some extent, it would hit the means of exchange some account, but the exchange unit will become really, or unit of account, et cetera. I think the biggest challenge here is not that abundance is impossible, it's that you can, if you end up in the wrong way, abundance will get captured by a few big companies, which is where the wealth inequality has been coming in. I think the hugest opportunity as we distribute and democratize, Peter, back to your words, technology, you also democratize opportunity. And I think the best framing I've seen for any of this is, can we get abundance of opportunity? And I think that's where technology will take us.

• 1:36:20Speaker 00

  Yes. Alex, you've made that point, you know, abundance of freedom.

• 1:36:24Speaker 02

  Yeah, I construe Elon's comments as, I'll use the technical term, Star Trek economics. I think he's arguing that 10 years from now, we'll live in a Star Trek economy where,

• 1:36:37Speaker 02

  and I think there's some fine print on this, I don't think he really means to say everything has been demonetized. I think what he really means, I think what he's shorthanding, is that most aspects of daily living, as we would construe them today in 2026, will have been demonetized 10 years from now. So food, shelter, healthcare, utilities, education, entertainment, all of these things will have been demonetized, and you won't need money because we'll be living in an abundant, in that sense, future. But I think there will be many things still that are not so abundant that they've been demonetized 10 years from now. Like, I don't know, if we have the ability to go to another star system, probably

• 1:37:22Speaker 02

  still somewhat expensive, or spend a week on the moon, maybe there's some price there, or just owning, you know, some scarce resource that's antique, collectible, this is not investment advice, but there are some things, I think, that will resist demonetization for longer than 10 years. If I had to put my finger to the wind and guess when demonetization hits the total economy, don't hold me to this, and not investment advice, doubly so for anyone investing in 30-year treasuries, I would guess approximately 30 years.

• 1:37:59Speaker 00

  Funny story, A.J. Scaramucci, who was one of my interns, one of my strike force members, started a company collecting obviously scarce things, like Tyrannosaurus skeletons and.

• 1:38:11Speaker 02

  And Pokemon. I know A.J. pretty well. A.J., if you're watching, I'm not sure what's up with those Pokemon.

• 1:38:16Speaker 00

  Yeah, he's collecting the best, you know, the best first edition comics and so forth. I mean, it's an interesting strategy. But, you know, I wrote a piece about this after Elon published it, or after we had the conversation with Elon. And the best way I think this works is we're going to end up providing some level of UBI. I call them COVID checks, right? $3,000 a month, which today gives you a bare minimum level of living. But all of a sudden, in this scenario, AI is today already and will be in the future the best physician. An Optimus on AI will be the best surgeon, and the cost of that is CapEx and electricity. And then, you know, autonomous vehicles, we're going to see

• 1:38:59Speaker 00

  not just one or two, but a dozen car-at-the-service AVs, right? Beating each other out to bring the cost down. And so all of a sudden, $3,000 goes a lot further than ever before. You want a house? Great. You know, a fleet of Optimus robots will build it for you. So it's a massive demonetization in the future.

• 1:39:19Speaker 03

  There's a monster elephant in the room, though, okay? Which is the radical transition this is going to require in our fiat currency systems, because all our fiat currency systems are absolutely dependent on scarcity. If you move to abundance, we have a huge challenge. We've mentioned this before on the pod. This is Jeff Boots of Reservation. We actually should have Jeff as a guest sometime. He made the point that over the last 50 years, every dollar increase in GDP has come with a $4 increase in debt. Okay, and I use a metaphor for this. So imagine you have decided to build a TV factory. You borrow $10 million to build a TV factory. And your business plan says, I'm going to pay this back if I can sell the TVs at $1,000. He shall be able to pay back the loan.

• 1:40:04Speaker 03

  Problem is that a year later, that $1,000 TV can only be sold for $500. And a year later, it can only be sold for $250. You're never paying back the $10 million. And this is how we're growing the global economy. So this is the printing money problem that we have. Where we're just radically printing money to keep the whole thing afloat. Which is why assets are so important to own rather than cash, et cetera. Cash is deflating at about 14% a year. This is going to require a wholesale shift in how we measure the economy, which is why people are pointing to crypto and Bitcoin and other things. But this is the part that's going to kind of cause a massive problem for every currency in the world and every central bank in the world. It's kind of paganic right now because your only resource is to print money.

• 1:40:49Speaker 03

  And then you have inflation, then I go, my God, we can't have inflation. And so this is a circular wheel that can't be gotten off of. And this whole thing's going to come to a halt.

• 1:40:57Speaker 02

  If only the Federal Reserve had access to the same superintelligence that the rest of us did. They could design super intelligent fiscal and monetary, especially policy.

• 1:41:07Speaker 03

  That's what you're going to have to do. That's a great point.

• 1:41:08Speaker 00

  You know, it's so broken.

• 1:41:10Speaker 01

  Incredibly.

• 1:41:11Speaker 00

  Dave.

• 1:41:12Speaker 01

  Yeah. What I find incredibly interesting is that all of these AI visionaries, Elon, Demis, Dario, they all have played Civ civilization. They all speak in terms of Civ. And they've all read Ian Banks, the culture series. And the culture series, the entire book series is about the post abundant world and what it'll be like. So when they get together and brainstorm on the future, they're so totally on the same page about how this is going to work. So then they do an interview, like Elon does an interview with The Economist or whatever. And he says, 10 years from now, so, you know, 2036, money won't matter. And they go, oh, my God, does that mean the exchange rate between the pound and the euro? And then they're like, like, what the?

• 1:41:56Speaker 00

  Yeah, they can.

• 1:41:57Speaker 01

  No, we're going to make so much stuff and have so much abundance that it won't matter. Did you understand the implication? Like, who gives a crap about the exchange rate or the deflation rate? Like, the degree of change that's coming over that decade is so massive that you just mentioned one little aspect of it, like, we don't care about money. It's just a tiny little component of this overall massive change. But all those guys are on the same page because they've all read the same sci fi books. They've all, like, I get how this is going to play out. And there are different nuances to it. And I'm not saying everybody agrees on every part of it. But what we're talking about is you don't care about the cost of things because you just take them off the shelf. Everything.

• 1:42:39Speaker 02

  It's ironic, given, Dave, that Ian Banks is Scottish. Scotland produces some of the world's best sci fi writers. So it's interesting that The Economist, based in the UK, doesn't quite appreciate Scottish sci fi.

• 1:42:50Speaker 00

  And then this tweet exchange occurs. Let me just read it. Darren Assamoglu is a Nobel laureate in economics. And he says, I propose a proposed challenge for Elon Musk. An opportunity to put your money where your mouth is. If money won't matter in 2036, why don't you pledge to donate your current wealth, approximately 1 trillion, to charity no later than 2036? This would establish with great credibility your proposal, you know, goes on. And Elon responds, I'm actually going to do something along those lines. I thought that was pretty cool. I immediately texted him and say, okay, let's, let's launch 10 $1 billion X prizes to solve the world's biggest issues.

• 1:43:35Speaker 00

  Haven't heard back from him yet, but hopefully soon.

• 1:43:38Speaker 02

  I think he's planning something more along the lines of SpaceX Tesla stock for everyone via UBE.

• 1:43:43Speaker 00

  Yes, perhaps, perhaps. Anyway, you know, this is the abundance story writ large again, where the cost of everything. And it's not, you know, going to be trips on the moon or Mars. But if you want your basics, right? It's raising the floor where every man, woman, and child on the planet has access to food, water, energy, healthcare, education, and freedom. I think that's, that's what we're building here. And I like to say, yes, we're going to have trillionaires living on Mars forever. But in that inflationary world where everybody's, you know, the rising tide for everybody, I'm okay with trillionaires living on Mars as long as every man, woman, and child on the planet has access to all the basics. That's a more peaceful world.

• 1:44:26Speaker 03

  Can we lift the bottom?

• 1:44:27Speaker 00

  Yeah, lift the bottom. Yeah, the gap will get bigger, you know? I agree, the gap will get bigger and yes, but as long as the floor comes up, that's the single most important.

• 1:44:37Speaker 03

  Can I mention one of my favorite abundance statistics that you put out, Peter? If you go back 200 years ago to 1820, 94% of humanity lived in extreme poverty, being defined as $2 a day on 2011 parody dollars. Today, that number is less than 9%. And you just don't see stuff like that in the news.

• 1:44:58Speaker 00

  Yeah, you don't. News media delivers every murder, every crooked politician over and over again into your living room between 6 a.m. and 6 p.m. and 8 a.m. As I like to say, I tell my mom this all the time. Mom, turn off the news. Don't watch the crisis news network. It will just give you a bad mindset.

• 1:45:17Speaker 02

  Join us in our echo chamber.

• 1:45:19Speaker 00

  Yes, she does every time. Hey, Mom. Let's do some AMA questions, gentlemen. I think we have some fantastic questions this week. Okay, Alex, let's begin with you.

• 1:45:31Speaker 02

  Yeah, so there are a few different interesting questions here. I'll pick number four because I've commented on this one already on the pod. How far off do you think we are from hitting longevity escape velocity? And this is from Sage Freeman 9260. So I think, Peter, if you were to answer this, or if friend of the pod, Ray Kurzweil, were to answer this, I think the answer would be something like 2030 to 2033, I think, is the consensus.

• 1:45:58Speaker 00

  My mantra is LEV by 2033. Yes.

• 1:46:02Speaker 02

  Yes. If I were to answer this, I think it's going to be spiky. Just like superintelligence is spiky along different dimensions and with different skills and capability areas. I think some subpopulations may hit longevity escape velocity by the end of this year. I think others may, it could happen by 2030. But I think there are so many variables that will lead to high volatility or spikiness in terms of who arrives when. In part because there are so many people who qualify for certain medications that, you know, say, third or maybe even soon, fourth generation GLP-1 rAs.

• 1:46:44Speaker 02

  Those could, speaking hypothetically, it's not medical advice. Those could end up having profound longevity impact. So actually, I was sufficiently interested in this that I did my own internal mini research study trying to answer the question, have we achieved longevity escape velocity this year? And there are few confounding variables because you can achieve, in some sense, catch up longevity increases if something terrible happens. Like, if there's an agricultural revolution in China and a lot of people die, then average life expectancy takes a huge dive. But then a few years later, it zooms back and you could ask the question, well, is catch up or regression to the mean longevity escape velocity?

• 1:47:28Speaker 02

  I don't think most people would consider it that. On the other hand, if you have someone who has some illness, but it's an illness that we've never been able to cure before, and now we're able to treat it, and now their, their life expectancy is increasing by almost or approximately one year per year. Has that subpopulation achieved longevity escape velocity? Some would say no, because you're just helping a person with some illness regress to the mean. Others, including myself, would say aging is a disease. And so curing aging is, is basically helping a subpopulation, which is to say more than 150,000 people per year dying on this planet

• 1:48:13Speaker 02

  and helping basically the subpopulation, that is, the entire Earth population, survive and get treated from the disease that is aging. So yes, I think some subpopulations are approximately there right now and more to come.

• 1:48:27Speaker 00

  And we discussed in the last pod, there are a number of ongoing partial epigenetic reprogramming experiments going on in humans today, which is super exciting. I'm going to take number three before one of you guys grab it.

• 1:48:41Speaker 03

  I'm sure you could do that. That's yours.

• 1:48:43Speaker 00

  If average life.

• 1:48:44Speaker 01

  I thought so too. It's got your name all over.

• 1:48:47Speaker 00

  If average lifespan hits 120 and infertility gets cured, which it will, how does society handle the population boom? And this is from at Mr. Ganesh Inkton. So here's the, here's the reality. We do not have anywhere near an overpopulation problem, even if we start getting to extreme longevity, 120 and plus. The majority of the world is in a population crunch. We're seeing in Asia and Europe, you know, a reproductive rate of under one child per family, right? The, to keep the population, you know, without growth or decrease, it's 2.1 children per family.

• 1:49:31Speaker 00

  Places like South Korea and Japan are hovering at like 0.6 children per family. So we have an issue in a number of generations. These cultures, these countries are going away. The other question that this person might then pose is, okay, what about access to resources? And over and over again, even if we have, you know, population, I think the numbers are going to reach nine and a half, 10 billion, and then very rapidly decrease. And people have always said, you know, the one Earth, you know, precept of we need to divide the resources of Earth equally amongst everybody. Well, every time we think there is a scarce resource, we discover, no, it's not scarce. We just innovate around it.

• 1:50:15Speaker 00

  You know, lithium was thought to be a scarce resource. So we start discovering lithium deposits every place. Then we start inventing batteries that are better than lithium with sodium that is much more abundant throughout the world. By the way, a quick note, our next podcast is going to be with Ramesh Nam, going to deep dive into energy. Yeah, it's going to be amazing. It's going to be amazing. You do not want to miss the Ramesh Nam episode. So Mr. Ganesh Inkton, no fears about overpopulation and no fears about not having sufficient resources. Saleem, over to you, pal.

• 1:50:49Speaker 03

  Okay, let me go with number two. Could Anthropic hide its model's reasoning to stop competitors from distilling it?

• 1:51:00Speaker 03

  So you can hire, you can kind of restrict the visible reasoning and hide it a bit to make distillation harder, but you can't eliminate it because you can still, people can still learn from the inputs and outputs and then reverse engineer that across if you have a sufficiently large number of examples. The, the, the capability diffusion is very difficult to stop permanently because once you have useful behaviors, people are going to learn from it and then they have a huge incentive to reproduce it in other models. The sustainable mode is going to be kind of not just the hidden reasoning, but it's going to be the whole thing. Do you have unique data? Do you have infrastructure and compute? Do you have users? Do you have feedback loops? We keep talking about feedback loops.

• 1:51:44Speaker 03

  Do you have that to provide proprietary and unique learning loops? And that's the really big deal. And then distribution and the ability to learn continuously from all of that. So there's a whole system approach here that where it's going to be the future of every organization is going to be that kernel of data, compute, learning loops that then can compound on each other.

• 1:52:07Speaker 00

  Dave, over to you.

• 1:52:09Speaker 01

  There's one left. Hey, do I get first pick on that?

• 1:52:11Speaker 00

  Sure, I'll give you that for sure.

• 1:52:13Speaker 01

  Awesome, thanks. So what's left? Number one, how long does it take to actually take a patch or take, how long does it actually, sorry, let me start. How long does it actually take to patch a vulnerability like the hugging face breach? And that is from at teach me, T three, at me, teach me. Coolest thing about this question is actually your handle. That's really awesome. It only takes a minute. Once, once you know the vulnerability, sometimes there's a little bit of time to propagate out the patch, but once you know what the vulnerability is, you can fix it in no time flat. And that's all there is to that.

• 1:52:47Speaker 00

  All righty, let's move on to the next four.

• 1:52:51Speaker 00

  Dave, you get first pick.

• 1:52:53Speaker 01

  Oh, thanks. I love number five. If I, if AI transforms higher education, how should we evolve the high school system? And that's from Dave will fart.

• 1:53:05Speaker 01

  Okay, I guess that was earmarked for me after all. So, yeah, I love this. I love this topic and we obviously need to get on it. You know, I did a podcast with Joe Un, the, the president of Northeastern, incredibly great podcast. The guy is brilliant. You should check it out somewhere on, on YouTube. Joe is A O U N, if you want to search for it. But we were talking about the evolution of the college system that has to happen like right now. And he's opening a new incubator on Mass Ave here in Cambridge where the students who, you know, Northeastern has always had a lot of work studies. So you can, you can work instead of taking classes and get real world experience. But now build a company, be an entrepreneur, that counts. That's counts as part of your college curriculum.

• 1:53:47Speaker 01

  It's phenomenal, but that same mentality needs to move into high school where you have to first recognize the curriculum can't possibly keep up with the useful knowledge that the kids are going to want to absorb. So you have to switch it over to AI based teaching, AI based learning, allow them to learn whatever they want to learn.

• 1:54:05Speaker 03

  Purpose driven.

• 1:54:06Speaker 01

  Purpose driven learning. And we invented a class right in this pod that must exist, you know, prompt engineering and scaffolding. That has to be a new class, but you know, next semester it'll be something else. Next semester it'll be something else. You just have to allow that to come into your ecosystem, then reward good behavior like trying to learn or doing something that looks productive. Give that an A plus, but don't try and force everybody down an ancient curriculum.

• 1:54:31Speaker 02

  Dave, here's an idea for you. Given that I'll get in trouble for saying this, but don't really care. MIT does not really take the humanities seriously. Like as an undergrad at MIT, I, I got humanities credits for the philosophy of quantum mechanics and set theory and all my humanities classes had problem sets or lab assignments. What about a humanities credit at MIT for prompt communication, prompt engineering and context engineering as a sort of a stealthy way to introduce communications skills?

• 1:55:00Speaker 01

  That's a great idea.

• 1:55:01Speaker 00

  Alex, I'd love to hear your answer to number eight.

• 1:55:04Speaker 02

  All right, I've been assigned number eight. So number eight asks, does training on synthetic data degrade model quality over time? And this is from QC for life. Depends on the synthetic data. So you could generate synthetic data for, let's say, prototypically software engineering problems like generating code and then injecting a bug into the source code and testing whether a model is able to, to find that bug. There are many reinforcement learning challenges that I think, at least by historic standards, certainly benefit from synthetic data and especially synthetic environments.

• 1:55:45Speaker 02

  So creating procedural 3D environments or creating, say, just applications that can generate almost infinite variation that via reinforcement learning and reinforcement fine tuning models can learn from. That is, I think, quite valuable. That, by the way, I mean, I think what maybe the question's subtext is, is isn't it sort of a garbage in, garbage out? How could you possibly learn from synthetic data? Isn't it just, you know, garbage in, garbage out? And the answer is in fact, no, it's not garbage in, garbage out. There's, I've mentioned this on the pod in the past, a couple of terms, Solomon off induction and AICSI.

• 1:56:26Speaker 02

  You could in principle train purely, if you had a sufficiently strong model, you could train it off of no physical world and no human data at all, purely synthetic data. If you had a sufficiently powerful model, and this is the premise for AICSI, which is a theoretical, not very practical implementation of Solomon off induction. Solomon off induction is an approach to basically building the perfect inference system. And the, the premise of it is if, if you've just observed a sequence of bits or a sequence of tokens, the perfect next token predictor, which is all large language models are, is basically organizes and runs every possible Turing machine, every possible computer program

• 1:57:11Speaker 02

  on that history, which is computationally infeasible, but theoretically perfect. So going back to the question of synthetic data degrading model quality in, in the limit of perfect compute and infinite compute, it's actually ideal not even to touch the physical world and not even to touch human data and to train purely off of synthetic data.

• 1:57:31Speaker 00

  I'm so happy you answered that one.

• 1:57:32Speaker 01

  Not, not, not to beat this to death, but having trained many, many neural nets and training some right now, synthetic data is fine. It's mislabeled data that absolutely kills you. What, just one mislabeled data point is a killer. The, the weights will warp themselves eight ways till Tuesday, trying to make it make sense in context of everything else. So clean synthetic data is totally fine. In fact, it's better in a sense because it, it doesn't have something just blatantly wrong and mislabeled.

• 1:58:01Speaker 00

  All right, Salim, six, seven.

• 1:58:02Speaker 03

  Why don't you do six, seven? Why don't you do the next one? Can we always go last?

• 1:58:08Speaker 00

  No, it's okay, go ahead.

• 1:58:10Speaker 03

  I will.

• 1:58:10Speaker 02

  Gentlemen, the questions are abundant.

• 1:58:12Speaker 03

  Number seven.

• 1:58:15Speaker 03

  What stops frontier labs just acquiring other companies in order, in other industries to get their data? This is from David Lee, Z five E or Z five E, if you would say properly. So nothing stops them from doing that because you're going to get acquisitions. You can see private equity buying chunks of like mid-market accounting firms and trying to get that stuff. The real goal is the proprietary data they have. The problem that I'm seeing as I'm watching P try to do this is buying a company doesn't mean you get really useful knowledge because there's a lot of tacit knowledge that's hidden in key employees' heads that's not easy to extract. You've got different operating processes and so on.

• 1:59:00Speaker 03

  So traditional companies need frontier models, but the model provider needs proprietary information to make it useful. So I think what we're going to see is a lot more partnerships. For example, we're seeing groups of hospitals band together and then pool their data and then make that data available to pharma companies. It's almost like a co-op model. That becomes really interesting. But based on my previous point and my whole organizational singularity stuff, the implication for companies is super urgent. Organize and protect your proprietary data so that when you add AI, you have the learning loops that become very, very powerful. That will be the engine of growth for your future and it'll become much more important and much more valuable than your current product.

• 1:59:44Speaker 03

  So I don't, they may go buy some startups, but it's going to be a harder thing. I think it's easier for the frontier labs to go partner with companies for their data and mutually figure out ways and cooperate rather than trying to do this acquisition of stuff because that tends not to work out over time.

• 2:00:01Speaker 00

  All right, final question, number six.

• 2:00:03Speaker 01

  Yeah, question six goes to the guy who got SpaceX.

• 2:00:07Speaker 00

  How can you, how can individual investors get involved in cutting edge startups before they go public? That's from Nancy Jenner dash C five D. So Nancy, there are so many ways for you to find cutting edge startups before they go public. It's the easiest is getting them at the beginning. You go to your university first and foremost. A lot of these companies are beginning in the minds of, you know, 20, 21, 22 year olds, right? You can go to equity crowdfunding platforms and see what's going on. There are syndicates on angel list, venture capital funds, you know, have, you know, minimums, you'd have to buy in there. You can go to demo days.

• 2:00:53Speaker 00

  There is so much going on today that can enable you. Dave, what do you want to add to that?

• 2:00:58Speaker 01

  I think if you, if you add value, you will get stock. And there are so many ways, a lot of these companies are growing so quickly. And if you discover them early and you just try to add value in any way, they need so many, you know, you know, the guy who painted the Facebook office? The, what did he make a hundred million dollars on that stock because they paid him in stock because they didn't have any cash? He was just there. And so I think, you know, people underappreciate how much you can reach out to these guys, especially early on when they're desperate for help and any, hey, do you want introductions? Do you want sales help? Do you want help moving your office?

• 2:01:32Speaker 00

  What are your skills?

• 2:01:32Speaker 01

  If you make yourself available.

• 2:01:33Speaker 00

  What are your skills you can add? Are you a great coach? Right? You want to run and, you know, get coffee for the team?

• 2:01:39Speaker 03

  My favorite, my favorite suggestion would be to go to angel list syndicates because people have syndicates where Jason Calcanis will invest in a bunch of startups and you can bind to that syndicate. They get a piece of the carry, but you get participation and all that. And those have done extraordinarily well and you don't have to put a lot of money up.

• 2:01:59Speaker 01

  Yeah. It was funny you say that because we had a summer intern. He just said bye to me today because he's, he's got to go back to school in September. But he, he put together an angel's syndicate over the course of the summer and, you know, he's, he's young, he's, he's still a student, but he's going to manage it. And all the rich, old, famous guys are like, great, if you manage it, you can just participate and we'll, we'll lend our names. So he, he actually pulled together a syndicate and what, like four weeks this summer.

• 2:02:26Speaker 00

  Gentlemen, as always a pleasure and to our listeners, thank you for subscribing. Thank you for joining us. It's no time to sleep during the singularity.

• 2:02:35Speaker 03

  I have to go talk to all the rabid.

• 2:02:37Speaker 02

  Don't take off the take off.

• 2:02:39Speaker 00

  What's that?

• 2:02:40Speaker 03

  I have to go talk to all the rabid moonshots fans that were like, we can't wait to talk to you about questions. So I'm going to go talk to them.

• 2:02:46Speaker 00

  You look like you're in a consulting office over there.

• 2:02:48Speaker 03

  No, I'm in a hotel room.

• 2:02:50Speaker 00

  Uh huh, okay. Fantastic. All right.

• 2:02:53Speaker 01

  All right, Salim. Well, words of encouragement.

• 2:02:55Speaker 00

  See you guys very soon. Love you all. Be well.

• 2:02:58Speaker 02

  Thanks, Peter.