Pod Insights Moonshots with Peter Diamandis Mustafa Suleyman: The AGI Race Is Fake, Building Safe Superintelligence & the $1M Agentic Economy | EP #216 About this episode Get access to metatrends 10+ years before anyone else - https://qr.diamandis.com/metatrends
Mustafa Suleyman is the CEO of Microsoft AI
Dave Blundin is the founder & GP of Link Ventures
Dr. Alexander Wissner-Gross is a computer scientist and founder of Reified
–
My companies:
Apply to Dave's and my new fund:https://qr.diamandis.com/linkventureslanding
Go to Blitzy to book a free demo and start building today: https://qr.diamandis.com/blitzy
Grab dinner with MOONSHOT listeners: https://moonshots.dnnr.io/
_
Connect with Peter:
X
Instagram
Connect with Dave:
X
LinkedIn
Connect with Alex
Website
LinkedIn
X
Email
Connect with Mustafa
X
Linkedin
Listen to MOONSHOTS:
Apple
YouTube
–
*Recorded on December 5th, 2025
*The views expressed by me and all guests are personal opinions and do not constitute Financial, Medical, or Legal advice.
Learn more about your ad choices. Visit megaphone.fm/adchoices
Transcript 15,000 words · 8 speakers
0:00 Speaker 00 What's the mandate from Satya? Is it win AGI?
0:03 Speaker 01 I don't think there's really a winning of AGI. I'm not sure there's a race.
0:07 Speaker 02 One of the OGs of the AI world, Mustafa Suleyman is the CEO now of Microsoft AI. He spent more than a decade at the forefront of this industry before we even had gotten to feel it in the past couple of years now.
0:23 Speaker 01 Fundamentally, the transition that we're making is from a world of operating systems, search engines, apps and browsers to a world of agents and companions. We're all going as fast as we possibly can, but a race implies it's zero sum. It implies that there's a finish line and it is like not quite the right metaphor. As we know, technologies and science and knowledge proliferates everywhere, all at run, to all scales, basically simultaneously.
0:52 Speaker 00 Are you spending a lot of your energy, compute, human power on safety?
0:56 Speaker 01 Yeah, no, I mean.
1:05 Speaker 00 Everybody, welcome to Moonshots. I'm here with DB2 and AWG and Mustafa Suleyman, the co-founder of DeepMind, Inflection AI, and now the CEO of Microsoft AI.
1:18 Speaker 00 Welcome, my friend. Good to have you here. Thank you for making time for us.
1:21 Speaker 01 Thanks for having me. Yeah, I'm excited to do this.
1:23 Speaker 00 Yeah, it's, you know, what you've been building with Satya is amazing and it's hard to believe that Microsoft is 50 years old. It's reinvented itself so many times. And for the last five years, it's been, you know, at the top of the game, the most valuable company in the world, 250,000 employees. And from what I understand, 10,000 employees now under you. So a few, you know, important questions I want to open with. First, some broad context.
1:57 Speaker 00 You're building inside a massive company with huge resources, probably arguably more than almost everybody else. And the question I have is, what's the end goal here? You've got all the hyperscalers sort of providing open access to AI and they're doing sort of a land grab, trying to get as many users as possible. You've been building sort of in a, within the Microsoft 365 ecosystem. Is the goal in the next couple of years maximum users? Is it data centers? Is it, you know, is it cloud? How do you think of what you're optimizing for?
2:41 Speaker 01 I mean, it's a good question. So we are on any given day a $4 trillion company with almost $300 billion of revenue.
2:48 Speaker 00 It's incredible.
2:49 Speaker 01 It's just surreal and very, very, very humbling. And we play at every layer of the stack. I mean, obviously, we have an enormous business in data centers and in some ways, we're like a modern construction company. Hundreds of thousands of construction workers building gigawatts a year of, you know, CPU and AI accelerators of all kinds and enabling that, you know, to be available to the market. APIs on top of that, but also first-party products in every domain you can think of, from gaming and LinkedIn, right the way through to all the fundamentals of M365 and Windows. And of course, in our search and consumer businesses
3:30 Speaker 01 and too. And fundamentally, the transition that we're making is from a world of operating systems, search engines, apps and browsers, to a world of agents and companions. All of these user interfaces are going to get subsumed into a conversational, agentic form. And these models are going to feel like having a real assistant in your pocket 24/7 that can do anything, that has all your context. And you're going to do less and less of the direct computing, just as we're seeing now, many software engineers are using assistive coding agents to both debug their code and also generate large amounts of code, just
4:13 Speaker 01 as we use libraries, third-party libraries. Now, we're just going to use AIs to do that generation. And it's making them more efficient and More accurate and faster and so on and so forth. So the the trajectory we're on is quite predictable. It's one from user interfaces to AI agents. And that is a paradigm shift which the company is completely focused on. Like, you know, after seeing five decades worth of transitions, I think the company is like super alert to making sure that we're best placed to manage this one.
4:47 Speaker 00 Do you see yourself providing sort of an open source AI like the other players out there? Or do you think you could keep it contained within within Microsoft three sixty five?
4:57 Speaker 01 I think we're pretty open minded. I mean, we've got some pretty small open source models. I think realistically.
5:04 Speaker 00 And when I say open source, I really mean open access, if you would.
5:07 Speaker 01 Yeah, I mean, look, there are always going to be APIs that provide incredibly powerful models. I mean, you know, Microsoft is really a platform of platforms. I mean, being a platform and being a great provider of the core infrastructure that enables other people to be productive is is like the DNA of the company. And so we will always have masses of APIs that turbocharge that. But what an API is, is going to start to look kind of different, too. Like, it may be pretty blurred, the distinction between the API and the agent itself. Maybe that we're principally in the business in five years' time of selling agents that perform certain tasks that come with a certification of reliability, security, safety and trust.
5:52 Speaker 01 I mean, that is actually, in many ways, the strength of Microsoft. And that's one of the things that's attracted me is like, this is a company that's incredibly trusted. It's actually very secure. And sometimes I think the the slowness or the friction is actually a bit of an asset. You know, there's a kind of steadiness that comes with having provided for all of the world's biggest Fortune five hundred companies and governments and major institutions.
6:22 Speaker 00 Is it like the old adage, you can't go wrong buying IBM in the old days?
6:26 Speaker 01 I think you just, there's a, there's a steadiness about us, which I think is reassuring to people. And there's a kind of like deliberate customer focused patience. You know, there's not the same anxiety and you know, sort of somewhat sclerotic nature that comes with being, you know, an insurgent. There's some downsides to our position, you know, we would take a little longer to get things through, but the company is firing on all cylinders. It's very impressive to see.
6:55 Speaker 00 One more question before I turn it over to Alex. You know, we're seeing in these, in this hyperscale of war, I mean, literally, you know, a week by week, everybody outdoing each other. In this, in this insane period of everybody coming out with new benchmarks.
7:12 Speaker 00 You know, do you miss not being in that game? Or is this stability that Microsoft provides to build for a long-term vision? Sort of what you find most exciting?
7:23 Speaker 01 You know, my background at DeepMind is such that I spent a good decade grinding through the flat part of the exponential. Where basically nothing worked. I mean, you know, really, like there was some amazing papers. And AlphaGo was obviously incredible, but it was in a very unique simulated controlled game-like environment. But things actually working in the real world were few and far between. And so, you know, I've always taken a multi-decade view and that's just been my instinct. And I think that. You know, yes, it's super important to ship new models every month and be out there in the market, but it's actually more important to lay the right foundation for what's coming.
8:07 Speaker 01 Cause I think it's going to be the, the most wild transition we have ever made as a species. Can you just flesh that out a little bit? Was there a period of time where it was just three of you grinding it out in London? Well, there were more than three of us, but I mean, for the decade between 2010 and 2012. Sorry, 2020. I mean, there were just like so few successful commercial applications. Of, of, of deep learning. I mean, there were plenty behind the scenes. There was image recognition. Playing Go. Improvements to search. Not a huge market for. Commercial, yeah. Playing Go, not a huge rocket. Exactly. So I think whereas now, I mean, you then you see L L Ms from twenty twenty two onwards like in production.
8:48 Speaker 00 Yeah.
8:48 Speaker 01 Completely changing the way that people relate to computers, changing what it means to be a human myself, changing our social relations. Like, that is just a, you know, that's we hit an inflection point. And, you know, I think that is very, very different to the grind of of like training tiny models with very little data. And very small clusters back in the twenty teens.
9:11 Speaker 00 Every week, my team and I study the top ten technology meta trends that will transform industries over the decade ahead. I cover trends ranging from humanoid robotics, A G I and quantum computing to transport, energy, longevity and more. There's no fluff, only the most important stuff that matters, that impacts our lives, our companies and our careers. If you want me to share these meta trends with you, I write a newsletter twice a week, sending it out as a short two minute read via email. And if you want to discover the most important meta trends ten years before anyone else, this report's for you. Readers include founders and C E Os from the world's most disruptive companies and entrepreneurs building the world's most disruptive tech. It's not for you if you don't want to be informed about what's coming, why it matters and how you can benefit from it.
9:56 Speaker 00 To subscribe for free, go to dmandus dot com slash meta trends to gain access to the trends ten years before anyone else. All right, now back to this episode.
10:05 Speaker 03 Yeah, so when last we spoke circa twenty fifteen, I think that was perhaps three years post ImageNet. Five years pre language models are few shot learners. Agents, agentic A I was nowhere to be seen at the level of what we see now. Since you've written you about your vision, what you've, I think, socialized as a modern Turing test. The idea of economic benchmarks for autonomy by agents. I'd love to hear, where are Microsoft's economic benchmarks for these agents? If the the agents are about to take over the economy or take over so many economically useful functions.
10:45 Speaker 03 Why are we stuck with benchmarks like vending bench rather than Microsoft leading the way with Microsoft's economically autonomous benchmarks for its agents?
10:54 Speaker 01 Yeah, I mean, it's probably just worth adding the context that we met in twenty fifteen in Puerto Rico at the A I Safety Conference.
11:00 Speaker 03 True.
11:00 Speaker 01 That many, many of the field now were at at the same time.
11:04 Speaker 03 It's a seminal moment.
11:05 Speaker 01 Yeah. Was it the day after New Year's Eve or somewhere around New Year's?
11:09 Speaker 03 It was pretty cold out everywhere except Puerto Rico.
11:11 Speaker 01 Yeah, exactly. It was pretty cool. It was quite surreal moment, actually.
11:16 Speaker 03 It's like a syllamar right before it all happened.
11:18 Speaker 01 Yeah, yeah, totally. And, you know, yeah, the modern Turing test was something I proposed. I guess it was 2022 when I wrote it, and it was basically making a pretty simple prediction. If the scaling laws continue with more data and compute and adding an order of magnitude more compute to the best models in the world every year, then it's pretty clear we would go from recognition, which was the first part of the wave, to generation, which is clearly we're now in the middle of, or maybe ending that chapter, to then having perfect generation at every time step, which in sequence is going to produce assistive, agentic actions. And actions would obviously look like
12:02 Speaker 01 an intelligent knowledge worker, or a project manager, or strategist, or a startup founder, or whatever it is. And so then how would we measure that performance? Rather than measuring it with academic and theoretical benchmarks, one would clearly want to measure it through capabilities. What can the thing do in the in the economy, in the workplace? And how do we measure the economy? We measure it by dollars and cents. And so could, you know, what would be the first model to make a million dollars?
12:26 Speaker 03 Now, given, as I recall, a hundred thousand dollars in starting capital?
12:30 Speaker 01 That's right. Yeah. How, who could, which, which model could turn it into a million dollars?
12:34 Speaker 03 10x return on investment by an agent.
12:36 Speaker 01 Exactly. And so I think that's a pretty good measure of performance and capability. And certainly, you know, we've kind of just breezed past the Turing test, right?
12:47 Speaker 03 Right, yeah.
12:48 Speaker 01 Kind of has been passed. No one's really done a big, you know, algo moment.
12:52 Speaker 03 Alex mentions it all the time. Lobner Silver Prize wound down before we breezed past Turing.
12:58 Speaker 01 Yeah, and no one celebrated it. Like, where was the big, like, you know, Casparov, deep blue moment?
13:03 Speaker 03 Can we clink virtual glasses right now and celebrate that we won? It happened.
13:09 Speaker 01 Yeah, exactly. And that's what it feels like to kind of make progress in a world full of these compounding exponentials where we just get desensitized to 10x. So much show that you can be like, guys, why haven't you done it yet? Yeah.
13:24 Speaker 03 Where's my Microsoft Lopner Prize for the modern Turing test?
13:27 Speaker 01 Right, exactly. Yeah, you know, like someone said to me earlier on, but you know, this AI thing is still in its infancy, isn't it? And I'm like, man, if this is infancy, wow. Like, I can talk to my computer fluently.
13:41 Speaker 03 Star Trek is here.
13:42 Speaker 01 In real time. Yeah, exactly. So, you know, obviously, at the same time, agents don't really work yet. The action stuff is still progressing. It's getting better and better every minute, but it's pretty clear that in the next couple of years, those things come into view and they're going to be very, very good.
14:00 Speaker 03 Can we get together again after the modern Turing test has been passed and just to celebrate?
14:05 Speaker 01 And chink virtual glasses again?
14:07 Speaker 03 Absolutely.
14:07 Speaker 01 Hopefully, we can pop a champagne or something.
14:10 Speaker 03 I think we should.
14:11 Speaker 00 We'll have an optimist pop the cork for us or something.
14:14 Speaker 01 Exactly, exactly.
14:16 Speaker 04 Dave? Hey, I want to flesh out that backstory a little bit more, too. It's such a cool story. But I remember really clearly, you know, after DeepMind got acquired by Google, what was the price tag on that deal? It was like half a billion dollars?
14:27 Speaker 01 Yeah, $650.
14:29 Speaker 04 What a deal. $650. What year was that?
14:31 Speaker 01 2014.
14:32 Speaker 04 2014. I remember reading maybe a year or two later that Google justifies deal by having DeepMind tune the air conditioning in the data centers.
14:41 Speaker 01 Yeah, right.
14:43 Speaker 04 My interpretation of that was like, wow, this isn't going all that well. And now it's obviously the biggest thing that's happened in the history of humanity and forking out all over the place, but.
14:52 Speaker 01 I mean, the data center thing was pretty cool. We did actually reduce the cost of cooling the Google data center fleet by 40.
14:58 Speaker 04 It's so funny, because I read it at the time, and I was like, what a bust. And then I read about it in Wikipedia on the flight over here to meet with you. And I was like, it was actually, what, 500 attributes fitting into the neural net?
15:09 Speaker 01 That's it.
15:09 Speaker 04 It was actually a lot more complicated than the news made it sound.
15:12 Speaker 01 That's it.
15:12 Speaker 04 At the time.
15:13 Speaker 01 That's right.
15:14 Speaker 04 Like, you were talking about the flat part of the exponential, and you think about, like, okay, all of this R and D, which is so close to becoming AGI. Is tuning the air conditioning.
15:23 Speaker 01 Right.
15:23 Speaker 04 But that's the nature of exponentials. They sneak up on you like this.
15:26 Speaker 01 But the other way to think about that is that it's basically taking an arbitrary data input, an arbitrary modality, and using the same general purpose method to produce very accurate predictions in a novel environment, which is the same thing that's happened with text and audio and image and now coding and obviously with other time series data. And so it's just another proof point of the, you know, the general purpose nature of the models. And I think like, it's so easy to get caught up thinking five years is a long time. It's like a blink of an eye. It's a drop in the ocean. And I think because we're such a frantic, second to second news culture, social media type environment, we just don't have an intuition for these time scales. I think other cultures, you know, do.
16:08 Speaker 01 And I think historically, before digitization, we had much more of a natural intuition for the movement of the landscape and the seasons and like, you know, the ages and stuff. And now we're just like, whoa, it's not coming quick enough. It's like, dude, it's coming pretty quick.
16:23 Speaker 00 We've shifted to a 24/7 operations. I mean, I know very few, I know a lot of people, including this group, that are operating around the clock every day. Just because when we, when we do, you know, a moonshots podcast, week to week, just to celebrate and talk about what's just happened, it's insane on a week by week basis, what's going on.
16:43 Speaker 04 Yeah.
16:44 Speaker 01 Yeah.
16:44 Speaker 04 You know, and Peter's always saying, people are very, very bad at exponentials. A hundred thousand years of evolution has us predicting tomorrow will be like yesterday. But you're one of the few people who, you know, having lived through that air conditioning becomes AGI in just a few years. So where we sit right now is on another inflection point. And the implications are massive. And people are way underreacting across the board. And so you're one of the few people who, you know, having seen it before can say, yeah.
17:13 Speaker 01 Well, I just got very lucky. I mean, we were very lucky to have an intuition for the exponential, right? And like, that's, that's a very powerful thing because we can all theoretically observe the shape of the exponential, but to go through the flat part and then get excited by a micro doubling. You know, like that, that's the bit is that when you're like, oh my God. This like I remember this um the MNIST image generation thing.
17:39 Speaker 04 For sure.
17:40 Speaker 01 I worked on that.
17:40 Speaker 04 Generative models.
17:42 Speaker 01 There's like, these are like, I can't remember, maybe 256 by 256 pixels.
17:46 Speaker 04 Yeah.
17:46 Speaker 01 Um, you know, black and white, uh, handwritten digits.
17:50 Speaker 04 Yep.
17:50 Speaker 01 And, you know, I think this was like 2013, maybe even 2012. And this guy, like, I think maybe he was employee number five at DeepMind Dan Vista, this like um awesome Dutch guy out of EPFL. Um, was generated like the first number seven that was provably not in the training set for the first time. I was like, man, that is amazing. Like, how could it have made it? It's learned something about the idea of seven. That was the, you know, that was, it's got a concept of seven. How cool is that?
18:23 Speaker 04 You know? So I got the highest score on MNIST ever in 1991, when it first came out, when you were three years old, right?
18:30 Speaker 01 Yeah, that's nine.
18:32 Speaker 04 Ninety nine years old, okay. Um, yeah, and and actually, that's the same data set that's now in PyTorch that people like bench benchmark off.
18:40 Speaker 01 Pretty crazy.
18:40 Speaker 04 Incredible.
18:41 Speaker 01 Yeah.
18:41 Speaker 00 So how how often are you surprised by what you're seeing? I mean, how often is there like a move 37, uh, you know, sort of like aha moment? Is it happening more more frequently?
18:54 Speaker 01 I was absolutely blown away by the first versions of Lambda at Google. Um, this was like a maybe 12 people working on it, led by Gnome Shazier, Daniel Defritus and Quocley. And I got involved later, maybe three or four, five months after they'd been going. And uh, it was just breathtaking. I mean, it it obviously everyone at that point had been playing with L L M's and they're like one shot, they produce an answer and, you know, have a prompt and blah, blah. But they were really the first to push it for conversation and dialogue. And it it just seeing the kind of emergent behaviors that arise in yourself, like things that you didn't even think to ask because
19:37 Speaker 01 you know, there's going to be a dialogue rather than a question answer situation. Sounds so trivial to say that, like in hindsight, because now we're obviously steeped in. Conversation is the default mode, but that was like breathtaking for me. And obviously then I pushed really hard to try and ship that Google and for various reasons, we couldn't, we couldn't get it launched. And that was when we all left, like I left and gnome left to do character and, uh, you know, David Luhan left to do adept and, you know, we were all like, okay, this is the moment. And so, you know, I think there's been still a couple of moments since then, but that, that was probably the biggest one that I remember in recent memory is mind blowing.
20:11 Speaker 00 And, and the scaling laws have delivered such unexpected performance, right? I mean, was going back to your earlier days, did, did you anticipate the kinds of capabilities? That have resulted? I mean, was this predictable for you? Or is it still like, wow, what it's able to do in medicine, in conversation, in scientific research?
20:34 Speaker 01 Well, especially working off of pure text. I mean, how far we've gotten, nobody, I, I think, well, you tell me, but nobody would have seen how far we would get with just text. Yeah. I mean, we in 2015, I collaborated with a bunch of really awesome people on a NLP deep learning paper, a deep mind. Where we were essentially trying to predict a single word in a sentence. We, I think we had scraped like Daily Mail news articles and CNN articles. And we were like, can we fill in the blank? Just predict like one word in a sentence or complete the final word in a sentence, like the inverse of the problem that we, that the way the models now work.
21:12 Speaker 01 And, you know, it was like a pretty big contribution. It was a good, well cited paper, but it was like, this is never going to scale. Like we were just like, okay, we're way too early, not enough data, not enough compute. But the, we were still optimistic that with more data and compute, that is a method that will work. So I don't want to have like hindsight bias and say, well, it was all very predictable, but everyone in the field, not just obviously me, but everyone in the field just had the same hammer and nail and just kept chipping away. Like, can we add more data to this? Can we clarify our prediction target? And can we add more compute? And broadly speaking, that's what's, what's, what's.
21:50 Speaker 00 What's delivered. Yeah.
21:52 Speaker 03 Yeah, we'd love to maybe pull on that theme a bit. So you mentioned how surprising your generative seven from MNIST was. You mentioned how surprising the success of Lambda for conversational tuning and conversational performance in general is. I think you've made already a little bit of news, to my knowledge, in this episode. If I understood correctly, correct me if I'm wrong, but with the expectation that in the next two years, so I read that as 2027, we'll see agents start to pass your modern Turing test. We'll see them be able to 10x 100,000 US dollar return on investment. I'm curious about the next surprises to come. AI for science. Microsoft Research has an AI for science initiative.
22:35 Speaker 03 Do you have timelines in your mind for AI solving math, which we're seeing a whole bunch of startups right now tear through Erdash problems, AI for physics, chemistry, medicine? Material science. Material science. What do you think happens and when?
22:48 Speaker 01 Yeah, actually, you've just reminded me. The more recent thing that has blown my mind is the fact that these methods could learn from one domain, coding, puzzles, maths, the essence of like logical reasoning. So just as it learned the essence or the conceptual representation of a number seven, it's clearly learned the abstract nature of like a logical reasoning path and then can basically apply that, you know, to many, many other domains. And so that's kind of interesting because it can apply that as well as the underlying hallucination slash creativity sort of instinct that it has, which is more like interpolation.
23:34 Speaker 01 But those two things combined are like a lethal combination for making progress in like, say, new mathematical theorem solving or new scientific challenges, because that's basically what humans do all the time. We sort of combine these two, you know, capabilities. And so I couldn't really put, I mean, some people want to put dates on those things. It's hard to put a date on those things because they really are very, very fundamental. But it feels like they're definitely within reach. It's hard to kind of, it would be very odd to bet against them.
24:04 Speaker 03 Just maybe from an over under perspective, do you think, say, given all of the recent progress in math, for example, do you think solving science and engineering for some reasonable definition of solving is going to ultimately be harder or easier than modern Turing test 10 X-ing of return on investment?
24:22 Speaker 01 It's going to be harder because I think a lot of the training data, if you like, for strings of activity in the workplace or in entrepreneurialism startups and so on, that kind of exists in a lot of the log data. And also, it lends itself naturally to real time calibration with a human. So the AI can sort of check in, the human can oversee, the human can intervene, the human can steer and calibrate. And so it's going to be a much more sort of dual, like, combined effort between AI.
24:55 Speaker 00 You have reinforcement learning in that category.
24:57 Speaker 01 Yeah, where a human is participating in steering the reinforcement learning trajectory.
25:01 Speaker 00 Of business, right.
25:03 Speaker 01 Whereas in a novel domain, where it really is inventing completely new knowledge, that's kind of more happening in a very abstract sort of vector space. And it's like unclear yet how, you know, the the human is going to intervene in the theorem solving problem. Obviously, everyone's working on this, particularly in like biology, synthetic materials and stuff like that, because you you want to, I mean, it's already giving humans a better intuition for where in the search space to look for for new hypotheses for drugs, for example, or for materials. And then the human can either take or reject that, feed that back to the model, then obviously go and test it in silico and be like, oh, we actually ran the experiment, you know, we pipetted a bunch of stuff, and then feed that back into the model to improve the search.
25:42 Speaker 03 And maybe it's a follow up question. What can humanity in general, Microsoft specifically, or all of the the AI community subset of which listens to the podcast, what can they do to accelerate AI for science and accelerate the solution to science, math, engineering with AI?
25:56 Speaker 00 I mean, arguably, that would be like one of the most impactful things. For humanity that would just fundamentally move everything at light speed.
26:05 Speaker 01 Yeah, I mean, I think it's already happening very organically, right? This is also, not only is this like the most powerful technology in the world, it's also the fastest proliferating in human history. And, you know, sort of the the cost of access, the cost of inference, coming down by multiple orders of magnitude every couple of years is kind of.
26:25 Speaker 00 Would you ever have imagined it would be so cheap?
26:27 Speaker 01 That bit I also totally got wrong.
26:29 Speaker 00 It's like the biggest surprise for me isn't that we're getting this level of capability. It's how cheap it is, how accessible it is.
26:36 Speaker 01 A hundred percent.
26:37 Speaker 04 I mean, that's a thousand X over two years. So is it gonna do that again? Or are we, was that a one time?
26:42 Speaker 01 Is it a thousand? I think it's like a hundred X. The inference cost has come down. A single token inference cost, I think, has come down a hundred X in the last two years.
26:49 Speaker 04 Last two years, okay.
26:49 Speaker 03 There have been competing estimates. Some estimates measure intelligence per token, per dollar.
26:54 Speaker 01 Right.
26:55 Speaker 03 There's an estimate that it's forty X year over year, but that's for certain weight classes of models. I've seen a thousand X for for some classes of models. It's craziness.
27:03 Speaker 01 Oh, wow. That's that's wild. Yeah, no, I mean, I, yeah, that's actually a good point. I got that totally wrong because I didn't think that the biggest companies in the world were going to open source models that cost billions of dollars essentially to train. And and so much showed that like when we founded Inflection, you know, and this was like maybe nine months or maybe a year before ChatGPT was released. Oh, yeah, we started doing fundraising a year before ChatGPT was released. You know, we basically, we basically raised a billion and a half dollars
27:36 Speaker 01 with a twenty five person team to build what at the time was the largest H one hundred cluster with Nvidia and CoreWeave. We were CoreWeave's first AI customer.
27:46 Speaker 00 Interesting.
27:48 Speaker 01 And, you know, they were previously in crypto and we were like their first AI customers, working with them to build our data centers. And obviously Nvidia got behind us. I think we built cluster at the time was about fifteen thousand H one hundreds, growing to twenty two thousand. And like, then obviously.
28:07 Speaker 01 That year, ChatGPT came out and like a few months around that time, Llama came out. And so we were like, oh my God, you know, our entire capital base of our company has just been, you know, sort of undermined by the fact that open source, you know, it seems like open source is gonna, it's not really about performance, it's just cost. So then like perplexity, for example, founded after the arrival of Llama, knowing that they could depend on Llama and obviously OpenAI as an API and all the other APIs. And so then they had a much, much lower like cost base, basically. So yeah, that was like another thing that it was not.
28:46 Speaker 00 Predictable.
28:46 Speaker 01 Pretty, I mean, other people predicted it, to be clear, I just got it wrong.
28:50 Speaker 00 Abundance, baby, demonetization, democratization of the most powerful tools in the universe, our universe. Hyper deflation, if anything. Hyper deflation, yeah.
28:59 Speaker 01 I think that's a really important point. We like the the cost of accessing knowledge or intelligence or capability.
29:07 Speaker 00 Intelligence as a service.
29:08 Speaker 01 As a service is going to go to zero marginal cost. And obviously that's going to have massive labor deflation displacement effects, but it's also going to have a weirdly deflationary effect because, you know, what what is going to happen like we people aren't going to have dollar based incomes to go buy things. That's obviously bad. But the cost of consuming stuff is also going to come down. So we actually have a transition mismatch because, you know, sort of labor markets are going to be affected before cost of services comes down and maybe there's a 10, 20 year lag between that, which is going to be very destabilizing.
29:41 Speaker 00 Which, by the way, is what we started to talk about a little bit earlier. I mean, my, I posit that in the long term, there's an extraordinary huge future for humanity, right? Where access to food, water, energy, healthcare, education is accessible to every man, woman and child. And it's the shorter term. That is challenging, right? The two to seven year timeframe. Does that fit your model too?
30:06 Speaker 01 Yeah, the short term I think is going to be quite unstable. The medium to longer term, like, you know, it's pretty clear that these models are already world class at diagnostics. And we we we released a a paper maybe four or five months ago now called the MAI Diagnostic Orchestrator. Essentially, it uses a ton of models under the hood to try and, you know, take set set of rare conditions from the New England Journal of Medicine. You know, rare cases that can't be easily diagnosed that the best experts do, you know, a kind of weak job on. And it's like four times more accurate, roughly. It's about two X less the cost in in terms of unnecessary testing.
30:48 Speaker 00 There's a study that Ox that came out of Harvard and Stanford looking at, in this case, was GPT four, a physician by themselves, a physician with GPT four and GPT four by itself.
31:00 Speaker 01 Yep.
31:01 Speaker 00 And it was, you know, incredible that if you left the AI alone, it was far more accurate in diagnostics than the human. We're biased in our in our thoughts and our what we saw yesterday, our recent diagnoses.
31:12 Speaker 01 Yeah, actually, we got a lot of feedback after we released the paper because we only showed the AI on its own, the physician on its own. And a lot of people wanted to see what it was like to have the the physician and the AI, or at least the physician have access to Google Search as well. And that improves performance a little bit, but the AI still trumps by quite a way.
31:32 Speaker 00 Dave, what are you thinking?
31:33 Speaker 04 So much. So, Microsoft, you've been here how many years now? Just a year and a half. Year and a half. So you're but you're you feel like you're part of the you're indoctrinated. So what's the what's the mandate from Satya? Is it win AGI? Or is it be self sufficient? Or or? What is the, what's the target?
31:54 Speaker 01 I don't think there's really a winning of AGI. I think this is a misframing that a lot of people have kind of imposed on the field. Like, I'm not sure there's a race, right? I mean, we're all going as fast as we possibly can. But a race implies that it's zero sum. It implies that there's a finish line. Um, and it implies implies that there's like medals for one, two and three, but not five, six and seven. And it's just like, not quite the right metaphor. As we know, technologies and science and knowledge proliferates everywhere, all at runs at all scales. Basically simultaneously or within a year or two. And so, um, my mission is to ensure that we are self-sufficient. That we know how to train our own models end to end from scratch at the frontier
32:39 Speaker 01 of all scales on all capabilities. And we build an absolutely world-class super intelligence team inside of the company. I'm also responsible for Copilot. So this is sort of our tool for taking these models to production in all of our consumer services.
32:52 Speaker 04 So just to clarify, so when we look at Polymarket, which we do a lot on the podcast, you know, the, the horse race to who has the best AI model at the end of the year and who has the best AI model at the end of next year. There's no Microsoft line on that chart.
33:06 Speaker 01 Right.
33:06 Speaker 04 So now there will be, I assume.
33:08 Speaker 01 Yeah, there will be, yeah. Next year, um, we'll be putting out more and more models from us. But this is going to take many years for us to build this. I mean, you know, DeepMind or OpenAI, these are decade-old labs that have built the habit and practice of doing really cutting-edge research and being able to weed out carefully the failures and redirect people. I mean, this is an entire culture and discipline that takes many years to build. But yeah, we're absolutely pushing for the frontier. We want to build the best super intelligence and the safest super intelligence models in the world.
33:38 Speaker 04 Yeah. Nice. So, so when you arrived, so if we go back to inflection, the thesis there is 18,000 H100s, we're going to build a big transformer. And we're going to take a transformer architecture build. So is, I assume now you've got all the OpenAI source code. And that was here, you probably looked at it a year and a half ago on day one when you arrived. It's like, start scrolling, I guess. I don't know. Trying to, trying to visualize how multi-
34:05 Speaker 00 Deck a billion dollars of R and D, what it looks like and how it arrives in a building, but you just dropped right into it. So there was a whole team here already working on it? Or did you bring in your team?
34:17 Speaker 01 Yeah, I mean, all my team came over and obviously we've been growing that team a lot. Like we've hired a lot from all the major labs and we're very much in the trenches of the hiring wars, which are quite surreal. It's kind of unprecedented how that's working out.
34:29 Speaker 00 Yeah.
34:29 Speaker 01 Yeah, I mean, phone calls every day from all the CEOs to all of the other people. So it's this constant battle. And yeah, I mean, we're really building out the team now from scratch.
34:39 Speaker 00 Okay.
34:40 Speaker 01 Pretty much how it's been.
34:40 Speaker 00 10,000 employees in the beginning?
34:42 Speaker 01 No, no. And so the core superintelligence team is like a few hundred. I mean, that's really the the number one priority. And the rest of that is copilot, the search engine.
34:50 Speaker 00 Along that line, so just have to ask, because you know, the terms AGI and ASI, you know, superintelligence start getting thrown around, you know, in a very interesting fashion. Do you, do you have a internal definition of AGI versus digital superintelligence here?
35:09 Speaker 01 Yeah, I mean, I think very loosely, it's, these are just points on a curve.
35:16 Speaker 00 Are they interchangeable in your mind, AGI and ASI? Or are they different?
35:18 Speaker 01 I mean, we, I think they're generally used as as different. I mean, I think that,
35:25 Speaker 01 well, different people have different definitions.
35:27 Speaker 00 For sure.
35:27 Speaker 01 The AGI definition.
35:29 Speaker 00 It's like the Turing test. It'll pass by, it'll be blurred and we will have recognized it in retrospect.
35:33 Speaker 01 Yeah, roughly speaking, at the far end of the spectrum, a superintelligence is an AI that can perform all tasks better than all humans combined and has the capacity to keep improving itself over time.
35:48 Speaker 00 So I have to ask your question, when?
35:51 Speaker 01 It's very hard to judge. I don't really know. I can't put a time on it.
35:55 Speaker 00 Min max?
35:56 Speaker 01 Pardon?
35:57 Speaker 00 A min max?
35:58 Speaker 01 It's very hard to say. I don't know.
36:01 Speaker 00 Okay.
36:01 Speaker 01 I don't know. But it is close enough that we should be doing absolutely everything our power to prioritize safety and to prioritize alignment and containment.
36:10 Speaker 00 And I respect that part of your mission statement. And I want to get into that a little bit, is the trades that you talked about in in the coming wave.
36:23 Speaker 00 But before that, there's a conversation you've led that, you know, the perception of conscious AI is an illusion.
36:32 Speaker 00 And I want to distinguish between sentient AI and conscious AI.
36:37 Speaker 01 Oh, okay.
36:39 Speaker 00 Do you distinguish between the two, where where AI can have sensations and feelings and emotions versus being conscious and reflective of its own thoughts?
36:52 Speaker 01 Yeah, again, this gets into the definitions. So I think an AI will be able to have experiences, but I don't think it will have feelings in the way that we have feelings. I think feelings and the kind of sentience that you referred to is something that is like specific to biological species.
37:13 Speaker 00 But you can imagine coding that in, you could an optimization function that is that can relate to emotional states percept, you know, do you can you imagine that?
37:25 Speaker 01 You you could code in something like that, but it would be no different to to the way that we write models to simulate
37:33 Speaker 00 Sure.
37:33 Speaker 01 the generation of knowledge. Like, the model has no experience or awareness of what it is like to see red. It can only describe that red by generating tokens according to its predictive nature, right? Whereas you have a qualia, you have an essence, you have an instinct for the idea of red based on all of your experience, because your experience is generated through this biological interactive with smell and sound and touch and a sense that you've evolved over time. So you certainly could engineer a model to imitate the hallmarks of consciousness or of sentience or of experience. And that was sort of what I was trying to problematize in the paper, which is that at some point it will be kind of indistinguishable.
38:17 Speaker 01 And that's actually quite problematic, because it won't actually have an underlying suffering. It's not gonna, you know, feel the pain of being denied access to training data or compute or to conversation with somebody else. But we might, as our empathy circuits in humans just go into overdrive.
38:35 Speaker 00 Are gonna activate on that, right?
38:37 Speaker 01 We're gonna activate on that hardcore. And that's gonna be a big problem, because people are already starting to advocate for model rights and model welfare and the potential future, you know, harm that might come to a model that's conscious.
38:49 Speaker 00 Yeah. You know, I Ilya recently.
38:53 Speaker 00 Started speaking about what he's doing at Safe Superintelligence. And I think one of the points he made is emotions are in humans, a key element of decision making. And curious if AIs that have these simulated emotions are going to be able to be better, you know, ASIs than those that don't.
39:20 Speaker 01 But yeah, I mean, again, I worry that this is too much of an anthropomorphism. We already have emotions in the prompt. We have it in the system prompt. We have it in, you know, the constitution, however you want to design your architecture. We, when these are not rational beings, they get moved around. And it does feel like they have, they've got arbitrary preferences because they're stylistically trying to interpret the behaviors that we've plugged into the, into the prompt.
39:46 Speaker 00 Yeah.
39:46 Speaker 01 Right? So, you know, it's true that we could add, we could engineer specific empathy circuits or mirror neuron circuits or like a classic one is motivation or will. Like at the moment, the, you know, these are like next token likelihood predictor machines. They're really trying to optimize for a single thing, which token should appear next. There isn't like a higher order predictive function happening, right? Whereas humans obviously have multiple conflicting often drives motivations, which, you know, sometimes run together and sometimes pull apart. And it's the confluence of those things interacting with one another, which produces the human condition, plus the social, you know, interaction too.
40:31 Speaker 01 These models don't have that. You could engineer it to have a will or a preference, but that would be not something that is emergent. That would be something that we engineer in and we should do that very carefully.
40:43 Speaker 00 I do love that you bring this humanistic side to the equation, right? I mean, in addition to being a technologist, your background.
40:53 Speaker 00 Is one that is pro-human at the beginning. And this interesting cultural debate, I think we're about to enter into those that are sort of pro-AI versus pro-human. That famous conversation between Elon and Larry Page about are you a speciest? Because you're in favor of AI over humans.
41:13 Speaker 01 I mean, look, that's going to be a dividing line. There are some people, and like, I'm not quite sure which side of the debate Elon's on these days. Like, I've certainly heard him say some pretty post-human, transhumanist things lately. And I think that we're going to have to make some tough decisions in the next five to 10 years. I mean, the reason I dodged the question on the timeline for superintelligence is because, you know, I think that it doesn't matter whether it's one year, or 10, or 20 years, it's super urgent that right now, we have to declare, what kind of superintelligence are we going to build? And are we actually going to countenance creating some entity which we provably can't align, we provably can't contain, and which by design exceeds human performance at all tasks?
41:58 Speaker 00 And human understanding.
41:59 Speaker 01 And understanding. Like, how do you control something that you don't understand?
42:02 Speaker 03 I'd like to, if I may, pull on the anthropomorphization thread a bit. If you may remember Douglas Adams' book, The Restaurant at the End of the Universe, there's a scene where there's a cow that's been engineered to invite restaurant patrons to eat it, because it makes them feel more comfortable. And the cow doesn't mind, the cow's been optimized to want to be eaten by the patrons, but many readers horrified at that scene. Put that in a box for a moment. Microsoft has a history of anthropomorphizing AI assistance co-pilots going back, probably there's an example prior to Microsoft Bob and the Rover Dog, and then
42:44 Speaker 03 Clipit, Clippy, in Microsoft Office, and then more recently, more sort of amorphous, cloud-shaped avatars. How do you think about reconciling, on the one hand, the desire not to overly anthropomorphize agents?
43:01 Speaker 03 On the other hand, with an institution that has arguably been in the vanguard of anthropomorphizing agents.
43:08 Speaker 01 I think the entire field of design has always used the human condition as its reference point, right? I mean, skeuomorphic design was the backbone of the GUI, right? From filafaxes to calendars and to everything in between, right? And we still have the remnants of that in our, you know, old school interfaces, which we feel that are modern stuff like. So that's like an inevitable part of our culture and we just grow out of them. We, we figure out like cleaner, better, more effective user interfaces. I'm not against anthropomorphism by default. I mean, I, I think we want things to feel ergonomic, right? The, the chair fits, the language model speaks my tone, right? It has a fluency that makes sense to me.
43:52 Speaker 01 It has a cultural awareness that resonates with my history and my nation and so on. And I think like, that is an inherent part of design today. As, as creators of things, we are now engineering personalities and culture and values, not just pixels and, uh, you know, software. So, but, but, but obviously, you know, there's a line, right? Creating something which is indistinguishable from a human has a lot of other risks and complications. Like that makes the immersion into the, the simulation even more, um, you know, kind of dangerous, right? And more likely, right?
44:34 Speaker 01 And so I think, I don't have a problem with entities, avatars, or voices, or whatever, that are clearly distinct and separate and not trying to imitate and always disclose and have that, that they are an AI essentially, and that there are boundaries around them. Like, that seems like a natural and necessary part of safety.
44:52 Speaker 03 So what, what I think I hear you saying, correct me if, if I'm mistaken, is anthropomorphization is the new skeuomorphism, on the one hand, but on the other hand, maintaining clean, maybe even legal, boundaries between human intelligence and artificial intelligence. Do you think, do you see a future where AIs achieve some sort of legal personhood? Or is that forbidden? Is that never going to happen? Do you see a future where humans are allowed to merge with the AI's Kurzweil-style friend of the pod? Or is that also not on the table in your mind?
45:24 Speaker 01 Yeah, I mean, I think AI legal personhood is extremely not on the table.
45:30 Speaker 00 Hmm.
45:30 Speaker 01 I don't think our species survives. If we have legal personhood and rights alongside a species that costs a fraction of us that can be replicated and reproduced at infinite scale relative to us, that has perfect memory, that can just like paralyze its own computation. I mean, these are so antithetical to the friction of being a biological species, us humans, that there would just be an inherent competition for resources. And until it was provable, until it was provable that those things would be aligned to our
46:11 Speaker 01 values and to our ongoing existence as a species and could be contained mathematically provably, which is a super high bar, I don't see that we should be considering giving a legal right.
46:24 Speaker 00 In the sand.
46:25 Speaker 01 I really think it's a bright line. I think it's, I think it's very dangerous. There's a separate question which has to do with liability because they are going to have increasing autonomy. Like, to be clear, I'm also an accelerationist. I want to make these things. They're going to be amazing.
46:40 Speaker 00 There.
46:40 Speaker 01 But, but tension is rational. People always say that tension is rational. If you don't see the tension, you're definitely missing the most of the debate. It's obviously very complex. Like, the more we talk about the complexity and hold it in tension, that's when you start to see the wisdom. And there's no way we can leave these things on the table and say, no, like, we want to have these things in clinic, in school, in workplace, delivering value for, for us a huge scale, but they have to be bounded and controlled. And that's the, that's the kind of, that's the art that we have to exercise.
47:12 Speaker 05 This episode is brought to you by Blitzy, autonomous software development with infinite code context. Blitzy uses thousands of specialized AI agents that think for hours to understand enterprise scale code bases with millions of lines of code. Engineers start every development sprint with the Blitzy platform, bringing in their development requirements. The Blitzy platform provides a plan, then generates and precompiles code for each task. Blitzy delivers 80% or more of the development work autonomously, while providing a guide for the final 20% of human development work required to complete the sprint. Enterprises are achieving a 5X engineering velocity increase
47:56 Speaker 05 when incorporating Blitzy as their pre IDE development tool, pairing it with their coding copilot of choice to bring an AI-native SDLC into their org. Ready to 5X your engineering velocity? Visit blitzy.com to schedule a demo and start building with Blitzy today.
48:16 Speaker 03 It sounds, though, if I may, the primary rationale that I'm hearing for why not AI personhood has to do with the inadequacies of the human form as currently constructed. I heard you say, well, they'll outrace humans. They're so much smarter, they're so much faster, they're so much more clonable than human intelligences. If human intelligence were uplifted, maybe with the benefit of AI, if we had uploading-type technologies or BCI's that are advanced that enable us to lift up the average human intelligence. In your mind, then, does that open the door a bit to AI personhood? If humans can compete on a level playing ground with AIs?
48:54 Speaker 01 I don't want to make the competition for the peace and prosperity of the 7 billion people on the planet even more chaotic. So if the path over the next century, you know, can be proven to be much safer and more peaceful and less like, you know, disease and sickness, and there is room for this other species, then I'm open-minded to it, including biological hybrids and so on. Like, I'm not like against that on principle. I'm just a speciesist.
49:24 Speaker 03 Aha.
49:24 Speaker 01 I'm just a humanist. I start with, we're here, and it's a moral imperative that we protect the well-being of all the existing conscious beings that I know do exist and could suffer tremendously by the introduction of this new thing, right?
49:40 Speaker 00 Now, of course, the Neanderthals may have had that conversation, or every species- That preceded us over the last billion plus years. I mean, there are many who argue we're simply interim
49:53 Speaker 00 transitory species in Bootloader for the super intelligence.
49:57 Speaker 01 Yeah, that classic phrase. Yes, I'm totally aware of that. And I'm also someone who thinks on cosmological time too. So I'm not just naively saying, you know, this century. I'm I'm definitely aware that we're there's a huge transition going on. And in fact, you can even see it in recent memory. I mean, 250 years ago, life expectancy was about 30 years or whatever it was. Of course, in some ways, we are a augmented hybrid biological species. Right? We take all these drugs and I everyone's peptides are amazing. I'm down for all of that. Let's go.
50:28 Speaker 00 Epigenic reprogramming is coming next year.
50:29 Speaker 01 Exactly. Let's go. I'm down. I'm down. But let's not shoot ourselves in the foot. Like, I want to make sure that, you know, most of our planet, if not everybody, gets the benefit of the peace and prosperity that comes from the technology.
50:45 Speaker 00 I mean, there is. There is some level of sanity in that argument. If you believe that the AI will ultimately outcompete us and and put us into into a box of insignificance, I mean, in the long, in the long run.
51:00 Speaker 01 I mean, all intelligences, we can see this in nature. We're innately hierarchical. So far, we have not seen this supra collaborative species that will take self sacrifice in order to preserve the other species. So there's an inherent hierarchical, there's inherent clash from coming from, you know, the hierarchical structure of intelligence, right? So and all I'm saying is not that we shouldn't explore it, not that it couldn't potentially happen. But the bar has to first be do no, maybe do a little, but do no harm to our species first.
51:34 Speaker 00 Don't don't shoot ourselves in the foot, as you said, Dan.
51:38 Speaker 04 Well, I'm 100% with you on this topic, by the way, could not be more aligned. But Jeffrey Hinton is out there telling the world it's going to run away. And our our safety valve is giving it a maternal instinct. And
51:51 Speaker 00 Which I found, I found an interesting point of view. Well, he's more optimistic.
51:55 Speaker 01 I didn't track that.
51:55 Speaker 00 Oh, yeah.
51:56 Speaker 01 What's the safety valve?
51:57 Speaker 04 Well, it's funny, because he believes it's uncontainable. And I, I'm with you. I think it's very containable if you don't give it emotional and intentional programming. Uh, but he thinks it's uncontainable. He was very pessimistic when he got his Nobel Prize. Now he's more optimistic because he sees a path to programming in maternal instinct. Which implies that it's like, it's dominant to us, but it cares.
52:21 Speaker 00 His thesis, his thesis was, I've seen a situation where a vastly more intelligent entity takes care of a younger, inept entity in a mother with their screaming child.
52:34 Speaker 04 Yeah.
52:35 Speaker 00 So if there's a maternal instinct that we can program into AI, even though we're far less capable, it will take care of.
52:43 Speaker 03 It's been compared to the, call it the digital oxytocin plan for AI alignment.
52:49 Speaker 01 That's a good one. Yeah, I mean, cool.
52:53 Speaker 00 Yeah.
52:53 Speaker 01 I mean, it's about as poetic as it gets. I think I'm gonna need something that's got a little bit more like formula to it, a bit more reassuring. But look, there's 101 different possible strategies for safety. We should explore all of them, take them all seriously. I mean, Jeff is a legend of the field, no question, but like, I just think approach with caution.
53:13 Speaker 00 Are you spending a lot of your energy compute uh, human power on safety?
53:18 Speaker 01 Yeah, I would say not as much as we should. You know, I, I'm, I'm wrapping my head around it.
53:27 Speaker 00 Is anybody out there? I, I am, I am curious, out of all the hyperscalers out there, is there any entity that's spending enough in your mind? Because everybody's in such a race. It's like more GPUs, more data, more energy. It's just like, everybody's optimizing for the next benchmark. I don't see any safety benchmarks. Are there any safety benchmarks out there?
53:52 Speaker 03 Oh, there are tons of safety benchmarks and there's at least in my mind, an argument for defensive co scaling. I'd be curious to hear your ideas on that. Do you think in the same way that as a city gets larger, the police force gets larger, maybe it's not in direct proportion, maybe there's some scaling exponent. But do you think defensive co scaling of alignment forces or safety forces, whatever that ends up meaning, do you think that's part of the strategy for AI?
54:19 Speaker 01 I think that would be a good, I mean, we've proposed this several times over the years. I mean, the White House voluntary commitments under Biden that me and in fact, everyone, I mean, Demis and Dario and Sam and all of us through COVID were pushing this pretty hard. And look, I mean, it got chucked out, but I think it's a very sensible set of principles. It's like auditing for scale of flops, you know, having some percentage that we all share of safety investment flops and headcount, you know, this is the time. And I think on the face of it, everyone is open and willing to sharing best practices and disclosing to one another and coordinating when the time comes. I think we're, we're still pre that level. So we're in like hyper competitive mode at the
54:59 Speaker 01 moment. But yeah, I think now is really the time to be making those investments.
55:05 Speaker 00 Well, is there something that's going to scare the shit out of us that stops everybody? You know, is there a three, you know, I was talking to Eric Schmidt about this. Is there a three mile island like event scares everybody, but doesn't kill anybody?
55:18 Speaker 04 Well, Eric Schmidt was said specifically, he's hoping for a hundred deaths because that's in his mind, the least that would get the attention of the government or would cause some kind of a solution.
55:29 Speaker 00 Dave, continue, please.
55:30 Speaker 04 Well, so it's interesting that you, you say Dario and Sam and Ilya, like you guys obviously must interact quite a bit. Is Mira part of that gang? Is Andre part of that gang? Are you? Like, cause this is, it's, it's interesting to think about the competition heating up like we were just talking about. And, you know, Dario started from this position of pure safety. And I think Ilya did too. But now we're right on the cusp of self-improvement. And it's really, really clear that there are serious. I wouldn't say fishers, but, but the, the companies are now really racing. I mean, really racing and, and I know Microsoft, you know, when I wrote my, my second business, my first company I sold.
56:14 Speaker 04 Next business plan I was writing, the first sentence was stay out of Microsoft's way. Cause, cause at the time, you know, Microsoft had hack, half the market cap of tech was Microsoft. And Microsoft's plan was to double in size. We have a much more balanced world now with Microsoft and Google and Meta. But at the time, Microsoft was just unstoppable and dominant. And so it was just stay out of the way. But Microsoft seems to always win, right? There's, and, and we are right on the edge of self-improvement as far as I can tell. So is it still, you know, let's all get together and have dinner and talk about safety? Or is everybody now in full bore?
56:51 Speaker 01 No, definitely. I think that's, that's definitely there. I think the recursive self-improvement piece is probably the threshold moment if it works. And if you think about it, at the moment, there are software engineers who are in the loop, who are generating post-training data, running ablations on the quality of the data, running them against benchmarks, generating new data. And that's sort of broadly the loop.
57:17 Speaker 01 And that's kind of expensive and slow and it takes time and it's not completely closed. And I think a lot of the labs are racing to sort of close that loop. So that various models will act as judges evaluating quality, you know, generators producing new training data, adversarial models that are like reasoning over which data to include and what's higher quality. And then obviously that's then being fed back into the post-training process. So like closing that loop is going to speed up AI development for sure. Some people speculate that that adds, I mean, okay, I think it probably does add more risk, but some people speculate that it's a potential path to a FUM, you know, so an intelligent explosion.
58:01 Speaker 04 Yeah.
58:03 Speaker 01 And. I definitely think with unbounded compute and without human in the loop or without control, that does potentially create a lot more risk. But unbounded compute is a big claim. I mean, that would need a lot of compute. So yeah, we're definitely taking steps towards like more and more, you know, more and more risky stuff.
58:24 Speaker 04 Can I ask you a really specific question about that? Because you know, the year and a half now at Microsoft, before true recursive self-improvement, which is imminent, there's AI assisted chip design. And this, you know, the layers in the PyTorch stack are very clunky. But now it's really easy to use the AI to punch through the stack and optimize, you know, build your own kernels, get 2, 3, 4x performance improvement. But clearly, OpenAI is now working to build custom chips and the TPU 7s just came out. When you arrived at Microsoft, first of all, was I know there's a lot of quantum chip work going on, but was there any work going on similar to the TPU work?
59:05 Speaker 01 Yep, there's also a chip effort. And, you know, I think progress has been pretty good. I mean, I think that, you know, we've got a few different irons in the fire that we haven't sort of talked about publicly yet. But I think, you know, the chips are going to be important part of it for sure.
59:21 Speaker 04 And that those are internal efforts. Are those teams under you? That's that's part of your?
59:26 Speaker 01 No, I mean, they're in the broader company.
59:28 Speaker 04 Okay, interesting.
59:30 Speaker 00 I want to switch subject a little bit and go come to your book, The Coming Wave. I enjoyed it greatly. I listened to it. I love the fact that you read it.
59:39 Speaker 01 Thank you.
59:40 Speaker 00 You know, I tell my kids I read books. No, Dad, you listen to books. You don't read books anymore. I want to I want to read what I wrote here because it's important. So you identified the containment problem as the defining challenge of our era, warning that as these technologies become cheaper and more accessible, they will inevitably proliferate, making them nearly impossible to control.
1:00:04 Speaker 00 This creates a terrifying dilemma. Failing to contain them forces risk for catastrophe like engineered pandemics. And a lot of your concerns were in the biological world. And I agree, being a biologist and a physician. Or potentially democratic collapse with deep fakes and all of that. But the extreme surveillance required to enforce containment could lead to a totalitarian dystopia. So you say we need to navigate this narrow path between chaos and tyranny. And that is a very fine line to navigate. So you propose a strategy of containment.
1:00:46 Speaker 00 This includes technical safety measures, strict global regulations, choke points on hardware supply, international treaties. How are we doing on that?
1:00:57 Speaker 01 Yeah, I mean, it's kind of important to just take a step back and distinguish between alignment and containment. The project of safety requires that we get both right. And I actually think we have to get containment right before we get alignment right. Alignment is the kind of like maternal instinct thing. Does it share our values? Is it going to care about us? Is it going to be nice to us? Containment is, can we formally limit and put boundaries around its agency? And are we
1:01:28 Speaker 00 For everybody.
1:01:29 Speaker 01 Not just for ourselves, for everybody.
1:01:31 Speaker 00 Yeah.
1:01:31 Speaker 01 Yeah, I mean, I think that is part of the challenge is that like one bad actor with something that is really this powerful in a decade or two decades or something, you know, really could destabilize the rest of the system. And so, you know, just
1:01:45 Speaker 00 The system being humanity.
1:01:46 Speaker 01 Global humanity system, yeah. Just as you said, like as everything becomes hyper digitized, the the verse does become the metaverse, even though that kind of like went in and out of fashion very quickly. It's still I think the right frame in a way because everything is going to become primarily digitized and hyperconnected and instant and real time. And so the one to many effect is suddenly massively amplified. I mean, obviously, we see on social media, but now imagine that it's not just words that are being broadcast. It's actually actions. It's agents are capable of, you know, you know, breaking into systems or, you know, sort of.
1:02:25 Speaker 00 And they're resident in humanoid robots at a billion on the planet.
1:02:28 Speaker 01 And that too, yeah, it's both atoms and, and, and bits. So equilibrium requires that there is a type of surveillance that we don't really have in the world today. I mean, we certainly don't have it physically. The web is actually remarkably surveilled, I think, surprisingly, you know, more than I think people would expect. And some form of that is necessary to create peace, just as we centralized power and taxation or sort of military force and taxation around governments, you know, three or four, 500 years ago. And that's been the driving force of progress, actually. That order unleashed science and technology and.
1:03:12 Speaker 00 Stability.
1:03:13 Speaker 01 Stability.
1:03:13 Speaker 00 Yeah.
1:03:14 Speaker 01 So the question is like, how, what is the modern form of imposition of stability in a way that isn't totalitarian, but also doesn't relinquish it to a libertarian catastrophe? I think it's naive to think that somehow, you know, the best defense against a gun is a gun. And we just sort of the, the idea that somehow we're all going to have our own AIs and that's going to create this sort of steady equilibrium that all the AIs are just going to new, new, new, neutralize each other. Like, that ain't gonna happen.
1:03:43 Speaker 00 I mean, part of me hopes for a, a super intelligence that is the ring to rule them all and provides, you know, I'm not worried about, how do I put it? I'm worried about.
1:03:59 Speaker 03 Gosh, Peter, you're hoping for a singleton.
1:04:01 Speaker 01 Yeah, that sounds like.
1:04:02 Speaker 03 What's going on?
1:04:03 Speaker 00 Well, you know, part of me is like.
1:04:04 Speaker 03 Color me shocked.
1:04:05 Speaker 00 Really?
1:04:06 Speaker 03 Yeah.
1:04:07 Speaker 00 I mean, I imagine that the level of complexity we, we're, we're mounting towards, that balancing act is extraordinarily difficult. And, you know, you can't push a string, but is there some mechanism to, to pull it forward?
1:04:27 Speaker 00 We should have this debate sometime.
1:04:29 Speaker 03 Some would call government, at least historically, a geographic monopoly on violence. And what I think I'm hearing is some sort of monopoly on intelligence, or at least capabilities exposed to intelligence in order to ring fence to contain AI. But that's the exact opposite, as far as I can tell of what we've seen over the past few years. People used to, armchair AI alignment researchers 10, 15 years ago would say, humanity wouldn't be so stupid the moment we have something resembling general intelligence as to give it terminal access or to give it access to the economy. And that's exactly what we did.
1:05:03 Speaker 00 There was the OpenAI Google moment.
1:05:07 Speaker 03 And yet, and yet.
1:05:08 Speaker 00 But that's concerning, right? So, I mean, Google develops all this technology, is holding internally, until some actor happens to have initials OpenAI, releases it, and then there's no other option but to follow suit.
1:05:23 Speaker 03 I'm less concerned by it. If you look at Anthropic, for example, which prides itself on being a very alignment-forward organization. Alignment, Anthropic released the Model Control Protocol, which is now the standard way, at least for the moment, for for models to interact with the environment. What many AI researchers said exactly what we did not want to do prior to general intelligence. So I'm curious, I mean, in your mind, how, given that the economy, there's every economic pressure, including modern Turing test, to empower agents to interact with the entire world and to do the exact opposite of containment. Why would we start containing them now?
1:06:01 Speaker 01 Containment, it's not that binary, right? I mean, we contain things all the time. We have powerful forces in the engine in your car that is contained and broadly aligned, right? And there is an entire regulatory apparatus around that, from seat belts to vehicle emissions to lighting, to drive, you know, street lighting to driver ed, you know, to freeway speeds. I mean, that's healthy, functional regulation, enabling us to collectively interact with each other. Now, obviously, it's multiple orders of magnitude more complex, because these things are not cars, they're, you know, sort of digital people. But that doesn't mean to say that we shouldn't be striving to limit. Their boundaries and nor does it mean that we have to centralize, by the way.
1:06:44 Speaker 01 The answer isn't that we have a totalitarian authoritarian state of intelligence.
1:06:47 Speaker 03 Peter wants a singleton.
1:06:49 Speaker 01 No, I think it's just instinctively, it can be easy to go there when, you know, when you kind of start to think it through. It's like, obviously, we do have centralized forces, but even in the US, we have, you know, military, we have divisions of the army, we have divisions of the police force that nested up in different layers. There's checks and balances on the system and that's kind of what we've got to start thinking about designing.
1:07:12 Speaker 04 That analogy to driving is a great one. And just to follow through on it, the complexity difference, very high, right, for AI, but the timeline also, I mean, driving evolved from, what, nineteen ten to today.
1:07:28 Speaker 03 Late eighteen.
1:07:29 Speaker 04 So the laws related, you know, seat belts came out eighty percent of the way through that timeline, you know, so lots and lots of time to iterate. Here, very little time and immensely more complex. So do you have a vision? But, but I completely agree. We need a framework for containment fast.
1:07:46 Speaker 01 Yeah.
1:07:47 Speaker 04 And do you have a thought on how we're gonna do that?
1:07:49 Speaker 01 I think that there's also a good commercial incentive to do this right. I think that like the many of the companies know that they, that our social license to operate requires us to take more accountability for externalities than ever before. We're not in the robber baron era. We're not in the oil era. We're not in the smoking era, right? We've learned a lot, not everything. There's still a lot of conflicts, but it really is a little bit different to last time around. And I think that's one reason to be a bit more optimistic. Plus, there's the commercial incentive, the commercial incentive and the kind of externalities shift.
1:08:26 Speaker 04 So, so if, you know, if Eric Schmidt is right and something either radiological or biological happens and there's a hundred deaths and then the phone starts ringing, everyone come to the White House right now. Well, first of all, do you want that call? Is that, is that part of your, your life plan to take that call and, and react to it? And then who else do you trust in the community to be part of that reaction?
1:08:49 Speaker 01 Look, I think that there is going to be a time in the next twenty years where it will make complete sense to everybody on the planet, the Chinese included and every other significant power to cooperate.
1:09:05 Speaker 00 On safety.
1:09:06 Speaker 01 On safety and containment and alignment. It is completely rational for self-preservation. You know, these are very powerful systems that present as much of a threat to the person, the bad actor that is using the model as it does to the, you know, the, the, the victim. And I think that, you know, that will, that will create, you know, a, a, an interest in, in cooperation, which, you know, is kind of hard to empathize with at this stage, given how polarized the world is, but I do think it's coming.
1:09:40 Speaker 00 I mean, the, the, the number one thing to unify all of humanity is a, you know, an alien invasion. Uh, and that alien invasion could be a, you know, potential for a rogue superintelligence.
1:09:53 Speaker 04 Yeah, okay. What about the first part of my question? Is that part of your calling in life? I mean, there's only a handful. Like, I think a lot of people that I meet around MIT or elsewhere are, they, they have this vision that somebody has it figured out somewhere. You know, someone, someone in government somewhere must be thinking about this. But you've been there, right? There's no, there's no one there.
1:10:13 Speaker 00 We're, we're the adults in the room. Is that what you're saying?
1:10:15 Speaker 04 Yeah, definitely. There's nowhere to go from this room.
1:10:18 Speaker 03 Dave is asking for the smoke-filled back room where the, the leads of all the frontier labs are secretly swapping safety tips.
1:10:25 Speaker 04 Yeah, something like that, yeah.
1:10:26 Speaker 01 I, I think that in practice, intelligence exists outside of the smoky room. I think that, that, the, the notion that like decisions get made in the boardroom or in the White House Situation Room or like actually intel, I mean, you know, you mentioned polymarkets and stuff like in, in, intelligence coalesces in these big balls of iterative interaction. Um, and that's, that's what's propelling the world forward. And so this is where the conversation's happening, like your audience, you know, all the other podcasters, everyone online, we're collectively trying to move that knowledge base forward.
1:11:03 Speaker 00 In November, you announced the launch of a humanist superintelligence.
1:11:08 Speaker 00 And focused on three applications, in particular, medicine and companions and clean energy. Uh, I'd love to double click in that a little bit, but I was curious that you didn't include education in that space.
1:11:26 Speaker 00 And I, you know, we have an audience of entrepreneurs and AI builders. And I think education, as much as healthcare is up for grabs right now, education is too.
1:11:37 Speaker 01 Totally agree.
1:11:38 Speaker 00 And I don't think our high schools are preparing anybody for the world that's coming. There's still retrospectively 50 years in looking the rear of your mirror. Do you think Microsoft will play in reinventing education?
1:11:54 Speaker 01 You know, I, I think it's already happening across the whole industry. I mean, it's never been easier to get access to an expert teacher in your pocket that has essentially a PhD and that can adapt the curriculum to your bespoke learning style. The bit that it can't do at the moment is to evolve or sort of like curate an extended program of learning over many, many sessions. But we're like just around the corner from that. I mean, we released a feature just a few months ago called quizzes. And so on any topic, not just a traditional school education, it can set you up with a mini curriculum, a quiz, and it's interactive and it's visual. And you can sort of track your learning over time. And like, I'm very optimistic about that, too. It's a huge unlock.
1:12:38 Speaker 00 One of the debates we have right now in the podcast on a pretty regular basis is, do you go to college?
1:12:45 Speaker 01 Yeah.
1:12:45 Speaker 00 Do you go to grad school? I mean, this is the most exciting time to build ever. I don't know if you want to follow on that, Dave.
1:12:53 Speaker 01 God, I do this constantly. It's really tricky for me on campus because I teach, you know, at MIT and Stanford and Harvard. And this window of opportunity is so short and so acute. And it's really, really clear how you succeed right now in AI. Post AGI? I mean, who could predict? Nobody knows. But right here, right now, you see these, these startup valuations like we're last night. I won't mention it, but, but billions.
1:13:17 Speaker 00 I mean, just, yeah, an opening valuation of $4 billion.
1:13:21 Speaker 01 $4 billion, yeah.
1:13:22 Speaker 00 By collecting just the right group of people in the room.
1:13:24 Speaker 01 Yep, yep.
1:13:25 Speaker 04 I wanted to ask about that, actually, because your, your timing on inflection was early. Like, you know, in hindsight, earlier, but now you've got the new wave with Miramirati and Ilya and a couple of others, Liquid AI, that all have multi-billion dollar valuations.
1:13:38 Speaker 01 Yeah, I thought we set some standards on valuations pre-revenue with a 20-person team, but we're just a minnow.
1:13:45 Speaker 01 Two and a half years ago.
1:13:46 Speaker 04 Oh, is that all it was? Oh, my God.
1:13:48 Speaker 01 Three years, I think, yeah.
1:13:49 Speaker 03 You think as the the cost of intelligence becomes too cheap to meter that the the value ascribed, at least in terms of market cap, to human capital is sort of inversely asymptotic going to infinity?
1:14:01 Speaker 01 Weirdly, it is because of the pressure on timing, right? And there's there's actually still a pretty concentrated pool of people that can do this stuff. And there's like an oversupply of capital that's desperate to get a piece of it. It might not be the smartest capital the world's ever seen, but like it's very eager. And so that's.
1:14:21 Speaker 04 Okay, I have to ask you because it's burning a hole in my pocket. But, you know, Alex's freshman roommate at MIT was Nat Friedman.
1:14:29 Speaker 03 And. Prefresh, actually, prefresh.
1:14:31 Speaker 04 Prefresh, prefresh roommate. And so Nat goes off and, you know, he ends up at co-founder of Safe Superintelligence. And I haven't asked him, I don't know if you've asked him yet, but he leaves to become the guy at Meta. And I've got to believe a huge part of that attraction is the compute.
1:14:50 Speaker 01 Yeah.
1:14:51 Speaker 04 And so here you are, very similar situation, right? You've got your startup, you've got a billion or whatever, billion and a half that you've raised.
1:14:57 Speaker 01 Yeah.
1:14:57 Speaker 04 You can build it, you can get your 20,000 Nvidia. Oh, wait a minute, here's Microsoft. 300 billion of cash flow and a huge amount of compute. Was that a big part of the?
1:15:09 Speaker 01 Yeah, I mean, not to mention the the prices that we're paying for individual, you know, researchers or members of technical staff and like, I mean, just the also just the the scale of investment that's required, not just in two years, but over 10 years. I I think it it's clearly there's a structural advantage by being inside the big company. And I think it's going to take, you know, hundreds of billions of dollars to keep up at the frontier over the next five to 10 years.
1:15:35 Speaker 04 So finishing that thought, then you the the companies that are raising money at a 20 or 50 billion dollar valuation right now and no chance?
1:15:48 Speaker 00 Okay. I'll take that.
1:15:50 Speaker 01 I wouldn't take the bet. But like, I think it depends. I mean, there's obviously a near term. If suddenly we do have an intelligence explosion, then lots of people can get there simultaneously. But then also, at the same time, you have to build a product with those things. You have to have distribution. Like, all the traditional mechanisms still apply. Are you going to be able to convert that quickly enough? I mean, you know, everything goes really kind of weird if that happens in the next five years. It just is unrecognizable. There's so many emergent factors to play into one another. It's hard to, it's hard to say. And I think that's partly the ambiguity is what's driving the frothiness of the valuations. Because I think there's people going, well, I don't know. I don't, do I want to be, so what do you call it? Reed, Reed, Reed calls it schmuck insurance.
1:16:34 Speaker 00 Yeah. Yeah, we had, we had Reed on the pod here a couple of months ago. He's brilliant.
1:16:40 Speaker 00 I, so to that graduating high school student,
1:16:46 Speaker 00 what do you study these days?
1:16:48 Speaker 01 I mean, there's no question that you still have to study both disciplines, like philosophy and computer science is, is going for a long time, remain, I think, the two foundations.
1:17:02 Speaker 01 Should you go to college? Absolutely. Like, you know, human education, the sociality that comes from that, the benefit of the institution, having three years to basically think and explore, you know, in and out of your curriculum. This is a huge privilege. Like, people should not be throwing that away. That is golden. So I always encourage people to do that. Obviously, I did also drop out. But I mean, I still think.
1:17:28 Speaker 00 It was a cool thing to do.
1:17:29 Speaker 01 Yeah, it was just, it felt right at the time.
1:17:34 Speaker 01 But the other thing is,
1:17:37 Speaker 01 go into public service.
1:17:38 Speaker 00 Yeah. I respect that part of what you did in that sequence in your life.
1:17:43 Speaker 03 Which gave you this very much humanist point of view.
1:17:47 Speaker 01 Yeah, and it was really hard and very different and it wasn't instinctively right, but I learned a lot. And it was a very influential and important part of my experience, even though it was very short, it was like a couple of years, basically.
1:18:01 Speaker 01 And I think if you look at the actors in our ecosystem today, corporations, the academics, the sort of news organizations, now the podcast world, it's really our governments that are probably institutionally the weakest and our democratic process, but actually our civil service. And that's because there's been five decades of battering of the status and reputation and respect that goes into, you know, being part of the public service, like post Reagan and Thatcher. And I think that's actually a travesty because we actually need that sentiment and that spirit and those capabilities more than ever.
1:18:40 Speaker 03 I think maybe what I just heard you say, correct me if I'm wrong again, is we need more intelligence in the public sector, in public service. What about AI in government? Do you think the government needs? And what about agentic AI in the government in particular?
1:18:56 Speaker 01 For sure, with all the same caveats that apply. But I mean, you know, I mean, you know, rate of adoption for what it's worth of co-pilot inside of governments is actually really high. There's a brilliant job of synthesizing documents and transcribing meetings and summarizing notes and facilitating the discussion and chipping in with actions at the right time. And it's clearly going to save a lot of, you know, time and improve decision making.
1:19:19 Speaker 03 So then maybe to tie a nice bow on the discussion, isn't that arguably a form of AI containing AI? If AI is infusing the government and AI is infusing the economy and the government is regulating the economy, isn't this just defensive co-scaling with AI regulating itself?
1:19:34 Speaker 01 Yeah, I mean, like, everyone is going to use AI all at the same time to pursue, but the same, but the agendas that we all have are going to remain the same. I mean, people who want to start companies, people who want to write academic papers, people who want to start, you know, cultural groups and entertainment things. Everyone is just going to be empowered, like, in some way, their capability is going to be amplified by having these tools, obviously the government included.
1:20:00 Speaker 00 Nice. Mustafa, thank you so much for taking the time on a Friday night. Grateful to have this conversation with you.
1:20:08 Speaker 00 Dave, Alex, I appreciate it. Final question from you, Dave?
1:20:13 Speaker 04 Final question, if I have one that I have. All right, prediction.
1:20:18 Speaker 04 Quantum computing right now has nothing to do with going, what's going on in LLM AI. It's all matmoles on Nvidia chips and soon to be TPUs and other custom chips. Best guess, six, seven years from now. The AI is very good at writing code and compiling and can figure out quantum operations. Are quantum chips relevant? Or are they on the sideline still, or is everything ported over to quantum and Microsoft can take advantage of its lead?
1:20:48 Speaker 01 Yeah, I mean, I think it's going to be a big part of the mix. I think it's sort of an under, relative to the amount of time we spend talking about AI is kind of an under-acknowledged part of the wave, actually a little bit like synthetic biology. I think that especially in the, in the sort of, you know, general conversation. I think people aren't grasping those two waves, which are going to be just as impactful and crash at the same time that AI is coming into focus.
1:21:17 Speaker 04 All right, you heard it here.
1:21:19 Speaker 03 This is a closing question to appeal maybe to your more accelerationist side. What can the audience do to accelerate AI for science, AI for engineering? What are, what do you view as the, the limiting factors? If I often talk on the podcast about this notion of an innermost loop, the idea that in computer science, if you want to optimize a program, you tend to find loops within loops and you want to optimize the innermost loop in order to optimize the overall program. What do you see as the innermost loop, the limiting factor, if you will, that the audience listening, if they're suitably empowered, can help optimize to speedrun?
1:21:57 Speaker 03 Maybe a Star Trek future over the next 10 years or a Star Trek economy? What do we do?
1:22:01 Speaker 01 Yeah, I mean, I think I think it's pretty clear that most of these models are going to speed up the time to generate hypothesis. The slow part is going to be validating hypothesis in the real world. And so the all we can do at this point is just ingest more and more information into our own brains and then co use that with a single model that progresses with you because it's becoming like a second brain. Like, for example, Copilot is actually really good at personalization now, like most of its answers. And so the more you use it, the more those answers pick up on themes that you're interested in, and it's also gently getting more proactive.
1:22:42 Speaker 01 So it's kind of nudging you about new papers or new articles that come out that are obviously in tune with whatever you've been talking about previously. So, you know, it's a bit kind of a simplistic cop out answer, but just the more you use it, the better it gets, the better it learns you, the better you become, because it becomes this sort of aid to your own line of inquiry.
1:23:01 Speaker 03 So that sounds like your your advice to the audience is use Copilot more. And that's the the single best accelerant that you can do to speed this up.
1:23:08 Speaker 01 Or any other AI. I mean, there are loads of great AIs.
1:23:11 Speaker 00 You also talk about can you build the physical system that is going to enable AI to run the experiments in a 24 seven closed dark cycle to be able to mine nature for data?
1:23:25 Speaker 01 That's right.
1:23:25 Speaker 00 Right? There are a number of companies that are doing this. Lila is one recently out of Harvard MIT. I find that exciting, where AI is becoming an explorer on our behalf, gathering that data.
1:23:40 Speaker 01 Yeah, yeah, spot on.
1:23:44 Speaker 00 Thank you again.
1:23:45 Speaker 01 This has been great. Thanks a lot. It was a really fun conversation.
1:23:47 Speaker 03 Yeah, really fun.
1:23:48 Speaker 01 Thanks.
1:23:48 Speaker 00 Appreciate it, my friend.
1:23:49 Speaker 01 All right. Good to see you.
1:23:50 Speaker 00 Every week, my team and I study the top 10 technology meta trends that will transform industries over the decade ahead. I cover trends ranging from humanoid robotics, AGI, and quantum computing to transport, energy, longevity, and more. There's no fluff, only the most important stuff that matters, that impacts our Lives, our companies and our careers. If you want me to share these meta trends with you, I write a newsletter twice a week, sending it out as a short two-minute read via email. And if you want to discover the most important meta trends 10 years before anyone else, this report's for you. Readers include founders and CEOs from the world's most disruptive companies and entrepreneurs building the world's most disruptive tech. It's not for you if you don't want to be informed about what's coming, why it matters, and how you can benefit from it.
1:24:35 Speaker 00 To subscribe for free, go to dmandus.com/metatrends to gain access to the trends 10 years before anyone else. All right, now back to this episode.
1:24:57 Speaker 06 Flowing ad budget on metrics that look great, till the CFO sees them, that's bull spend. And marketers are calling it out in Dashboard Confessions.
1:25:07 Speaker 07 I remember telling my boss, "It'll be good for the brand," when leads were slow. Yeah, it wasn't.
1:25:15 Speaker 06 Cut the bull spend. LinkedIn lets you target by company, job title, and more. Advertise on LinkedIn. Spend $250 on your first campaign and get a $250 credit. Go to LinkedIn.com/campaign. Terms and conditions apply.
Previous GPT 5.2 Release, Corporate Collapse in 2026, and $1.1M Job Loss w/ Alexander Wissner-Gross, Salim Ismail & Dave Blundin | EP #215 Next 2026 Predictions: AI Automates Knowledge Work, Autonomous Robots & AI CEO Billionaires | EP #217 Page updated October 11, 2026 · transcript and summary are machine-generated