Pod Insights Decoder Microsoft AI CEO Mustafa Suleyman says conversational AI is the next web browser About this episode Today, I’m talking with Mustafa Suleyman, the CEO of Microsoft AI. Mustafa is a fascinating character in the world of AI — he’s been in and out of some pivotal companies like DeepMind, which he cofounded, and Google. He landed at Microsoft through a unique not-quite-acquisition deal of his latest startup, Inflection AI.
As CEO of Microsoft AI, Mustafa now oversees all of its consumer AI products, including the Copilot app, Bing, and even the Edge browser and MSN — two core components of the web experience that feel like they’re radically changing in a world of AI. The company has also a unique relationship with OpenAI, one that’s grown more complicated of late. That’s a lot of Decoder bait, and we really get into it.
Links:
Google DeepMind co-founder joins Microsoft as CEO of its new AI division | The Verge
This is Big Tech’s playbook for swallowing the AI industry | Command Line
The new AI deal: buy everything but the company | NYT
Sam Altman lowers the bar for AGI | The Verge
OpenAI seeks to unlock investment by ditching ‘AGI’ clause with Microsoft | FT
Microsoft needs to win back trust | The Verge
Microsoft’s AI boss thinks it’s okay to steal content if it’s on the open web | The Verge
Read Microsoft’s optimistic memo about the future of AI companions | The Verge
Microsoft gives Copilot a voice and vision in its biggest redesign yet | The Verge
How Microsoft is thinking about the future of Copilot and AI hardware | The Verge
Transcript: https://www.theverge.com/e/24078862
Credits:
Decoder is a production of The Verge and part of the Vox Media Podcast Network.
Our producers are Kate Cox and Nick Statt. Our editor is Callie Wright. Our supervising producer is Liam James.
The Decoder music is by Breakmaster Cylinder.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
Transcript 13,613 words · 9 speakers
0:00 Speaker 00 Give you and your team more time to focus on the work that matters. This is AMEX Corporate, one intelligent platform for company spending. With smart expense management to help capture details, categorize spend, and streamline expense submission and approval, there's less manual work for your team and greater visibility and control for you. Built to simplify, designed to scale. Get started at go.amex/ammexcorporate. Terms apply.
0:31 Speaker 01 This episode is brought to you by Subaru. You know that place your mind always wanders to? The lake, the mountains, the homes of the people you love most? The completely redesigned 2026 Subaru Outback is built to help you get there. With legendary capabilities, standard symmetrical all-wheel drive, and the confidence to go further. The 2026 Subaru Outback. Love never looked so good. Visit Subaru.com/Outback to learn more.
0:56 Speaker 02 Flowing ad budget on metrics that look great. Till the CFO sees them, that's bull spend. And marketers are calling it out in. Dashboard confessions.
1:06 Speaker 03 I remember telling my boss, "It'll be good for the brand." When leads were slow. Yeah, it wasn't.
1:13 Speaker 02 Cut the bull spend. LinkedIn lets you target by company, job title, and more. Advertise on LinkedIn. Spend $250 on your first campaign and get a $250 credit. Go to LinkedIn.com/campaign. Terms and conditions apply.
1:28 Speaker 04 Hello and welcome to Decoder. I'm Neelai Patel, editor in chief of The Verge. And Decoder is my show about big ideas and other problems. Today, I'm talking with Mustafa Suleyman, the CEO of Microsoft AI. He was one of the co-founders of DeepMind, which got acquired by Google in 2014 and is now known as Google DeepMind, the center of that company's AI efforts. He was a Google VP for several years before leaving to found another AI startup called Inflection in 2022. Then earlier this year, Inflection cut a deal with Microsoft to license its core technology in a weird and kind of controversial, not-quite-acquisition that sent Mustafa, his co-founder, and a majority of their employees into Microsoft and made Mustafa CEO of Microsoft AI.
2:11 Speaker 04 As CEO of Microsoft AI, Mustafa now oversees all of Microsoft's consumer AI products, including the Copilot app Bing and even the Edge browser and MSN, two core components of a lot of people's web experience that feel like they're radically changing in the world of AI. That's a lot, and it's a lot of decoder bait. I am continually fascinated by Microsoft's org chart and all of the little CEOs that report up to Sachin Adella. And of course, I'm also obsessed with what AI might do to the web at large. I also took the opportunity to ask Mustafa to compare and contrast working at Microsoft and Google, since he has direct experience at both. And I would say his answer is pretty revealing. It was also important to me to ask Mustafa about AI training and the data it requires.
2:53 Speaker 04 He's caught some heat for describing content on the web as "free ware" before, and Microsoft and its partner OpenAI are in the middle of major copyright lawsuits about training data. I'm generally curious about how AI companies are thinking about the risky and seemingly uncertain legal foundations of their work, and I wanted to know how Mustafa was thinking about it now. But before we got into all of that, I needed to ask about AGI, or artificial general intelligence. That's the idea that these AI systems will be able to handle tasks as well as a human, or even better in some cases. Sam Altman and OpenAI, which again is a huge partner with Microsoft, has said he thinks AGI is achievable on our current computing hardware, and his most recent comments at
3:34 Speaker 04 the Dealbook conference seem to lower the bar for how he defines AGI entirely, which makes it easier to argue that it will arrive sooner than we think. On top of that, there's a lot of reporting that says OpenAI can get out of its Microsoft deal when it says it's achieved AGI. So Altman has a lot of incentives to say it's happening. So I asked Mustafa straight up if he agrees with Sam Altman and if AGI is achievable on current hardware. Because if the answer is yes, maybe a bunch of org chart questions are a little secondary to what should humanity do to deal with AGI. You'll hear Mustafa be optimistic about achieving AGI and a much more diffuse timeframe than Sam Altman, but you will also hear him pull away from the idea of AGI being a superintelligence,
4:18 Speaker 04 which feels like that same kind of redefinition. There's a lot going on in this episode, including a discussion of what I have started calling "the DoorDash problem." You'll see what I mean. Okay, Microsoft AI CEO Mustafa Suleyman. Here we go.
4:45 Speaker 04 Mustafa Suleyman, you are the CEO of Microsoft AI. Welcome to Decoder.
4:49 Speaker 05 Neelai, great to be with you.
4:50 Speaker 04 Yeah, I'm very excited to talk to you. I have a lot of questions for you about how Microsoft AI is structured within Microsoft, about what it means to be the CEO of Microsoft AI at a company that appears to be all about AI lately, about how you make decisions, all the Decoder stuff. But I want to start hot out the gate. I hope you're ready for this because I realize that the answer to this question from you is if you answer one way, this whole interview goes a different way. So I'm just going to ask right out the gate. Very recently, Sam Altman said in a Reddit AMA that he thinks we can achieve AGI on current hardware. Do you think that's possible?
5:26 Speaker 05 What does current hardware mean?
5:29 Speaker 04 Well, within one or two generations of what we have now, I would say.
5:34 Speaker 05 I don't think it can be done on GV200s.
5:38 Speaker 05 I do think it is going to be plausible at some point in the next two to five generations. And I don't want to say, I think it's high probability that it's two years, but I think within the next five to seven years, which is, you know, each generation takes 18 to 24 months now. So five generations could well be up to even 10 years, depending on how things go. And we really are facing increasingly tough challenges with these chips. I don't think it's going to be as linear in terms of its progress, cost per dollar and so on, as we've seen in the past. But things are accelerating very fast. So I agree with that sentiment.
6:20 Speaker 04 So between two and 10 years, you think?
6:23 Speaker 05 I think that's the right, the right, the uncertainty around this is so high that any categorical declarations just feel sort of ungrounded to me and over the top.
6:34 Speaker 04 Yeah, you and I have spoken several times in the past about a lot of things, and I want to follow up on a lot of those ideas. But it just occurs to me that if we think between two and 10 years, very much in the spans of our lifetimes, there will be AGI, maybe we shouldn't be working on anything else. Like, that seems like it will complete, that's the paradigm shift, right? We're through the singularity, now there's AGI, everything will be different on the other end of it. How do you approach that and then also think about, well, I need to launch the Copilot app on the iPhone?
7:07 Speaker 05 Well, so that depends on your definition of AGI, right? AGI isn't the singularity. The singularity is an exponentially recursive self-improving system that very rapidly accelerates far beyond anything that might look like human intelligence. To me, AGI is a general-purpose learning system that can perform well across all human-level training environments. So, knowledge work, by the way, that includes physical labor, the definition. So, a lot of my skepticism has to do with the progress and the complexity of getting things done in robotics. But yes, I can well imagine that we have a system
7:48 Speaker 05 that can learn without a great deal of handcrafted prior prompting to perform well in a very wide range of environments. And I think that is not necessarily going to be AGI, nor does that lead to the singularity. But it means that most human knowledge work in the next five to 10 years could likely be performed by one of the AI systems that we develop. And I think the reason why I shy away from the language around singularity, artificial superintelligence, I think they're very different things. And the challenge with AGI is that it's become so dramatized that we sort of end up not focusing on the specific capabilities
8:33 Speaker 05 of what the system can do. And that's what I care about with respect to building AI companions, getting them to be useful to you as a human, work for you as a human, be on your side, in your corner, on your team. Like, that's my motivation. And that's what I have control and influence over, is to try and create systems that are accountable and useful to humans, rather than pursuing the purely kind of theoretical superintelligence quest.
8:59 Speaker 04 Yeah. One of the reasons I'm particularly curious about this is the notion that all human knowledge work can be performed either with the assistance of a very capable general AI or by the AI itself. It sort of implies that we will build a new kind of AI system, right? One that will be able to be as creative as a human knowledge worker at the 99th percentile. And I don't see that in our systems now. Right, the way an LLM works, they don't necessarily come up with a bunch of individually creative thoughts. You can prompt them to do surprising things, but they don't, that turn, I have not experienced it. Do you think that the way that the current LLMs are built and trained and deployed is a linear path to the kind of AGI you're describing, or is there another kind of thing we need to build?
9:45 Speaker 05 Which is funny, because two or three years ago, people would often say, well, these systems are destined to regurgitate the training data that they were trained on, and that there is some one-to-one mapping between query, training data, and output. And it's pretty clear today that they're actually not doing that. The interpolation of the space between multiple n-dimensional elements of their training data is in itself the creative process, right? It's picking some point in this massively complex space to produce or generate a novel form of the response to the question that it has never seen before. We've never seen that specific answer produced in that specific way. To
10:27 Speaker 05 me, that is the beginnings of creativity, is the kind of glimmer of a truly novel invention, which is obviously what we're trying to produce here, right? And just to level set here, intelligence is the very thing that has driven all of our progress in the world in history, right? This power to synthesize vast amounts of information, aggregate it into conceptual representations that help us reason more efficiently in complex space, make predictions about how the world is likely to unfold, and then take actions on the basis of those predictions. And whether you're making a table, or you're playing baseball with your friend, every single one of those environments that you experience has those
11:08 Speaker 05 characteristics. And so if we can distill those sort of moments, if you like, into an algorithmic construct, then of course, there is huge value there. And what I think we see in this little mini moment in the last three or four years is the glimmers that they really can be creative, that they can exert real judgment, that they can produce novel ideas, these LLMs. And your point about can they do that proactively?
11:37 Speaker 05 I think is a good one, like can they do that unprompted? Can they do it independently? Can they do it with very subtle or nuanced or lightweight guidance? I think that's kind of an open question. I feel very optimistic about that myself. Um, much of the infrastructure to sort of ensure that they can do that is kind of an engineering issue now. So stateful memory and meta reasoning about the current context of a model are things that we know how to do in software today. We know how to introduce a second or a third system to observe the working state
12:16 Speaker 05 of an L L M in its activity and use that to then steer or re steer a prompt that it is operating to. And if you can do that kind of asynchronous meta reasoning, which is what the initial quote, quote chain of thought methods seem to show in the last sort of six to 12 months or so, then you can imagine that it could string together actions in these continuous environments and then orchestrate and coordinate with other parts of its working memory, other parts of its system, some of which are designed to do more short term things, some to draw from long term memory, some to be a bit more creative, some to be more adherent to the behavior policy or the safety policy that you're designing to.
12:57 Speaker 05 So it's obviously not done and dusted, but there are very, very clear signs that we're on the right path, I think.
13:04 Speaker 04 Those orchestration systems are fascinating to me because the models themselves are never going to produce the same output twice. A lot of the things we want computers to do are insanely deterministic. We definitely want them to do the same thing twice, over and over and over again. In a variety of situations where an A I might be really helpful, right? If you want to just do tax preparation, like you want the A I to be very helpful and understand all the inputs, but you also want it to follow the rules 100% of the time. And it seems like connecting our more traditional logical computer systems to control the non deterministic AI systems is a big pathway here, more so than making
13:46 Speaker 04 the AI more capable. And that feels like a new way of talking about it that I've only just recently seen. Does that feel like the kinds of products you need to build? Are you still focused on the capability of the model itself?
13:57 Speaker 05 It's a good framing, but let's tease apart what you mean by determinism, right? So determinism operates at layers of abstraction. So at the very lowest layer, each token is being generated non deterministically. But as those outputs become more recognizable with respect to a behavior policy, or a heuristic, or a known objective, like in your case, filling out the tax form, then that knowledge can be stored in representations which are more stable and deterministic, right? And this is exactly how humans operate today. No matter how well you might memorize something, if I ask you to do it 100 times over, you're most likely going to have some variation in the output. We don't really store things
14:40 Speaker 05 deterministically. We have co-occurring conceptual representations, which are quite fluid and abstract, which we then reproduce and fit into a schema of words and language in order for us to be able to communicate with one another. These models are actually very similar to that architecture. They can store stable information that can then be retrieved in quite deterministic ways, and like you said, integrate with existing computer systems and knowledge bases. But it's not true to say that one approach is going to sort of trump another. The models are going to get way more capable, and the methods for retrieval and information access and the use of, you know, existing databases, or making function
15:23 Speaker 05 calls to third-party APIs to integrate that information, those are going to advance simultaneously. And by the way, we're going to open up a third front, like a whole new front of capability, which is that now these LLMs can speak natural language. They're going to be able to go and query in real time other humans and other AIs. So that's like a third paradigm for quote unquote retrieving information or verifying that information or accessing new knowledge or checking state on something. So that in itself is going to drive like huge gains in addition to straight up model capabilities and integration with existing systems.
16:03 Speaker 04 I want to talk about the agent component of that at length because that seems to be where so many companies are focused, including to some extent, Microsoft. And it raises a million questions about how our computer systems and our networks should work. But now that I've just level set on, we think we're headed towards AGI between two and 10 years. We think we can do it with an increase in model capability, but also some novel approaches to how we use those models. I want to talk about how you're actually doing it at Microsoft. But it occurred to me from the jump, if we didn't agree on what the goals were, the structure conversation would be kind of ungrounded from reality. So those are the goals. That seems, those are huge goals. At Microsoft AI, how are you structured to accomplish those goals?
16:46 Speaker 05 First and foremost, my organization is focused on the consumer AI part. So it is about Bing, Edge, MSN and Copilot. So for consumer facing products that have many, many hundreds of millions of Dow, lots of user data and lots of direct commercial surfaces where we can deploy into production, get feedback, drive large scale experimentation. So for me, that's mission critical because five years ago, we were in a state with LLMs and AI more generally where, you know, we were still relying on the benchmarks to drive progress. Everything was happening.
17:28 Speaker 05 Evaluation was taking place in basically academic environments, albeit in commercial engineering labs. The models weren't good enough to actually put them into production and collect feedback from the real world. That has completely shifted now where all of the innovation is happening by optimization and hill climbing in production. So I think that's the first. Thing to say. Second thing to say is obviously our Azure business and the immense number of customers that we have that are using M three six five Copilot every day provides another huge experimentation framework, which is very different to the consumer experimentation framework. And it's actually a great opportunity for me because I'm learning a lot from how many, many businesses are integrating true AI agents in their workflow today. Because
18:13 Speaker 05 they have more visibility and control of their internal data, and in many cases, they have tens or even hundreds of thousands of employees, they're able to introduce novel co-pilots into their workflows, be it for training, sales agents, upskilling, underperforming, you know, sales agents, providing marketing feedback. I've seen HR co-pilots. There's all kinds of customer service co-pilots happening. So that gives me a sort of window into all the different flavors of testing and pushing the limits of these AI models in third-party production environments in the enterprise context. The third arena, of course, is our
18:54 Speaker 05 collaboration with OpenAI, our great partners. I think this is going to turn out to be one of the, you know, most successful partnerships in computer history. Five years old that partnership now and many, many years to run. And we get models from them, we get IP, and they get compute and obviously funding and it's obviously a huge source of support for us. And then the fourth area is that we've just spawned, since I arrived eight or nine months ago now, our own core effort to develop these models at scale inside of Microsoft AI. And so we have some of the best AI researchers and scientists who are pushing the frontier
19:35 Speaker 05 of post-training and pre-training for our weight class, which is, you know, so we're choosing a flops match target that really suits the kind of use cases that we care about and making sure that we have absolutely world-class frontier models that can do that.
19:49 Speaker 04 Let me just unpack some of the vocabulary there. You said weight class. Does that just mean giant corporation or do you mean something more specific by weight class?
19:58 Speaker 05 Oh, sorry. Weight class is the way that we refer to comparing frontier models with one another. So obviously, your flops need to be matched to your competitor model that you're evaluating yourself against. So size is really the, by far, the overriding predictor of capability performance in these models. So you can't compare yourself to something that's 10x larger by flops. You have to treat them as weight classes or flops classes, if you like.
20:26 Speaker 04 Yeah, that makes sense to me. And then you said you want to target it towards the applications you're using, right? So you're making many models that are geared towards specific Microsoft products?
20:36 Speaker 05 That's right. So if you think about it, Copilot under the hood is a whole collection of different models, different sizes that adapt to different context. If you're in a speech setting, it's a different type of model. If you're on desktop, if you're actually in the native apps on Mac or on Windows, they're all slightly different models. And then there's different models for search, reasoning, safety. And I think that that is going to get even more heterogeneous as we go.
21:02 Speaker 04 And then I just want to be very clear about this. It sounds like you're developing a frontier model that can compete with Gemini, with GPT-4, 5, whatever it is. Are you working on that as well?
21:13 Speaker 05 For the current weight class, yes. So at the GPT-4, GPT-4O scale. But it depends on how things turn out over the next few years because each order of magnitude increase is really a phenomenal piece of physical infrastructure. You're talking about hundreds of megawatts, soon gigawatts of capacity. There will really only be three or four labs in the world that have the resources to be able to train at that scale by the time that we get 10 to the 27 flops for a single training run. So we won't duplicate that between us and OpenAI. OpenAI is our pre-training frontier model partner for those things, and hopefully that continues for a long time to come.
21:57 Speaker 04 So you're not going to compete with the next generation of model size, right?
22:02 Speaker 05 Right.
22:02 Speaker 04 You're going to let OpenAI do that. The reason I ask that is because Microsoft runs the data centers, right? That is a partnership, it is ongoing, but Amazon runs its own data centers and Google runs its own data centers. And it seems like there is just a core tension here, regardless of how good the partnership is, between we are going to build these data centers and restart nuclear power plants in the United States to supply power to some of these data centers, and maybe it's better to sell that to someone else versus build the models ourselves. Do you feel that tension?
22:33 Speaker 05 You know, every partnership has tension. It's healthy and natural. I mean, they're a completely different business to us. They operate independently and partnerships evolve over time, right? So, you know, back in 2019, when Satya put a billion dollars into OpenAI, I mean, it seemed pretty crazy. I didn't think it was crazy, but I think a lot of people thought it was crazy. And, you know, now that has paid off and both companies have massively benefited from the partnership. And so, you know, partnerships evolve and they have to adapt to what works at the time. So we'll see how that changes over the next few years.
23:05 Speaker 04 Do you have a backup plan if OpenAI declares AGI and walks away from the Microsoft deal? There's some credible reporting that says if they declare AGI, they can walk away from the deal.
23:13 Speaker 05 No. So, look, I mean, it's very unclear. That's why I said she was very unclear exactly what the definition of AGI is. I mean, we have inside of Microsoft AI, one of the strongest AI research teams in the world. If you look at the pedigree of our crew, my own co-founder, Corinne Simonion, for example, led the deep learning scaling team at DeepMind for eight years, was behind many of the major breakthroughs. Nando de Fritis has just joined us. He previously ran audio video generation at DeepMind for 10 years. So, you know, we have really an exceptional team. And, you know, we'll make sure that whatever happens, we'll be in a position to train the best models in the world.
23:53 Speaker 04 It does seem like that you have some uncertainty there. You've said whatever happened several times now in the context of the OpenAI ideal. Does that feel like something that you can rely on?
24:02 Speaker 05 It definitely does. Look, they're an exceptional company. They're on a tear. There aren't many companies in the world that have grown as fast as they have. And so during that kind of meteoric rise, things are going to be brittle and some of the bits and pieces are going to fall off occasionally. And that's what we've seen in the last 12 months. So that doesn't really change their trajectory. They're going to be incredibly successful and we're going to do everything we can to help them be successful because they've helped make us successful. That's genuinely what's going on here. And that's naturally in any partnership, there's little tensions here and there, but fundamentally, we will win together.
24:37 Speaker 04 Yeah. I want to come back to the cooperation, competition dynamic there when we actually talk about products, but I want to stay focused on Microsoft AI inside of Microsoft for one more turn. You obviously started Inflection, Microsoft, sort of reverse acquihired all of Inflection. They brought over all the people, they issued you all shares. Why do the deal that way? Why join Microsoft and why structure that deal in that way?
25:02 Speaker 05 You know, Microsoft, so I've sort of known Satya for a very long time. He's been sort of trying to get me to come and be part of the Microsoft crew for a good long while, as far back as 2017, when we first started hanging out. And I've always been inspired by his leadership particularly. And I think the company is actually in an incredibly strong position. The investments that we're making in compute, like I said, the distribution that we have with so many enterprise partners now deploying M365 Copilot, and what you can learn from that is a real game changer. You know, a lot of people are talking about these actions, right? Clearly, you want your consumer Copilot experience to have these
25:41 Speaker 05 seamless interactions with brands, businesses, opportunities for getting stuff done, buying things, booking, planning, and so on. And so having that kind of protocol built in-house and available to the consumer side is super important. The thing I realized about where we were at with Pi and Inflection, I mean, we had really unbelievable engagement with Pi. Very high intensity Dow. The average session of the voice interaction lasted thirty three minutes a day. It's pretty, pretty remarkable. So it was well up there. But I think the challenge is the um. Competition is going to invest uh for years and years and years and basically keep it free.
26:23 Speaker 05 If not reduce it to like nothing and basically make it widely available to hundreds of millions of people. And so from a consumer perspective is a very, very, very competitive landscape. And look, when Satya made me the offer to come and run all the consumer stuff here. It was just an offer that we couldn't refuse. It's sort of enabled us to pursue our long term vision of actually creating a true AI companion that has a lasting relationship with hundreds of millions of consumers that is really useful to you. And to me, that's going to shape the future. That is really the thing that is going to shape our long term trajectory. So I couldn't turn that down.
27:04 Speaker 04 We have to take a short break. When we come back, we'll get into all the juicy questions about structure.
27:14 Speaker 01 This episode is brought to you by Subaru. You know that place your mind always wanders to? The lake, the mountains, the homes of the people you love most? The completely redesigned twenty twenty six Subaru Outback is built to help you get there. With legendary capabilities, standard symmetrical all wheel drive and the confidence to go further. The twenty twenty six Subaru Outback. Love never looked so good. Visit Subaru dot com slash Outback to learn more.
27:40 Speaker 02 Flowing ad budget on metrics that look great till the CFO sees them? That's bull spend and marketers are calling it out in. Dashboard, confessions.
27:49 Speaker 03 I remember telling my boss, it'll be good for the brand when leads were slow. Yeah, it, it wasn't.
27:57 Speaker 02 Cut the bull spend. LinkedIn lets you target by company, job title and more. Advertise on LinkedIn. Spend two hundred fifty dollars on your first campaign and get a two hundred fifty dollar credit. Go to LinkedIn dot com slash campaign. Terms and conditions apply.
28:10 Speaker 06 College football is back. So Hilton called to me, the superstition concierge, to make your fan rituals a reality. Need a room to match your lucky number? We got you. Want to make sure our team doesn't wash your lucky jersey? Oh, that smells lucky. Hilton's unmatched hospitality can keep up with any superstition, even a marching band wake up call at 5:55 and 55 seconds. Hit it! When you need a team that will do whatever it takes on game day, it matters where you stay. Hilton, for the stay.
28:43 Speaker 04 Welcome back. I'm talking with Mustafa Suleyman, CEO of Microsoft AI, about Microsoft's somewhat unusual leadership structure.
28:52 Speaker 04 You are the CEO of Microsoft AI. Microsoft is an interesting company in that it has a CEO and then several other CEOs. Phil Censor is the CEO of Microsoft Gaming. Ryan Roslansky is the CEO of LinkedIn. We just had Thomas Domke from GitHub on. He's the CEO of GitHub. What does it mean to you to be the CEO of Microsoft AI?
29:11 Speaker 05 Look, Microsoft's an enormous organization, a quarter of a trillion dollars in revenue, about 280,000 employees. So the logic of making single individuals accountable for our own P and L, I think is very rational. There's about 10,000 or so people in my org. We have full integration from training the models, building the infrastructure, running the ads platform, managing all the sales leaders, making sure that our content is high quality, getting that integrated across four platforms. So it just creates accountability. That's the logic here. And that's very much how Satya runs it, extreme accountability.
29:50 Speaker 04 One thing that strikes me here is GitHub is a product. LinkedIn is a product. It has a beginning and an end. It's very tangible. People can understand it. Microsoft AI is the company. It's, there's just a lot of AI at Microsoft that is infusing into all of these products. I think Satya has agreed that AI feels like a platform change. There's enormous opportunity inside of a platform change. You've obviously got your core products in Bing and Edge and MSN and all that. But when you think about the relationship to the rest of the AI efforts at Microsoft, where does the line begin and end for you?
30:22 Speaker 05 That's a good question. Right now, the company is so focused on winning on Azure OpenAI, for example, getting our models into production and getting them into the hands of hundreds of thousands, millions of businesses. I'm involved in a lot of the reviews on the enterprise side, but really, I play a role as an advisor and support. And our MAI internal models so far haven't really been focused on those enterprise use cases. My logic is that we have to create something that works extremely well for the consumer and really optimize for our use case. So we have vast amounts of very predictive and very useful data on the ad side, on consumer telemetry and so on. And so my focus is on building models that really work for the consumer companion.
31:07 Speaker 04 That's a product-focused structure, it sounds like. Have you reorganized Microsoft AI to be a more product-driven team?
31:14 Speaker 05 I think that the business was focused on the product before. What we've done is bring the kind of AI sensibility into the heart of each one of our products. So, you know, we have a lot of ranking, we have increasingly conversational and interactive surfaces. We're trying to bring the voice of Copilot to Bing, to MSN. You know, we want to make it a core part of the search experience so that your first thought is, let me just ask my AI. What does my AI think about that? My AI can remember that for me. It can save it, it can organize it. And so making sure that it shows up in deeply integrated ways that really support the surface, rather than sort of just are an adjacent kind of add-on or an afterthought, that's the craft that we're kind of working towards.
31:59 Speaker 04 You are a unique person to have on the show because you also founded DeepMind and you worked at Google. We've had Dennis, the CEO of DeepMind, on the show before. Google's a challenging place to work at. He is the CEO of Google DeepMind. Google doesn't have CEOs like the way that Microsoft has CEOs in that particular way. Can you compare and contrast these two companies? You worked at one huge company, you were at a startup for a minute, now you work at the other huge company. They are very different culturally and structurally. Do you think Microsoft has advantages over Google's approach?
32:30 Speaker 05 I do. I think that at Microsoft, there is a lot of discipline around revenue and P and L. And I think that is a very healthy attitude because it really focuses the mind on what is a consumer going to find truly valuable and be prepared to pay for. Second, I think there's a real long term thinking in terms of like, where does this platform shift take us? And what does the five to 10 year horizon look like? So there's a kind of planning attitude, which at least during my time at Google felt more instinctive. I mean, their instincts are really good. It's a very incredibly creative company and many times they've made long term bets.
33:14 Speaker 05 But it was kind of reactive, instinctively reactive, whereas I think there's a lot more thought in the kind of scenario planning and really kind of thorough deliberation. I would say the third thing, I guess I would say is like, in a Friday's senior leadership team meeting with Satya is just like a phenomenal experience. I mean, it runs basically eight thirty till two thirty in the office in Redmond and everyone's there, all the leaders. And, you know, we sort of review all the big businesses or all the big strategic initiatives in detail. And the SLT cross functionally is in the weeds and that is a pretty remarkable thing. Because they're sort of reviewing these things week after week, like security, huge priority, genuinely like
33:59 Speaker 05 a number one focus for the company, AI and infrastructure, then reviewing all of the businesses. It's very cool to see the other leaders ask the questions or probe. And I kind of see the world through their eyes, which is sort of slightly different. You know, so although there's sort of lots of CEOs, everyone's looking at everyone else's businesses and giving advice and feedbacks. There's quite an intellectually diverse group. And then the other thing I would say is that Because there's obviously a enterprise DNA to the company, there's a real focus on what does the customer want. Like, Google is like, what would be a cool technology for us to build? Whereas like, Microsoft's like, how would this actually help the customer and
34:42 Speaker 05 what are they asking for? I think both of those strategies have their own benefits, but if you swing one way or the other to an extreme way, there's sort of real problems. And so I've certainly enjoyed learning from the fact that Microsoft is very much like, what does the consumer want? What does the consumer want? What does the customer need? Et cetera.
35:00 Speaker 04 You mentioned security at Microsoft. The renewed focus on security is because there were a bunch of lapses earlier this year, right? This has been an issue. Can you just explain, you know, you have an outsider perspective. You're building a lot of products that might go out into the world and do things for people. You're building a lot of products that require a lot of customer data to be maximally useful. As you go into these meetings and you talk about Microsoft's renewed effort on security because there were some problems in the past, how that's affected your approach to building these products?
35:33 Speaker 05 Yeah, I mean, I definitely think that the company culture is security first.
35:38 Speaker 04 But that's now. I just want to be very clear to the audience. It's such as I started saying that now, but it's because there were these enormous security lapses in just in the past year.
35:48 Speaker 05 That's true. That is very true. I'm just saying, since I've got there, I sit in a weekly security meeting where literally all the heads of the companies, various different divisions, are singularly focused on what we can do. And it is the number one priority. Like, there's nothing that can override that. No customer demand, no amount of revenue. It is the first thing that everybody asks. So culturally, as far as I've known it, it is the central priority, which has been good for me, too. I mean, for my businesses are also like, mission critical, that we preserve consumer trust, right? And trust means that, you know, people just expect us to be able to store and manage and use their data in
36:29 Speaker 05 ways that singularly benefit them and in their interests. That is a central part of the culture. And you're right, maybe that's a refocusing of late. So, but it certainly is the case now.
36:42 Speaker 04 You also mentioned you have P and Ls as CEOs. I sort of understand how LinkedIn has a P and L. Right. They have a product. They have some engineers. They make some money. People pay for premium. Microsoft AI, it feels like kind of a lot of losses and not so many profits. How are you thinking about bouncing that out?
37:00 Speaker 05 Oh, we're very profitable. We're very profitable.
37:03 Speaker 04 Well, I'm just saying, there's a lot of forward investment in AI, right? Like, that stuff hasn't paid off yet.
37:09 Speaker 05 That's true. That's true. The AI stuff hasn't paid off yet. I think it's fair to say. But remember, I spend over half my time focused on the Bing business. I mean, and Bing business is doing incredibly well. I mean, we grew 18% last quarter and we actually took gains from Google, which means we're, you know, we're growing faster than Google, which makes everybody feel happy and that's kind of the main goal. So the product is deeply integrated AI. There's generative search results in the context of your search experience. There's increasing conversational experiences there. So, and just the general quality that we've been able to level up with LLMs has been very impressive. And I think that's translating into revenue improvements as well.
37:51 Speaker 05 So in that sense, AI itself is actually in production across the company. It's not like we're just waiting for these sort of chatbots to suddenly miraculously generate a new business model. You know, LLMs are being used at all sizes across the existing business for all kinds of things, like even in Edge, for example, for transcription and summarization built into the browser. There's so many different ways that AI is showing up. I think you've got to think of it more as like a new high bar in terms of the table stakes of the features that we offer.
38:26 Speaker 04 The part where the LLMs are integrated into a bunch of products like Bing or Edge, are they driving more revenue from those products? Or are they just taking share away from Google?
38:39 Speaker 05 The way I think about it is like it's improving the quality of ads that we show, improving the relevance of those ads. And so it's making the experience more useful for the consumer. And that is obviously the overall pie is growing, which is that's the nature of the growth because obviously Google's growing too. So the entire market is continuing to grow. The point is that we're growing faster than Google for this quarter. And I think that's a huge achievement. The team's done an amazing job and it's not about me, by the way. That's a product of them, many years of them investing in quality and relevance and just generally doing a great job.
39:15 Speaker 04 Famously, when Bing with Copilot was introduced, I sat down with Sacha. He said, I want to make Google dance. And then I went and asked Sundar about that. He said, he just gave you that quote so people would run that quote. And that was kind of his response. Sundar was very calm in that way. You came into it after that whole that whole situation and now you run the products that are directly competitive with Google. Do you think that you are, you know, you're growing faster than Google in some places? Do you think that you are actually posing a competitive threat to Google in either Bing with search or Edge with Chrome?
39:48 Speaker 05 Well, I think one of the things that I've realized as I've got a bit more experience and mature over the years is that you have to be very humble about how the landscape changes. On the one hand, this really is an opportunity to relitigate some of the battles of the past. The chips are going to fall in a completely different configuration in the next two or three years. At the same time, that's a very challenging thing to do. Habits die hard and so on. But our goal with this completely new interface is to make it 10 times easier for people to access information, advice, support in a truly conversational way and to do things that our competitors won't do.
40:30 Speaker 05 That are truly useful to everyday consumers. And I think that's actually going to be one of the differentiators. It's like, what is the personality and the tone and the emotional intelligence of an AI companion? Because remember, most people do love information and they like getting accurate and reliable information, but that's going to be commoditized, right? All of these models are going to have that. And despite what we like to think in Silicon Valley, surrounded as we are by, you know, sort of nerds and information obsessives who, you know, read all the content that you can get access to, most people really connect to brands, really connect to ideas in a social way, right? They connect to it because it is
41:14 Speaker 05 friendly, kind, supportive, emotionally reassuring. And, you know, I think that's going to form a big part of the way these models actually turn out to be successful in a few years' time.
41:26 Speaker 04 I need to ask you the core decoder question, but then I want to come back to the idea that the information will be commoditized. You've described a lot of change, right? You were at one company, you were at a startup, you're at Microsoft, you're learning how Microsoft works. You have big decisions to make about how to deploy these products. What is your framework for making decisions? How do you make them?
41:43 Speaker 05 The way that I like to operate is in a six-week rhythm. So I have a six-week cycle, and then we have a one-week meetup for reflection, retrospectives, planning, brainstorming, being in person. The reality post-COVID is that people work from all kinds of places and they like that flexibility. So my rhythm is to keep people in person two to three days a week, and then really come together for that seventh week of retrospectives. So my general framework is to try to be as in the weeds as possible. Okay, really spend a lot of time in our tools, tracking telemetry, hearing feedback from people, and then creating
42:24 Speaker 05 this very tight operating rhythm where in the context of a cycle, six, seven-week process, we have a very falsifiable mission. Every single team can express in a sentence exactly what it is they're going to deliver, and it'll be very falsifiable at the End of that, so we'll know. And then when we observe, you know, whether or not that happened, that's a moment for retrospective and reflection. And I like to really write. I'm a writer. I think by writing. And I like to broadcast my writing. So every week I write a newsletter to the team that is just like a reflection on what I've seen, what I've learned, what's changing, what's important. And then I document that over time and use that to kind of track and like steer where we're going.
43:09 Speaker 05 That's kind of the basics of how I practically implement my process for reflection and and stuff like that. But in terms of the framework, so one thing is to really tune in to the fact that no matter what product you invent, no matter how clever your business model is, we're all surfing these exponential waves. And the goal is to predict which capabilities fall out of the next large training model. And if you overthink that and assume that actually there's some genius, you know, new ecosystem incentive or new business model or new UI style. All of that is super important. But if you think that it's really only going to be that
43:54 Speaker 05 or that that's going to be the overwhelming driver, I think that's a mistake. And and maybe this comes from sort of my fifteen years experience of trying to build these models. You know, remember at DeepMind, twenty fourteen to twenty twenty, I was banging my head against the table, trying to like ship machine learning models, ship CNNs in the early days, find classifiers, like do re-ranking, try and predict what to watch next on YouTube, trying to do activity classification on your wearables, trying to ship crash detection algorithms inside of Waymo, like every single applied practical machine learning objective I had explored there. And and now we actually have the tools to be able to do those things and do them really, really well. They're really working.
44:36 Speaker 05 So we're basically surfing those tides. The goal is to really nail those waves because we already have models.
44:45 Speaker 05 Which are giving us more than we can extract and apply into products. That's quite a profound state that we're in, you know. We actually haven't yet completely extracted all the gains from the current class of frontier language models. Every week, there's still some new capability or some new trick, or people have crafted or sculpted them in post-training in a new way. And I think that that that is going to continue for the next few years to come, many years to come, in fact. So in terms of the decision-making framework, the goal is to be very focused on model development and scaling those models, getting them to be practical and useful, really aligning them and getting them to behave in the way that you need for your product.
45:30 Speaker 04 Well, let me ask you about that because model development and we need to get more of the models we have now. There's a little bit of attention there, right? There's a notion that the scaling laws are going to run out, that the next class of models is not significantly outperforming the models we have now. And I think you can track that in just the way we're talking about the products. A couple of years ago, it was AI is an existential risk. We have to stop it so we can make sure it's aligned before we kill everyone. And now we're kind of at like, well, we got to get more out of the models we have now and actually ship some products and make some money, hopefully, and figure out what it's all good for and how to best use it. Because it doesn't seem like the next generation of models is actually running away as fast as we think they might. Is that your view that the sort of frontier models are not getting better as fast as as we thought they might?
46:15 Speaker 04 And so we have to get more out of what we have?
46:18 Speaker 05 No, I don't think that's true. I think that they're going to continue to deliver the same, you know, seismic gains that we've seen in the previous generations. Remember that they are more costly and they're more fragile and they take longer to train this time around. So we're not going to see them happen in the same sort of 12 to 18 month timeframe. It's going to shift to 18 to 24 months and then a bit longer. But I don't see any sort of sign that there's this like structural slowdown. I kind of see the opposite is that we there's there's huge gains to extract from where we are today. But it's very clear to me that there's huge gains to extract from the next two orders of magnitude, you know, of of training as well.
47:01 Speaker 04 We have taken another quick break. We'll be back in a minute.
47:12 Speaker 01 This episode is brought to you by Subaru. You know that place your mind always wanders to? The lake, the mountains, the homes of the people you love most? The completely redesigned 2026 Subaru Outback is built to help you get there. With legendary capabilities, standard symmetrical all wheel drive, and the confidence to go further. The 2026 Subaru Outback. Love never looked so good. Visit Subaru.com slash Outback to learn more.
47:38 Speaker 02 Are your ad campaigns lighting up the dashboard? But not the pipeline? That's bull spend. And marketers are calling it out in. Dashboard Confessions.
47:47 Speaker 03 My boss asked for results, so I opened my dashboard for the only positive sounding metric I had. Impressions.
47:55 Speaker 02 Cut the bull spend. See revenue, not just reach. LinkedIn delivers the highest return on ad spend of major ad networks. Advertise on LinkedIn. Spend $250 on your first campaign and get a $250 credit. Go to LinkedIn.com slash campaign. Terms and conditions apply.
48:08 Speaker 06 College football is back. So Hilton called to me, the superstition concierge, to make your fan rituals a reality. Need a room to match your lucky number? We got you. Want to make sure our team doesn't wash your lucky jersey? Oh, that smells lucky. Hilton's unmatched hospitality can keep up with any superstition. Even a marching band wake up call at 5:55 in 55 seconds. Hit it! When you need a team that will do whatever it takes on game day, it matters where you stay. Hilton, for the stay.
48:41 Speaker 04 Welcome back. I'm talking with Microsoft AI CEO Mustafa Suleyman. Right before the break, we were talking about extracting gains from current AI models. Mustafa mentioned the idea of commodifying information, and I definitely wanted to dig into that a little bit more. I want to make sure we talk about the thing you mentioned, the commodification of information. And then I want to make sure we talk about agents very quickly to bring this all around to the products to come. The commodification of information is, I think, the big story of the internet that we have today, the platform internet, for lack of a better word. You go to Google, you ask it a question. Now it might spit out an AI generated answer. You go to MSN, you ask it for the news, and it might algorithmically or with AI sort a bunch of news and summarize that news for you. Everyone's headed in this way. We've been talking about this for a long time.
49:26 Speaker 04 To train the next generation of models, we need even more information. You've gotten yourself into some trouble, I would say, saying that the information of the internet is quote unquote freeware and the expectation is that you can use it to train. There are a lot of lawsuits, including several pointed at Microsoft. Where do you think that next body of information comes from before we sort out the copyright implications of using all this stuff to train?
49:50 Speaker 05 So one way of thinking about it is that the more computation you have, the more time these models can spend attending to the various sort of relational components of all that training data. So think of flops as a way to spend understanding time, learning the relationship between all these various sort of training inputs. So first of all, you can still gain more from just having more computation to learn over all the existing data. Second thing is, we learn a vast amount from interaction data. You know, users tell us implicitly and explicitly how they feel about an output. Is it high quality? Is it used? Is it ignored?
50:33 Speaker 05 Third is, we're generating vast amounts of synthetic data. That synthetic data is increasingly high quality. When you ask a AI teacher or a raider to compare two or three different examples of the synthetically generated output and, you know, the human written output, it's extremely difficult to detect those precise nuances. So the synthetic data is increasingly high quality and used in a whole bunch of different settings. Then the fourth is, I can imagine AIs talking to other AIs, asking for feedback, AIs that have been primed for different areas of expertise or different styles, prompted in different ways. You can imagine those interactions producing valuable new knowledge, either because they're
51:16 Speaker 05 grounded in different sources or because, just because of their stylistic output, they're actually producing novel interactions. So I don't necessarily see data being the limitation anytime soon. I think that there's still huge benefits to come from scale for a foreseeable future.
51:33 Speaker 04 So that's all new data, right? You're going to get a bunch of interaction data, maybe the synthetic data will be a high enough quality to train the next generation of models. But the original data sets were the web, right? It was a bunch of web content, it was the entire, maybe it was to video platforms to some extent from some of the model providers. The quote I have from you in June, I think you were speaking to Andrew Ross Sorkin. Here's a quote, you said, "I think that with respect to content that's already on the open web, the social contract to that content since the 90s is that it's fair use, anyone can copy it, recreate with it, reproduce with it." That has been, quote, "freeware," if you like, that's the understanding. I'm curious, right, you said that, that was the understanding for search, right? And there was a lot of litigation around search and Google image search and Google
52:17 Speaker 04 Books that led there. Do you think that that is still stable enough for you in the age of AI with all of the lawsuits outstanding?
52:24 Speaker 05 I mean, what I was describing in that setting was the way that the world had perceived things up to that point. And I think that my take is that just as anyone can read the news and content on the web to increase their knowledge, under fair use, so can an AI. Because an AI is basically a tool that will help humans to learn from publicly available material. And all the material that has been used for generating or training our models has been scraped from publicly available material.
52:54 Speaker 04 But publicly available and copyrighted are very different things on the internet, right? Like publicly available does not mean free of copyright restriction.
53:04 Speaker 05 Oh, yeah. I mean, look, obviously, we respect the content providers' rights. So that's not, you know, that's an important distinction. But, you know, I guess what I'm trying to say is, from our perspective, there's certain types of content, like, for example, in our Copilot Daily or MSN Daily, that is paywall publisher content that we pay for directly. And that is what MSN has been doing since the beginning of time, is what we've decided to do with Copilot Daily for high-quality content, because we want those publishers to create an information ecosystem that really works for everybody. And I just think this is one of those things where, you know, things will play themselves out in the courts. Like, at any time when there's a new piece of technology, it changes the social contract as it is at the moment.
53:49 Speaker 05 There's clearly a gray area in terms of what constitutes fair use and whether an AI can have the same fair use as a human. And, you know, we'll just have to sort of play it out, you know, over the next few years. And I think we'll, we'll have some perspective over that in the next few years as things land.
54:05 Speaker 04 One of the reasons that I ask that as directly as I'm asking it is the cost of training the next generation of models is very, very high. But that cost is built on a foundation of, well, the training data is free. And if a couple of court decisions go a couple away, the cost of the training data might skyrocket, right? If a court says it's not fair use to use the New York Times as content, or it's not fair use to use these books from these authors, suddenly you might have to pay a lot of money for that data as well. Do you think that that is something the business can sustain?
54:39 Speaker 05 Yeah, I mean, we already pay for books at huge scale, right? So, you know, and if it's a copyrighted book, that's not, we're not sort of, you know, taking that, hoovering that up from the internet.
54:50 Speaker 04 Well, Microsoft might not be, but there's a very big lawsuit from a bunch of publishers who say that, for example, OpenAI is, right? And that's the model that you're reliant on. So it just seems like there's a, maybe legally, we'll see what answer the answer is. But economically, there's also a lot of uncertainty here, right? Because of the costs of the underlying data.
55:10 Speaker 05 Yeah, that's true. And I think, you know, our focus has been to make sure that we pay for the really high-quality copyrighted material from publishers, both news publishers and, you know, book publishers and others. And I think that's going to continue. And that's definitely what we're committed to.
55:26 Speaker 04 Who decides what's high quality?
55:28 Speaker 05 That's actually an interesting question. Quality is actually something that we really can measure. We want to make sure that the content, especially from a nonfiction perspective. So we're particularly interested in academic journals, academic textbooks. We can verify the source and citations for that, for that knowledge. And that is one of the big measures that we consider to be high quality, so.
55:54 Speaker 04 But, you know, the visual artists, the nonfiction artists, visual effects artists, the movie industry, right? They're saying, hey, we're going to get pushed out of work because we are not compensated for any of the work that's going into these models. Like, how do you think this plays out for that? Because... Again, this is, I agree that the law here is deeply uncertain. These cases are going to play out, but I'm looking back at what you're describing as the social contract of the web. And I, what I see is, oh, Google litigated a million of these lawsuits. We didn't just all wake up one day and decide this is how it's going to work. Google went to court 15 times, and they were a bunch of kids who had slides in the office, and they had just made Google, and they were just very, they were positioned as a company in a moment, and they had a product
56:38 Speaker 04 that was so obviously useful in so many different ways, that they kind of got away with it. And I don't know that the tech industry is in that position anymore. I don't know that the products are so obviously useful, the way that putting Google on the internet for the first time ever was so obviously useful. And I certainly don't know that the feelings from particularly one set of creators are as mixed or to positive as they were for Google back in the 90s and early 2000s. And that, to me, feels like, I mean, you're on the board of The Economist, right? Like, that to me feels like the, the people that make the work are having the most mixed emotions of all. Because yes, I think a lot of us can see the value of the products, but we also see the value transfer to the big tech companies, not the upstarts, not the cute
57:23 Speaker 04 kids with the slides in the office.
57:25 Speaker 05 I think that this is going to be more useful and valuable than search.
57:30 Speaker 04 Okay.
57:30 Speaker 05 I think search is completely broken, and I think it's a total pain in the butt. And we've just kind of got used to using a terrible experience, typing a query. Just sort of think about what a query is. We had to invent the word query effectively, to describe this really weird, restricted way that you express a sentence or a question into a search engine because of the weakness of the search engine, and then you get 10 blue links, and then those things are vaguely related to what you're looking for. You click on one, and then you have to go and refine your query. I mean, it is a painful and slow experience. I think that if we can get this right, if we can really reduce hallucinations to the minimus amount,
58:11 Speaker 05 I think we've already demonstrated that they don't have to be toxic and biased and offensive and all the rest of it. Like, it's pretty good. It's not perfect, but it's Getting much much better and I think it's only going to get better with more stylistic control, then these conversational interactions are going to become the future of the webs. Quite simple. I mean, this is the next browser. This is the next search engine. It is going to be a hundred times easier for me to just turn by voice to my co-pilot and say, hey, co-pilot, what's the answer to this? I already do it five times a day. It is my go to. It's made my bottom right hand app in my iPhone. My thumb instantly goes to it. I use the power button to open, you know, my favorite app like I did with Pi. I mean, it is clearly the future,
58:55 Speaker 05 that conversational interaction. So to me, the utility is phenomenal. And I think that is going to weigh into the cases as they make themselves make their way through the court.
59:05 Speaker 04 So that leads us, I think, directly to agents, right? Where you are just going to ask some app on your phone or some part of the operating system on your computer to do something and it will go off and do it. It will bring you the information back or it will accomplish some task on your behalf and bring you the result. You and I have talked about this before in various ways. That commodifies a lot of the service providers themselves, right? You say, I want a sandwich and now I don't know if it's DoorDash or Uber Eats or Seamless or whoever is going to bring me the sandwich. My AI is going to go out and talk to them. That implies that they will allow that to happen. They will allow the agents to use their services. In the best case, that they would provide APIs for you to do it. In the worst case, that they let people click around on
59:49 Speaker 04 their websites, which is a thing that we've seen other companies do. And sort of in the medium case, that they develop some sort of AI to AI conversation, right? Not quite an API, not quite. We're just literally clicking around on a website and pretending to be human, but our AIs are going to have some conversation. What is the incentive for those companies to build all of those systems or allow that to happen, to become disintermediated in that way?
1:00:12 Speaker 05 I mean, people often ask that when there's a new technological or scientific revolution and we're going through it and it's causing a massive amount of disruption. And people are curious, it's like, well, why would someone do that in 10 years? And then if you look back for centuries, it's always the case that if it is useful, it gets cheaper and easier to use, it proliferates, it becomes the default. And then the next revolution comes along and completely turns everything on its head. My bet is that every browser and every search engine and every app is going to get represented by some kind of conversational interface, some kind of generative interface.
1:00:55 Speaker 05 The UI that you experience is going to be automatically produced by an LLM in three years, in five years, you know, and that is going to be the default. And they will be representing both the brands, businesses, influencers, celebrities, academics, activist organizations, just as each one of those stakeholders in society, you know, ended up getting a podcast, you know, getting a website, writing a blog, you know, maybe building an app, like using the telephone back in the day, you know. So the technological revolution produces a new interface, which completely shuffles the way that things are distributed.
1:01:40 Speaker 05 And, you know, some organizations adapt really fast and they jump on board and it kind of transforms their businesses and their organizations and some don't. And so there will be a kind of, you know, an adjustment. We'll look back by 2030 and be like, oh, that really was the, you know, the kind of moment when there was this true inflection point because these conversational AIs really are the primary way that we have these interactions. And so you're absolutely right, like, you know, a brand and a business is going to use that AI to talk to your personal companion AI. Because I don't really like doing that kind of shopping. And some people do, and they'll do that kind of browsing experience direct to consumer. And many people don't, and it's actually Super frustrating and hard and slow.
1:02:24 Speaker 05 And so increasingly you'll come to work with your personal AI companion to go and be that interface, to go and negotiate, find great opportunities and adapt them to your specific context. And that'll just be a much more efficient protocol because AIs can talk to AIs in super real time. And by the way, let's not kind of fool ourselves. We do already have this on the open web today, right? We, we, we have behind the scenes, this real time negotiation between buyers and sellers of ad space or between search ranking algorithms. So there's already that kind of marketplace of AIs. It's just not explicitly manifested in language. It's operating in vector space.
1:03:01 Speaker 04 Well, so that's the part I'm really curious about. The idea that natural language is the platform shift, is the paradigm shift.
1:03:07 Speaker 05 Yeah.
1:03:07 Speaker 04 I think is very powerful. I don't think it has been expressed very clearly, but the notion that actually the next form of computing is inherently based in natural language, that I'm just going to talk to the computer, it's going to go off and do some stuff because it understands me, is very powerful. I buy it. How that actually plays out on the backend is the part that to me still feels up in the air, right? I'm going to ask for a sandwich. That necessitates there to be companies that are in the business of bringing me a sandwich. And how they talk to my AI and how they stay in business seems very challenging. Right, right now, those companies, they're in business because they can sell ad space on my phone to the other companies that actually make the sandwiches. They have upsells. There's a million different ways that these companies make money.
1:03:52 Speaker 04 If they abstract themselves down to their AI talks to my AI and says, okay, here's a sandwich, and I take away all of their other revenue opportunities, I'm not sure that that ecosystem can stay relevant or even alive.
1:04:06 Speaker 05 I'm not sure about that. I mean, your sandwich making AI is still going to want to sell itself, be persuasive, be entertaining, produce content to the consumer, right? It's not that it, it kind of completely disintermediates and disconnects because brand and display advertising is still super relevant. And, you know, there will be ways that that sandwich making AI shows up in the context of your personal AI context in maybe a sponsored way too. So, you know, there'll still be that core framework of keyword bidding, paying for presence, paying for awareness. There's still going to be ranking. That is still going to be relevant to some extent. It's just that.
1:04:48 Speaker 05 You are going to be represented by a personal AI companion that is going to be that interlocutor negotiator. And those two AIs are going to have an exchange in natural language, which is what we would want. We'd want to be able to go back and audit that negotiation and check where the error came from and see if it really was a good price in hindsight and all the rest of it.
1:05:08 Speaker 04 As you start to build these products in Copilot, have you had these negotiations with these other providers? Have they started to say what they would want?
1:05:16 Speaker 05 We've talked, I wouldn't describe them as negotiations. I mean, I think lots of brands and businesses are building their own AIs. Today, they're characterized as customer support AIs that pop up in your website. But tomorrow, in two or three years' time, they're going to be fully animated, conversational, rich, clever, smart, digital co-pilots that live in social media. They're going to appear on TikTok, right? They're going to be part of the cultural space. So, you know, I think that there's not so much a negotiation to happen there. I think it's just this inevitable tide of the arrival of these co-pilot agents.
1:05:57 Speaker 04 You run MSN. You obviously have peers at Microsoft who run other kinds of social networks, other kinds of information products. I see a flood of AI slop choking out some of these networks. I've searched Facebook for spaghetti Jesus and I have seen the other side of the singularity, my friend. How do you, right? We already had one conversation about determining high quality. And the answer is sort of, I know it when I see it. But if you run these networks and you're faced with a bunch of agent AIs who are talking or AI influencers on TikTok, can you label that stuff effectively? Can you make it so that users can only see things from other people?
1:06:36 Speaker 05 You certainly can. It would require a shift in the identity management system of the platform, which has a lot of pros and cons. You can certainly tell which accounts come from a human and which are AI-generated. To some extent, I think there can be digital watermarking and signing for verified human content or verified AI content from a specific source. And then to some extent, there can be detection of synthetically generated content because that does have a specific signature. Long term, I don't think that's a defense. I think it is going to be perfectly photorealistic and very high quality. And it's going to be a game of cat and mouse, just as it has been in security and privacy and information for decades and centuries, actually.
1:07:20 Speaker 05 So I expect that to continue. It is going to get harder and more nuanced. But this is the sort of natural trajectory of things.
1:07:29 Speaker 04 Do the people who run LinkedIn or do your folks at MSN say this is a problem that we can't stop? Right? We need to make sure we don't have too much AI content here because right now it's not good enough, right? You can, I can see it a mile away. I see those bullet points. I think someone made this with ChatGPT. I don't even want to read it. Is that a problem that you're facing right now? Is it a problem to come?
1:07:49 Speaker 05 I think it's a problem to come, but the thing I would say is, you know, we humans are behaviorists, right? We observe the output of other humans and we evaluate and we decipher trust based on the quality of information with respect to our own assessment. Is it accurate? Is it reliable? Is that person consistently doing what they said they would do? And so we can observe their actions. And rather than sort of introspecting, why did this happen? Why did this neural network generate this output? Why did this person come to this conclusion? And that's actually an important distinction because I think a lot of purists are kind of fixated on the causal
1:08:30 Speaker 05 explanation for why an output has been produced, rather than the kind of more observational assessment of like, was it useful? Does it do the same thing over and over again? That's what drives trust. So I do think that poor quality content will be detectable in that sense, or sort of AI content that is deliberately misrepresentative or misinforming will be detectable because I think we will have better models and we're getting them all the time for ranking down and deprioritizing certain types of content.
1:09:00 Speaker 04 One of the things that I've been thinking about a lot throughout this conversation, you're in charge of Microsoft's consumer business. Microsoft's consumer business, I think famously right now in 2024 is built around
1:09:14 Speaker 04 Not making the iPhone, right? Like, that's the thing that Microsoft missed in consumer famously. It has nothing to do with you. But the iPhone happened. Microsoft pivoted to being an enterprise business. And it's now slowly coming back because I think the company rightfully sees a platform shift, a paradigm shift in computing. Apple still exists. The iPhone still exists. You said, I've got this icon on my iPhone. It made it onto the home screen. It's in this preferred position, the position everybody wants in the bottom corner. Apple has a pretty big distribution advantage here. They have a deal with OpenAI to use ChatGPT. Can you make products so good that you overcome the iPhone's distribution advantage? They're bundling into the operating system?
1:09:49 Speaker 05 It's a great question. I mean, distribution and defaults really matter. And so from our perspective, obviously, we're focused on distribution deals. But fundamentally, we are also focused on building something that's truly differentiated. And to me, that AI companion really is going to be differentiated. The tone and the style of that interaction matters. The fact that it will be able to remember you and what you've said over time, the fact that it will reach out at that opportune moment, just before a difficult moment in your life, where you're starting a new job, or your kids just having their birthday party or something. You're in a moment where having your companion reach out, be supportive, is a differentiator. And that's how a lot of people make their decisions, and it's how a lot of people seek support.
1:10:32 Speaker 05 So I think that's a really big opportunity to spread, you know, a good vibe and spread kindness. And I think most apps and most kind of product thinking in Silicon Valley doesn't really engage with that kind of emotional plane in the way that the advertising industry in New York just thinks of that as second nature, for example. And I think that's a big shift that we're making as an industry, and it's certainly one of the areas that we're going to be focused on in Copilot. And we have to build something that is really beautiful and differentiated. It's going to be a real challenge. It's not easy.
1:11:04 Speaker 04 Do you think this is an opportunity to build consumer hardware again? Not a phone, but whatever comes after the phone?
1:11:10 Speaker 05 I am open minded about that. The voice first experiences are going to be transformational and they do represent new platform. And I think we're increasingly tired of our screens. I'm frankly sick of looking at a grid of multi-colored icons on my iPhone. I think many people are. You sort of feel trapped down this sort of, you know, structured, fixed kind of unit of tapping these things. And I don't know, I think people are looking for more opportunities to go hands-free and to be away from keyboards and screens, leave your phone at home. So I think there's a lot of opportunity there. I'm very, very interested in that space.
1:11:48 Speaker 04 Have you played with the products that are out now, the Humains, the Rabbits?
1:11:51 Speaker 05 I have, I've played with all of them, yeah. And I've actually just come back from an extended trip to China where I visited all the big manufacturing companies, got to know those guys. Very impressive what they're doing out there, moving at light speeds. Very, very interesting to see.
1:12:07 Speaker 04 Should we expect hardware from you?
1:12:10 Speaker 05 No, not anytime soon. But I think we're, you know, we're a huge company. We're keeping open mind about lots of things and, you know, we'll see how things go.
1:12:18 Speaker 04 Very good. Well, Mustafa, we're going to have to have you back very soon. I have a million questions here I didn't get a chance to ask you. This was great. Thank you so much for being on the show.
1:12:24 Speaker 05 This has been a lot of fun. Thanks, Eli. I really appreciate it.
1:12:29 Speaker 04 I'd like to thank Mustafa for taking the time to join me on Decoder. We spoke over the Thanksgiving break, so I appreciate it. I'd also like to thank you for listening. I hope you enjoyed it. If you'd like to let us know what you thought about this episode or really anything else, drop us a line. You can email us at [email protected] . We really do read all the emails. And for our last episode of the year, I will be answering some listener questions. So now's the best time to send them in if you want to ask anything. You can also hit me up directly on Blue Sky or on Threads. I'm at reckless1280 on Threads and at reckless.bsky.social on Blue Sky. We also have a TikTok, check it out, it's at DecoderPod, it's a lot of fun. If you like Decoder, please share it with your friends and subscribe wherever you get your podcasts. Decoder is production of The Verge and part of the Vox Media Podcast Network. Our producers are Kate Cox and Nick Stat. This episode was edited by Travis Larchuk and Callie Wright.
1:13:13 Speaker 04 Our supervising producer is Liam James. The Decoder music is by Breakmaster Cylinder. We'll see you next time.
1:13:26 Speaker 07 This week, it pays extra to be a MyLowe's Rewards member. Through October 14, members get $10 MyLowe's money when you spend $200 or more on an eligible purchase during MyLowe's Money Days. Also, using your MyLowe's Rewards credit card? Even better, that's an additional $20 MyLowe's money. Use it to save on your next Lowe's haul. Exclusions, restrictions, and more terms apply. See Lowe's.com/MyLowe'sMoneyDays for details. MyLowe's money expires 30 days after issuance. Subject to change. Credit offer subject to credit approval.
1:13:55 Speaker 08 Your heart can tell you a lot about your health. Apple Watch Series 12 measures your heart rate every five seconds with the most accurate heart rate sensing in wearable. So your vitals app, now with heart rate variability, can tell you when something is off. And your readiness score can let you know when to rest and when to push. Hear the story in every heartbeat with Apple Watch Series 12. The features described are for wellness purposes only and not for medical use. iPhone 11 or later required. Based on Apple conducted study of heart rate accuracy, August 2026. Visit apple.com slash apple watch series 12.
Previous AI is a money pit — here’s why investors don’t mind Next Why every company wants a podcast now Page updated October 12, 2026 · transcript and summary are machine-generated