Google DeepMind CTO: Advancing AI Frontier, New Reasoning Methods, Video Generation’s Potential

Koray Kavukcuoglu is the Chief Technology Officer of Google DeepMind. Kavukcuoglu joins Big Technology to discuss how his team is pushing the frontier of AI research inside Google as the company's Google IO developer event gets underway. Tune in to hear Kavukcuoglu break down the value of brute scale versus novel techniques and how the new inference-time “DeepThink” mode could supercharge reasoning. We also cover Veo 3’s sound-synced video generation, the open-source-versus-proprietary debate, and what a ten-percent jump in model quality might unlock for users everywhere. Learn more about your ad choices. Visit megaphone.fm/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Alex Kantrowitz?

  What's going on in the heart of Google's AI research operation? We'll find out with Google DeepMind's Chief Technology Officer, right after this. This episode is brought to you by Genesis. What does it actually take to put Agentic AI to work across an entire enterprise? I recently spoke with Genesis Chairman and CEO Tony Bates about why orchestration is emerging as a competitive advantage in customer experience, and what companies need to get right in the AI era. Then, I sat down with Adam Mitchell, Head of Enterprise Business Solutions at Voya Financial, to go inside a large-scale Agentic CX transformation, including the business decisions, trade-offs, and lessons along the way. You can watch both conversations now on my YouTube channel today.

• 0:44Alex Kantrowitz?

  It's never been more challenging to get frontier compute. How do you know where to look, who to trust, or how much to pay? Akash is an open cloud that provides easy access, flexibility, and peace of mind. That's how companies like Razer were able to cut their inference costs by 15 times. Visit akash.network/alex for a free consultation. That's akash.network/alex for a free consultation. Welcome to Big Technology Podcast, a show for cool-headed and nuanced conversation of the tech world and beyond. We have a great show for you today, a bonus show just as Google's I/O news hits the wire. We have so much to talk about, including what's going on with the company,

• 1:28Alex Kantrowitz?

  what it's announced today, but also what is happening in the research effort underlying it all. And we have a great guest for you. Joining us today is Korai Kabucholou. He is the Chief Technology Officer of DeepMind. We're going to speak with Korai today, and then tomorrow you'll hear from DeepMind CEO Demis Hassabis. Korai, great to see you. Welcome to the show. Thank you very much. Folks, by the way, if you're watching on video, Korai and I are in two separate conference rooms in Google's I don't know, it's a pretty cool new building that they have. It's called, what, Gradient Wave or something?

• 2:00Speaker 01

  We call it the Gradient Canopy.

• 2:03Alex Kantrowitz?

  Gradient Canopy. Anyway, we're here and I wanted to ask you a question that we've been asking on the show a lot, which is the scale question. Now, Google has a tremendous amount of compute at your disposal. And so you basically have the option. Is it scale that you want to throw at these models or is it new techniques? So let me just ask it to you as plainly as I can. Is scale the star right now? Or is it a supporting actor in terms of trying to get models to the next step?

• 2:32Speaker 01

  It's a, um, it's a good question. I think also the way you framed it because it is definitely an important factor. The way I'd like to think about this is it's rare that in any research problem, you would have a dimension that pretty confidently would give you improvements, right? Like, of course, like with maybe diminishing returns, but most of the time with research, it's always like that. So like when we think about our research right now, in the case of generative AI models, right? Scale is definitely one of those, but it's one of those things that are equally important with other things. When we are thinking about our architectures, like the architectural elements,

• 3:14Speaker 01

  the algorithms that we put in there that come, that make up the model, right? They are as important as the scale. We of course analyze and understand as with scale, how do these different architectures, different algorithms become more and more effective? That's an important part because you know that you are putting more computational capacity. And like you want to make sure that you research the kinds of architectures and algorithms that pay off the best under that kind of scaling property, right? But as I said, that's not the only one. Data is really important. I think it is as critical as any other thing. The algorithms, architectures, modules that we put into the system is important.

• 3:57Speaker 01

  Understanding their properties with data, with more compute, that is as important, right? And then of course inference time techniques is as important as well, right? Like, because now that you have a particular architecture, a particular model, you can multiply its reasoning capabilities by making sure that you can use that model over and over again through different techniques at inference time.

• 4:25Alex Kantrowitz?

  You know, to me, it's both hopeful and puzzling to hear about all the different techniques to make these models better. And I'll explain that. It's hopeful because it seems like we're definitely going to see a lot of improvement from where the models are today, and the models are already pretty good. The thing that's puzzling to me is the idea with scale was there was effectively limitless potential in making these AI models bigger. And you said the words diminishing returns. And we've heard that from you and basically everybody working on this problem. And it's no secret, right, that right now we've been waiting forever for GPT-5. Meta had some problems with Llama.

• 5:07Alex Kantrowitz?

  Anthropic has been trying to tell us there's a new Claude Opus model coming out forever. We haven't seen it. So clearly, a lot of the research houses, maybe with the exception of Google, are struggling with what you get from when you make the models bigger. And so I just want to ask you about that. I mean, it seems like it's nice that there are all these techniques. But again, thinking about this one technique that was supposed to have limitless potential, is that a disappointment for the generative AI field overall, if that's not going to be the case?

• 5:38Speaker 01

  Yeah, I really don't think about it that way because we have been able to push the capabilities of the models quite effectively, right? I think in a way, the whole scale discussion starts from the scaling those, right? Like scaling those explain the performance of the models under both data and compute and number of parameters. Right? And like researching all three in combination is the important thing. And when I look at the kind of progress that we are getting from that general technology, I think it is still improving. What I think is important is to make sure that there is a broad spectrum of research

• 6:23Speaker 01

  that is going on across the board. And rather than thinking about scaling only in one dimension, there's actually many different ways to think about it. And investing in those. And we can see the returns that I think across the field, really, not just not just here at Google, but across the field, many different models are improving with quite significant steps, right? So I think as a field, the progress has been quite stellar. I think it's very exciting. And in Google, we are very excited about the progress that we have been having with Gemini models, going from one point five to two to two point five.

• 7:08Speaker 01

  I think we had a very steady progress, very steady improvement in the capabilities of models, both in the spectrum of the capabilities that we have, but also at the quality level for each capability as well, right? So I think what I'm what I'm excited about is we are pushing the frontier all the time, and we see returns in many research directions and many different dimensions of research directions. And I'm excited that there is actually, I think, there is there's a lot more progress to do, and there's a lot more progress that needs to happen for reaching AGI as well.

• 7:43Alex Kantrowitz?

  We had Jan LaKoon on the show a couple of weeks ago. You worked in Jan's lab. Jan emphatically stated, there is no way the AI industry is going to reach human level intelligence, which is his term for AGI, just by scaling up LLMs. Do you agree?

• 8:01Speaker 01

  Well, I mean, I think that's a hypothesis, right? That might turn out to be true or not. But also, I don't think that there's any research lab that is trying to only do scaling up the LLMs. So like, I don't know if anyone is actually trying to negate that hypothesis or not. I mean, we are not. From my point of view, we are investing in such a broad spectrum of research that I think that is what is necessary. And clearly, I think, like many of the researchers that I talk to and me myself, I think that there is a lot more critical elements that needs to be invented, right?

• 8:42Speaker 01

  So there is critical innovations on our path to AGI that we need to we need to get through. That's why we are still looking at this as a very ambitious research problem. And I think it is important to keep that kind of critical thinking in mind. With any research problem, you always try to look at multiple different hypotheses, try to look at many different solutions. A research problem this ambitious, like probably the most important problem that we are working in our lifetimes. Right, it is the hardest problem maybe we are working. As as a problem, as a research problem in our in our in our work.

• 9:25Speaker 01

  I think like having that really ambitious research agenda and portfolio. And making investments in many different directions is the important thing. From my point of view, what is important is defining where the goal is. That our goal is AGI, our goal is not to build AGI in a particular way. What's important is build the AGI in the right way, that is positively impactful. That is building building on it, that we can bring a huge amount of benefits to the world. That's why we are trying to research AGI, that's why we are trying to build AGI. Right, like AGI in itself, sometimes like it it might come across as it's a goal in itself.

• 10:08Speaker 01

  The goal in itself is the fact that if we do that, then we can huge the benefit all of society, all of the world. Right, that's the goal. So like with that responsibility, of course, like you put in not just particular. It's not very important to me if that particular hypothesis is important or not. What is important is we reach that with doing a very ambitious research by pursuing a very ambitious research agenda. And building a very strong understanding of the field of intelligence.

• 10:41Alex Kantrowitz?

  Okay, so let's get to a little bit of that research agenda. One of the announcements that you're making at I O, which is this week, which just when this airs, it will just have been made. Is that you're there's a new product called Deep Think that you're releasing. Which is relying on reasoning, or as you put it, test time compute. I think I have that right in terms of what the product is going to look like. How effective has including reasoning in these models been in advancing them? I mean, would you say, when you think about all the different techniques that you've discussed so far today, scaling included, what sort of a magnitude improvement are you seeing by using reasoning?

• 11:26Alex Kantrowitz?

  And talk a little bit about DeepThink.

• 11:28Speaker 01

  Okay, I mean, first of all, DeepThink, it's not necessarily, it's not like a separate product. It is a mode that we are enabling our 2.5 Pro model so that it can spend a lot more time during inference time to think, to build hypotheses. And the important thing is to build parallel hypotheses rather than a single chain of thoughts. It can build parallel ones and then can reason over multiple of those, build a hypothesis, build an understanding over those, and then continue building those parallel chains of thoughts.

• 12:04Alex Kantrowitz?

  But this one thinks a little bit longer than your traditional reasoning model?

• 12:08Speaker 01

  It will, I mean, in the current setup, yes, it takes longer and it takes, because like, understanding those parallel thoughts and building those parallel thoughts, it's all, it's all a much more longer process. But like, one thing that we are also, that we are also positioning it as is, right now it's research, right? Like, we are sharing some initial research results. We are excited about it. We are excited about the technique, that what it enables, what it can actually, what it can actually enable in terms of new capabilities and new performance levels.

• 12:51Speaker 01

  But it's early days and that's why we are only sharing it right now. We are going to start sharing with safety researchers and some trusted testers because we want to also understand the kinds of problems that people want to solve with it and the kinds of new capabilities it brings and how we should train it the way that we want to train, right? So it is, it is early days on that, but it is like, what I think is an exciting research direction that we found in the inference time thinking model space.

• 13:21Alex Kantrowitz?

  Yeah, can, so can you talk about what precisely it does different than traditional reasoning models?

• 13:26Speaker 01

  But the current reasoning thinking models, most of the time, at least I can talk from our research point of view, builds a single chain of thought, right? And then, as you build a single chain of thought, and as the model continues to attend to its chain of thought, it builds a better understanding of what response it wants to give you. It can alternate between different hypotheses, reflect on what it has done before. Now, of course, like one, if you think about it just also in a visual kind of space, one kind of scalability that you can bring onto the table is, can you have multiple parallel chains of thoughts? So that you can, you can actually analyze different hypotheses in parallel, and then

• 14:09Speaker 01

  you will have more capacity exploring different kinds of hypotheses. And then you can look at, you can compare those. And then you can eliminate the ones, or you can, you can, you can continue pursuing, and you can sort of expand on particular ones. It's a very intuitive process in a way, but of course, it is more involved.

• 14:28Alex Kantrowitz?

  I just want to cap this segment by asking you, in terms of the pace of improvement of models, like I'm just going to use the OpenAI schema just to give an example. The progress, this is something that everybody who comes on this show says, the progress of going from like GPT three to GPT four was undeniable. GPT four to four point five, less of a leap. So I want to ask you just in terms of the velocity of improvement, if that's the right way to put it, are we coming back down to earth a little bit right now?

• 15:00Speaker 01

  Again, when I look at our model family, right, going from Gemini one to one point five to two, to now to two point five, I'm very excited about the pace that we have. When I look at the capabilities that we keep adding. Right, like we have always designed Gemini models to be multimodal from the beginning, right, like that was our ambition because we want to build AGI, we want to make sure that we have models that can fulfill the capabilities that we expect from, from, from a general intelligence. So multimodality was key from the beginning. And we have been, as the versions have been progressing, we have been adding that natural multimodality more and more and more.

• 15:44Speaker 01

  And when, when I look at the pace of improvement in our reasoning capabilities, like lately we have added the thinking capabilities, and I think with 2.5 Pro, we wanted to make a big leap in our reasoning capabilities, our coding capabilities. And I think one of the critical things is we are bringing all this together in one single model family. And that is actually one of the catalyzers of, of, of improvement and improvement at pace as well. It's harder, but we find that creating a single model that can understand the world and then you can ask questions about, oh, can you code me this, this, this sort of like a simulation of a tree growing and then it can do it, right?

• 16:27Speaker 01

  That requires understanding of a lot of the things, not just how to code, because like again, we are trying to bring these models to be useful, to be usable by a very broad audience. And I think our pace has been really reflective of the research investments that we have been doing across the board.

• 16:47Alex Kantrowitz?

  So no velocity slowdown is what I'm hearing from you.

• 16:50Speaker 01

  Let me just put it in the way that I'm very excited about everything that we have been doing as Gemini progresses and research is getting more and more exciting. Of course, like for us, folks who are doing research, it is, it's really good.

• 17:02Alex Kantrowitz?

  Okay, so I want to ask you, you know, you're on the model side. I want to ask you, basically, sometimes we debate on the show what the value is of improving models. So let me just like put a thought experiment to you. What do you think the value of improving these models by 10% would get us?

• 17:20Speaker 01

  The question there is like, how do we define 10%, right? Like that is where the, that is where the value is defined already.

• 17:31Speaker 01

  Right, one of the important things about doing research and improving the models is quantifying progress, right? We use many different ways to quantify progress. And not every one of them is linear, and not every one of them is linear with the same slope. Right? So when we say by improving 10%, if we can improve 10% by its understanding in math, right? Understanding of really highly complex reasoning problems, I think that is, that is a huge improvement, because then that actually expands the general knowledge, that that would indicate that the general knowledge and the capabilities of the models have expanded a lot. Right?

• 18:14Speaker 01

  And you would expect that that would make the model a lot more applicable to a broader range of problems.

• 18:21Alex Kantrowitz?

  And what about if you improved the model by like 50%? What would that get you? Would the, is your product team like saying there are things that we can build if this model was just like 50% better?

• 18:34Speaker 01

  Again, I think like, we work with product teams a lot, right? Like, that's actually a, taking a step back, that's a, that's a quite important thing for me. Thinking about AGI as a goal, I think that also goes through working with the product teams. Because it is important that when we are building AGI, it's a research problem. We are doing research, but the most critical thing is we, we actually understand what kind of problems to solve, what kind of domains to evolve these models from the users. So that user feedback and that knowledge from the interaction with the users is actually quite critical. So when our products tell us about, okay, here is an area that we want to improve on,

• 19:19Speaker 01

  then that is actually quite important feedback for us, that we can then turn into metrics and, and, and pursue those.

• 19:29Speaker 01

  As you ask, like, I mean, if, as we increase the capabilities of the model across, I think what is important is across a broad range of metrics, which I think we have been seeing in Gemini, as I said, from like one point five to two point five, right? You can see the capability increases across the model. A lot more people can actually use the models in their daily life to help them to, to either learn something new or to help them solve a, an issue that they see. But that's the goal, right? Like at the end of the day, again, like the, the reason we built this technology is to build something that is helpful. And the products are a critical aspect of how we measure and how we understand what

• 20:14Speaker 01

  is helpful and what is not. And as we increase more in that, I think that's, that's our main ambition. That's great.

• 20:21Alex Kantrowitz?

  Let's take a concrete example that, again, the company Google is releasing today, talking about today, which is V O three. This is your video generation model. And I think we've really seen an unbelievable acceleration in terms of what these models can do from the first generation to second generation to the third. And for listeners and viewers, what's hap, what Google is doing now is not only are you able to generate scenes, you're able to generate them with sound. And having watched one of these videos or a couple of them, I can tell you the sound matches. And then there's this other crazy product that Google's putting out, I think it's called Flow, where you could just extend the scene that you've generated and storyboard out

• 21:05Alex Kantrowitz?

  like your own basically short film.

• 21:08Speaker 01

  Yeah.

• 21:09Alex Kantrowitz?

  So I'd love to hear your perspective on how this happened. And is this like, you know, I kind of asked you, what do we get at 10%, 50%? But is this kind of that perfect example of the model getting better, producing something that goes from, you know, that's a fun little video to like, oh, I can really use this now?

• 21:27Speaker 01

  Yes. Um. I think the main difference, the main, um, the main progress going from V O two to V O three, from V O one to V O two, it was a lot more about understanding the physics and the dynamics of the world. With V O two, I think for the first time, we could comfortably say that for many, many cases, right? The model has understood the dynamics of the world well. That's very important, right? Like to be able to have a model that can generate scenes and, and, and complex scenes where there's dynamic environment happening. And also there's interactions of objects happening.

• 22:11Speaker 01

  I remember one of the things that was quite viral was like cutting the tomato. Where it was so precise, the video generated by V O two, that, um, it looks so realistic that one, like, like a person was slicing tomatoes and the dynamics there and the, and, and how both the, like, not just any single object, like how the hand moves, but also the interaction between the, between different objects, the blade, the tomato, how the slice falls down and everything. It was very precise, right? So that interactive element was important. Understanding the dynamics is about not just understanding the dynamics of a particular single object, but it's also mu- multiple objects interacting with each other, which is much, much more complex.

• 22:56Speaker 01

  So I think there we had a big jump. With V O three, I think we are doing another jump in that aspect. But I see the sound as an orthogonal, a new capability that is coming in. Of course, our real world, we have multiple senses and vision and sound go hand in hand, right? Like they are perfectly correlated. We perceive them all the, all at the same time and they complement each other. So to be able to have a model that understands that interactivity, that complementarity, and being able to generate scenes and videos that can generate both at the same time. I think that speaks to the new, like the capability level of the model. And like the quality, I think, like this is the first step.

• 23:40Speaker 01

  There are very impressive examples, there are examples that are like a little bit more falling short of what you would say, okay, this is really natural. But like, I think this is an exciting step in terms of expanding that capability. And as you said, I think I'm excited to see how like this kind of technology can be useful, right? Like you just said that, oh, it is becoming useful. I think that is great to hear, right? Like that, like now this is a technology that can be built. And I think flow is an experiment in that direction, to give it to the, uh, to give it to users so that, like, for, for, for people to experiment and build something with it.

• 24:17Alex Kantrowitz?

  Yeah, you like prompt a scene and then they create, that creates a scene, then you prompt the next scene and you can continue to have a flow, a story flow, which is a good, good name for it. All right, this next question comes to me from a pretty smart AI researcher. They basically talked about how there's this basic, uh, there's a tension between open source and proprietary. And of course, we have companies like Google that's building, uh, you know, that obviously attention is all you need. The transformer came from Google. Now Google's building proprietary models. We saw DeepSeek, uh, push the, the, um, state of the art forward, you could argue. So this, this person wanted to know, and I think it's a really good question, um, is

• 25:00Alex Kantrowitz?

  there a coordination or, um, or, or possible between open source and proprietary? I mean, we see OpenAI doing the, you know, their new open source model or teasing it? Or should each, uh, sort of side try to get its own part of the market? What do you think?

• 25:19Speaker 01

  Um, I think like, I wanna say a couple of things, right? Like, um, first and foremost, again, like, take a step back, like, there's a lot of research that went into building this technology, right? Like, of, of course, like, in the last, like, um, two, three years, I think it became so accessible and so general that people are using in their daily lives. But there's a long history of research that built up to this point. Right, so like as a research lab, Google and like before, of course, like there was DeepMind and Google Brain, two separate labs that are working in tandem in different aspects. And many of the technologies that we see today has been built as research prototypes, right?

• 26:03Speaker 01

  As research ideas and have been published in papers, as you said, transformers, the most critical technology that is underlying things. And then, and then models like AlphaGo, right? AlphaFold, all of these kinds of things, all these research ideas have been evolving into building the knowledge space that we have right now. All that research, I think publications and, and, and, and open sourcing all those have been a critical element. Because we were, uh, we were, we were really in the exploratory space at those times. Nowadays, I think like the other thing that we always need to remember is actually we have at Google, we have our Gemma models. Right, that, that are, that are the open weights models, just like Llama open weights models.

• 26:47Speaker 01

  We have the Gemma open weights models. The reason to do those for us is also there's a different community of developers and users who want to interact with those models, who actually need that kind of being able to download those weights into their own environment and use that and, and, and build with that. So I feel like it's not an either or. I think there are different kinds of use cases and communities that actually benefit from different kinds of models. But what is most important is at the end of the day, in the, in the path towards AGI, of course, it's important that we are being conscious about what we enable with the technologies that we develop.

• 27:31Speaker 01

  So when we develop our frontier technologies, we, we, we choose to develop them under the Gemini umbrella, which are not open weights models, because we want to also make sure that we can be responsible in the way that they are used as well, right? But at the end of the day, what really matters is the research that goes into building the technology and doing that research and pushing the frontier of that technology and building it the right way with the positive impact. And I think it can happen both in open weights ecosystem or in the closed system. But I think when I think about all the sort of the umbrella of things that we are trying

• 28:12Speaker 01

  to do, we are quite ambitious goals, building AGI and doing it the right way with the positive impact. That's how we develop our Gemini models.

• 28:20Alex Kantrowitz?

  Okay, I have like thirty seconds left with you. You're Chief Technology Officer. Are you a fan of vibe coding?

• 28:26Speaker 01

  Yes, exactly. I find it really exciting, right? Like, I mean, because like what it does is all of a sudden it enables a lot of people who are not necessarily, who do not necessarily have that coding background to build applications. It's a whole new world that is opening, right? Like you can actually say, oh, I want an application like this. And then you see it. You can imagine what kinds of things could be possible in the space of learning, right? You want to learn about something, you can, you can have a textual representation, but you can ask the model to build you an application that explains you certain concepts and it would do it, right? And this is the beginning, right?

• 29:08Speaker 01

  Like some things it does well, some things it doesn't well, it doesn't do well. But I find it really exciting. This is the kinds of things that the technology brings. All of a sudden, like the whole space of building applications, the whole space of building dynamic, interactive applications becomes accessible to a large, broader community and set of people.

• 29:32Alex Kantrowitz?

  All right. Great to see you. Thank you so much for coming on the show.

• 29:36Speaker 01

  Yeah, thank you very much. Thanks for inviting Alex.

• 29:38Alex Kantrowitz?

  Definitely. We'll have to do it again in person sometime. All right, everybody. Thank you for listening. We'll have Demis Hassabis on, the CEO of Google DeepMind tomorrow. And so we invite you to join us then. We'll see you next time on Big Technology Podcast.

• 29:54Speaker 02

  Now, more than ever, we need someone on our side. But Rob Whitman? Whitman's votes drove up costs, cut Medicaid, and risked 350,000 Virginians' health care to pay for tax breaks for himself and his donors. He's not on our side. Shannon Taylor will fight corruption, cut taxes, and bring down costs. This November, vote for Shannon Taylor. She's for us. Paid for by HMP, the HouseMajorityPac.com. Not authorized by any candidate or candidate's committee.