The Path Toward AGI, According to Google's DeepMind — With Colin Murdoch

Colin Murdoch is the chief business officer at Google DeepMind. He joins Big Technology Podcast for a conversation about artificial general intelligence, discussing why we want to get there at all, and what the path looks like. We also discuss DeepMind’s merger with Google Brain, how pursuing the AI business changes Google, and how DeepMind’s AlphaFold AI is revolutionizing the healthcare space. Tune in for a dynamic conversation with one of the world's leading AI executives. --- Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice. For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/ Questions? Feedback? Write to: [email protected] Learn more about your ad choices. Visit megaphone.fm/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Alex Kantrowitz?

  A top executive at the heart of Google's DeepMind efforts to advance artificial intelligence joins us right after this.

• 0:09Speaker 01

  LinkedIn presents.

• 0:14Alex Kantrowitz?

  This episode is brought to you by Genesis. What does it actually take to put Agentic AI to work across an entire enterprise? I recently spoke with Genesis chairman and CEO Tony Bates about why orchestration is emerging as a competitive advantage in customer experience and what companies need to get right in the AI era. Then I sat down with Adam Mitchell, head of enterprise business solutions at Voya Financial, to go inside a large scale Agentic CX transformation, including the business decisions, trade offs, and lessons along the way. You can watch both conversations now on my YouTube channel today. It's never been more challenging to get frontier compute. How do you know where to look, who to trust, or how much to pay?

• 0:57Alex Kantrowitz?

  Akash is an open cloud that provides easy access, flexibility, and peace of mind. That's how companies like Razer were able to cut their inference cost by 15 times. Visit akash.network/alex for a free consultation. That's akash.network/alex for a free consultation.

• 1:18Alex Kantrowitz?

  Welcome to Big Technology Podcast, a show for cool headed, nuanced conversation of the tech world and beyond. We're joined by a very special guest today. Colin Murdoch is here. He's the chief business officer at Google's DeepMind. We're going to talk a little bit about theory. We're going to talk about practice and how Google is trying to take the cutting edge in artificial intelligence and productize it. Colin, welcome to the show.

• 1:43Speaker 01

  Alex, it's fantastic to be here. I'm really looking forward to this conversation.

• 1:47Alex Kantrowitz?

  Why build artificial general intelligence? I mean, this is something that is a stated goal of DeepMind, to build AI on par with human intelligence, or even something that surpasses it. Why do it?

• 2:00Speaker 01

  That's right. Well, I mean, just stepping back for a moment, I think it's really important to think about what artificial general intelligence is or AGI is, because you'll be familiar with a lot of AI systems today. You build an AI system to solve a particular problem, and that works exceptionally well. And we've seen huge kind of breakthroughs in fundamental AI research, which has driven really important impact in the world through this form of AI. What we hope, though, with artificial general intelligence is to build a system that can solve multiple different problems. So one AI system that can solve multiple different problems, and much like us humans, Alex, that means we can take learnings, and the AI AGI system can take learnings from one setting and apply it to a new setting.

• 2:43Speaker 01

  And we expect that, therefore, means that this AGI system can create more creative and transformational solutions. And we know this is possible, actually, because humans are a form of artificial, well, not artificial, in fact, real general intelligence. And look at the incredible things that we've been able to achieve. And that's why we at DeepMind think it's really worthy to pursue, to develop a form of artificial general intelligence that will help, hopefully, tackle some of society's biggest challenges, things like climate change and problems and questions in healthcare. That's actually the core of what we're up to, and it's incredibly important, and I think incredibly interesting.

• 3:19Alex Kantrowitz?

  So what do you, what type of research and advancements need to happen in order to get us closer to that point?

• 3:27Speaker 01

  Well, we are still in early days, but let me give you some examples of what's currently working, what we call generalization. And I can talk about some of the areas of active research we think are going to need for us to get there. So just stepping back for a moment, what I, what I, what I mean by the ability to generalize, and you'll hear this a lot in this field, is the ability to take learnings from one setting and apply them in another setting. And we recently developed, for example, an algorithm called MuZero. Which was originally developed actually to play the games of chess and go. And then we realized we were able to take this algorithm and apply it to, I'm going to say the game of YouTube video compression, that's maybe funny I say that, but we were able to take an algorithm developed for games that was a master in chess

• 4:11Speaker 01

  and use that to dramatically reduce bandwidth requirement to stream YouTube videos. We did that by understanding that actually a video is a series of individual pictures. If you imagine the transition between each of those pictures is like a step in a game. That gave us the insight that this algorithm would generalize from playing chess and go to YouTube video compression. And of course, generative AI is actually a great example as well. So these new, these new tools where you're able to interact with them in a way that is kind of fairly conversational and get a really surprisingly powerful response. That is one way we're beginning to see this move towards more general intelligence.

• 4:56Speaker 01

  And maybe I could just jump in and tell you a little bit about how, for example, that recent work in generative AI is allowing us to move closer to AGI.

• 5:05Alex Kantrowitz?

  Yeah, let's do that. That's fascinating.

• 5:08Speaker 01

  Fantastic. So what's maybe surprising to know, if you've been following the field in generative AI, you've really seen it burst onto the scene in the last, you know, eighteen to twenty-four months. Some of the underlying breakthroughs were developed about, you know, maybe about five years ago. What's happened in the last, you know, eighteen, twenty-four months though, these systems have been really, really scaled up. And by that I mean, the size of the model, the number of parameters in the model which contain model power has grown dramatically. And these systems have been trained on kind of larger and larger data sets. And what's happened is that by scaling up these models. We've seen these emergent capabilities appear.

• 5:52Speaker 01

  And by that, I mean, it's not always possible to predict exactly what capabilities will appear. But we've had these new capabilities appear that have demonstrated really powerful generalizability. So you can then take a system that's been trained in this way, and you can ask it to summarize a document or write you an email. And it wasn't necessarily trained expressly on these tasks, but it's able to achieve these tasks because of the training process and the scaling up has happened. And that's been, as I'm sure you've been following and many others have been following, that's been a massively important breakthrough in the last eighteen to twenty-four months. And but these systems are still not complete. They still get things wrong. They maybe can't plan in the right way.

• 6:36Speaker 01

  They maybe can't remember what you did yesterday and help you today. So things like memory, the ability to remember between episodes, planning, the ability to imagine a whole range of different future scenarios and plan effectively in that setting. Those are two areas of active research that are really important. And at a kind of zoomed out level, another is what we call kind of concepts and transfer learning. So as humans, we're able to build this kind of deep conception understanding, and that actually forms a kind of really strong foundation for us to take knowledge that we generated in one setting and transfer that to another. So concepts and transfer learning, planning and memory, are all really active areas of research, which I think will help us push the next frontier. And actually, by the way,

• 7:22Speaker 01

  we haven't necessarily reached the limit of making these models bigger either. We're not, no one's quite sure where that limit is. And so that's also a really important, active area of research, just making these things bigger and bigger. Where will that, where will that go and where will that land? And what more can we get from that?

• 7:37Alex Kantrowitz?

  Yeah, we've had Jan LeCun on the show, and I've been speaking with Jan for since twenty fifteen, twenty sixteen, so seven or eight years on this point about what intelligence is from the eye of an artificial intelligence researcher. And he's always said that it's the ability to predict and to plan. And it is very telling right now that the research now is, is all about teaching these AIs to predict and to plan. And in fact, speaking about the Gemini, the new Gemini model, I'm pretty sure people from DeepMind have talked about, I think I'm going to just cite this, that the algorithm should be better at planning. And problem solving. So that seems to be where we're going. So first of all, I'm going to get, you know, I have a few questions for you about Gemini, but just let's talk about

• 8:19Alex Kantrowitz?

  it on a broad level. How do you teach an AI to plan and predict?

• 8:25Speaker 01

  So there's a whole range of different active research tasks here. And to be clear, there isn't an answer yet, which is why it's still active research. But one of the ways we motivate this research is by making sure we have tasks that require planning. So we spend a lot of time and investment in building a whole suite of different evaluations and tasks, which then provide the target, if you like, for our research and our research programs to focus on. And that's a really interesting definition of intelligence. And one of the definitions of intelligence that we use at DeepMind and was actually created by one of the founders of Google DeepMind, Sheng Li, is intelligence is the ability

• 9:06Speaker 01

  to perform well across a range of different tasks. And I really like that definition because it's, I think it's very descriptive, and it's very easy to operationalize into a research program. And so this sense of building multiple different evaluations and tasks that provide then a way for us to measure our performance and progress against whether it's planning or adding memory, is really central to actually the way we conduct research. And then behind that, it's a creative process. So what you're trying to do is bring together people from a whole range of different disciplines, from neuroscience, from different areas of AI research, to come together and have ideas about how we could make progress, and then

• 9:50Speaker 01

  use the incredible engineering talent we have, and the compute resources we have to experiment and take steps forward. That's how we do it at a kind of meta level.

• 10:00Alex Kantrowitz?

  And DeepMind started largely with some breakthroughs in gaming. So how does that applicable? Because, you know, I think about predicting and planning, and it seems like if you're playing, you know, sophisticated games like Go, then that's basically going to take you in that direction.

• 10:17Speaker 01

  Yeah, it's a great point, because games are a fantastic proving ground for these algorithms. They're fantastic because they're actually hard for humans. They have a, they have ability for us to measure how good performance is. There's normally a score of some sort, so we can benchmark the algorithm's performance versus the human's performance. And there's a whole raft of different existing games out there that can push and pull the algorithm, AI's capability in different directions. And by the way, you can develop new games. And I think maybe the third, the third, or the, the, maybe the final point is that games can run faster than clock time. So you can do many, many iterations in a kind of simulated game much, much faster than you could experiment in the real world.

• 11:01Speaker 01

  Which is why they're such an incredible proving ground and development grounds. You're absolutely right for these algorithms. And we continue to invest deeply in kind of game-like environments for exactly those reasons. Maybe one other important point, there's also a really useful way of testing algorithms out to test kind of their limits. And we can check their kind of technical safety to make sure they're doing what we're expecting to do. So they're a nice way of developing and testing an algorithm before they break out into the real world. And maybe a nice example here, actually, we often use this technique of first developing an algorithm in a game, to your point, to do planning. And there's an example here in robotics.

• 11:44Speaker 01

  If you try and train an algorithm directly on a real robot, it's going to take you a long time because a robot can take quite some time to complete the task. And in the beginning, it may be all over the place, like maybe like a young child learning to walk. What we, what we do is we create a simulation of that robotic environment, be it robotic arms stacking blocks. And we train the algorithm in that simulated environment until it gets good in that simulated environment. And we take the algorithm and then we apply it to the real robot stacking blocks. We discover it's actually then pretty good out of the blocks. And in the real world, the robot can then begin to build on the training there.

• 12:23Alex Kantrowitz?

  So the way that I picture this happening is like, it feels like most of the general public has started to get a chance to like, start talking with AI via these large language models. So, you know, when I, when I try to conceptualize like what this might look like down the road, I start thinking that like, when I'm speaking with a chat GPT or a Bard or a Bing, it starts to remember who I am, it starts to be able to accomplish tasks for me, it starts to be able to help me plan. Is that, you know, is that, is that sort of like the next step here? Is that where this research is building toward?

• 12:59Speaker 01

  That's right. So you're able to converse with these star group agents today, as you've discovered, and you can have actually quite a meaningful, important conversation. But it might have not remembered what you did last week, for example. They've got limited kind of context windows, as you may have heard it called. But what you really want it to remember, as you've noted, what did I do yesterday? What did I last week? What's my preference when it comes to kind of looking at a given film, for example? Because next time I ask to watch a film, and it wants to know what I watched before, or maybe what my preferences were. So that ability to remember more about our previous interactions actually becomes really important, as you want.

• 13:35Alex Kantrowitz?

  I mean, yeah, these things have like the memory of a goldfish. It's like you're talking with it and then five minutes later, it's like, hey, just remind me what you said, like it totally forgets. So that's like one step.

• 13:46Speaker 01

  Yeah, yeah, absolutely right. It's a really important area for us to kind of expand the memory of these systems. Sometimes we refer to this as episodic memory. So they remember episodes, important episodes in the past that they are able to bring to bear that important understanding. Then when it comes to planning about the future, these systems need to be able to stop and reason about the right sequence of steps to take. So, you know, for example, I want to plan a holiday, you know, I want to go here, then I want to go here, and I want to go there. And the series of things I want to do may change over time. I may get on a flight, I may, if you could ask one of these systems

• 14:28Speaker 01

  to date, they can, they can come out with a pretty good, pretty good response on some of these things, but they aren't able to plan based on what you've done in the past. And, you know, what would a reasonable kind of itinerary be that's changing over time? I'm actually going to holiday with my family very soon, this is very live on my mind. I don't think the AI systems can really get to a level that I would really want them to at this point.

• 14:51Alex Kantrowitz?

  Right. And so we think about where this is going. We talked a little bit about, you know, being able to predict and plan. And we talked about, um, you know, I get, we, we sort of hinted at multimodality, right? Like having a model that's generalized. So be, being able to like do text, but also in like a human, we can talk, we can read, we can see, can process. And most of these models have just been text or computer vision or computational. And it does seem like the next step is really going to be bringing them all together. That seems like a massive technological feat, but my understanding is that that is something that's being worked on inside Google with this new Gemini model. I mean, those two descriptions that I just read are, are both Gemini. So talk a little bit about what Gemini is and

• 15:35Alex Kantrowitz?

  how it's going to take us on, on that road.

• 15:38Speaker 01

  The Gemini is one of, one of our latest research programs, and you're absolutely right. One of the really important areas it's touching on is what we call multimodality. It's a bit like the human senses you just described. We can kind of use all our human senses together and combined to achieve the goal where we're setting out to. So it will bring in things like text. It will bring in things like images. Now we're able to input those things, but also output both of those things. So you might have a question about something you can see, you can share that image and you can also ask a question about it. And you may want to then adapt something in that image by saying, please edit this element of the image. And it can do that for you. So bringing together these different

• 16:23Speaker 01

  modalities is something that is a really cool and important part of that Gemini program, as well as the kind of memory and planning architectures that we discussed earlier. And, and maybe a final important component is, you know, we're hoping to develop models of different sizes and scales. So there'll be kind of different sizes of these Gemini models, which can then be applied to different use cases, depending on what's important.

• 16:47Alex Kantrowitz?

  I mean, has there been anything about training Gemini that's surprised you? Or is this kind of like where you think it's supposed to where? Yeah, it should have been going the whole way.

• 16:55Speaker 01

  I'm not deep in the Gemini research program myself. But what I would generally share is that not Gemini specific is that when it comes to training these large models, I think people in general have been surprised that as you make these models bigger, they get more capable and they start to demonstrate these capabilities that you wouldn't necessarily have planned or expected. And in the field, this is generally referred to as this emergent, these emergent capabilities. And I'm not sure if we've fully got to the end of that process yet. So there's a, there's a kind of almost a constant state of surprise as these new capabilities emerge.

• 17:32Alex Kantrowitz?

  Right. So I was speaking with some folks at Google and trying to figure out like what to ask you about, and someone brought up talking about modes of training. So I'm curious, I want to ask you about the DeepMind approach versus this new approach that's or maybe not new, but definitely is gaining share in people's minds called Constitutional AI. So I'm just going to read you what constitutional and our listeners, what Constitutional AI is from a recent New York Times article. And I want to get your take on whether that's the right way to train these models. So it says, "Constitutional AI begins by giving an AI model a written list of principles, a constitution, and instructing it to follow those principles as closely as possible.

• 18:14Alex Kantrowitz?

  A second AI model is then used to evaluate how well the first model follows its constitution and corrects it when necessary." You know, I'm curious what you think about this, this approach and whether that's something that, you know, Google would consider employing. And if not, why not?

• 18:30Speaker 01

  This, this is kind of, I would generally think about this approach and then other approaches like this, there's a way of ensuring these models are behaving in the way that we want them to behave. And we think about, we do definitely think about that very deeply. It's very important to everything we do. And there are different ways to do that. One way is actually by having an AI system like the one you've described, provide feedback to the model that you're training about whether it's behaving in the way that the designers would like their system to behave. And that's certainly something, it's all part of the overall approach. Another important way actually, is that you have humans providing feedback to the model. This

• 19:10Speaker 01

  is a process called ROHF that folks might be familiar with, where human, human races interact with these models and observing the constitution and provide feedbacks to the model on whether and how well the model is performing against that constitution. And actually, at the moment, that's a really important part of, I think, the core research process, because humans are actually very good at this. There's a kind of secondary benefit of that is that we are beginning to understand how we can begin to embed more and more human feedback into the model process. So I think in general terms, yeah, this is a really important part of how we approach research to make sure the model is well aligned

• 19:54Speaker 01

  with the sort of, if you like, constitution that the designers and the society ultimately would like these models to be behaving in accordance with.

• 20:02Alex Kantrowitz?

  Colin Murdock is here with us. He's the Chief Business Officer at Google DeepMind. When we come back, we're going to talk a little bit about the business side of these models, and especially how they're being applied within Google. Back right after this. This episode is brought to you by AppPoint. Everyone's racing to roll out AI right now. Copilots, chatbots, agents doing real work. But here's the part nobody loves talking about. All that AI runs on your data, and most teams have no single way to see it, secure it, and prove it's under control. That's exactly what AppPoint does. For 25 years, they've been the trusted layer beneath the world's most demanding data, now extended across

• 20:42Alex Kantrowitz?

  your entire AI estate. Your data, your cloud, and the agents acting on your behalf. It's how more than 20 28,000 organizations deploy AI with confidence. So innovation scales without scaling risk. Avpoint, the unifying trust layer for AI. Head to avpoint.com to see how enterprises deploy AI with confidence. Learn more at avpt.co/bigtechnologypodcast. That's avpt.co/bigtechnologypodcast. Violent threats against executives are growing at an alarming rate. When a company experiences backlash, executives are the first people blamed. When their address and other personal details are sitting online,

• 21:27Alex Kantrowitz?

  this backlash can lead right to their front door. The team at Ironwell knows this better than anyone. They've protected some of the most targeted executives and individuals on the planet for almost two decades. As a white glove enterprise security service, they protect your people with continuous personal data removal, proactive prevention tools, and human-led emergency support. So when someone goes looking for your executives, Ironwell ensures they hit a dead end. So here's what to do. Go to ironwell.com/bigtechnology, fill in the quick form, and request your free risk assessments. Their team will show you just how exposed your executives are and how to lock it down before a threat reaches their front door. That's ironwell.com/bigtechnology. Learn how to stop online threats before they become real-world attacks. The link's in the show notes.

• 22:21Alex Kantrowitz?

  And we're back here with Colin Murdock. He's the Chief Business Officer at Google's DeepMind. Colin, what is the state of the merger between DeepMind and Google Brain, which just came together to be able to work together in a way that hasn't happened for years?

• 22:38Speaker 01

  That's right. So we've just formed Google DeepMind from the team that was at DeepMind and the team that was at Brain. And actually, these teams have been working together for quite some time in the background. But I think the recent merger, if you like, to form this super unit has come at a really important time in the overall development of AI. We're kind of in this super era or golden era of AI development. And we just thought it was the right time now, for that reason, to start to bring together the talent, but also the compute and the resources so that we could make sure we were focused and organized in the right way for the next phase. And I've actually been at Well, DeepMind, now Google DeepMind for about nine years.

• 23:22Speaker 01

  And the pace and the change and the kind of frontier that we're working at means we're constantly needing to refine the way we organize to make sure that it fits where we are in the kind of technology evolution cycle. And, you know, it's going great. I'm really enjoying kind of getting to know an entire new team and we're making good progress.

• 23:45Alex Kantrowitz?

  Right, and so it's so interesting because, you know, DeepMind's areas have been the gaming, working on protein folding, which we're about to talk about. Google Brain, you know, maybe more search related. So how much of your activities are now going to be focused on the core Google business versus some of this other type of research?

• 24:03Speaker 01

  I think it was interesting to know, even at DeepMind, and actually this is very close to my role, is that we have for a long time been, taking the technology that's been developed in our fundamental research programs and apply that to Google's products and services. So that's actually been a cool part of both these groups. And actually, it's now a fundamental part of what we do at Google DeepMind. So we're both advancing the state that they are in the technology, applying that to really big problems in science, and then using those breakthroughs to drive value and impact across these, you know, what was often bidding user products at Google. And that's absolutely right, Alex. It's fundamental to the new setup at Google DeepMind.

• 24:46Alex Kantrowitz?

  So where do you see the bigger business opportunity? Is it going to be, I mean, you're the chief business officer. So is it going to be search? Or we talked a little bit about artificial general intelligence. I mean, you have AlphaFold right now that's out in market. Like, where is, where's the future of the business on this front?

• 25:02Speaker 01

  So search is, of course, an incredibly important part of Google's portfolio. I expected, I expect it to continue to be a very important part of Google's portfolio. So we'll continue to do everything we can to drive value in search. Let me tell you about how I think about it. Because this is a, you know, a technology transfer process, and that's not easy, going from research to real-world impact at any means at all. Even when you're operating at Google DeepMind, working with Google, I think about it actually as a matching process. So on the one side, we have all this amazing research and these research breakthroughs. And there's a team of people that are developing those. And on the other side, we made same relationships with all the great businesses and business units across the whole of Google, and in fact, the Alphabet Group as a whole.

• 25:48Speaker 01

  So we can deeply understand what's important to them in moving their business forward. So we've got this set of solutions on one side and this set of problems on the other side. And then we try and match these two things together. I sometimes joke, it's a bit like running a dating service where you're trying to match problems and solutions. So we go ahead and do that. And then we try that out, and if it works, we go ahead and launch. So there's a process there, that's what I want to share. It's quite important to share, it's quite a systematic process. It's one of matching technology solution and product problem as defined by the business. Search is an important area. We've done a lot of work with YouTube as well. So for example, I talked about it a bit earlier. We've worked with YouTube to help create better tooling for YouTube Shorts,

• 26:33Speaker 01

  so you can more easily find the videos you want. We worked with YouTube to reduce the bandwidth requirement to watch these videos. We've even worked with internal teams to create better coding tools, so we can really power up all the developers at Google. We've worked with other teams at Google to do things like predict the output from wind farms that Google's part of, so we can make more efficient use of energy. So there's a whole range of different applications, and I think that's important to recognize. Yes, search, I think, will continue to be really important. And also, I expect us to weave the technology into all parts of Google, so we can really help lift the whole business.

• 27:17Alex Kantrowitz?

  I think that AlphaFold, and maybe we've done it earlier in this conversation, sort of gets talked about as a thing that exists. And, you know, okay, it happened, and then people move on. But I actually want to hear a little bit about, like, what is going on with AlphaFold? Talk a little bit about the breakthrough itself and how it's being applied right now.

• 27:38Speaker 01

  Fantastic, yes. So we did touch on it earlier on, but just as a brief recap, AlphaFold is a way of determining the structure, the 3D structure of proteins, which ends up being really important in a whole range of different fields. And this is something that folks have been trying to do for many years, but it took years to determine the structure of just one protein. But with AlphaFold, we've gone from years to minutes to even seconds sometimes to determine the structure of a protein. So what does that mean in practice? Well, we've used AlphaFold now to map all 200 million proteins known to science, or 200 million proteins known to science. We've made that available to everyone.

• 28:18Speaker 01

  And actually, someone estimated recently that that's probably saved about a billion years of PhD time. Because, you know, you probably on average, you spend about a PhD to determine the structure of just one protein. That's available to everyone now. We've had hundreds of thousands of biologists and scientists from around the world that are now tapping that database to be able to advance their particular work in their particular domain.

• 28:48Speaker 01

  Let me tell you some stories about how people are using this. There's actually a team, I think at the University of Colorado, that are using AlphaFold predictions as part of their work. So they're focused on the problem of antibiotic resistance. We kind of take antibiotics for granted in most parts of the world, and that's a great thing. But the bacterias are developing and there is increasing cases. And I think in the US alone, there is probably millions of cases a year of antibiotic resistant diseases. And that's an important, also quite a scary problem. So there's a team of scientists working on how to address antibiotic resistance. There's a particular bacteria involved in antibiotic resistance,

• 29:29Speaker 01

  and they've been trying to determine the proteins on this bacteria for a number of years, a number of years, quite some years, but hadn't yet made an advancement. With AlphaFold and the protein structures from AlphaFold, they were able to solve that particular protein in minutes. They've gone from years to minutes, really unblocking and accelerating that research. I think that is a, you know, that alone is an incredible, incredible example of how AlphaFold is impacting in the world. There's another equally important example. There's a group working on developing malaria vaccines, you know, a disease that devastates hundreds of thousands of lives every year. And they've been able to use these AlphaFold structure predictions with different proteins, with still AlphaFold

• 30:13Speaker 01

  structure predictions to speed up their research into malaria vaccines. So a couple of examples in healthcare, and there's other groups focused on neglected diseases, where, you know, it may have been too expensive to do this the traditional way, but with AlphaFold predictions, they're making advancements. A slightly different example, but I think equally important and quite cool, is there is a group at the Centre for Enzyme Innovation, which I think is a university here in the UK, which is focused on developing enzymes that can eat plastics, eat the plastics that clog up our landfills and our oceans. And they've been able to use these protein structure predictions to speed up their work into producing

• 30:58Speaker 01

  plastic eating enzymes. So we've got, we've got like, and those are, those are just a kind of sampling of the different ways that AlphaFold has been used today. It's quite difficult to keep up. There's a kind of new, new group almost every week coming up with a way of using these, these predictions in their work.

• 31:15Alex Kantrowitz?

  Yeah, that's, that's wild. So as AlphaFold applications expand, I mean, as Google comes up with more, you know, programs like this, does it change the nature of Google's business? I mean, AlphaFold and Google Search are very different. So talk a little bit about how that fits together.

• 31:32Speaker 01

  Yeah, it's, it's, you know, it's a good point. These, these two things are quite different. And AlphaFold is a good example here of, you know, I described some of the ways that it is having impact in the world. When I looked at AlphaFold, to your point, I was like, well, how does this work with Google Search? It's not obvious, right? How do these two things knit together? What's the match there? So I took a step back with my team and thought about other ways we could employ and deploy this. And it seemed, we looked across a range of different areas and business opportunities, by the way, from agriculture to all sorts of areas. But in the end, we concluded that actually there is a great opportunity here in drug discovery.

• 32:14Speaker 01

  It takes 10-plus years to develop a drug, and then often when it goes into clinical trials, it fails. There's a very, very high failure rate. And so you've spent all that time and money and investment, and it doesn't actually make it through and solve the clinical need you're concerned about. So having understood this kind of scale and importance of the problem and the opportunity, that then gave us the impetus to form a new company. So we formed a new company, which is a sister company now to Google DeepMind. It's part of the overall Alphabet group. It's called Isomorphic Labs. It's about two years old, and its mission is to use AI to reimagine drug discovery. And the team is making fantastic

• 32:56Speaker 01

  progress. I'm really excited to see how that work will help reimagine that whole process. Now, there's definitely more research to do there. That's not just kind of AlphaFold and done. There are kind of AlphaFold-scale problems along the way. That's a really good example of where we've been able to set up something new based on a breakthrough like AlphaFold. And I think there could be other advances that come in science that may trigger a similar sort of arrangement.

• 33:23Alex Kantrowitz?

  Let's end with this. We just had a year where people have been going bananas over large language models. I got a question today when I mentioned I was going to be interviewing you. People want to know, what is the next model breakthrough that's not an LLM, that people aren't paying attention to, but will be as impactful as what we've seen with these models?

• 33:47Speaker 01

  I'm really excited. I don't exactly what the breakthrough will be, but I'm really excited about the union of these LLMs plus reinforcement learning. And I'm excited about that because I think there's a lot more to come from reinforcement learning. And I know at Google D-Mind, we have great deal of expertise in that. So I expect to see the fusion of those two things creates some really powerful and important breakthroughs.

• 34:08Alex Kantrowitz?

  Colin Murdoch, thanks so much for joining.

• 34:11Speaker 01

  You're welcome. Great to be here.

• 34:13Alex Kantrowitz?

  All right. Thanks, everybody for listening. Thank you, Nick Guattini, for handling the audio. LinkedIn for having me as part of your podcast network. And all of you, the listeners, great to have this conversation with Colin here for you. Hope you've enjoyed, and we'll see you next time on Big Technology Podcast.

• 34:35Speaker 02

  Now, more than ever, we need someone on our side. But Rob Whitman? Whitman's votes drove up costs, cut Medicaid, and risked 350,000 Virginians' healthcare to pay for tax breaks for himself and his donors. He's not on our side. Shannon Taylor will fight corruption, cut taxes, and bring down costs. This November, vote for Shannon Taylor. She's for us. Paid for by HMP, the HouseMajorityPac.com, not authorized by any candidate or candidate's committee.