Pod Insights No Priors AI for Atoms: How Periodic Labs is Revolutionizing Materials Engineering with Co-Founder Liam Fedus About this episode What happens when you apply the scaling laws of large language models to the physical work of atoms? Elad Gil sits down with Liam Fedus, co-founder at Periodic Labs, which is pioneering an AI foundation lab for atoms. Liam discusses how he pivoted from dark matter physics research to the front lines of artificial intelligence, including stints at Google Brain and working on ChatGPT at OpenAI. He talks about how Periodic is connecting massive language models to the physical world to overcome data bottlenecks in material science. Liam also shares how they use language models as an orchestration layer operating alongside specialized neural nets to run closed-loop physical experiments. They also explore the future of AGI and ASI, as well as the role of robotics in lab automation.
Sign up for new podcasts every week. Email feedback to [email protected]
Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @LiamFedus | @periodiclabs
Chapters:
00:00 – Cold Open
00:05 – Liam Fedus Introduction
00:39 – Liam’s Background at Google Brain, OpenAI
05:14 – From ChatGPT to Materials and Atoms
06:34 – Training Data in the Physical World
09:52 – Generalization Across Domains
11:31 – Models as an Orchestration Layer
12:48 – Commercialization and Business Model
16:10 – How Periodic’s Success May Shape the Future
17:45 – Multidisciplinary Scaling
19:41 – Capital and Compute
21:12 – Hiring at Periodic
21:44 – Thoughts on AGI and ASI
23:30 – Timeline for Machine-Directed Self-Improvement
25:39 – Automation and Data Generation
27:59 – Why Liam is Excited About the Future of Robotics
29:25 – Conclusion
Transcript 0:05 Speaker 00 Today on NoPriors, we're talking with Liam Fettis. Liam is one of the co-creators of ChatGPT, which I think almost everybody uses at this point. He was the VP of Post Training at OpenAI and before that was at Google Brain, where he worked on a variety of really early AI innovations. Liam will be telling us a bit about periodic labs, his company, which is focused on building an AI foundation lab for atoms. In other words, how do we impact the physical world, material sciences, chemistry, et cetera, using AI? Very exciting topic and excited to be talking with him today. Liam, thank you so much for joining us today on NoPriors.
0:37 Speaker 01 Yeah, thank you so much for having me. It's great to see you.
0:39 Speaker 00 Yeah, so maybe what we can do, I think you're doing incredibly interesting things in terms of alternative types of models, specifically for material sciences, for the physical world. Effectively, what you're building is an AI foundation lab for atoms, which I think is fascinating.
0:52 Speaker 01 That's right.
0:53 Speaker 00 But maybe we can start with a little bit more of your background. You know, I think you were VP at OpenAI. You worked on one of the first trillion parameter models ever, et cetera. Could you tell us a little bit more about just like what got you here?
1:04 Speaker 01 Yeah, so even further back, I was a physics major in undergrad, spent some time doing dark matter research. We had an apparatus that was directionally sensitive to dark matter's direction. So it was very interesting.
1:21 Speaker 00 Why are there, sorry to interrupt, but I'd love to come back to this, but why are there so many physicists in AI right now? So you look at Dario Emadi, who runs Anthropic.
1:28 Speaker 01 Of course, yeah.
1:29 Speaker 00 You look at Adam Brown at Google. You look at a variety of people and they all kind of have these physics backgrounds.
1:33 Speaker 01 Yeah, my old manager, Joshua, also physics and on Anthropic.
1:37 Speaker 00 Yeah, why do you think that is?
1:38 Speaker 01 I think it's a great way to think about the world. It's like very principled, very like hard-nosed scientists, very careful. And I don't know, I think it's just, it's such an incredible field. You have such high leverage in computer science, in AI. And so I think a lot of physicists were seeing that, particularly in like high-energy physics. After the discovery of the Higgs, I think a lot of high-energy physicists were sort of looking for what's next. Ultimately, it becomes bottlenecked on the new apparatus for pushing the next energy frontier. And I think a lot of physicists were looking at their skillset and looking at the progress elsewhere and saying like, hey, I think I could be a huge contributor elsewhere.
2:22 Speaker 00 This has been fascinating to see like string theorists and people working on buckles and all sorts of effects like kind of moving into AI.
2:27 Speaker 01 Absolutely.
2:28 Speaker 00 It's almost, it almost feels like we're recreating the Manhattan Project or something, except now what we're seeking is, you know, different forms of intelligence. So.
2:34 Speaker 01 Yeah, that's right.
2:35 Speaker 00 Kind of just in that perspective. Sorry to interrupt. You know, you studied physics, you worked on dark matter.
2:39 Speaker 01 That's right. And then I was basically, and then in grad school in physics, I was always gravitating towards the machine learning problems. I was looking at particle reconstruction and it's seeking effectively machine learning problems. But it felt if I really wanted to push frontier of machine learning, I should be in, you know, computer science. So ended up at Google Brain, was overlapping with the first year residence there. Absolutely remarkable group of people, remarkable period for Google Brain. I mean, it's the era of when there's the creation of like distributed training strategies, mixture of experts, the transformer. It was a really rich period in that history. And it was a fun, kind of like Cambrian era
3:20 Speaker 01 where people were really pushing the frontier with just like a handful of GPUs, really small collaborations. The field was much, much earlier. And I think there's a lot of diversity and entropy in the research and it was very fun.
3:33 Speaker 00 So it's kind of late 2010s or so, something like that?
3:36 Speaker 01 This was 2016, 2017. So Google Brain at that point was still real small and eventually was subsumed by DeepMind or combined with DeepMind. So I was at Google for many years. Mostly I was just doing architecture work. So was really pushing sparsity. That allows for more efficient serving of models at scale and just really pushing the scale of what we could do. Towards late 2022, really became excited about the creation of products. The technology was getting very compelling. And so I ended up at OpenAI with some other Googlers as well.
4:13 Speaker 00 And what did you work on specifically at OpenAI?
4:15 Speaker 01 Well, so the goal was we need to come up with some productionization of GPT-4. So we, opening I had GPT four, it was pre-trained and there were some like LaRaff post-trains on it. And there's questions about like, how do we turn this incredibly powerful model into products? And we're all spitballing ideas like writing bot, coding bot, you know, very natural at the time. Some of our least interesting ideas were a meeting bot. So it would just sit in a Google Meet, take notes and then send out like to-dos after. But John Schulman was very opinionated. He's like, we think we should keep it very general. Let's do chatbot. And that became a large part of the effort for those few months.
4:56 Speaker 00 That's what I call, yeah, so you worked on ChatGPT.
4:58 Speaker 01 That's right.
4:59 Speaker 00 And obviously I felt like that was kind of the starting gun of this whole AI revolution, or at least in terms of people's awareness, like I'd started investing in the area beforehand.
5:07 Speaker 01 Right.
5:07 Speaker 00 But it seemed like almost as a secret up until ChatGPT came out of it. And suddenly everybody realized that there's this powerful technology available.
5:13 Speaker 01 Yes.
5:14 Speaker 00 How did that lead you to materials and atoms and, you know, the physical world again? I know that was sort of your starting point in terms of economics. But what brought you back, given how much is being transformed right now through language?
5:26 Speaker 01 I think just the inevitability of connecting these systems to the physical world. The opinion that I and others held as periodic was you're not going to see the same kind of acceleration in science and technology unless you start connecting these things to the physical world. Science ultimately isn't sitting in a room thinking really hard. You have to conduct experiments, you have to learn from them, you have to interface with reality. And the creation of ChatGPT in late 2022 was a, you know, important technology, but it was still far too weak. Like, we couldn't have done periodic on technology of that era. I think over the next few years past that, we saw ever improving models.
6:11 Speaker 01 We saw reasoning, I think like test time inference became really important. That led to more reliable error correction, more reliable tool use. And we see like the rise of coding agents and other agents. And I think those were foundational technologies necessary to then connect these systems to the physical world. Like it was just not possible with like the AI technology of 2022.
6:34 Speaker 00 I guess the other thing that's missing from the physical world is data, or at least data that's easily accessible. So you look at something like the big foundation models on the language side, and they're basically trained on the internet as a metro corpus. It's augmented in all sorts of ways with other data sources. How do you think about that for what you're doing, where you're trying to model atoms in the physical world and how all that stuff kind of works?
6:52 Speaker 01 Yeah, so experiment. I mean, so we have simulation, physics simulations, and we have experiment. And, you know, I think exactly as you're pointing out, ML systems are good on the data you've trained them on, on the tasks you've trained them to do. I think sometimes there's like this mythology of AGI, ASI, RSI. And I think we see increasingly powerful systems, but they do become limited if they don't have access to the raw data to actually make informed decisions.
7:23 Speaker 00 How much data do you need? And so I know that there's some data scale related
7:28 Speaker 01 Yes.
7:29 Speaker 00 research and other things in terms of how you kind of hill climb towards like a really good model.
7:34 Speaker 01 Yep.
7:35 Speaker 00 How many experiments do you need to run? Or how many data points do you need? Or how do you think about the diversity of data points you need to generate? I'm a little bit curious, like, what does that actually look like tangibly?
7:44 Speaker 01 So there is some generalization from the existing models. So we don't need to reproduce a system that can understand and write English or write code. So we're kind of like leveraging.
7:56 Speaker 00 And are you using open source for that? Or closed source models or some mixture?
7:59 Speaker 01 We use a combination.
8:00 Speaker 00 Uh huh.
8:00 Speaker 01 Yeah, so for example, like periodic spend zero effort on improving coding models. We're incredibly impressed by Codex, Claude Code. And so that's been a huge accelerator for the company, but focused our machine learning efforts, where, you know, the existing frontiers is not sufficiently good for us. I think going back to the data question, we're leveraging, call it order, tens of trillions of tokens that went into open source models. And that's given us like very like foundational understanding. But once we start moving into specific discovery areas, chemical spaces,
8:37 Speaker 01 we can see.
8:40 Speaker 01 A very high level of sample efficiency. So the system isn't starting as like a randomly initialized neural net. It has a strong prior on the world and
8:50 Speaker 00 So where does that prior come from? What data does it inform that just general?
8:53 Speaker 01 Just, just like, you know, papers, the internet, as you're pointing out.
8:56 Speaker 00 Yeah.
8:57 Speaker 01 However, that's insufficient. One of the engineers on our team was looking at a reported material property. And it was just sort of extracted values from literature. And it was really interesting to see the reported value spanned many orders of magnitude. And so you train an ML system on that. And it's like, well, the best you can do is model this distribution, but you're no closer to like a ground truth. And that's where experimental data comes in, where you now have a grounding in this. But really important, it's not just like a pool of data. It's this interactive closed loop system that is so powerful. Once you have the experimental data, you can look through it.
9:39 Speaker 01 You can look for aberrations, you can look for patterns, you can look for consistency with simulation data, with literature. And then that helps drive the next set of experiments. So it's not just a pool of data, it's this very active loop.
9:52 Speaker 00 I see. And then how do you think about diversity of data? So I look at something like AlphaFold or some of the protein folding related models, which are amazing, right? If you think about it, I used to work as a biologist and we would, you know, a crystal structure would take years if it happened at all. Cause you wouldn't necessarily certain if you could crystallize the specific protein and a certain reaging conditions in a way that would be performant for actual, you know, crystal x-Lography and everything, or NMR or whatever approach you took for structure. And then sort of AlphaFold comes out and you can just arbitrarily model anything.
10:22 Speaker 01 Right.
10:23 Speaker 00 On the protein world, which was, you know, amazing as a breakthrough. But it was a very specific data set that already existed that had lots and lots and lots of structures.
10:30 Speaker 01 Over decades.
10:31 Speaker 00 Over decades of work. How hard do you have to bootstrap that for every single materials domain? Or do you choose specific ones that you think can then generalize?
10:39 Speaker 01 We have seen internally the greatest advances where we have an abundance of data in some space. And that that has led to the highest rate of acceleration internally. But I think you can think of different levels of generalization. And for systems that are strongly governed by quantum mechanical effects, there is some generalization there.
11:00 Speaker 00 I see.
11:01 Speaker 01 But like if you produce a system that has modeled quantum mechanical objects really accurately, it's not really helping much on like fluid dynamics or you know, like another kind of like level of abstraction. And so the generalization we're seeing is quite good, but there's almost like a first principle is you can.
11:20 Speaker 00 Oh, that's interesting. So you could do like here are the basic steps of chemical synthesis. Here's quantum mechanics. Here's different aspects of how atoms interact in general or van der Waals forces or things like that.
11:29 Speaker 01 Absolutely.
11:30 Speaker 00 Oh, so interesting. Yeah, that's cool. And then from an architecture perspective, is there anything unique that you're doing or interesting? Or can you talk a little bit about how you're actually constructing some of these models on top?
11:39 Speaker 01 Yeah, so language models are incredibly powerful. It's a very natural interface. And so we continue to use these. But we think about them almost as like an orchestration layer. So that's sort of a co-pilot assistant, but also like a system that can direct experiments. And it's almost it's orchestrating other specialized models as well. So we do construct neural nets that are specially designed for atomic systems, where there's like some symmetry awareness. And those have much lower latency and they've been like fine tuned for that. And so basically you kind of think of this like orchestrating layer that can ingest literature.
12:22 Speaker 01 It can go through our experimental data. It can go through different modalities. But they can also use specialized neural nets as tools, as reward functions. So it's like an overall system.
12:33 Speaker 00 Okay. Yeah, that makes a lot of sense. Yeah, I've seen a lot of people architect those sorts of approaches even for things like customer support or other areas. It seems like it's the common. Architecture that's emerging as you're doing these different use cases.
12:44 Speaker 01 That's right. Yeah, but transformer has been very powerful.
12:47 Speaker 00 Yeah, and that's really cool. So if I look at the language world, one of the things that was pretty unique about it, and it's the reason I think these companies like OpenAI, Anthropic and others are growing so fast, is it just plugged into a very big domain of human existence, which is all language. And all language means enterprise software and enterprise interactions, and it means consumer behavior. It's basically how we interact with the world.
13:08 Speaker 01 Yes.
13:09 Speaker 00 It seems like there's a little bit more of a leap for other areas. So for example, in robotics, there's really interesting things, different types of robots that exist in the world. But the footprint of that is quite limited relative to language. And the same seems to be true for material sciences. So how do you think about where you're going to commercialize this first, or who you're going to work with?
13:25 Speaker 01 Right.
13:25 Speaker 00 Are there specific domains of products that you're working on first?
13:28 Speaker 01 So we've begun working very closely with scientists. We've treated periodic as our customer zero and seeing how can we transform how this field of science is done. But there's huge opportunities across all of these industries, all these enterprises that are interfacing with the physical world. People who are bottlenecked by materials engineering, process engineering. And again, those are kind of the same natural interfaces where engineers are asking questions about their data. They're trying to find aberrations, they're trying to debug machinery, they're trying to get to a better formulation. It's actually a quite universal thing as well. And so we've kind of created our little testing ground internally.
14:13 Speaker 01 And now we're sufficiently excited about the tech we've been building and to see this acceleration for advanced manufacturing more broadly.
14:21 Speaker 00 And is your model going to be
14:25 Speaker 00 developing materials for other third parties, is it developing your own materials that you then sell in the market? Like, because it almost reminds me a little bit of a biotech model.
14:32 Speaker 01 Yeah.
14:32 Speaker 00 Where in biotech, you can either partner with a big pharma and then effectively help them create a drug and take a royalty on it, or you can build your own drugs. How do you think about that in the context of what you're doing?
14:41 Speaker 01 We're Thinking about us ourselves as an intelligence layer for these companies. So you can think about system of record, control plane for different experiments and getting to solutions. But like you're saying, there is a very interesting aspect of some breakthroughs here could have really high value and it might be more akin to a discovery model like we've seen in biotech and elsewhere. But starting thinking about it just as a software business.
15:10 Speaker 00 Have you ever had the diamond age?
15:11 Speaker 01 That's very fast.
15:11 Speaker 00 Yeah. Have you read The Diamond Age?
15:14 Speaker 01 No, I haven't.
15:14 Speaker 00 It's the Neil Stephenson book. It's basically this book about, it was written in the 90s.
15:18 Speaker 01 Okay.
15:18 Speaker 00 And there's two key concepts in it. One key concept is there's effectively an AI tutor that's unleashed on the world and it kind of teaches huge numbers of young girls, all sorts of skills. And it's a, this is very interesting thing about AI education. And then in parallel.
15:32 Speaker 01 Why young girls in particular?
15:34 Speaker 00 Basically, this AI research scientist creates a primer for his daughter. And the Chinese steal it and clone it and distribute it across the country. And because he built it for young girls, it's suddenly every young girl in China has it.
15:47 Speaker 01 Right, right.
15:48 Speaker 00 So that's the reason. It's this very China theft of IP kind of thing.
15:51 Speaker 01 Yes, right.
15:52 Speaker 00 And then the other part of the book is about matter pipes into everybody's homes and they all have 3D printers and you download blueprints and it just creates whatever you need in the physical world. And some people start evolving different nanobots to do different things. It's this very advanced kind of AI plus materials kind of future world.
16:09 Speaker 01 Yes.
16:10 Speaker 00 What is your vision or conception of what our world looks like in 10 years, assuming periodic is successful?
16:16 Speaker 01 Well, I mean, I think as you're pointing out, you're going from systems that aren't just writing essays, not just writing software, but to literally generating matter. And I think it has pretty profound implications to semiconductors, aerospace, energy. And I think it's incredibly important for can we increase like the pace of
16:39 Speaker 01 Just like the physical development of the world. I mean, we see how quickly the digital realm is changing. Software engineering now looks wildly different than even six months ago.
16:51 Speaker 01 But I think we see like, you know, similar opportunities in the physical world. Of course, like atoms are hard. And so you will have some limits of physics. But just because atoms are hard, doesn't mean there's not an order of magnitude or two to speed up. Just making sense of huge amounts of data and getting to solutions more quickly.
17:12 Speaker 01 Yeah. So I think what we're trying to do is give humanity this agency for atomic rearrangement synthesis. And we think it's going to just be a huge accelerator. So, I mean, if our physical world can keep up at some fraction to our digital world, I think life will just feel dramatically different.
17:31 Speaker 00 Yeah, that's kind of the revolution that could really come. Yeah, it kind of reminds me of almost the materials equivalent of the agricultural revolution.
17:36 Speaker 01 Yeah.
17:37 Speaker 00 We suddenly had a massive spike in productivity.
17:39 Speaker 01 Exactly.
17:40 Speaker 00 And it seems like there's been all sorts of bottlenecks that have constrained us until now that you fix or trying to address.
17:44 Speaker 01 That's right.
17:44 Speaker 00 Yeah. What, um, what aspect of the work that you're doing are you most excited about?
17:48 Speaker 01 The iteration with our, between these groups of people. I mean, it's like, this is just irreducibly a multidisciplinary problem. We have physicists and chemists working really closely with some of the top AI researchers in the world, working closely with some of the best engineers in the world. And this multidisciplinary, like really close collaboration is just absolutely incredible because seeing firsthand how a field can fundamentally change. People who have been doing research for, in some cases, decades in a field. And now seeing like, oh, under these systems, under intelligent systems, it could look this very different, uh, different way. And I mean, I use like an analog to machine learning a lot.
18:32 Speaker 01 Going back to the early Google Brain days where the frontier is pushed forward by a few GPUs and a few people. Now you look at this era where it's really like industrialized and there's dozens, hundreds of researchers working together with hundreds of thousands, millions of GPUs dictated and driven by scaling laws. Everything is about scaling. It's given that predictability. It's allowed us to put huge amounts of capital into this field. And I think the physical sciences, physical engineering will have a very similar property where we establish these scaling properties and.
19:07 Speaker 01 Bring that mindset. And so periodic in this field is really thinking about how do we bring much larger scale sets of experiments to bear on this. And intelligent systems have enabled this, automation has enabled this, and you really need both. An improvement to automation where you can soon become, create bottlenecks in intelligence. And I mean, the scientists very much feel this where they're not used to working at that level of throughput, and they just can't simply make sense of so much data.
19:40 Speaker 00 So interesting. Yeah. So I guess in terms of scale here, one of the real benefit, one of the things that's really benefited the frontier labs on the LLM side is just scale of capital and therefore scale of GPU and scale of data.
19:52 Speaker 01 Of course.
19:54 Speaker 00 Is this similarly a capital intensive area in your mind?
19:57 Speaker 01 Yeah, we will require more capital. GPUs are so extraordinarily expensive. What's interesting is just the compute costs relative to physical infrastructure is actually surprising where, you know, so much money is spent on the compute, that the physical infrastructure sometimes is actually lower, but, you know, has very large lead times and there's intrinsic difficulty of having these well calibrated, well functioning physical systems. But from a capital perspective, it's primarily a compute cost.
20:28 Speaker 00 Yeah, it's really interesting. If you look up the cost of a Stanford postdoc, for example, relative to a machine learning engineer, it's like such a big difference. And you really, you know, my takeaway is that many people working in science, particularly in academic center setting are very undercompensated relative to sort of their societal value.
20:46 Speaker 01 Absolutely.
20:47 Speaker 00 And so I always like it when companies kind of help bring people into the, into the fold in terms of both human impact, but also, you know, that, that ability to do things at real scale and. You know, really do things a different way. So it must be very exciting for the people on your team.
21:02 Speaker 01 Yeah, I mean, it's like, I mean, some of the scientists who've joined us are among the best in the world. And it's been absolutely incredible working with them.
21:09 Speaker 00 Yeah, I mean, it sounds like you've built such an amazing interdisciplinary team. Are there specific roles you're actively looking for right now or key things that you really want to hire up?
21:16 Speaker 01 Absolutely. So on our site, we have decomposed the world into bits and atoms. You know, it's a loose taxonomy, but on bit side, we're really thinking about mid-training, pre-training roles from the AI side. Always more infrastructure roles and on atom side, like control engineering, system engineering. But also now thinking too about, you know, spanning that with like product engineering. So, uh, yeah.
21:41 Speaker 00 Across the board. Yeah, that's exciting. Yeah, that's really cool. So I think one of the things that everybody is really thinking deeply about or is excited about right now is AGI, ASI, sort of these
21:50 Speaker 01 Yes.
21:50 Speaker 00 advanced systems that are as good as humans or better than humans at different things.
21:55 Speaker 01 Right.
21:55 Speaker 00 Or are very generalizable in terms of their abilities to do a broad swath of things. How do you think about that, but in the context of what's happening over the overall foundation model curve? Because obviously you were very integral in terms of the development of so many systems. And then how do you think about that applied specifically to some of the areas you're working in?
22:10 Speaker 01 I think one fallacy is thinking about intelligence as a scaler. We've consistently seen these systems have a very odd spikiness. And it's actually possible to architect a system that is world-class on some math domain. But then you could do some perturbations to the questions and actually degrade it substantially. So it's like a bad high school student. And so there's this like odd spikiness to these systems.
22:37 Speaker 00 So basically you can make a system that's like a genius at one thing and not very good at a bunch of other stuff.
22:41 Speaker 01 And I guess the point I was making is those fields can actually be quite adjacent. So like sometimes a generalization can be non-intuitive.
22:50 Speaker 01 But one way I think about recursive self-improvement. Is really kind of akin to neural architecture search from roughly 10 years ago. And I think there's a very clear path for software engineering. So these systems have become so incredibly impressive on this domain as a result of huge amounts of data, really cheap verifiable environments. Like you can check unit test go from failing to passing with just a few CPUs. It's basically instantaneous. There's no domain expertise gap between an AI researcher, software engineer.
23:24 Speaker 01 And obviously, this will become and is becoming a larger contributor to the next generation of the system.
23:30 Speaker 00 When do you think it just flips into we just, everything is machine self-improvement versus human directed? Or needs a lot of human intervention? So do you think that's two years away? Do you think that's five years away? Do you think that's 10 years away?
23:42 Speaker 01 Well, I guess like building on what I was saying is I think there's a domain caveat to that.
23:49 Speaker 00 Sure.
23:49 Speaker 01 So rolling forward that software engineering self-improvement. I think you're going to have a system that can write complete repositories, identify bugs, refactor code. But it doesn't suddenly understand biology.
24:02 Speaker 00 Sure.
24:02 Speaker 01 Right? It's just like there's a domain gap there in knowledge.
24:06 Speaker 00 Yeah.
24:06 Speaker 01 But even beyond that, there's sets of strategies done in software engineering that differ from scientific or engineering strategies. So it's, you're not operating under, it's not like decision making under uncertainty to the same degree. It's like very verifiable and that's driven so much of our work. So in that domain, I think it's happening nowish. And I think we'll see the same thing too for AI research. That's a slower outer loop because now the experiment isn't just checking some unit test passing, but it's checking. What was the scaling property? Did this model converge? What's the generalization of the system? That requires GPUs.
24:51 Speaker 01 That requires many hours of experiments. But I think that will also will.
24:55 Speaker 00 And those are all evals that people use today as they're looking at existing models. And so they do have that utility function, that feedback loop that can be just driven by self learning.
25:04 Speaker 01 That's right. That's right. But again, like the connection of these things to the physical world is going to be so critical because both of those systems are being trained in a closed loop against that domain. So it's a closed loop for doing software engineering, a closed loop for doing AI research. And that's the premise of periodic. Like, we need to have these closed loops of actually doing science, of actually doing engineering. And these two, I mean, these two domains are how I think the rest of the world will go with some delay. And this is again, like, the foundational technology that we're thinking about.
25:39 Speaker 00 Do you think you need sufficiently good robotic systems in order to have that closed loop for what you're doing? In other words, do you need something like Pi or Skills or something else to work in order for periodic to hit that escape velocity in terms of a closed loop system?
25:56 Speaker 01 No, but it's a huge accelerator. The goal for periodic is to generate high quantity, high quality data, diverse data. And automation is assistance to that. So right now, we employ people as well. And we have autonomous parts that are just, you know, very reliable. If you had a dexterous humanoid who could wander into an unstructured lab and make sense and follow instructions reliably, that would be a huge accelerator. Right now, the automation of physical systems is, requires a very careful design. And it's slow, but I think with improvements in robotics, this is just going to accelerate this.
26:40 Speaker 01 But already, the reliability of the sort of like hybrid systems is sufficient to produce. Huge amounts of reliable data, but it's just going to accelerate us.
26:50 Speaker 00 Yeah, one of the reasons I ask is I used to run this company Color and we built our own liquid handling robotic systems, right? We buy liquid handling robots, but then we have to adjust them dramatically. We had like cameras that would use M L to monitor the system and sort of make adjustments. We had to three D print parts to decrease vibrations on the platform because we were dealing with such small volumes of liquid.
27:13 Speaker 01 Right.
27:14 Speaker 00 And so there's enormous amounts of customization versus just having, and the firmware for it was awful and writing against that was painful.
27:20 Speaker 01 Yep.
27:20 Speaker 00 Versus just having like a robotic system that would work like a modern system in all the ways that you'd conceive that.
27:25 Speaker 01 Right.
27:25 Speaker 00 And so the reason that I was asking is if you really want to do high throughput experiments, you need these underlying systems to be able to do all the liquid handling and to do, you know, all the titration of stuff and all the rest of it. So.
27:34 Speaker 01 Yeah, that's right. I mean, I think it's look, right now we're using almost like more like off the shelf robotics. It's like very simple, very commoditized, not doing like a huge amount of innovation on that front. But again, like as these more general robotic systems come to be like hit this reliability threshold, it's going to be a massive accelerator for spinning up new labs as well.
27:59 Speaker 00 Yeah, you've seen such a wide range of different things happen in the A I world since.
28:03 Speaker 01 Indeed.
28:03 Speaker 00 You know, you're working at Google, I guess at this point about a decade ago. And so you were there during the birth of the transformer model, you were there for the birth of chat G P T. What are you most excited about outside of periodic over the next few years in terms of what's happening with A I?
28:19 Speaker 01 I mean, of course robotics. Again, I'm like, I'm just so excited about the interface of A I systems with the physical world. And we're approaching one angle of that, which is science engineering. And we need that data in order to make those advances. But simply just agency and control of the physical world via robotics is going to be transformative.
28:46 Speaker 01 So I'm very excited about these interface layers. I think that's going to be such a massive opportunity. Cause I mean, you know, how many software engineers are there in the world versus people who feel like the physical world? And there's just labor shortages everywhere. So yeah, I think it's going to be a very interesting decade.
29:01 Speaker 00 Amazing. Well, thank you so much for joining us today.
29:03 Speaker 01 Yeah, well, thank you so much. It was really good chatting today.
29:08 Speaker 02 Find us on Twitter at NoPriorsPod. Subscribe to our YouTube channel if you want to see our faces. Follow the show on Apple Podcasts, Spotify, or wherever you listen. That way you get a new episode every week. And sign up for emails or find transcripts for every episode at no-priors.com.
Previous Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI Next The Agentic Economy: How AI Agents Will Transform the Financial System with Circle Co-Founder and CEO Jeremy Allaire Page updated October 12, 2026 · transcript and summary are machine-generated
