AI Discovered Antibiotics: How Small Data & Small GNNs Led to Big Results, w/ MIT Prof. Jim Collins

Jim Collins, Termeer Professor at MIT, unveils his AI-powered project that has discovered several new antibiotics, effective against resistant strains and often employing entirely new mechanisms of action. He details how their refined multi-step AI process, even with small datasets and modest compute, can efficiently screen vast chemical spaces to identify promising drug candidates. This breakthrough offers a realistic and affordable path to tackling the staggering antibiotic resistance crisis, which currently claims over a million lives annually. Collins argues this practical application of AI represents a transformative win for humanity, often overlooked amidst the focus on AGI. Sponsors: AssemblyAI: AssemblyAI is the speech-to-text API for building reliable Voice AI apps, offering high accuracy, low latency, and scalable infrastructure. Start building today with $50 in free credits at https://assemblyai.com/cognitive Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first 3 months of Claude Pro at https://claude.ai/tcr Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr AGNTCY: AGNTCY is dropping code, specs, and services. Visit AGNTCY.org. Visit Outshift Internet of Agents Shopify: Shopify powers millions of businesses worldwide, handling 10% of U. S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:30) Introducing Jim Collins (05:26) Antibiotic Resistance Primer (14:04) The Antibiotic Market Failure (18:45) AI Discovers Halicin (Part 1) (18:51) Sponsors: AssemblyAI Ad 1 | Claude (22:11) AI Discovers Halicin (Part 2) (30:58) The Economics of Discovery (39:10) Inside the AI Architecture (Part 1) (39:17) Sponsors: Linear | AGNTCY | Shopify (43:47) Inside the AI Architecture (Part 2) (01:00:13) Human-in-the-Loop Discovery (01:12:12) Novel Mechanisms & Properties (01:19:02) Future Applications & Risks (01:27:01) A Call to Action (01:28:04) Outro

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  Hello and welcome back to The Cognitive Revolution. Today, my guest is Jim Collins, Termeer Professor of Medical Engineering at MIT and the leader of an AI-powered project that has created several new antibiotics, which are not only effective against antibiotic-resistant strains, but also work, at least in some cases, via entirely new mechanisms of action. The problem of antibiotic resistance is genuinely staggering in scale. More than 1 million people are estimated to die globally each year from treatment-resistant infections, and it's getting worse. In 2016, a special commission in the United Kingdom warned that if we don't address the resistance crisis soon, by 2050, we could have 10 million deaths per year, which would

• 0:44Speaker 00

  put the problem on par with all of cancer. Yet pharmaceutical companies have largely abandoned antibiotic development because the economics simply haven't worked. It costs just as much to develop an antibiotic as any other drug, but people take them for only a short period of time. And critically, given a new antibiotic that's capable of treating the most drug-resistant strains, the medical system would reserve it to be used as a last line of defense, naturally limiting the size of the market. The good news is that Professor Collins and team seem to have created not just a few breakthrough drug candidates, but a multi-step AI-powered process, which they've refined for the last five-plus years and proven by applying it to several different bacterial

• 1:25Speaker 00

  targets that can select candidate antibiotic molecules from the vast expanse of chemical space in silico with a high enough hit rate that it's now realistic to expect that the antibiotic crisis could be, for practical purposes, solved in just the next few years. That is obviously awesome news, but with so much AI news flying around these days, it's a story that surprisingly few people have heard. Even at The Curve last weekend, where all attendees were super well-informed AI obsessives like me, not many were aware of this development. And I think that's really unfortunate, because I'm digging into Professor Collins' work. I found that this is not just a feel-good story, but an example of how, even with relatively small data sets and modest compute budgets, modern machine learning techniques cleverly

• 2:10Speaker 00

  applied can drive huge value without anything looking like AGI.

• 2:16Speaker 00

  In concrete terms, as you'll hear in much more detail, by training small convolutional graph neural networks on data sets consisting of just a few thousand chemical structures and how effective each one was at stopping the growth of a target bacteria, the team was able to create a model that could screen tens of millions of compounds for efficacy in just a few days' time. And then, by using these predictions as part of a pipeline that also scored candidate molecules for novelty as compared to known antibiotics, chemical stability, the ease or difficulty of synthesis, and safety or toxicity for human cells, they were able to identify a small set of very promising candidates, which, upon actual synthesis and testing, did contain hits that were not only effective against the target strains,

• 3:01Speaker 00

  but again, at least in some cases, work via previously unknown mechanisms and without harming other types of bacteria. These compounds are now moving toward clinical trials. And while barring some sort of operation warp speed for antibiotics, it will still be years before they're broadly available. I was struck by Professor Collins' estimate that with these techniques at our disposal, the R&D costs to generate a pipeline of 15 or 20 promising new antibiotics could be as low as a few tens of millions of dollars, while the entire process, including the clinical trials required to get them approved, would cost maybe $20 billion. By the standard of recent data center build-out deals, which have been dominating the headlines, this is extremely affordable.

• 3:44Speaker 00

  And the fact that this work remains relatively unknown, even in the AI community, suggests to me that in our haste to create, understand, tame or control, and hopefully live in harmony with fully general or even superintelligent AIs, which we hope will then turn around and cure all the diseases and otherwise benefit all humanity, we risk blinding ourselves to simpler, safer, surer wins, which themselves could still prove positively transformational for the human condition without introducing poorly understood or potentially existential risks. With that in mind, I hope you enjoy this deep dive into how AI, even with small data sets and just a few GPUs, is accelerating the discovery of lifesaving drugs, with MIT Professor Jim Collins.

• 4:30Speaker 00

  Jim Collins, Termeer Professor of Medical Engineering at MIT and creator of Novel Antibiotics. Welcome to The Cognitive Revolution.

• 4:38Speaker 01

  Yeah, thanks for having me on your show.

• 4:40Speaker 00

  I'm really excited about this and really excited about the work that you have done. It's, you know, an incredible thing. I often reflect on just how many groundbreaking milestone moments are passing us by all the time. And I've been going around telling people, literally at like cocktail parties and stuff about this work, and nobody's heard of it. I swear, when I was a kid, people would have heard about this. And I think it would have been like the talk of the town. But these days, there's just so much stuff flying by that people are missing it. So I'm excited to correct that.

• 5:11Speaker 01

  Thanks.

• 5:13Speaker 00

  For starters, before we get into all the AI side and ML techniques and all the details, because people who subscribe to this feed like are very obsessed with all the AI stuff and probably don't know nearly as much about the biology, could we just do a little primer on the biology of antibiotics and antibiotic resistance? Like, how do antibiotics work? And why do they stop working sometimes?

• 5:38Speaker 01

  Yeah, so antibiotics are generally small molecules, like an aspirin type that you would take typically orally to treat an infection that you might have in some part of your body, a bacterial infection. The antibiotics act by basically disrupting a protein typically inside a bacterial cell that will be associated with an important process, be it cell division, protein production, DNA replication. This will disrupt that associate process. And we've shown that that will then lead to downstream stress responses from the bug that will lead to energetic demands that will produce toxic metabolic

• 6:19Speaker 01

  byproducts that will lead to additional damage inside the bug, damaging DNA, RNA, protein, membranes, lipids, that will trigger additional energetic demands, et cetera, leading to this cycle that will contribute to the disrupted initial process. Why resistance arises is that the bacteria have effectively an intrinsic goal of replicating, surviving and replicating. And so you'll have mutations that occur, so alterations of DNA or other features, with some frequency every time the bug will divide. As well as in response to a stress directly such as antibiotics that will lead to changes

• 7:01Speaker 01

  in the target of the antibiotic or these downstream features that will make the bug less susceptible to the antibiotic. Those bacteria that have acquired that mutation then now have a fitness advantage, meaning they will survive, whereas the other members of the population don't have that, won't survive. So the others will die at that concentration of the antibiotic, but the ones with the appropriate mutation will live and will survive the antibiotic treatment, thus will now be resistant to it. As a result of our overuse of antibiotics, both for human use directly and through animal use, where the agricultural industry will use antibiotics both prophylactically to protect the animals from potential infection

• 7:42Speaker 01

  as well as a growth stimulant, we've now seen resistance growing dramatically over the last few decades. And really, in the past, the biggest risk would be in hospitals, so-called superbugs. I tell my students, worst place to be when you're sick is a hospital because of these superbugs. Get out as quickly as you can. But these superbugs, these resistant bugs to our frontline antibiotics are now no longer restricted to our hospitals. They're on our playing fields, they're in our childcare centers, they're in our schools, they're in our shopping centers, they're in our communities. And so the problem has escalated due to our overuse and misuse of antibiotics.

• 8:20Speaker 00

  So just double click on that a little bit. One of my mantras for AI is that AI defies all binaries. And I think that's like, the more I learn about biology, it seems like that's true for many aspects of biology as well. So one thing I was kind of struck to notice in reading the papers is that I think a lot of times people think of like an antibiotic, you know, it's sort of like a, you know, missile that sort of zooms in and, you know, smashes the bacteria and it's just gone. And as I was reading, I was like, well, it's not, doesn't really kind of look like that so much. The way that the effectiveness of the antibiotic is measured is not like a binary, but rather a scaler, right? It can

• 9:02Speaker 00

  be like anywhere from sort of not effective at all to like very effective or kind of anywhere in between.

• 9:11Speaker 00

  Does that like, I'm not sure if this is right, but I was kind of inferring from that, that this sort of growth slowing maybe implies that there's actually still like a major role for the immune system. Like, what is the actual role of the drug? Is it killing the cells? Or is it like slowing them down enough that the immune system can rally and, and destroy them for us?

• 9:32Speaker 01

  Yeah, it's interesting. So it depends upon the antibiotic and depends upon the type of antibiotic. So they're the ones that we typically think of, you know, the missile that you referred to would be bactericidal antibiotics. So those that have really been developed to kill the bacteria at a safe concentration for human use. The challenge with that is that not every bug in the infection site will see the same concentration. So many will see sublethal concentrations. Briefly, the second class of antibiotics, the so-called bacteriostatic, those that are actually selected, developed to inhibit the growth or stop the growth of bacterial infection without killing the bugs in that infection.

• 10:15Speaker 01

  Interestingly, as you picked up in the piece, screening done for identifying new antibiotics is almost always through a growth inhibition assay and not a killing assay. So a growth inhibition assay where you'll look to see when you apply some library of compounds, which of these inhibit significantly the growth of the culture would then indicate there is some interesting antibacterial properties. In many cases, those are also associated with killing activity. Some are only associated then with inhibition. Killing assays are much more difficult to get after. The further level that's also in our piece is that you

• 10:55Speaker 01

  want, and I have alluded, that you want the antibiotic to really largely impact only the bacterium and not our cells. And frankly, if possible, so only to impact the pathogen bacteria and not the healthy bacteria that make up our gut or on our skin or other parts of our body.

• 11:13Speaker 00

  Yeah, defining all binaries indeed. So one more just primer question there is I also noticed in the paper that you run some experiments on on these new antibiotics that you've found that test how quickly bacteria can develop resistance to them. And I was struck that in general, like, it seems to happen pretty fast. So should we understand that this is like, always going on, even like, in our bodies on an ongoing basis? I mean, we kind of, I kind of saw this with COVID 2, where it seemed like there was a lot of mutations happening all over the place. And not all of them, of course, break out. But should I, should my mental model be that, like, these resistance strains are kind

• 11:57Speaker 00

  of popping up all over all the time, mostly not going anywhere, but occasionally, you know, getting out of control? Is that the right way to think about it?

• 12:05Speaker 01

  Yeah, I think, I'm not sure getting out of control, but that they, they might break out, as you say, from the stress and survive and then propagate. You know, there's the interesting dynamics challenges between the interactions of different mutations, which ones are beneficial, under which situations, which will be retained, which give you an advantage, which give you disadvantage. I think it's fair to say, I like to say that if you come across an antibiotic researcher who tells you that they designed or discovered an antibiotic for which there's no resistance, they're either lying to themselves or they're lying to you. And that, and to then speak to it, that if you apply it for long enough,

• 12:47Speaker 01

  eventually, resistance will develop. And it becomes interesting to then consider the role of AI as we increasingly utilize AI in this space is that I think AI gives us an advantage in the battle then of our wits against the genes of these superbugs in as follows, in the two different ways around resistance. We continually discover and or design new antibiotics that act in new ways, that would not be bedeviled by existence resistance. You still have to get it through approval process and now introduce them. But second is also to explore how AI might be able to Reduce the probability of resistance over a given time period, meaning extending

• 13:28Speaker 01

  the runway. And some of the ways that can happen is by discovering and designing molecules, for example, that hit more than one protein target. So that if its efficacy is linked to the action of each individual protein in independent way, now the bug would need to develop mutations in more than one site in order to provide itself with protection, which makes it that much more difficult for the bug to evolve away from the actions of the antibiotic.

• 13:59Speaker 00

  Yeah, okay, cool. Well, we'll come back to all that in a second.

• 14:03Speaker 01

  Yeah.

• 14:04Speaker 00

  One more just angle that I want to set this up with is the societal angle. We haven't had a lot of antibiotics recently, and I understand that the pharmaceutical industry broadly has kind of given up looking for them. Given that this is such a big problem with, my understanding is like, tens of thousands of Americans and, you know, probably a couple orders of magnitude more than that, people dying annually from these antibiotic resistant strains.

• 14:33Speaker 01

  Yeah.

• 14:33Speaker 00

  Why has that happened? Like, what is the social failure that has led us to this state?

• 14:38Speaker 01

  It's an interesting, I think it's largely an economic driven failure that tapped into some interesting aspects of how we handle things as a society. Maybe to just kind of ground the audience. Alexander Fleming discovered penicillin a little less than 100 years ago. So September 1928 is when he serendipitously discovered penicillin. It was not then developed and manufactured as a drug until early in World War II in the 1940s by a group at Oxford. So we haven't had them for very long, but they have transformed our medicine, enabling us to have surgeries, deal with any number of injuries, cuts, bruises,

• 15:21Speaker 01

  balusters than in the past would have been lethal and no longer lethal. Interestingly, the heyday of antibiotic discovery was in the 1940s, 50s and 60s. So before the microbiology revolution, before the biotech revolution, before the genomics revolution, before the AI revolution. What has happened since then is that we've been, you know, really in a discovery winter of sorts that That we haven't discovered new antibiotics and the investment into the field has diminished dramatically. Multiple reasons for that. One is that it costs just as much to develop an antibiotic drug as it does effectively to develop a cancer drug or a blood pressure drug. But antibiotic, you're only going to sell for a few dollars, whereas a cancer drug

• 16:03Speaker 01

  or a blood pressure drug, you can sell for thousands, if not many more dollars. Antibiotic, you'll take maybe over a course of a day or a small number of days. Cancer drug, blood pressure drug, you take over many months, years, if not even for the rest of your life. So the economics support the development of non-antibiotic drugs. Further, you have that even companies that stayed in the business and made it all the way through to getting their young molecule approved, once it was approved, the community of doctors said, oh, we're going to shelve your product, put it on a shelf and keep it for when we really need it. And as a result, many of these companies then went bankrupt after this milestone of getting their compound approved. And so we face this dire situation, you know, so how do we get out of it?

• 16:48Speaker 01

  You know, as you allude, we have this underlying epidemic that's been going on for decades, isn't it? About a million to a million and a half people die each year from back to infections around the world. And a UK Commission estimated if we don't address this resistance crisis soon, we'll have upwards of 10 million deaths per year by 2050, so outpacing deaths from cancer. It's a challenge, how do we motivate pharma companies, biotech companies to develop these products they're really not going to generate revenue from? And I think we need to explore public-private partnerships of the type we saw with Operation Warp Speed or Warp Travel, whatever it was called around vaccine development during COVID. Second is I think we need to better engage philanthropists.

• 17:30Speaker 01

  So we have various months to dedicate to different diseases, cancers notably. We have walks, charity walks, runs, ribbons, colors. We have none of this for antibiotic resistant infections. So every one of your listeners has lost a friend or a family member, I guarantee to an antibiotic resistant infection. Your family member went into the hospital for a certain treatment for us, caught the infection and died. And it somehow does not. Rise to the prominence in our consciousness of a need to address. And I expect you probably have some fairly prominent, very successful, wealthy listeners on the show, and it's interesting to think of the uber wealthy and uber wealthy individual

• 18:13Speaker 01

  could single-handedly address this challenge for the lifetime of everybody on this planet. So my estimate is for about a $20 billion investment, we could address AMR, and specifically antibacterial resistance, over the next many decades. Okay, it's a lot of money for you and me, it's a lot of money for most of your listeners, but it's not a lot of money for an interesting number of individuals. So for individuals who would like to make history, but not make a dollar or much money off of it, I think there's opportunities here to really have, to leave an impact on humanity.

• 18:45Speaker 00

  Yeah.

• 18:46Speaker 02

  Hey, we'll continue our interview in a moment after a word from our sponsors.

• 18:49Speaker 00

  Well, let's get into then how you would put that money to work. I know you've been working on this for a number of years, and the first reported antibiotic that you found goes back to 2020. Just give kind of a high-level overview of the trajectory of the work for the last half dozen years, and then from there, we can kind of really dig in, especially to the most recent work and the, you know, the data sets, the techniques, and all the nitty-gritty details.

• 19:19Speaker 01

  Yeah, so maybe I'll maybe go back even a little, little later. So we, our lab is doing, working on antibiotics now for a little over 20 years, and we've used machine learning, so a sub-branch of AI, in that context from the very beginning. And our initial efforts, we're really using machine learning to infer, reverse engineer biomolecular networks inside bacteria in order to better understand how antibiotics act. And our goal there was to better understand mechanisms of resistance, as well as to identify molecules, come up with ways that we could boost existing antibiotics. Here at MIT in 2018, the institute launched a campus-wide initiative in AI,

• 20:03Speaker 01

  kind of recognizing that the institute had been asleep at the wheel on this third wave of AI. First wave really in the very early days, late 50s to 60s, where folks like Marvin Minsky, Seymour Pepper here at MIT led the way with their interest in early neural nets and perceptrons. And then in the 1980s, in the second wave, where there was interest in things such as Lisp, other language-based programming languages and executive programs with folks like Patrick Henry Winston. This third wave focused on big data, deep learning, eventually then large language models. The institute realized that we really hadn't stepped up in so, in March of 2018, we launched a campus-wide initiative.

• 20:46Speaker 01

  I had the opportunity to sit next to Regina Barzley, one of our AI stars here on the faculty, who has done a lot of work in applying AI to problems in biology and medicine. We realized we both had interest in drug discovery and thought, wouldn't it be interesting if we could apply our interests to get after antibiotics? And we brought on Tommy Jacola, who's another faculty member and AI expert. And we really didn't have money to do this, so we bootlegged the project, looking around to see what could we pull together and pull together a small training library of 2,500 compounds, which was remarkably small. This consisted of 1,700 FDA-approved drugs, including the known universe of antibiotics, plus 800 natural compounds.

• 21:31Speaker 01

  Applied them to E. coli. So E. coli is both a model organism that we use in molecular biology to understand different biological processes, but it's also a pathogen that many of you listeners may have, unfortunately, experienced it, whether in a urinary tract infection or food poisoning. Applied each of those compounds to EQUA to see which exhibited antibacterial activity as evidenced by growth inhibition, took those data, discretized it to say yes, no, if you achieved at least 80% growth inhibition, you're considered antibacterial. If you didn't achieve that, you're considered not antibacterial. Took the structure of each compound and trained a deep neural net, specifically a graphical

• 22:14Speaker 01

  neural net, that could learn bond by bond, substructure by substructure, those that were associated with the feature of interest, in this case antibacterial and not antibacterial. We then applied it to an internal library at the Broad Institute, where I also run a lab, that was the drug repurposing library at the Broad, that consisted of just 6100 compounds, but asked which of the molecules there were predicted to be antibacterial, which were predicted not to be toxic against human cells, and which did not look like existing antibiotics. And interestingly, only one molecule fit all those three criteria, which is the molecule we call Halison, in an homage to Hal, which was the killing AI system from 2001 Space Odyssey.

• 22:59Speaker 01

  Hal, in the movie, killed humans. Halison, our molecule, killed bacteria, and turned out to be a remarkably potent new antibiotic.

• 23:06Speaker 00

  So it's really striking to me how small that data set is. We're so used to, you know, today, when I think of large language models, I'm like, you know, it's sort of one to 15 trillion tokens is the range of data set, just on the pre-training, right? And then they do lots of post-training and reinforcement learning and all that kind of stuff on top as well. I guess if you had proposed to me, you know, in my ignorance, before seeing all these results, that something like this could work with just a 2,500 compound library to learn from, I would have guessed that that was like, probably at least two orders of magnitude

• 23:50Speaker 00

  too small. How do you think about the fact that this works at all?

• 23:56Speaker 01

  You know, it's interesting, Nathan. So I think your response is very similar, very consistent with the response we got from our colleagues in the AI space. So we presented what we had and what we were doing. They dismissed us and said, don't even start to explore. You have far too little data to do anything meaningful. And so, you know, a few points of note. One is that the growth inhibition data that we collected, we could have discretized. So when you look at those data, you could see that we could have said, okay, this compound achieved 90% inhibition. This one was 10%, 30%. But we didn't recognize we didn't have a lot of data. So we just discretized 0.1. So we reduced coarse grain now the feature of the data.

• 24:41Speaker 01

  To your earlier point, binarize in this, make it binary. Two is that, you know, again, interesting, you know, to this day, that these models are very data hungry, the more data, the better. And the latter were not challenging. But it's interesting that here we had a good number of hits, having known antibiotics of a couple hundred in that data set. And we weren't looking to get 100% true positive rate. We would have loved it. In the end, when we tested it, we had about a 51, 52% true positive rate, which might sound small if you're trying to differentiate a picture of a cat from a dog on the interweb. But really good for looking at prediction.

• 25:25Speaker 01

  You know, did you come up with a new antibiotic? Where usually for a random screen or large screen, it's well less than 1%. So, yeah, we were, I was surprised how well the model performed. Pleasantly so. And I think it speaks both to the value for positive data in these compound structures and the fact that it was really rich and enriched for antibacterial in that case.

• 25:55Speaker 00

  So the question of discretizing the data or not.

• 25:59Speaker 01

  Yeah.

• 26:00Speaker 00

  Again, I think if you had said to me, hey, I've got this relatively small data set and I've got these measures which range from zero to one for how much a given compound inhibits the growth of the bacteria. Should I discretize it or should I try to train the network to predict the scalar quantity?

• 26:20Speaker 01

  Yeah.

• 26:20Speaker 00

  I think my intuition would have been you should try to predict the scalar quantity and then maybe like apply the threshold at the end. I imagine, because these models are not huge, right? It wasn't like you only had the compute for one run. So I imagine you probably tried both.

• 26:35Speaker 01

  I suspect we did and I can tell you that if we did, the data weren't good. Me and the results weren't good. So that doing a correlated model, there just really wasn't sufficient data to get predictive capacity now from a completely new structure of where we sit on that line. But given that, I think, and what the difference is, is that getting after now that discretization of molecule that really would inhibit growth, you're now, I think, getting after specific structural features of the compound that really make for a good antibiotic versus, and then I think if you got enough data, if you had enough

• 27:19Speaker 01

  compounds, I think you could predict where you'd sit on that line from zero to one. But I think you probably, in that case, would need many, many hundreds of thousands, if not millions of compounds, to fill that out. Here, we reached a lot with no effect and then a good number with effect. And so the training set itself was kind of binarized.

• 27:39Speaker 00

  Yeah, it's really interesting. How much does it cost to collect this sort of panel data in the first place? Like, if you wanted to set out to do tens of thousands, hundreds of thousands of compound to bacteria?

• 27:55Speaker 01

  So here, there's two, three levels of cost. There one is actually Curating, buying the compounds themselves. So in this case, the initial one we had, I think we had the library available. We then subsequently, as part of the Interbox, I put together a library of 37,000 additional compounds, and I think that cost us about $150,000 to put together. So it's still not a large amount when you think there's sort of order, you know, $5 per compound. If we go to any of the vendors, you're going to be anywhere from $10 to $20 per compound in a larger bit to get after them, especially ones that could be of order $100 per compound. So it goes up very, very quickly.

• 28:38Speaker 01

  Now, for some of these larger public health challenges, there are compound libraries available in pharma that include about a million molecules or so, and maybe larger, but they don't make them publicly available. I wish they would in some cases, maybe they've already mined them for the features they like, but to make them available with things like Interbox. The second level of charge is now how do you screen? So when you start getting to these tens of thousands, that's a lot of work for a grad student. And so it's one of the few spots where we'll use robotics, liquid handling robots, but they're costly.

• 29:15Speaker 01

  And so it probably charge, it probably runs us of order $20,000 in robot time to screen a 40,000 compound library. I wouldn't say that linearly scales when we go to a million. And so, but it's decent cost. And so, for example, our 40,000 compound library, we've now applied to seven different bacterial pathogens and three different human cell lines. So we've done this 10 different times.

• 29:45Speaker 00

  I mean, honestly, that's like astoundingly little money in the grand scheme of things, right? I mean, in the world of AI that I'm following on a daily basis, we've got, you know, in the space of the last couple of weeks, like $100 billion from Nvidia to OpenAI and Oracle and, you know, it's like tens of, it has to be tens of billions or you're not even making the news. So, I mean, we're talking like a full three orders of magnitude less to do sort of the biggest scale versions of the experiments you're running and probably four orders of magnitude less to do some of the ones that you actually ran. And that is

• 30:21Speaker 00

  You know, affordable, as you said, for um.

• 30:24Speaker 01

  Yeah, so I put in, in, and I'll frame it, you know, along those lines. I saw an announcement on the news that maybe it was this morning that XAI, so Elon Musk's company, was in the midst of raising $20 billion on their most recent round. That's the number I just quoted, could solve the antibiotic resistance crisis for the coming many decades. So you have young kids, I have little kids. For the lifetime of your kids, that could be solved, which is stunning for a single, in this case, a private company. If you now break it down, it's anywhere from 500 million to a billion to 2 billion per drug to be developed. I think depending upon how one, since you might get that even down to 100 million in some cases for certain drug cases with orphan status.

• 31:07Speaker 01

  So again, I think if, if there are some wealthy individuals there that are publicly spirited and, and recognize the need of public good, I do think here's a great example of AI for good, and it's a great example where with additional capital, I think we can take these compounds into patients and actually begin to expand our armament, our portfolio, to go after these superbugs.

• 31:34Speaker 00

  When you talk about solving the whole thing, big picture, for decades, at $20 billion, I guess like, how many, which by the way, is under a 10th of a percent of US GDP, another way to think about it. How many drugs are we talking there? Is that like 20 drugs at a billion each, including all the clinical trials and all that kind of late-stage stuff?

• 31:57Speaker 01

  You know, it's a border 15 to 20 drugs would be the, the, the real pitch here. And, you know, in fairness, it's not that everything's ready to go if, if Elon Musk wrote a check for 20 billion. I think we, we need to put in the certain infrastructure, get things in place. But, you know, when you look out of what we could do, I think it's, it's again, it's an interesting, for some reason, oversight that hasn't raised to public consciousness levels at the level that should. The term existential has kind of gone out, it's been set up as being overused. But if you look at individuals' list of existential threats to humanity. Antibiotic resistant infections is on that list for most individuals.

• 32:39Speaker 01

  And it's the cheapest risk that could be solved on that list. Whether it's the global poverty, hunger, climate change. Those are multi trillion dollar problems. This is avoided tens of billions, low tens of billions. So we have some work to do to convince folks. But again, for those who really want to make history without worrying about making money, I think it's a good one to go after. And I think AI is becoming, again, an interesting way where it's making it interesting. I think raising the attention to your community, to my community, where, again, it's a true beautiful example of AI for good.

• 33:20Speaker 00

  Yeah, it's an area I would also love to see the US and China decide to race. And I propose like-

• 33:28Speaker 01

  Maybe even team up, but a race, I'm a very competitive guy, so a race would be marvelous as well.

• 33:33Speaker 00

  Yeah. I mean, I would love to see, this is a whole other digression. What passes for a China dove these days in the sense that my outlook is like, I think this AI stuff is going to be a really big deal. And we might need to work together across the US and China to end up in a good place. You know, the alternative being we like race to weaponize and create a whole new sort of Damocles. And that all sounds terrible to me. So, but obviously the spirit of competition is high and rising. So it was kind of like, maybe we can make a metal tracker for new drug discoveries or something like that. You know, I know that the CCP loves to collect gold medals.

• 34:13Speaker 00

  So if we kind of create more gold medals for antibiotics and similar, that could be a good thing. I guess one more point on the money before going deeper into the techniques. The money to actually develop the drugs is, again, like a very small amount, right? Compared to all the trials and downstream stuff. Or we talk-

• 34:34Speaker 01

  That's a fair point, yeah. So I think that it's of order of millions.

• 34:42Speaker 01

  Per compound to develop it pre clinically before trial. Low millions would probably be the fair number. And really, the cost comes in when you start coming up your phase one, phase two, phase three trials for antibiotics. But of order, you know, low millions from early discovery hit to lead optimization is, I think, a decent estimate.

• 35:07Speaker 01

  And so, for example, we're working with FairBio. FairBio is a nonprofit we helped launch as part of the antibiotics AI project. And with FairBio, we have fantastic support from RPH, federal agency. Together, we've received a $27 million grant to develop 15 antibiotics through preclinical development. So to establish a very robust pipeline driven by generative AI. And so, you know, looking at that, you avoid a little under $2 million per compound to get it through to being IND ready.

• 35:41Speaker 00

  Yeah, so just a couple percentage points down payment could take that to be

• 35:47Speaker 01

  Yeah.

• 35:48Speaker 00

  The scale that you'd need to stock the shelves indefinitely.

• 35:52Speaker 02

  Hey, we'll continue our interview in a moment after a word from our sponsors.

• 35:58Speaker 00

  All right, well, we can do another call to philanthropists at the end. But let's, let's go deeper into the techniques because this is really where the AI obsessives, I think, want to understand what's going on. So a couple of things that jumped out at me about your techniques, and I'll just kind of give this to you as a prompt, so to speak, and then you can, you know, elaborate on what you think people should better understand. One point was that you're using graph neural networks with a convolutional approach as opposed to some of the new graph transformers. I was kind of interested in if you tried both or like how you think about that, like why that particular architecture. I also noticed that you train a number of them.

• 36:41Speaker 00

  I think it's 20, if I understand correctly, identical convolutional graph neural networks, basically as a way, I think, to sort of, because I assume they're like all differently randomly initialized as a way to sort of.

• 36:56Speaker 00

  Avoid any one of them kind of overfitting or going weird and then you sort of ensemble all of those to actually make the predictions? What else do we need to know about the actual architecture of the networks?

• 37:08Speaker 01

  So you're spot on, right? So I think the reason we chose the GraphNet with convolutional net as the only was that this was the platform that Regine and Tommy's team had developed under the banner of ChemProp. So this preceded our work on inabotic. So this was efforts done by Yang in their lab and I think Kyle Swanson and Wingon Jin, really a marvelous platform. You know, this was, we started this probably it was late 2018, transformers were just beginning to appear at the time, weren't really yet that popular. Subsequently, so and maybe just to pick up, so our strategy is generally we will create

• 37:52Speaker 01

  an ensemble of models, trained similarly, I would say, if it is trained identically, but with different initial conditions, that we then will average across the ensemble kind of wisdom crowds of sorts. We subsequently, in more recent work, we've explored large language models that have been developed. So these are not graphical neural net per se, but language models where you'll look at a string of symbols from a compound structure. And they've done okay. So many of these are pre-trained on large libraries of compounds, but they've not yet outperformed our graph neural net. We have seen, they seem to be learning a slightly little different schemes and they

• 38:36Speaker 01

  make predictions that are a bit different. We have explored, can we do a multimodal, a hybrid model with a little bit of success, giving us a little bit of a bump, but not considerably high. More recently, we've actually implemented Mini-MO, which is another graphical neural net that is pre-trained using quantum mechanical calculations, considerations.

• 39:00Speaker 01

  And work that we'll be submitting soon shows that it significantly outperforms minimal Chempro. There's earlier graph neural net. So it's interesting, you know, here we really are, I think, accounting for that these models were set up in part that they could look at graphical representations and it fits beautifully for the compounds that we're looking at. You know, you can think of back to your chemistry class you had in high school or college. It's those types of structures we're feeding it. Now in many cases, the model is considering a 2D representation of the molecule. And we are also beginning to think about how we can better take advantage of 3D representations for improving and extending the predictions.

• 39:44Speaker 00

  I can't resist the follow-up question. What are the foundation models that you have looked at? The ones I've studied are like Evo, Evo 2, ESM fold.

• 39:54Speaker 01

  Yeah, so Evo and Evo 2 are basically genomic ones on DNA. ESM are protein-based. So these we'd be looking at language models that were set up specifically for small molecules. So we looked at Chembert was a dominant one. We looked at, oh gosh, I'll think of the name, but we looked at Nvidia has their own, IBM had a version. So we've looked at the the leading cases. Evo is not well set up for what ours, because we're doing small molecules as well as ESM. No, but in each case, we are intrigued at each of those models for how we can apply for some other things we have going in the lab.

• 40:33Speaker 00

  Yeah, okay, cool. There's maybe another question around, but I'll save it a little later around kind of bridging these modalities.

• 40:41Speaker 01

  Yeah.

• 40:42Speaker 00

  But, okay, so we'll keep going through the process. So we got these ensemble of convolutional graph neural networks trained. Then the big computational step, which I understand is still not all that big, is taking increasingly larger and larger libraries of, again, if I understand correctly, both real and hypothetical molecules out of these big libraries of molecules and just crunching through literally millions of them, tens of millions, I think even over 100 million in one case, to get all these scores and say, okay, here's the ones that are predicted to kill this particular bug.

• 41:25Speaker 00

  There's also an interesting Monte Carlo tree search kind of algorithm that seems to, if I understand correctly, like cluster molecules in sort of not functional space, but sort of physical space, right? Those that have kind of similar structures are clustered together so that you can not only get the prediction, but also kind of look at, oh, there's a cluster of things here that are all predicted to work well, and they have something in common. Therefore, that thing that's in common seems to be the key that's actually driving. And that is really interesting, too, in terms of just an alternative approach to explaining what's going on in the AI system.

• 42:06Speaker 01

  Yeah. So first, you have the first. So yeah, we with the trained model, then we'll feed it structures that are then from in silico libraries that are either been curated of ones that are available for purchase in some cases and or can be synthesized. In other cases, might be kind of arbitrary that they think we can synthesize, but we're not really sure. In that initial house in peace, we screen computationally of order about 110 million compounds. So enormous library from a real world standpoint that you would never empirically screen in the lab, but we did it over a course of three days on the computing platform we had at the time. Since then, just as an aside, we have been doing a lot

• 42:49Speaker 01

  of work with Edamene, which is a small chemical synthesis company in Kiev, Ukraine. Obviously, quite occupied with the war going on right outside their synthesis company, but they've been great partners. And notably, they have much larger in silico libraries. Now that their real spaces of order 65 billion to 70 billion, and we've been screening those now, which now, you know, it's getting up there, right? You're several orders of magnitude larger than that initial 110 million, which itself was very large. The second space he was speaking to was an effort that was led by Felix Wong, which is around the idea, could we get after explainable AI to better understand

• 43:33Speaker 01

  structures, common structures amongst the best scoring molecules, enabling us to better identify novel structural classes? Meaning, could we set up, in this case, which we did, was a monochoric research, to look at rationales or substructures across the top predictive compounds to see, is there a substructure rationale overrepresented that would suggest that maybe we are on to a new class that goes after a similar mechanism, but has chemical diversity of some sort within that class, increasing the chance that we really did come up with something new and meaningful.

• 44:15Speaker 01

  And we posted that in Nature a little over a year ago to a lot of interest, and it really turned out to be quite a powerful approach that gave us insight into the chemical structures that have been learned by these models that could matter in the antibiotic space.

• 44:32Speaker 00

  Yeah, I find that really interesting. I find all of this really interesting because it is quite a bit less black boxy at a few different points than what I'm used to when I just look at, you know, the big foundation models that kind of dominate my consciousness most of the time. And that is a really interesting alternative way to try to make the AI process explainable. Yeah. So, okay, the the move from, you know, tens or hundreds of millions to tens of billions of molecules definitely is a huge leap. Can you give me a little bit of an intuition for chemical space? I actually was a chemistry undergrad, but I am embarrassed to say that I don't have much intuition for this.

• 45:17Speaker 00

  At that time, we were like working on natural product synthesis. And I understand there's been like a pretty big shift in the field from pick one molecule and, you know, do whatever it takes to synthesize it to a more kind of sane approach that is more like building block, kind of almost Lego style approach to putting these things together?

• 45:40Speaker 01

  So, you know, a few levels. So, you know, an academic lab like ours will typically have compound libraries in order of 10,000, tens of thousands. Large research centers will have libraries of orders of hundreds of thousands, maybe a million. Pharma will have libraries of order of millions, low millions.

• 46:05Speaker 00

  And when you, when you said libraries, these are anhan, on hand?

• 46:08Speaker 01

  Yes, to be compounds that you have in little bios. So for example, the Broad Institute, they have a center for C dot, center for discovery of therapeutics that we work with. And they have this beautiful robotic system that has a order of 800,000 to a million compounds on site that you can program via barcode to go have your liquid handling robot go grab, shoot, come it out and then couple it to another liquid handling robot that can apply it to our bacterial cells. So there is kind of the, the physical world compound, typical order number. So I think, for example, E has maybe four to four and a half million

• 46:50Speaker 01

  molecules stored, ready to send you right away. Now you go into the insulco space and you maybe, you know, you touched nicely on your building blocks at edamine, their 65 billion is based on a building block, set of building blocks and a set of recipes, synthesis steps to get there. So I don't know what the number of building blocks is, but it gets you to the 65 billion and they're confident they can do those. So that's the order you have there. So you're in 10 to the 10 compounds. Going back again to your chemistry days, the estimate is that there should be avoided 10 to the 60 compounds that I'm not sure fall into the drug like space, but let's just say 10 to the 60 compounds, which, you

• 47:34Speaker 01

  know, is more than astronomical. And we're literally just scratching that surface with, say, you know, I mentioned the 65 billion, maybe off by a little bit there. They're unreal space that edamine I think is now 220 billion. Okay. So you're now 10 to the 11, still not even close to 10 to the 60.

• 47:56Speaker 00

  Yeah, 10 to the 60 is really hard to wrap one's head around. Yeah. What's out there? Is that like?

• 48:05Speaker 00

  Is that, how real should we think of that as being like?

• 48:09Speaker 01

  You know, I don't know. You know, I'm just in a meeting with my team and they claim that there's a group that BioSoft, I think is the team that, that, that they can get to trillions of molecules from their building blocks. Okay, that doesn't sound too crazy, given Eadmeen is confident with the 220 billion. It's okay. Order five more to get to a trillion. Yeah, I get it. 10 to the 60, I've, I've never seen the calculation. I've heard the number. I've passed along the number. Um, you know, I've seen it in many different spots. I don't know how pragmatic or real world that number is. But a border trillion seems okay to me for now.

• 48:50Speaker 01

  It will be interesting to see to what extent AI can help us better define what the real space of possible compounds are. One of the challenges we had was as we moved from discovery to design is can you actually synthesize with the model made? And there is a big challenge and one of the best in the business is one of my colleagues here at MIT, Connor Coley, who's developed AI models to predict the synthesizability of a compound. And there you want to get after the answer to can you synthesize? And then you want to ask, can you do it in a reasonable number of steps? Can you do it for a reasonable amount of money?

• 49:26Speaker 00

  Yeah. So I guess regardless of how vast the chemical space ultimately is, safe to say it's pretty big and you're turning through an increasing fraction of it with basically a pipeline of, of steps, right? You've got the prediction as to whether or not it's going to kill the bug. And then you're also applying,

• 49:48Speaker 00

  I guess it would be filters or classifiers or scores. Uh, I'm not sure if these are applied like in sequence or all at once, but you're, you're scoring all the molecules on how novel they are, like how different they are from existing antibiotics.

• 50:00Speaker 01

  Right.

• 50:01Speaker 00

  Their predicted level of toxicity to human cells, which is obviously important. How stable they are, which is obviously important for like putting them into a pill and shipping around the world. As you've said, the, how, how easy they are to synthesize.

• 50:17Speaker 00

  How is that happening? Like, is that a sort of sequential thing? Or is there one kind of heuristic that waits all those things and gives you an order?

• 50:25Speaker 01

  So we, we in the past have done a kind of multi-step application of the models and our filters. We've begun to explore multi-task modeling. And are there advantages to do multi-task modeling? I think in the case where there's overlap in features being common across a pathogen or scheme, we've seen some advantages. But for the most part, it's a matter of coming in with these different models in sequence, really to cut down on the space, cut down of now can you move from this interesting thing in the computer to something you really got to pay to get and actually test. We're expanding that. So as you alluded, we've got, I think, really good models on antibacterial.

• 51:08Speaker 01

  We've got good models for toxicity, easy to calculate, is it different from an existing antibiotic? We need more data to get after drug-like properties beyond toxicity, solubility, bioavailability, lack of metabolic liabilities. And we're working hard with FairBio to get those data to train what we're going to probably call drug prop AI. So you can get after drug properties and use this to really increase the chance that the molecule would make for a good drug that would be effective not only in a mouse but in a human. And I'm sure your readers, your listeners have heard many times the comment that we've cured cancer, you know, 900 times in a mouse or rat, but very few times in a human.

• 51:49Speaker 01

  In my world of antibiotics, if the molecule works in a mouse model effectively from a systemic delivery standpoint, the estimate is about 90% chance that would also work well in human. Our AI models to date are really good at coming up with molecules that will kill the bug in a dish. They're not as good as they need to be yet of also predicting, are they good at killing the bug in a mouse? And that's where we need these additional data and additional steps to move the power of AI further down the antibiotic development pipeline.

• 52:25Speaker 00

  I guess one other question there is, is there any role for human taste or judgment in this process?

• 52:33Speaker 01

  Absolutely. Yeah, no, absolutely. It's a really nice question. You know, I think the medicinal chemists remain still pretty skeptical about the value of AI. In part, they feel that their decades of work and expertise that identifying molecules, modifying the molecules, tweaking the molecules can still outpace AI. And I think in some cases they can. Now, in fairness, there's no medicinal chemist I know that can review 110 million molecules. But I do think, a few points to this, we ran an interesting case where we just had a really talented medicinal chemist as a postdoc in my lab. And we pitted him against the synthesizability model.

• 53:15Speaker 01

  The kind of college group that came up. So we gave both the model and the postdoc 30,000 compounds to see how they were ranked and compared it to then what edamine would say. And the human outperformed the model. So then the next level is, you know, how do we better capture this intuition? I do think there's opportunities to recruit panels of medicinal chemists and develop kind of the medicinal chemists in the loop with the reinforcement learning with human feedback to improve the models for these different features that that they are able to capture and maybe not necessarily describe or quantify.

• 54:00Speaker 01

  You know, there's the interesting anecdote, which I'm sure where it was Google D-Mine was developing AlphaGo. They had trained the model on synthetic systems and even human systems, but really began to make a big leap when they actually brought in an expert. I think he was maybe the 1,000th ranked player who could give additional human insight of strategy and moves. And it elevated their system to a new level. And I think we need to figure out how to do that better in drug discovery.

• 54:33Speaker 00

  So that head to head, when you say 30,000, does that mean that the human expert actually went through and scored 30,000 things?

• 54:42Speaker 01

  So it was discreet. So the human expert, right swipe, left swipe, 30,000.

• 54:48Speaker 00

  Holy moly.

• 54:49Speaker 01

  And so I've been happily married for 35 years, but I don't know what left swipe, right swipe means. I know what is, I like, what I don't like, so I don't know which is, but but holy moly is right. That, you know, it was so impressive that this guy did this. And it was interesting. Andreas Lutten is his name. He's a talented now, young professor at the Karolinska Institute in Stockholm. And I asked him really what was guiding him and he was really looking for liabilities. So he would say, bad, bad, bad. And, and if he couldn't find a liability, he said, good. And so that was an interesting take that is not how I would have set up my model to do. And so again, I think it's examples such as this that I think we need to do a better job. Now there's remains some

• 55:32Speaker 01

  dismissal, significant dismissiveness, but maybe some rather so and some hostility from the medicinal chemistry towards these types of approaches. And I think we need to turn to them for help to make them that much better and do a better job of capturing the medicinal chemist in our code, in our models.

• 55:50Speaker 00

  And just to make sure I understand where that is in the pipeline. These liabilities are for a molecule that has been identified as likely to kill the bacteria. It's like, oh, but I can spot that this is going to be hard to synthesize or it's going to be not available.

• 56:06Speaker 01

  I think, I think in this test, it was really only around synthesizability. But you can imagine it'd be great for me to also be able to do something similar of, you know, would this make for a good drug? Will it, will it be stable? Will it be available at the side of the infection? Will it not be cleared too quickly? Will it not be broken down by the liver too quickly? And, you know, these are things where, you know, if you have many medicinal chemistry friends, but they can kind of look at a molecule and say, ah, I like that molecule. Or, oh, that's an ugly molecule for XYZ. We need, we need to sit these guys down and get that. I'll give another related example, which you don't hear as much about anymore.

• 56:46Speaker 01

  But pre pandemic, I remember I was meeting with a number of different folks from China coming through the MIT area. And I was with someone who was either working for Baidu, had insight into Baidu, and Baidu at the time had hired 15,000 individuals to label data. This goes back to about 2018. Supervised learning was the big thing. And so labeling, featureizing data was key. And in that, they had 2,000 medical students they had hired that were labeling medical images, might be pathology. And I thought that was brilliant, that a country could, or a company within a country, could have the resources that could take advantage of that. I think we don't need something of that scale, but I

• 57:27Speaker 01

  think figuring out how I could rally a group of medicinal chemists to commit to letting me peer into what they've learned and how they act on what they learned could make a big difference.

• 57:42Speaker 00

  Yeah. Honestly, it's really striking how well this seems to work, given how little data you start with and, you know, just how coarse that original signal is. I mean, the whole thing is, because it is worth repeating too. Like, again, if I understand correctly, there's no encoding of the target bacteria at all, right? It's just like, literally, it could be anything. It's totally abstracted away into a, it works or it doesn't work.

• 58:13Speaker 01

  Yeah. Era one, yeah.

• 58:15Speaker 00

  That's amazing.

• 58:16Speaker 01

  Yeah.

• 58:17Speaker 00

  So when things work better, what does that mean? Like, I guess I'd like to understand a little bit better, the trade offs between you could do, you know, you've got like compute costs, and then you've got synthesis costs, right? I guess those are kind of the two big costs in getting to the end of something that you're like, okay, this actually confirmed kills a bug. Now we got to go into the sort of medicinal chemistry phase.

• 58:46Speaker 01

  Yeah.

• 58:47Speaker 00

  How do you think about those trade offs? Like, if the model works a little bit better, but maybe it's also a little bit bigger, you know, maybe we do like 10 times as many malachias?

• 58:56Speaker 01

  Yeah, the compute cost isn't very large. You know, you can kind of, as a fixed cost in the background. You know, I do think the other, you know, getting after larger training libraries is expensive. Compute, not so much. Synthesizing is the big challenge, right? Because you're making a commitment both on just outlay of the money, the time, and what's the probability you've got something that's good? The next is then animal models. Animal models are not inexpensive. And you've now got to decide which of the ones am I going to advance? And is it good enough to go? If that looks good, now you're back at, okay, I've got to now maybe do an analog generation. Which of those will I synthesize? And it becomes interesting within a little academic lab like mine,

• 59:40Speaker 01

  how much of it do you really commit to? So it's the trade-offs. Given our experience on generative AI and the challenges of synthesis, I'm much more inclined towards looking at these libraries of molecules, like Gieda means, where I'm guaranteed I can synthesize. Still might need to pay a bit more for those are the difficult to synthesize or not readily synthesized. But I'm more comfortable there than coming up with an exotic new molecule that I'm not sure I'm going to synthesize. And what's the probability that it's going to work?

• 1:00:15Speaker 00

  So can you give a sense of where we are today in terms of like, okay, you start with millions, tens of millions of molecules out in chemical space. You do the predictions, you do all these filters for the novelty, for the non-toxicity humans, for the stability, for the synthesizability. It seems like we get out of that process like dozens? And then you synthesize dozens? And then like we get down to the end, like a couple actually work, at least in a mouse? Is that basically the right?

• 1:00:46Speaker 01

  Yeah, I'd say that we probably get down to maybe hundreds before we try to synthesize would be probably the fair set of filters we've set up. And then after that, you were correct. And so I think that, you know, we can expand the starting point of libraries, of course. But I think it's where we have not yet gone is that really from the early hit to a so-called lead development, that's where can we get after? More drug-like properties, so-called admetts, if absorption, excretion, metabolism, toxicity, distribution, as well as PKPD, so the dynamics of the drug.

• 1:01:27Speaker 01

  It's where I think AI, given most of you listen to the AI space, I think AI has done a really nice job in early discovery efforts, certainly antibiotics, but I think in other drug space. AI has not yet really been utilized much further downstream, I think because of lack of data. And it becomes interesting of where are you going to get that data? Who makes the commitment? And, you know, it's expensive. And I think the companies that make those commitments, the companies are going to have advantages going forward.

• 1:01:57Speaker 00

  So the big, in terms of improving the models, the big way that that, because you're already like seemingly quite successful, I don't know if there's any negative results or any strains you've tried this on where it didn't work, but to read the papers, it seems like the general workflow of identify a target bacteria you want to be able to kill, run the panel of all the, you know, test molecules against them, train the network, do the pipeline, apply it to the, you know, huge swath of chemical space, get candidates out, synthesize those. It seems like that is pretty consistently working, is that right?

• 1:02:34Speaker 01

  I think that's fair. I think, yeah, I think with a, an acceptable success rate, it's decently working. I think our goal always is can you do things even better, even a higher success rate? Could you really identify those compounds that, boy, that's really a great starting point? And I think we have a little work to do there because we still need to get after those other drug-like properties is kind of the key thing and figure out how do you, you know, how do you accommodate for multi-objective optimization across these compounds? And I'm hopeful we'll get there, but we're not there yet.

• 1:03:13Speaker 00

  Yeah. But it sounds like from the standpoint of like society. You know, to the degree that you can improve the models and get even more confident predictions, that would effectively reduce the cost of the development process kind of from the end of, from where you are like, okay, it works in a mouse to the, to the point where we actually get into clinical trials. But that is a cost that sure it'd be great if it was cheaper. And of course, you, you have like intellectual interest in, you know, finding new techniques to make it better. But from society standpoint, it seems like it already works well enough that we should just clone your lab 10 times and like apply this to, you know, as many targets as we can

• 1:03:58Speaker 00

  basically immediately.

• 1:04:00Speaker 01

  Yeah, I, I, I think, I think that's fair. I think that our group and other groups have shown that AI is a valuable tool and I think it needs to be utilized. Why do you think for sure in the early discovery, it's reducing cost, increasing hit rate, success rate, and thus increasing our chance of getting to new molecules that can make a difference for human health?

• 1:04:23Speaker 00

  There's a couple of other aspects of the results that we've barely touched on too. So again, it's worth just repeating, these are drugs that are working against drug resistant strains, right? This is not just that they work, but they work on things that other drugs don't work on. Key point, worth emphasizing again. At least some of what you found has been shown to work with a new mechanism, meaning it is working by disrupting the bacteria in a different way than other molecules.

• 1:04:55Speaker 00

  And it's even, oh, there's also specificity. So again, at least some of what you've done here has shown to work against the target and not disrupt the other quote unquote, good bacteria.

• 1:05:08Speaker 01

  Maybe, maybe I just comment on that briefly. So that's worked in several cases and that was surprising. And why it was surprising is that the models were not designed to yield a so-called narrow spectrum. So narrow spectrum hetero-bacteria, one that goes after the pathogen of interest, but spares the commensals are good guys as well as other pathogens. In fairness, the models, we've only trained against eight particular pathogens. So they're only trained against the pathogen, but they weren't then counter-trained to avoid the other ones. And yet, in the case of Abalicit, which was a molecule we discovered to be effective against this ineffective alimony, in the case of also molecule we discovered that was designed

• 1:05:51Speaker 01

  effective against gonorrhea, in each of these cases, they were narrow spectrum. And so it was intriguing that, I think we got it more or less by luck, but that the model pointed us to these molecules that were sparing most of the good guys in our gut.

• 1:06:10Speaker 00

  Yeah, I guess if I had to attribute that to something, it would be the novelty filter. The theory would be like, if it's very different from other antibiotics, maybe it's more kind of particular to the target, even if that wasn't like explicitly.

• 1:06:25Speaker 01

  Yeah, maybe that's an issue. We haven't, you know, it's an interesting notion. It is possible.

• 1:06:31Speaker 01

  Yeah, you know, I, I'll, I'll, I'll put an esoteric spin on it that we're doing phenotypic screens and in many cases, I think we're getting after membrane-acting antibiotics. So they're targeting targets in the kind of outer layer and or inside layer. And it appears that many of them are getting after lipoproteins and lipoprotein transport, again, kind of an esoteric point. But I think that the narrow spectrum aspect of compound may be that these lipoproteins are very specific to the given pathogens. So that while we're not targeting a target, we're targeting the pathogen, looking at phenotypic

• 1:07:14Speaker 01

  screen, I think we're selecting for compounds that are getting at these lipoproteins that are specific to the pathogen and not to other pathogens. And I think that's what's happening. So we're also now beginning to look, can we use AI specifically now to start with the lipoprotein as a target? And then can we find small molecules that would interact with those, with those targets, those protein targets of interest?

• 1:07:38Speaker 00

  Can you speak a little bit also to resistance resistance? Like the, that's another notable finding that, again, at least some of the drugs you've discovered.

• 1:07:49Speaker 01

  Yeah, so yeah, that's a, for point, right? So Halison, for example, we.

• 1:07:54Speaker 01

  Compared it to Cipro, so Cipro is a very commonly used quinolone antibiotic, and applied each for over thirty days inside a lab to E. coli. Within a few days, there was significant resistance to Cipro. Several fold then after thirty days, there were many hundred folds levels of resistance to Cipro. When we applied Halison, after a few days, we didn't see any resistance, and thirty days out, we didn't see any resistance. As earlier, we'll eventually see resistance if we look out long enough. I think that the resistance to resistance of Halison was likely that it's targeting multiple molecular targets, so multiple proteins, probably at the membrane level. And again, to my earlier points where I think we can also use AI with this as an intent,

• 1:08:38Speaker 01

  intent to goal, intended goal, is that because it's hitting multiple targets, the bug can develop mutation against one or even two, but because maybe three or four, and any one of those can be a killer to the bug. I think it just puts off the development of resistance.

• 1:08:56Speaker 00

  Fascinating. Okay, so kind of zooming out for a second and then, you know, talking about the future and how these methods might evolve. I mean, I guess my, I want to emphasize my general sense that like, this should just be scaled up even as it is, we don't need to worry about getting too much more clever. You know, give me the warp speed for new antibiotics. But that said, because it's interesting, if nothing else, I'm interested in, I guess, like, when do you think this could have first worked is one interesting question. I'm not sure, you know, I'm always reading like new AI and ML literature, and it's always like some new technique.

• 1:09:39Speaker 00

  But I'm not sure here, like, what was the limiting technique? Or were all these techniques kind of sitting out there potentially for a few years before you came along and figured out how to integrate them?

• 1:09:50Speaker 01

  You know, I think they probably were sitting there for a few years. I do think that these graphical neural nets were the real trick. I think the ability of these models to Learn chemical structures and break them down and associate them with a feature of interest. Narcissant bacteria are not toxic. It was that was the differentiating tech. And we're now expanding that to other features and other schemes. And that, you know, the deep neural nets, you know, were introduced, you know, of order many years ago, but really became quite popular about 10 years ago, largely on image analysis out of groups like Yashar Benjio and Jeff Hinton, Yann LeCun. So I think that was a differentiator that we could.

• 1:10:35Speaker 01

  I think it can be scaled up, I think, quite nicely. I think we need more data. I think we need more talent. I think that models can be extended in clever ways. I think the way to look at bigger chemical space, associate and bring in more biological data, more chemical data to get after mechanism, to get after features, using more and more generative AI to get after design properties. So can we design the molecule specifically to go after multiple targets by from the get go? I think all of this is possible. And I think we'll see developments along these lines in the coming few years.

• 1:11:13Speaker 00

  How far could this go in terms of other things? Like you mentioned, we've cured cancer, you know, in mice lots of times. I mean, obviously, a can't human cancer cell is presumably a lot closer to a other healthy human cell as compared to bacteria versus the human cell. But could we imagine a similar technique working for human cancer cells?

• 1:11:37Speaker 01

  Yeah, most definitely. This and, and I mean, human cells and for other conditions other than cancer as well. So Felix Wong, a postdoc in my lab, who's also leading integrated biosciences in the Bay Area, is focusing among many things, but it was also age-related conditions, aging.

• 1:11:54Speaker 01

  And using this platform identified molecules that could act as senolytics. So they could eliminate so-called zombie cells amongst our cells. So these are cells that have stopped dividing that are thought to underlie neurological conditions, scarring, skin conditions. Worked beautifully. He's applying the approach now to many other schemes and other conditions. Within the infectious disease space, we've worked with folks to do it for antifungals, antivirals, antiparasitics. The more complex, I think, is potential for cancers, potential for neurological conditions, potential for metabolic conditions. So this and related, both phenotypic and target-based screens, I think, has tremendous potential.

• 1:12:37Speaker 00

  I guess if you imagine applying the same kind of core approach to all these different things, and for some of the more challenging ones, it maybe doesn't work at first, or it doesn't work as well. What kind of enhancements do you think you would need? Earlier, we touched on like EVO and EVO2, and I know those are sort of, well, first of all, EVO1 was like only bacterial. But there's an interesting possibility there where these foundation models can potentially be used to identify targets. There's like, of course, lots of different models now that do like, you know, all kinds of different molecule binding, small molecule to protein binding.

• 1:13:17Speaker 00

  You know, well, if you if you sort of had to imagine a next generation pipeline that kind of brings in either some foundation models or other specialist models, like what kind of elaboration would it be?

• 1:13:29Speaker 01

  Yeah, I'd say it's multiple levels. So I do think, you know, alpha fold for predicting 3D protein structure certainly was a major advance. It's been widely used, but it's not really good enough yet for drug development. And that the 3D printed, 3D predictive structures are not at a fine enough level that you could use it in target screen. We need work there. Our binding predictions for affinity of small molecules against an identified binding pocket are not there yet. They're not as good as they should be. So I think if we could advance each of those now, we could do so much more in silicon from a target ID from a

• 1:14:15Speaker 01

  Understanding how the drugs act, we need, I think, to better use AI to embrace the complexity of underlying biology. We've been fixating in single targets, but these targets operate in very complicated networks that vary depending upon cell tech, that vary depend upon context. I think we need to develop tools that can embrace that complexity to identify the meaningful targets, to understand how the drug would interact with them. I think interfacing those layers, and then it's also how do we get to phenotype, can we make predictions? So right now, we're not very good at predicting functional phenotype from our interactions. Now, I'll give this a case. There's a lot of interest, I'm sure, you've seen in where

• 1:14:58Speaker 01

  you are in AI scientists and AI-driven kind of automated labs, and you're saying they're going to replace all scientists. I think it's way premature to make these claims, but they're being set up in my world largely to do things where we know exactly what needs to be done, and so you just wrestle. But, so for example, in E. coli, you know, this very simple organism, model organism, been studied for decades. When I first moved into microbiology 25 years ago, I still don't work on it by big, big people in microbiology, because everything's known. Well, but with 4,000 genes, you look at the genome, 1,500 of those genes, we still don't know what they do. And so if I now give AI, AI said

• 1:15:41Speaker 01

  the challenge, okay, functionally annotate each of those 1,500 genes and run the experiments to validate it, we can't come anywhere close to that. So I think that AI has tremendous things to offer, and we've got these other types of models I alluded, but we also have a ways to go in order really to take advantage, where I really still very much believe in AI as a thought partner for us, and it's still keeping the human in the loop is critical for many of these advances.

• 1:16:12Speaker 00

  Um, cool. I don't know if I have any additional follow ups there. One question I always want to touch on, at least for a second, is possibility of dual use or safety concerns. And one thing I do like about this approach and the, you know, the sort of, not just ensemble, but like pipeline nature and sort of many specialist models, is it seems like it's not really prone to a dual use problem in the same way that a lot of other much more general purpose techniques might be. Maybe I'm missing something there, but what would you, you know, say is the sort of risk, if any?

• 1:16:53Speaker 01

  I think, I think for the most part of what we're working on, it's kind of single use, you know, can we, can we help humans from these problematic pathogens? There is one interesting case of dual use that's worrisome, and that is for these tox models that we developed. So here we're developing models to predict toxicity of a compound against a human cell or set of human cells. And we're mainly interested in identifying those that are not toxic. Well, those same models can be used to identify molecules that are toxic. And so now you can imagine bad actors using them to identify molecules in natural product space, or design them in such a way that they're highly toxic. And in particular, would be problematic is if they develop ones that would get after

• 1:17:35Speaker 01

  mechanism toxicity for which we don't have countermeasures. So that's a unfortunately dark, but possible dual use that we hadn't thought about until we actually published our toxicity models that I alluded to back in 2024 in a nature piece. And some of my friends in the federal government came and said, Jimmy, you, you worried about this? And I had to admit that we hadn't really thought about it, but we have since thought about it.

• 1:18:03Speaker 00

  Is there anything that can be done to create versions of the model that don't have that sort of reverse the sign?

• 1:18:11Speaker 01

  No, no, right? Because you're going to get a score. I mean, I guess it could be that you only score those that are not toxic, and that you don't know how toxic, I guess you could, but anybody could easily pull apart the model and just shift the threshold on that.

• 1:18:30Speaker 00

  Yeah. That's kind of the, yeah, I could imagine.

• 1:18:36Speaker 00

  Interpretability techniques there could be sort of applied for bad, even if you, and I'm generally a big fan of interpretability, but if you did have something that sort of only, you know, I put a score of point eight or higher or whatever, but you asked everything below, presumably the model inside still does have a representation that you could access if you were determined enough to do it.

• 1:18:59Speaker 01

  Yeah, yeah, that's a point.

• 1:19:01Speaker 00

  Cool. This is fascinating, and I really appreciate all the time and remedial education that I've got from you.

• 1:19:10Speaker 01

  Thanks for the great, great conversation.

• 1:19:12Speaker 00

  Is there anything more that we should say about just, you know, call to philanthropists? Like, where are, where are we on warp speed?

• 1:19:21Speaker 01

  I, you know, I think, I encourage young people to think about this problem and from the AI standpoint, from the microbiology standpoint, from the drug discovery standpoint, and that these are exciting, practical problems that can make a big difference, and we need more young people to take them on. I think it's a great time to be a young person in science, it's okay, the world seems to be on fire, but it's still a great time to be in the young, in science, young person, because so many cool tech, technology are being developed, and we need young folks to take on this problem. So that would be my, my call in addition to the philanthropists to at least think about, you know, can you make a difference here?

• 1:19:57Speaker 00

  Cool. Well, I hope that a couple of listeners are inspired and might go a little bit in that direction based on your example. Again, this has been fantastic. I really appreciate it. Professor Jim Collins, thank you for being part of the Cognitive Revolution.

• 1:20:10Speaker 01

  Great, thanks for having me. Really enjoyed our discussion.

• 1:20:13Nathan Labenz?

  If you're finding value in the show, we'd appreciate it if you'd take a moment to share it with friends, post online, write a review on Apple Podcasts or Spotify, or just leave us a comment on YouTube. Of course, we always welcome your feedback, guest and topic suggestions, and sponsorship inquiries, either via our website, cognitiverevolution.ai, or by DMing me on your favorite social network. The Cognitive Revolution is part of the Turpentine Network, a network of podcasts where experts talk technology, business, economics, geopolitics, culture, and more, which is now a part of A16Z. We're produced by AI Podcasting. If you're looking for podcast production help for everything from the moment you stop recording to the moment your audience starts listening,

• 1:20:55Nathan Labenz?

  check them out and see my endorsement at ai podcast dot I N G. And finally, I encourage you to take a moment to check out our new and improved show notes, which were created automatically by Notions AI Meeting Notes. AI Meeting Notes captures every detail and breaks down complex concepts, so no idea gets lost. And because AI Meeting Notes lives right in Notion, everything you capture, whether that's meetings, podcasts, interviews, or conversations, lives exactly where you plan, build, and get things done. No switching, no slowdown. Check out Notions AI Meeting Notes if you want perfect notes that write themselves. And head to the link in our show notes to try Notions AI Meeting Notes free for 30 days.