The AI Product Going Viral With Doctors: OpenEvidence, with CEO Daniel Nadler

OpenEvidence is transforming how doctors access medical knowledge at the point of care, from the biggest medical establishments to small practices serving rural communities. Founder Daniel Nadler explains his team’s insight that training smaller, specialized AI models on peer-reviewed literature outperforms large general models for medical applications. He discusses how making the platform freely available to all physicians led to widespread organic adoption and strategic partnerships with publishers like the New England Journal of Medicine. In an industry where organizations move glacially, 10-20% of all U. S. doctors began using OpenEvidence overnight to find information buried deep in the long tail of new medical studies, to validate edge cases and improve diagnoses. Nadler emphasizes the importance of accuracy and transparency in AI healthcare applications. Hosted by: Pat Grady, Sequoia Capital Mentioned in this episode: Do We Still Need Clinical Language Models?: Paper from OpenEvidence founders showing that small, specialized models outperformed large models for healthcare diagnostics Chinchilla paper: Seminal 2022 paper about scaling laws in large language models Understand: Ted Chiang sci-fi novella published in 1991

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  One of the things we hear so frequently from doctors about Open Evidence is, you know, I used it to look up this thing for a patient case that is maybe a patient case that I would have seen one or two times in my career.

• 0:16Speaker 00

  And then the same doctors are saying that about a different patient case, and then about a different patient case, and then about a different patient case. And then you realize just how long the tail of this thing is, where it's like, well, if the majority of your uses of Open Evidence are patient cases that you would see once or twice in your career, then that really captures what the thing is doing.

• 0:56Pat Grady?

  One of the questions on everybody's mind as it relates to AI is, will this actually be good for humanity? One of the use cases where AI is inarguably good is medicine. We have Daniel Nadler, co-founder of Open Evidence, on the show today. Open Evidence is trained on peer-reviewed medical literature to provide an AI co-pilot that helps doctors make better decisions at the point of care. This is inarguably good for humanity. It doesn't take crazy assumptions to believe that Open Evidence will save a million lives

• 1:40Pat Grady?

  over the next decade. Today, we'll hear from Daniel on how they've built the product, what's different versus some of the other application-layer AI products out there, and some real-life examples of how it's being used in the field to the benefit of everybody. We hope you enjoy.

• 2:01Pat Grady?

  Daniel, welcome to Training Data. Thanks for coming on the show.

• 2:04Speaker 00

  Thanks, Pat, for having me.

• 2:05Pat Grady?

  All right, how many doctors will use Open Evidence today?

• 2:12Speaker 00

  Today, probably over 100,000 physicians in the United States and more globally.

• 2:17Pat Grady?

  And what would that number have been about a year ago?

• 2:21Speaker 00

  A thousand, fewer than zero. You know, look, most people aren't aware of this, but there's only about a million doctors in the United States, serving a population of over 340 million people, which is itself an issue that we'll probably talk about later on. But there's only a population of about a million doctors. Today, maybe 100,000 of them are going to use Open Evidence. On a monthly basis, about 300,000, 400,000 monthly active users touch our system, including over 200,000 that log in and ask questions. So you're talking about 10, 15, 20%,

• 3:04Speaker 00

  maybe even 25% of doctors in the United States that are using Open Evidence in some form or another.

• 3:11Pat Grady?

  And we're not healthcare investors. We're technology investors here at Sequoia. But my understanding is that it's not normal for 100,000 doctors to be using something overnight. My understanding is that in healthcare, it normally takes a lot longer to get to that sort of scale. So what did you guys do right?

• 3:28Speaker 00

  Well, that's why we get along so well. Because you're not healthcare investors, and our approach has not been a healthcare approach. What we got right is we realized that doctors are people too. Doctors are consumers. In fact, everyone's a consumer. I think that's what you get right in your investment strategy, which is you don't sort of think about

• 3:51Speaker 00

  consumer internet applications as one category, and then a bunch of stuff over here as its own kind of weird, quirky, opaque, siloed. Industry categories over there. You think about everything in terms of consumer, consumer and that growth curves. And that's exactly how we've thought of it. You know, obviously, if you try to go top down. So everyone says, you know, it's such a refrain. You know, healthcare is impossible to break into. Healthcare is so hard. Don't start healthcare.

• 4:20Pat Grady?

  And I think the evidence generally supports that.

• 4:23Speaker 00

  Of course, because they're all trying to do the same. They're all trying to bang their head against the wall in the exact same way. They're all trying to go to the top of some integrated delivery network, which is like a large network of hospital systems. Score a meeting with the C M I O or the C T O or the, you know, all these acronyms. It'll take them three months to four months, even if, you know, if they're properly networked and connected. It would take them three or four months to get meeting one on the calendar. Meeting one will be great. They'll high five each other. They'll be like, that was a great meeting. We got great feedback. What's the follow up? Well, they're going to schedule a follow up meeting, which will probably be with a responsible AI committee. That will take three months after the first meeting. Then you'll present to the responsible AI committee, you know, at that hospital.

• 5:06Speaker 00

  Along the way, the committee members will have changed their strategy and responsible AI will have changed. Maybe the presidential administration will have changed. And now J D Vance is saying, actually, you have to change your approach to responsible AI. So that gets delayed. And you're a year into it before you're, you know, in meeting three or meeting four. And by the way, no doctors there along the way are getting the benefit of using the application. I had a lot of experience. You know, this wasn't my first rodeo. I had sold a very successful AI company before starting Open Evidence. Ken Show. And so I was very familiar with, with how corporate America works and how large organizations work. It's not specific to the healthcare system. It's just called large organizations. And I was very familiar with that. I had pattern recognition to that.

• 5:51Speaker 00

  And so I realized that that wasn't really a viable path forward for us, especially. This is my second company was very mission driven. It was very impact. Driven, but it would not have been much a sense of accomplishment for me to have nominally started a second company that was mission driven or impact driven in healthcare, but then have no doctors using it because we're waiting for meeting number six or seven or eight with the hospital system. So, long story short, we just took a radically different approach. Doctors are people too. Doctors are consumers too. And if you make something awesome that is life-changing and game-changing and profession-changing for knowledge workers,

• 6:34Speaker 00

  and it's really good enough, and you put it out on the App Store, it sounds 101, but it really works, people. You make something awesome, you put it out on the App Store for free, and it turns out that without fancy marketing campaigns or large marketing budgets or anything like that, all of our growth is word of mouth, doctor to doctor to doctor to doctor. People will start using it, and people will discover it, and then they'll start using it. And when they start using it, and if it's really awesome, they'll tell other people about it. And then you get just sort of the network effects that, you know, you got with Tesla early on. Tesla early on famously spent, you know, almost no money in marketing. They didn't, you know, as I understood, car commercials were kind of one

• 7:18Speaker 00

  of the largest category of advertising. It was taken as dogma that if you wanted to have even a remotely successful automobile, you needed to spend enormous sums of money on advertising those cars. And Tesla early on said, we're just gonna make a product that's so awesome that people will tell other people about it. Someone will drive it, they'll be like, oh my god, this is so much better than other cars. And tell other people about it. And that sort of word-of-mouth network effect that Tesla had happened with open evidence with doctors, where doctors downloaded from the App Store, as I said, a year ago would have been, I don't know, somewhere between zero and a thousand doctors using it. Today, it's hundreds of thousands. It's, you know, 10, 15, 20, maybe 25% of active

• 8:02Speaker 00

  physicians in the United States. It really, the denominator, it depends on how you calculate it, because there are more physicians that are, have a medical license that are necessarily active at any one time. But, you know, it's as little as 10% and as high as 25% of active physicians in the United States use open evidence today. And all of that is just this sort of Tesla logic of like, make an awesome car, it'll spread through word of mouth.

• 8:29Pat Grady?

  And I think it's intuitive to people what it means to have an awesome car. It's probably not intuitive to people what it means to have an awesome app for doctors.

• 8:37Speaker 00

  Yeah.

• 8:38Pat Grady?

  So what are doctors actually doing in this app? Why do they like it so much?

• 8:41Speaker 00

  So I think something is awesome if first and foremost, it solves a real need and a real pain point. Right? So much of technology is a solution in search of a problem. It's important to build toward problems that that are real and have a solution that addresses a real problem. So you got to begin from, well, what's hard about being a doctor? One of the hardest things about being a doctor, besides the hours, having to go through medical school and all the rest, the fact that they're stretched too thin and there's too few of them for the population, is that they're expected to keep up with a fire hose of medical information. So this is really not appreciated by people who are not doctors.

• 9:19Speaker 00

  But there's two new medical papers published every minute 24 hours per day. Two new medical papers published every minute 24 hours per day, seven days a week. There, there was a study done in publishing nature that said that medical knowledge doubles every 73 days. That's probably, that methodology was probably a little aggressive. We did our own internal study at Open Evidence of the rate of doubling of medical knowledge. We came up with a much more conservative number, but that's still five years. Our conservative number is medical knowledge doubles every five years. There's a lot of methodology in how you think about counting, you know, all citations. If it's all citations, yeah, it doubles every 73 days, but not all citations in medicine are equal.

• 10:03Speaker 00

  Even if you really just count what you should count, which is the stuff that doctors really need to know, like top tier journals that have the highest impact factors. Let's say the top third of journals, something like that. Even with that very conservative methodology, you're talking about medical knowledge doubling every five years. So if you think about the math of that for a second. So in 1950, medical knowledge doubles every 50 years. Today it doubles every five years. What that means is if you graduate medical school in 1950, the half-life of what you've learned in medical school, meaning the time it takes for half of what you learn in medical school to kind of be out of date.

• 10:44Speaker 00

  And we're not talking about anatomy or, you know, that anatomy, cellular biology, that stuff. Doesn't change or doesn't change that quickly. But the rest of it actually does change. And so in 1950, the growth of medical knowledge, meaning new treatments that they need to be aware of, was every 50 years, which means the half-life of what they learned in medical school nicely overlapped with the length of their career. So by the time they retired, maybe half of what they learned in medical school in terms of the efficacy of new treatments and new treatments that were available was kind of out of date, but they were retiring. So that's kind of okay, right? And they tried to keep up along the way and it was easier to keep up along the way because it was so much slower.

• 11:26Speaker 00

  Today, if you think about that same framework, by the time they're like, depending on their specialty, going through their residency and fellowship, half of what they learned in medical school is now out of date in terms of new treatments, the efficacy of those treatments and so on. So it's just, it's impossible for doctors to keep up with that because medical school, which is what most people who are not doctors assume is the information transmission mechanism for medical knowledge, only sustains a doctor for a couple of years these days in terms of the half-life of their knowledge. You have a patient coming to the dermatologist who has psoriasis.

• 12:11Speaker 00

  Okay, maybe say, fine, just read up on the new classes of biologics and pick one based on efficacy and safety. And in this example, you see that the specialization of medicine becomes very challenging because the dermatologist maybe is keeping up with the dermatology journals and all the new biologics for psoriasis that are published in the dermatology journals. But MS is a neurology condition and it's ludicrous to expect the dermatologist to also read every single page of every single neurology journal, let alone the border region or the interaction between those two specialties.

• 12:54Speaker 00

  So the dermatologist in that situation, in that scenario, is in a real pickle because they don't want to make the MS worse. They don't want to just send the patient away and say, hey, everything's too risky. So we're not going to treat your psoriasis because that's a quality of life issue for the patient. And they need to sort of figure out. What is the latest evidence, hence open evidence? What is the latest evidence on the efficacy of, yes, IL-17 inhibitors and IL-23 inhibitors, but specifically with a lens to what is the efficacy and safety of those inhibitors for patients who also have the comorbidity of MS?

• 13:32Speaker 00

  And that information hunting gathering exercise is, in a traditional, you know, pre-open evidence, is just very painful. The traditional way of doing that, you would, I don't know, you'd go on Google, try to Google this, you'd go on PubMed, none of those searches work particularly well. They'll sort of give you the titles of the articles, but this is such a specific question. This is a very specific question. This is not like a generic article title, like what is the efficacy of IL-17 inhibitors? This is a very specific question. What is the safety of IL-17 inhibitors versus IL-23 inhibitors for a patient with both psoriasis and MS? And that was a real need to come back to your question, what makes something awesome for doctors?

• 14:17Speaker 00

  Not just this one specific case, but as you can imagine, for every example you can give like this of, you know, a comorbidity, psoriasis, MS, seeing a dermatologist. The surface area of medicine is so enormous that you have millions and millions and millions of cases like this, you know? Engineers that are listening to this can immediately understand this. Everything is an edge case, everything is a corner case, right? So from an engineering perspective, the way to think about medicine is, you know, the surface area is, it's not truly infinite, but it's for all intents and purposes enormous. And everything is an edge case and everything is a corner case. And you're trying to always look up the edge case or the corner case.

• 15:00Speaker 00

  That's the experience of being a doctor, put in engineering terms. And so if you can solve the experience of being a doctor framed in engineering terms of everything is an edge case, everything is a corner case, go find, solve the lookup for that edge case and that corner case, meaning go find the reference somewhere in a medical journal that is a peer-reviewed. Top tier medical journal that answers the question of the comparative safety of IL-17s versus IL-23s in a patient with psoriasis and MS, which is never going to be in the title, which is what PubMed or Google could find. It's always going to be buried on page five or six or seven of that 30-page medical journal article.

• 15:43Speaker 00

  Then you have made the experience of being a doctor that much better. You have made the lives of doctors that much better. And most importantly, you've improved the life of the patients that they're treating because then you've prevented a scenario where the MS is getting worse because the doctor didn't know, hey, IL-17s are very promising generally for psoriasis, but if a patient has MS, IL-23s are actually a lot safer, right? If the doctor didn't know that, which is no reason for them to know because the average, given the average age of a doctor, neither of those two things existed when they went to medical school. They couldn't have, it's not even like a study question. They could not have learned that in medical school.

• 16:28Speaker 00

  IL-23 inhibitors came out in 2017, 2018, 2019. There's no way, even if doctor's my age, and I'd be a young-looking doctor, most doctors you see are older than I am, and even if a doctor were my age, I am old enough that were I doctor, I would not have learned that in medical school. So there's no way a doctor can learn that in medical school. They would need to sort of keep up with post-medical school. And because it's an edge case or corner case, and because for every one example, like that example, there's 10,000 other examples that they would also need to stay on top of, they probably would have had a hard time keeping up with that data point pre-open evidence, and that would have resulted in a worse outcome for patients.

• 17:09Speaker 00

  And one of the things we hear so frequently from doctors about open evidence is, you know, I used it to look up this thing for a patient case that is maybe a patient case that I would have seen one or two times in my career.

• 17:28Speaker 00

  And then the same doctors are saying that about a different patient case. And then about a different patient case. And then about a different patient case. And then you realize just how long the tail of this thing is where it's like, well, if the majority of your uses of open evidence are patient cases that you would see once or twice in your career, then that really captures what the thing is doing. It's essentially running search and discovery and knowledge retrieval on a tail that is not, nothing is infinitely long, but it, but is so long that it, for all intents and purposes, to a, to a, to a wet human brain might as well be infinitely long.

• 18:06Pat Grady?

  Yeah. Yeah, the, you know, the data on the rate at which medical knowledge is increasing, it's a very, it's a very positive data point, right? Like, it's great that medical research and medical knowledge is increasing so quickly. It's like this keg being filled with potential energy that hasn't converted into kinetic energy because we have this choke point, which is a human's ability to ingest and make sense of all this information. So it, it, it makes sense that now that AI is here, AI is great at looking over enormous amounts of text and doing reasoning across enormous amounts of text. It makes sense that AI is a little bit of an unlock to sort of convert that into kinetic energy with the, with the system level view. The question, we talked a bit about some of this evidence that's going into the system. Decompose the name of the company real quick. Open Evidence.

• 18:51Pat Grady?

  Why is being open important? And what exactly is all the evidence that's going into the system?

• 18:57Speaker 00

  Sure. So the, the evidence is peer reviewed medical literature. And it's most important to say what it's not. One of the reasons you got so many egg on face situations from large publicly traded tech companies that put out AI systems in the area of medicine, you got these sort of egg on face situations. I won't say specific examples, but I think we all know what they are, is because they were doing retrieval across the public internet, which means they're doing retrieval across health blogs.

• 19:31Speaker 00

  Health blogs on the public internet. They might have been doing retrieval at the time on Twitter before Elon cut off access to that. There's a lot of stuff on Twitter that you wouldn't want to be the basis for for a doctor's decision. But even if you just take the health blog thing, it's amazing how many health blog writers there are on the internet. I only discovered that when I started working on this problem. And most people assume that the people writing health blogs are doctors, or at least have some connection to medicine. That's actually not the case. These are not bad people. They're really well meaning people, but what you'll find is a lot of these people are only part time health blog writers, and they're also part time travel writers.

• 20:14Pat Grady?

  Hmm.

• 20:15Speaker 00

  Or they're part time cooking recipe writers. They're basically, you know, they're sort of journalists, bloggers, where their core skill set is writing. They're very good at writing. They don't have any domain expertise in medicine. They don't know any more about medicine necessarily than they know about planning an itinerary for a trip to Mexico. And that's what goes in to the training data. This thing's called training data. And then we're shocked when in the early days of large language models, they said all sorts of crazy things. Well, they didn't say crazy things. They regurgitated what was in the training data.

• 20:57Speaker 00

  And those things didn't intend to be crazy, but they were just not written by experts. So all of that's to say, you know, where open evidence really, right in its name and then in the early days, took a hard turn in the other direction from that is we said, all the models that we're going to train do not have a connection to the internet. They literally are not connected to the public internet. You don't even have to go so far as like what's in, what's out. There's no connection to the public internet. None of that stuff goes into the open evidence models that we train. What does go into the open evidence models that we train is the New England Journal of Medicine, which we've achieved through a strategic partnership with the New England Journal of Medicine.

• 21:38Pat Grady?

  Say a word about that for a minute, because my understanding is that New England Journal of Medicine doesn't just give all of its research to everybody for free to go train on.

• 21:47Speaker 00

  They don't, to the best of my knowledge, were the only AI company that they've done this with. And to the, and without getting into the specifics, we're not the only AI company that's asked. They've said no many times.

• 22:00Pat Grady?

  So what, why do they trust, seemingly trust open evidence when they don't trust other folks? Like, what, what makes you particularly appealing to them?

• 22:09Speaker 00

  Well, looking into the exact play by play, what happened was a number of other well-known AI companies showed up at their door and said, can we train on the England Journal of Medicine? And the England Journal of Medicine said no.

• 22:23Speaker 00

  I won't even get to the reasons of why they said no, and I'm not them, so I was speaking on behalf, but they said no. In our case, we didn't show up at their door. A number of the very senior people on the editorial board in the England Journal of Medicine were power users of open evidence and they wanted their content to show up in the thing that they were using. So it's beautiful, right? And so they came to us and then we spent a lot of time really getting right what a framework for cooperation, collaboration, which prioritizes and privileges the importance of their brand and the sanctity of their brand. And, you know, they're, they're, they're the pinnacle, they're the apex medical journal. And the Massachusetts Medical, and they're nonprofit, they're not commercially motivated.

• 23:07Speaker 00

  There's no amount of money you could throw at them that's going to make them make a perfectly mercenary decision. And in fact, without getting into specifics of it, some of these really well-funded AI companies threw enormous amounts of money at them and they said, no. If they're a private company, they probably would have said yes, but they're a nonprofit. So they said no, because the Massachusetts Medical Society, which is a nonprofit organization, cared more about the sanctity and the pristiness of their mission as a nonprofit than they did about just trying to score some sort of quick commercial contract. In the case of, of open evidence, again, it was beautiful. The very senior people there were users. And then this sort of circles back to what we talked about right at the start, which is,

• 23:50Speaker 00

  Had we waited, had we taken a top-down approach? Had we taken an enterprise SaaS approach? And been, you know, in waiting mode for meeting number 17 with the hospital system and no one was using it? Well, if no one was using it, that would include no one at the New England Journal of Medicine using it, which would have meant that they wouldn't have fallen in love with it, which meant that they, we wouldn't have ever had a opportunity to strike a content partnership with them. That would have, you know, that in turn made the whole thing that much better and more awesome to the people using it. So you get into vicious cycles versus virtuous cycles. In our case, the whole thing was a virtuous cycle. We put it out there. People downloaded it for free. Some of those people included

• 24:34Speaker 00

  various new people at the New England Journal of Medicine. They started using it. They fell in love with it. They reached out to us. We did this deal and now the thing is 10,000 times better because, you know, is trained on the full text of New England Journal of Medicine, which no AI today in the market, I can tell you with certainty, no AI today in the market is trained on the full text of New England Journal of Medicine, other than Open Evidence.

• 24:57Pat Grady?

  So we talked about the evidence part. Let's talk about the open part a little bit. What is, what does the open piece of Open Evidence mean? And why is that part important?

• 25:05Speaker 00

  Open meant a lot of things to me in the early days. One of the things that it meant was capturing that go-to-market strategy that we talked about, which is, for me, open was almost a reminder to myself that this was not an enterprise SaaS company. You know, my first company was an enterprise SaaS company. Those can be great businesses. I don't need to tell you, you had phenomenal success with enterprise SaaS companies. They can be great businesses. But for my second company, I didn't want to just have a mission-driven, impact-driven company. I also wanted to have a company that was different from my first company in every respect, because I don't like repeating myself. Specifically, I want it to be sort of direct to consumer, or in our case, direct to prosumer.

• 25:50Speaker 00

  So Open, for me, sort of symbolized that, that we would go directly to doctors, that we wouldn't go to their gatekeepers. We wouldn't allow people to be gatekeepers to doctors. We would go directly to doctors, we'd appeal directly to doctors, we'd appeal directly to the pain points that they experience on a daily basis, which is that they're overstretched, they're overworked, there are not enough of them. They're stretched far too thin in terms of the number of patients that they need to see and treat. But also that they're forced to drink from a medical information fire hose, and we were going to make that better. And we were going to help tame that medical information fire hose. And we're going to make that appeal directly to doctors as consumers and as people specifically. And that was a big part of what Open meant. You know, there's enormous inequality in the healthcare system in the United States.

• 26:37Speaker 00

  As there is in everything in the West. And there are the haves and there are the have-nots. And the best hospital systems in the United States, which have enormous endowments and unlimited funding, can afford to buy not just like one tool or two tools or three tools, they can afford to buy every tool in the category and try them all out. And they can afford to have like doctors not really use most of them. And that's okay, because you know, if Doge or Elon went and did an audit of the SaaS spend of some of these really well-endowed hospitals, he would have a field day, because what you would find is they're buying everything and they're using almost nothing.

• 27:17Pat Grady?

  Yep.

• 27:18Speaker 00

  And that's happening over here, while over here, you have doctors in rural parts of the country or urban parts of the country that just are socio-economically disadvantaged. Or you have doctors that are in private practice or in groups of, you know, ten or fewer, practices of ten or fewer doctors. Most people don't realize about doctors, a lot of doctors are small business owners. They don't work for these enormous hospital systems with a lot of money. A lot of doctors. Are self proprietors, they're small business owners. They they have a practice. It's kind of almost like the 1950s, but it persists. They have a practice. They might have one or two people helping them in an administrative capacity or a secretary or something like that. But they're the they're the principal and they have to deal with all the administrative

• 28:02Speaker 00

  stuff, plus see patients, plus, plus, plus, plus. And they don't have these, you know, enormous technology budgets. They they certainly don't have endowments, like university style endowments, like some hospitals do. Then they can't afford to go pay $10,000 for a enterprise SaaS subscription to some software product. So that all of that is what open meant. You know, we got a letter from a doctor in Albany, Georgia, who said he's the director of a cancer center in Georgia. And he's in community practice, is a community oncology practice. And that open evidence has become a lifeline to his daily practice in his cancer center and has been a game changer for patients and treating his cancer patients.

• 28:47Speaker 00

  And like most people, I didn't know much about Albany, Georgia. So I looked up Albany, Georgia. And very quickly on Wikipedia, I discovered that Albany, Georgia is in southwestern Georgia. It's 75% African American. It has a median household income of $43,000 a year. And I started to piece together the situation. You know, this doctor is probably the only oncologist in a 50 mile radius. Maybe there's a second one.

• 29:15Pat Grady?

  Hmm.

• 29:15Speaker 00

  And they're serving, you know, an enormous geography of fairly poor people. And there's no way that this doctor has the resources to pay $10,000 or $20,000 SaaS subscription, software rates for for anything. And that, to me, is what open means. It means the doctor in Fairbanks, Alaska, who wrote us a letter saying that she practices in, again, a community setting in Fairbanks, Alaska, and very limited access to subspecialists and open evidence has been.

• 29:53Speaker 00

  A game changer for her in allowing her to sort of access subspecialty level medical knowledge without direct access to human subspecialists in Fairbanks, Alaska. Again, if you look up that situation or just even think through that situation, she's not paying, you know, she's in a community practice. She doesn't work for a hospital that can afford this kind of stuff. So that's what open means. It's every doctor in the country. We're really proud that we're used not just at Mayo Clinic in Cleveland. We're, we love the Mayo Clinic. We were partly incubated at the Mayo Clinic. We love these sort of elite hospital settings. We have a lot of users at these elite hospital settings that also use it for free. But we're not just used at the Mayo Clinic. We're not just used at the Cleveland Clinic.

• 30:38Speaker 00

  We're, we're, we're used across the country. We're used in the middle of the country. We're used at Walter Reed, where our nation's warriors and veterans are treated without the government having to go through a three-year procurement process to decide whether they want to use open evidence. You know, that's another example. So, so one of the biggest health systems is the VA. To me, that's one of the most important health systems because it treats our warriors and our veterans. For the VA to decide to do anything is probably a three-year exercise. And were open evidence not open, to answer your question, we would probably still be in year 1.5 of three to four years of a government procurement process to decide whether doctors in the VA could treat their patients who are warriors and veterans with the benefit

• 31:23Speaker 00

  of open evidence. And thankfully, we didn't go that route and we're getting letters from, from doctors in the VA talking about using open evidence to make a treatment decision at the point of care for a wounded warrior. You know, that's, it energizes me waking up every day. So that's what open means.

• 31:39Pat Grady?

  Okay. So you, you guys, you've built something of a killer app for medicine and it's working. It's working really well. And we have a lot of people typically who listen to the show who are themselves trying to build killer apps of some sort for AI. So I'm curious, using AI.

• 32:01Pat Grady?

  So I'm curious, how did you build it? Like, what, you know, is this a wrapper on top of GPT three or GPT four? Like, what is the, um, what's going on under the hood? How'd you build it?

• 32:12Speaker 00

  So I, I think what I'm gonna, I'm gonna sort of have two parts to what I say. I'm gonna sort of talk about what we did and then talk about what is applicable for a lot of people listening to us. Now, I'm guessing a lot of people listening to us are, are building applications that don't necessarily have the same requirements that medicine has. So I do want to address that. In the case of medicine, the, the way we attack the problem is by bringing together a team of PhD level scientists who are working in the field. We, you know, my co-founder Zachary Ziegler is a brilliant computer scientist from Harvard, studied with Alexander Rush in his natural language processing lab at Harvard.

• 32:55Speaker 00

  That was one of the leading labs before ChatGPT even came out.

• 33:01Speaker 00

  Evan Hernandez comes from Jacob Andreas's lab at MIT. So I could go on and on, Eric Lehman from MIT as well. I mean, we, we put together a team of sort of elite scientists who are working at the frontier of language models at the top, you know, two of the top three maybe labs, if not two of the top two labs at the time in the country, in the world, actually. And we needed to do that because we're trying to solve medicine. And we're trying to solve the application of language models in medicine. And that was a very high standard and a very high bar. And it hadn't been solved. And, and what the very large consumer companies were putting out

• 33:41Speaker 00

  was creating all sorts of embarrassing moments in medicine for those companies at the time. Sort of recent enough that we probably all remember this. And so we needed sort of that level of almost the intersection of academia. And engineering to go after this problem. And we needed to, in our case, produce original research and original knowledge. So we attacked the problem in a different way. Everyone was trying to, at the time, focus on us, you know, scaling these language models larger and larger and larger and larger. And we were very, very early. You know, now this is sort of consensus with DeepSeek and all this stuff. But rewind, this is 2022.

• 34:23Speaker 00

  We were very early to the insight that smaller, highly specialized models, overtrained on in domain data, would outperform much larger models on those in domain tasks. They were very rigid. They wouldn't write you a poem. They'd fall over very quickly the second you go outside the domain. But in the domain, they were beautiful. They outperformed. And we published our work. We approached this very academically. My background is, you know, academic as well. I did my PhD at Harvard. And we were all academics by background. And we published our work in this paper, Do We Still Need Clinical Language Models? Which was awarded the best paper in machine learning in 2023 at the, at the, at the leading conference in machine learning in healthcare.

• 35:08Speaker 00

  And attracted a lot of attention. It was really the first paper in the field altogether that showed that in medicine, the best way to attack the problem was these smaller, more specialized models. Again, that's become consensus today, but you have to sort of pretend you're not listening to this today, pretend you're listening to this in 2022, pre ChatGPT. It wasn't obvious because what was, what was coming out at the time was like the Chinchilla paper from DeepMind. And everything was about larger, larger, larger, scale, scale, scale. And we just took this very different approach. And in a way, like, it's very, with the benefit of hindsight, everything's obvious. But with the benefit of hindsight, it's kind of obvious, right? If you, if you. You go and listen to Jensen's interview of Ilya.

• 35:53Speaker 00

  You know, Ilya uses the metaphor of JPEG compression, basically. It's like these language models, basically like a JPEG compression of the world. And that's, okay, well, if they're JPEG compression of the world, what's the world? What's the world that you're compressing? And it goes back to what we talked about, public internet. Yep. If you're, if you're doing a JPEG compression of the public internet, then what you're, which is what these large language models that we're focusing on scale, where, where, where basically they're token limited. They're like, give me as many tokens as possible for me, for me to train on. And so, well, where do you find all the tokens in the world? You find them on the public internet. Well, to go back to Ilya's point, well, what are you compressing then? What are you JPEG compressing? You're compressing the public internet. And then you get all these sort of embarrassing outputs that, that were sort of of that late 2022,

• 36:38Speaker 00

  early 2023 vintage. In our case, we sort of said, let's make a JPEG compression of medicine. And so let's, let's overtrain on, again, peer reviewed medical science, stuff that comes out of the FDA, the CDC. We had the advantage, this is way before the New England Journal of Medicine partnership, but we had the advantage of that under copyright law, anything created by the US government is public domain. That's how Wikipedia does a lot of what it does. So in the early days, we started with the sort of like Creative Commons, public domain stuff that was available. And we were very lucky that in medicine, this wouldn't work in every other field. Because in, in other fields like law or accounting or tax, there's a lot of stuff that's behind walls.

• 37:23Speaker 00

  But in medicine, it turned out that a lot of the, the really great stuff was created by the US government in the form of the FDA and the CDC and what they had put out. So we overtrained on that stuff and solved the copyright issue that way early on, which then allowed us to bootstrap something awesome enough that people could download it, which then won over users.

• 37:45Speaker 00

  At places where there were copyright considerations like the New England Journal of Medicine, which then started the flywheel of them reaching out to us. And then now that's having the benefit of the stuff that is under copyright, the New England Journal of Medicine. But that was our approach and was very technical and it was very academic and it was very scientific because accuracy mattered that much, given our domain in medicine.

• 38:11Pat Grady?

  Yeah, I was gonna ask you about that. So you have doctors using open evidence to make clinical decisions at the point of care.

• 38:18Speaker 00

  Yeah.

• 38:18Pat Grady?

  So in most applications, a hallucination is annoying. With open evidence, a hallucination could be literally life threatening, given how it's being used. So how do you do with hallucinations in particular?

• 38:31Speaker 00

  Well, and just to reiterate the first thing you said, and maybe this is advice for entrepreneurs or engineers who are listening to this, there are scenarios where hallucination is not even annoying. There are scenarios where hallucination is a feature. One of my favorite applications is Mid Journey.

• 38:46Pat Grady?

  Yeah.

• 38:46Speaker 00

  Hallucination is a feature.

• 38:48Pat Grady?

  Yeah, yeah.

• 38:48Speaker 00

  Of Mid Journey. Maybe one takeaway is find applications where the biggest hesitation actually gets juda moved into a feature as opposed to a limitation. And just to total aside, an example, and someone should go start this company. Again, my first company was in finance and I feel like I kind of grew up on Wall Street and I think that way. And if I wasn't running open evidence, I wouldn't run another company because I'm going to work in medicine, I think, for the rest of my career because of the impact. But if I were pressed to sort

• 39:30Speaker 00

  of like, what would I do in finance now that large language models exist? I would actually begin from thinking about hallucination as a feature as opposed to a limitation. So where is hallucination a feature in finance? Well, it's certainly not in like doing retrieval on the PE ratio. You need that to be right. Well. Where else could it be used? What about risk management? A lot of finance is about figuring out what the black swans are.

• 39:59Pat Grady?

  Hmm.

• 40:00Speaker 00

  A lot of finance is what could go wrong? And then at the extreme tail, there's a lot of money at stake. What could, what is very unlikely, but that could go really, really wrong? And the first two questions, most people can reason through without the aid of computers. What can go right and what can go wrong? You can kind of reason through that with your wet brain. But in terms of like, what could go really, really, really wrong at the level of the 2008 financial crisis? That's harder for, for the, for, for most unaided brains to imagine that. But these language models would be pretty good. And I've tested some of this in my own portfolio management at hallucinating those things.

• 40:39Pat Grady?

  Hmm.

• 40:41Speaker 00

  I've actually, as an experiment, done this in my own portfolio management. Just use these language models in a way that the hallucination is a feature where I give it certain details of my portfolio. I talk about the company, I, you know, I, I give it in the context window enough information so that it understands what the company does and so on. And it comes up with all sorts of scenarios that are kind of on the long tail of what could go wrong. And I'm like, huh, I never thought that I, I love Nvidia, but I never thought about that happening to Nvidia. That's interesting. So at a high level, I think there's enormous opportunity.

• 41:23Speaker 00

  I think we're like 1% of the market captured today in 2025 in terms of applications built that even begin to think about hallucination or riffing as an advantage as opposed to as a limitation. So that's for all the entrepreneurs listening, there's, there's 99% is still up for grabs. Yes, in my specific domain, medicine, none of that is fair game. And so the way, you know, we had to deal with that is by not connecting open evidence and the models that we train to the public internet.

• 42:01Speaker 00

  Is by only training on peer reviewed medical knowledge. And go back to Ilya's point, the JPG compression that we made in our models, in our, in our smaller specialized retrieval models and ranking models. You know, we don't use one model without getting into our sort of trade secrets, like it's an ensemble architecture.

• 42:22Speaker 00

  There's multiple models that do different things. There's half a dozen models. They hand off tasks to each other. You can't get the accuracy level of open evidence by training one large language model. It's under the hood going to be this sort of cooperative ensemble architecture. And those are made up largely of smaller models that do very specialized things like retrieval and ranking and other things. And for those models, the JPEG compression is exclusively of peer-reviewed medical literature. So it's never going to be at risk of regurgitating or surfacing something that is not in the peer-reviewed medical literature, which is, as they say in G I Joe, more than half the battle, right?

• 43:05Speaker 00

  And then the other half the battle is allowing transparency and interrogation of the answer. And we were very early to that. I've seen now that ChatGPT and others start to do that, but we were probably the first application. I would go on a limb and say we're like the first application that grounded our answers in references that you could drill down and drill through to see the underlying sources of. We did that in early 2023, long before Chat and others started to come out with similar features. And that's how we won over users in the early days because doctors saw that not only is this not saying anything egregiously wrong in terms of regurgitating something on the public internet, but it's also even within the domain of the answers that it gives based

• 43:49Speaker 00

  on peer-reviewed medical literature, allowing me as the physician to go interrogate where it's getting that thing that it's saying, where it's getting that source of information from and drill down all the way to the reference and then go and read the reference, which by the way, also created a beautifully symbiotic relationship with the publishers. Because instead of just compressing all their knowledge and then giving it away, as some folks did, as a result of just trying to make this as accurate as possible, inadvertently stumbled upon a model of cooperation with.

• 44:26Speaker 00

  Publishers that ended up being very good for them too, because we send an enormous amount of traffic to medical journals. We send millions and tens of millions, tens and tens of millions of visits from doctors to medical journal pages hosted by those medical journals, including traffic they might not have otherwise have gone because the doctor is going to that journal because of some detail deep in the methodology section that the doctor would have never known to go to that journal for. Really this virtuous circle kind of all around. And then we had medical societies that write guidelines reaching out to us saying, hey, we noticed that you index this other society's guidelines.

• 45:10Speaker 00

  Can you go index our guidelines? Because we want the traffic. It's beautiful, right? So you get accuracy. You get a symbiotic and a mutually beneficial relationship with medical journal owners. But critically, you get the right information back to the doctor using open evidence who then will make the better decision as a result of having better information for their patient at the point of care.

• 45:34Pat Grady?

  And it's been, it's been a decade or so since KINSHO got going. And obviously, there's been a lot of progress in the field of AI machine learning since then. If we were to inspect the underlying architectures of KINSHO and open evidence, how much is the same and how much is different? And I guess part of the question behind the question is, how much of what goes into making an AI application that actually works is recent breakthroughs? And how much of it is more sort of classical engineering, machine learning principles?

• 46:08Speaker 00

  KINSHO was pre-large language models, pre-language models, pre-small language models, pre-BERT, pre-anything, almost pre-FIRE.

• 46:21Speaker 00

  So it's hard to compare, right? I mean, KINSHO was very early in OP. Not when I sold the company, by the time I sold the company, it was much more sophisticated. But I'm talking about when I founded KINSHO in 2013. So it's very different today. What they have in common is there's an enormous infrastructure component to building this stuff. So, you know, we train our own models. I mean, I talked about that over the last few minutes and, but even if you're not training our own models, even if you're just like using an API to.

• 46:55Speaker 00

  One of the usual suspects, you know, that's going to fall over at some point if you're successful and and you want to be successful and you want to get to the point where it falls over and it will fall over. And at that point, you need to have all the traditional things that you have in traditional software engineering, like infrastructure and really good infrastructure. And that is very similar to Kancho because both were critical systems, you know, in the case of finance, there's enormous amounts of money being moved around on the basis of this information. You can't have it just stop or fall over in the middle of a trade. And I think that's a good thing. I think that one of the things that everybody was concerned about post the chat GPT moment was that all the rules of the game had changed.

• 47:41Speaker 00

  And, you know, I'm here to sort of tell you that they haven't. Yeah, the technology is better, but that's a continuum. The technology has always been better. The technology was better from 1982 or 83 to 1987, right? And from 93 to 97, right? The technology has always gone better. Yes, there's a step function now. Yes, there's nonlinearity. Yes, there's an exponential rate of increase. Yes, everything Ray Kurzweil said is correct and turned out to be correct. But but it's a continuum, you know, even Ray Kurzweil thinks about this stuff as a continuum. And when you think about something as a continuum, it's very, it's a relief in a way because a continuum is something where the laws of physics aren't changing along the continuum,

• 48:25Speaker 00

  even if you think about the metaphor of travel toward the speed of light. Yes, the technology that would get us from one tenth the speed of light to one half the speed of light in a spacecraft is highly nonlinear in its sophistication. But the laws of physics in that acceleration are not changing. It's just the technology is on a nonlinear continuum, but it's still a continuum. And that same continuum, nonlinear, but continuum exists in engineering and entrepreneurship more broadly, but specifically in AI, where everything that mattered at Kancho continues to matter today. And the the intelligence level of the people that you're bringing to bear on the task matters, you know, Kancho and Open Evidence

• 49:10Speaker 00

  are identical in that we were able to be successful because we brought people with really high IQs to bear on the task.

• 49:17Pat Grady?

  Let's talk about that. Yeah, you mentioned Zach and Evan and Eric and Micah. How do you? How do you attract people like that? Why do they choose? For all the options they have, why do they choose to work on open evidence?

• 49:32Speaker 00

  It's impossible for me to answer that without just

• 49:36Speaker 00

  repeating what Steve Jobs has said, which itself has been repeated so many times. But I don't have a better way of phrasing it. A players want to work with A players. It's that simple. Elite people want to work with elite people.

• 49:53Speaker 00

  A lot of people who sign up to BUDs, which is the sort of screening process for Navy SEALs, do so because they just want to see if they can keep up with the other people that are doing it. They want to test themselves. They want to see what their limits are.

• 50:10Speaker 00

  That's as old as Achilles. That's not new. It doesn't matter whether it's warfare or engineering or sports or any other domain, finance. The very best people in the world want to see just how good they are. They want to see what they're made of. And the only way to do that, the only way to learn that is to put yourself around other elite people and see how you stack up against those people. So that's, that's the common denominator to what I did. A Kentsch that worked very well to what I'm doing here that's working out very well, which is, you know, and it's kind of controversial, or at least was controversial for a minute. You know, you couldn't talk about IQ.

• 50:55Speaker 00

  You couldn't say out loud for a while, like, I just want people with really high IQs. I don't care about anything else. That's

• 51:03Speaker 00

  I don't care who you are, what your background is, what you look, I, I just want someone with a really, really high IQ.

• 51:11Speaker 00

  But that's the honest truth. I just don't know, I don't know how to sugarcoat it. I don't know how to say it differently. I don't know how to talk around that fact. And so, you know, if you think about the people on, you know, the, the first four or five people, Zachary Ziegler, Jonas Wolf, Evan Hernandez, Eric Lehman, Micah Smith, that, that came together, sort of senior people on my team initially. Yeah, every one of them, if

• 51:39Speaker 00

  If I have to sort of classify it this way, you know, came from a PhD program at Harvard or MIT. But that's not because I'm like, I'm only going to recruit from Harvard and MIT. It was because I had the cultural experience and I learned from that experience that if you bring very high IQ people with very high velocity of learning to bear on a very difficult problem, they make more progress far more quickly than a team 100 times that size. That's a more normal team. And I think the really reassuring thing for everybody listening in this moment is the rules of the game haven't changed. The physics haven't changed. All the things that used to matter still matter.

• 52:23Speaker 00

  You know, an elite team, high IQ people, high velocity people, hungry people, very motivated people, people with very high neuroplasticity. And by the way, when I say high IQ, what I mean is high neuroplasticity. I mean something very neurologically specific. I don't mean speed at solving a Rubik's Cube, which actually doesn't necessarily correlate very highly. It's the Francois Chalet definition of the ability to efficiently acquire new skills. Absolutely. It's the ability at which you can learn completely new information and assimilate that new information. That's what I mean by very high IQ. And guess what? That mattered 1,000 years ago, mattered 3,000 years ago. The domain was different.

• 53:08Speaker 00

  It showed up in warfare and tactics and Sun Tzu and those sorts of things. But whatever humans were doing at any moment in history, what mattered was neuroplasticity. You know, I spent a lot of time reading in my personal life, Von Clausewitz and Machiavelli and Sun Tzu and the history of warfare. It's a subject I'm very interested in. And the history, of course, Napoleon and Alexander the Great and these folks. It's all just neuroplasticity. You know, if you had to sort of say in a few words, what differentiated these people?

• 53:46Speaker 00

  I mean, none of these people were the physically largest people in their armies, not even close. What they all had in common is you, the facts on the ground could change very rapidly, as tends to happen in war. And their thought, not just their decisions, but their entire frameworks for thinking would just like adapt. That's the quality that like a Napoleon or an Alexander the Great had, which is, you know, yeah, they over-prepared for the battles that they went into and thought through every single thing that the adversary could do. But then, none of that preparation would exactly match to what happened in the battle.

• 54:30Speaker 00

  And what differentiated them from even very good generals or very good military leaders is they would just completely adapt their way of thinking about the battle to the facts on the ground that were developing in real time in the battle. And that's, you know, the standard way of describing that as neuroplasticity, or at least in some branches of cognitive science, which is very high neuroplasticity individuals. So what humans have been doing over the last, let's say, 3,000 years has kind of changed a lot, right? We're, I mean, unfortunately, there are elements of what humans were doing 3,000 years ago that persist to this day. And the war does persist. But not everybody today in 2025 is engaged in warfare in a way that might have been the case during the time of the Greek city-states.

• 55:15Speaker 00

  You know, people thankfully today that are engaged in things other than city-state warfare. But what hasn't changed are sort of the neuroprocesses and cognitive qualities that are required for outlier success.

• 55:33Pat Grady?

  Awesome. Let's jump into a lightning round.

• 55:36Speaker 00

  Sure.

• 55:36Pat Grady?

  Okay. Question number one. I know this number is impossible to measure because it requires a counterfactual. But we suspect that the way open evidence is being used, it's saving lives, like it's helping doctors make better clinical decisions. On what date

• 55:58Pat Grady?

  will we be able to say that open evidence has saved a million lives?

• 56:03Speaker 00

  A million lives. Well, in a way, this feels like a McKinsey interview because you got to sort of reason through your like, well, if you have 150,000 or 500,000 doctors using it and those doctors each see a certain number of patients and what percentage of those patients are in life threatening your situations, I'm doing this sort of-

• 56:19Pat Grady?

  Can I tell you my math?

• 56:20Speaker 00

  Yeah, yeah. You tell me your math.

• 56:22Pat Grady?

  My math is, you know, it depends on where you look, but kind of 300,000 to 800,000 lives per year lost due to just straight up medical mistakes. Not all of those are going to be attributed to doctors making decisions at the point of care. There could be other things that happen, but let's take the low end of that, 300,000. Let's cut it in half. That's 150,000. That says it's about six and a half years, you know, until you get there. And that's a fully ramped open evidence. So we'll give you a couple of years to keep growing. I don't know, maybe eight or nine years from now. So we'll call it like 20, we'll call it November 4th, 2034.

• 56:56Speaker 00

  I'm going to use this as an interview question.

• 57:00Pat Grady?

  All right.

• 57:00Speaker 00

  The only thing I would add is, is, you know, maybe in the 2030s, you have a million lives saved through the use of open evidence, but what that doesn't count is the patient today, whose MS didn't get worse because the dermatologist used the wrong biologic. And that's happening today, right? And, and for every black and white life saved, you know, there are those examples. There was a doctor who uses open evidence in Rhode Island who wrote us that he saved his patient's life by using open evidence to reason through whether the patient's presentation of symptoms was consistent with a pulmonary embolism. And literally used open evidence as like a curbside consult to sort of reason through

• 57:43Speaker 00

  that patient's presentation of symptoms, realizing that actually it was the patient's presentation of symptoms was consistent with a pulmonary embolism, they rushed the patient back to the emergency room and, and saved that patient's life. So lives have already been saved through the use of open evidence and we know that because doctors tell us that. But for every one of those things that happens, it's just, you know, the MS not getting worse, or it's some comorbidity not getting worse. That's in the order of millions today.

• 58:07Pat Grady?

  Yeah, yeah, yeah. Broad domain, general purpose foundation models, they are commoditizing. Yes or no?

• 58:17Speaker 00

  I think they're getting better and better. I think the costs are coming down. I think everything Ray Kurzweil says is typically always right. So, you know, the frontier of the frontier doesn't get commoditized. It's always the frontier, but you know, they, yeah, the costs are gonna, the costs of the wow factor that the first ChatGPT produced.

• 58:36Pat Grady?

  Yes.

• 58:37Speaker 00

  Are gonna converge to zero, which is why I think all the interesting stuff is gonna increase from a business perspective, all the, there's still phenomenally interesting work being done at the foundation model layer intellectually, academically, scientifically. From a business perspective, I think so much of the interesting work, the great companies, to be blunt, are gonna be at the application layer.

• 58:58Pat Grady?

  Yeah, well put, well put.

• 59:01Pat Grady?

  AGI, on what date did we or will we reach AGI?

• 59:09Speaker 00

  I think we've already reached, we keep moving the goalposts. We've reached AGI. We've passed Turing, we've passed the Turing test.

• 59:15Pat Grady?

  Yep.

• 59:15Speaker 00

  And even, so we just keep moving the goalposts on what AGI is. What people really mean when they talk about AGI is consciousness, and they don't know how to say that.

• 59:22Pat Grady?

  Yeah.

• 59:22Speaker 00

  So they're, what they really, cause like, they, they try to sort of say, well, it's this thing, or it's this other thing, and then the AI does that thing, and like, well, it's the ability to have high school level expertise in multiple different fields. Okay, it reaches that. Fine, fine. It's not that. AGI is college level expertise, and then it reaches that. And now it's like, you know, PhD level expertise in everything from coding to medicine, that would be AGI. That's never gonna, and then it reaches that. What they really mean is consciousness. That's what people, I think, underneath it all, mean. When does a, when do you get what you get in the movies, when an AI becomes aware and conscious? I'm not sure that ever happens, because I don't know that consciousness is an emergent property of sufficient density

• 1:00:07Speaker 00

  of a neural network.

• 1:00:08Pat Grady?

  Hmm.

• 1:00:09Speaker 00

  That's a philosophical question.

• 1:00:11Pat Grady?

  Yep, yep. For AI founders, AI builders, AI fans, other than this podcast, what one piece of content should they consume?

• 1:00:25Speaker 00

  Ted Chang's novella, Understand.

• 1:00:28Pat Grady?

  Okay, tell us why.

• 1:00:30Speaker 00

  Uh, I want you to have the joy of experiencing it. I won't, um, I won't spoil the story. It's a, it's a, Ted Chang is one of the great science fiction authors of all time. He wrote, um, Arrival, which became a major, major motion picture. And, uh, the, the novella, Understand, uh, was written in the early nineties. And it is the best encapsulation of what, without any spoilers, it is the best encapsulation of what nonlinear

• 1:01:05Speaker 00

  acceleration of intelligence looks like.

• 1:01:09Speaker 00

  To it, it's my touchstone for everything that I do. Um, most people expect a, a nonfiction answer. There's great nonfiction. There's tons of nonfiction reading, um, including just like, go read the Chinchilla paper.

• 1:01:23Speaker 00

  Great paper. If you want really just a touchstone for what it is that's happening, uh, in our civilization right now, it's this Ted Chang story, Understand, because that just captures narratively, um, really the feeling of nonlinear acceleration.

• 1:01:39Pat Grady?

  Yes. Awesome. Love it. All right. Last question. What is the most optimistic or positive thing that you can imagine AI bringing to the world in the next couple of decades? How are, how will all of our lives be better? Thanks to AI.

• 1:01:56Speaker 00

  Um, I have to go with a, kind of an extrapolation of, of the field that I'm kind of obsessed with. Um, but which is not truly possible today, uh, which is personalized medicine, by which I mean, so personalized medicine has been just over the horizon. It's kind of like quantum computing. It's kind of like fusion, you know, it will happen on some civilization scale. Um, it's been just over the horizon for a very long time. What it means changes. In a way, we've been talking about it this whole time because, um, using open evidence to say that, hey, if you have psoriasis and MS, means you should use this biologic versus this other biologic. That is the beginning of personalized medicine. That's personalized to your comorbidity

• 1:02:40Speaker 00

  versus any other person with psoriasis. But that's just scratching the surface of what personalized medicine can be. You know, I think in 10 years from now, uh, whether it's open evidence or whether it's a constellation of these types of AIs.

• 1:02:53Speaker 00

  The exact, specific fact pattern of your specific medical case is going to be matched to everything that is known in the entirety of medical knowledge about everything that is relevant to your case. And a plan of care is going to be formulated that is hyper tailored to everything that is specific to you and that is specific about your case. And I mean, to me, that's just enormously exhilarating. And I think that is just over the horizon, but that that is feasible and that that will change. That's how you really start to push the ceiling on life expectancy. That's how you start to get into maybe 120, 130 is no longer the ceiling anymore.

• 1:03:38Speaker 00

  And you get into these sort of ancient Greek metaphors and paradoxes of Theseus's ship and replacing every plank on the ship to the point where there's no plank in the ship anymore that was the original plank. But you're walking around and you still have your memory of your wife and your child and your relationship to them and still alive to to watch your own child turn 100 and those things. And I'm an optimist in that in that regard. I have an atomistic view of human biology, and I think the the Theseus ship approach to human biology is just over the horizon and a lot of it turns on the sort of personalized medicine stuff.

• 1:04:18Pat Grady?

  Awesome. Daniel, thanks for joining us.

• 1:04:20Speaker 00

  Thanks, Pat.