This AI Broke Every Benchmark — Then It Did Something Worse. Vivienne Ming - #551

A neuroscientist built an AI that refuses to give answers — and it outperformed every model on the market, including the ones trained on billions of users’ data. The implication: every AI that hands you the answer may be quietly making you less capable of thinking without it. Dr. Vivienne Ming is a neuroscientist, AI researcher, and author of Robot Proof, who has spent nearly 30 years building machine learning systems and studying what makes humans irreplaceable alongside them. We cover: -why the 5–10% of people who argue with AI outperform both elite human forecasters and top AI models -what GPS is already doing to your memory and why GPT may be next -the "Sexy Face" game that was secretly training a neural network to reunite orphan refugees -why the information explosion paradox means more free answers lead to less human exploration — even among scientists. Giving you the answer is almost the worst thing these machines can do. Key Takeaways 0:00 – The AI Trained to Never Answer You 0:49 – Why Most People Just Hand Problems to AI 2:18 – How the Cyborgs Beat Everyone 4:55 – What Happens When AI Only Asks Questions 6:10 – The Failure Resume: What It Actually Means 9:14 – What Amazon & Facebook's Data Revealed About Innovation 11:23 – Why Even Scientists Are Exploring Less 15:23 – The Hidden Parenting Book Inside This AI Book 16:14 – If Kids Were Bonds, What Would They Be Worth? 20:17 – The Skills That Predict Everything at Age 65 25:22 – The "Sexy Face" Game That Reunited Refugee Families 31:24 – What Diversity Actually Means on Breakthrough Teams 35:56 – What Einstein's Dad Would Have Gotten Wrong 37:40 – This Is Not the Industrial Revolution 41:17 – GPS Already Shrank Your Brain. GPT Is Next. 51:49 – Why the Book Cover Is Black and Yellow 56:55 – The Benchmark Nobody Is Building 59:46 – Can an AI Ever Have a Happiest Thought? ——— 📬 Get the transcript, fascinating bonus content, and my Monday M. A. G. I. C. Message: https://briankeating.com/yt 🌠 Have a .edu email and live in the USA 🇺🇸? You automatically win a meteorite: https://BrianKeating.com/edu 🔔 Subscribe: https://www.youtube.com/DrBrianKeating?sub_confirmation=1 🎯 Support Into the Impossible on Patreon — get my weekly M. A. G. I. C. Message, unfiltered bonus content, and live monthly Office Hours with me: https://www.patreon.com/drbriankeating ⭐ Join this channel for perks, monthly Office Hours, and your name in the Member Roster at the end of every episode: https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join 📚 My books: Losing the Nobel Prize (memoir): http://amzn.to/2sa5UpA Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu Focus Like a Nobel Prize Winner: https://a.co/d/hi50U9U Galileo's Dialogue (first-ever audiobook): https://a.co/d/iZPi9Un 🌐 More: 🏄‍♂️ Twitter: https://twitter.com/DrBrianKeating ✍️ Blog: https://briankeating.com/blog 🎙️ Audio-only: https://briankeating.com/podcast #intotheimpossible #briankeating #science #physics #astronomy #cosmology #podcast #universe Learn more about your ad choices. Visit megaphone.fm/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  This episode is brought to you by Indeed. You're ready to level up your business, but the pressure to find the right person to make that happen is intense. Indeed sponsored jobs can help carry the load. It boosts your job post to help it reach quality talent fast. Cut through the chaos with Indeed sponsored jobs. Get a $75 sponsored job credit at indeed.com/podcast. Terms and conditions apply. Hiring now? Then this is a job for Indeed sponsored jobs.

• 0:31Speaker 01

  Low energy, unfocused, foggy? You might be dehydrated. Whether it's hot yoga, over 100 degree weather, or too much sun. Gator Light, with a specialized blend of five electrolytes, was scientifically designed to help move fluids into the body faster for rapid rehydration. Shop now at retailers nationwide. Gator Light hydrates faster than water. Is it in you? Symptoms noted are signs of mild to moderate dehydration. Consult a healthcare professional if symptoms persist.

• 0:59Speaker 02

  What if the smartest thing AI could do is refuse to give you the answer?

• 1:04Speaker 03

  We trained it to never give answers. It is Socrates. It only gives context and questions. But amazingly, upwards of 20% of participants switched into cyborg mode and did this amazing, not just superhuman, but super AI performance. What is the point of us if the best and brightest can't beat what an AI can do? But then, in about 5 to 10%, did something amazing. We called them the cyborgs. If we zombie walk our way into a future where it has all the answers and we don't, what's the point of us? Exploring the unknown is the one thing humans are uniquely well-suited to do.

• 1:48Speaker 03

  What is the best use of AI right now? I have a paper coming up, and the title of that paper is "Human Capital, Not AI Benchmarks, Predicts Hybrid Intelligence in Forecasting." So how do you measure how creative a human is, or an AI is, or the two together? When maybe, you know, a massive, large language model has just memorized every measure of it we would typically use in science, which, by the way, it has, and so it distorts. And then you have a bunch of, like, marketing professors or computer scientists, who, I love them, but they aren't scientists, running these experiments that aren't really valid. What have we made predictions of the future?

• 2:31Speaker 03

  What will the price of oil be in six months? Which, as we record this, everybody has some sense. But I will tell you, when we ran the experiment several months ago, nobody, nobody knew what the price of oil was today, much less six months from now. So the humans in this experiment did terribly. The AIs did great and pretty much how they did tracked with the traditional AI benchmarks that they were used on. But then we paired them together. And human capital absolutely dominated. Which is to say, the vast majority of people in the experiment, including a whole lot of UC Berkeley students, smart kids, essentially said, Gemini, GPT, what will the price of oil be in six months?

• 3:15Speaker 03

  And then they submitted that answer.

• 3:17Brian Keating?

  What do you expect from the second best UC school, right?

• 3:20Speaker 03

  Yes, well, I mean, we can't all be in the sunshine all the time. In this particular case, you know, you could look at that and feel really terrible. What is the point of us if the best and brightest can't beat what an AI can do? That essentially they're just a pair of legs to walk it across the answer across the room. But then, in about 5 to 10%, not a huge percentage, but we saw it in there, about 5 to 10% did something amazing. We called them the cyborgs. The cool thing was, you couldn't tell who made the prediction. Was it the machine? Was it the person? Because what they would do is they'd make a big prediction.

• 4:02Speaker 03

  And then the AI, and we used a variety of different models, would sort of say, oh, but wait a minute, what about the data? And then the humans would say, okay, you're right. That wasn't right, but what about this? And then they go back and forth several rounds. They had to make 10 predictions in an hour. They didn't have time to cheat the system. Like, they went in, they did better than the best humans. Even if they themselves, on their own, were modest. They did better than the best AIs. Even when our cyborgs just had a small open source model available to them. And we took the questions off of Polymarket, which again, six months ago, very few people knew about, now that's in the news.

• 4:44Speaker 03

  And in many contexts, they were comparable to Polymarket in high-volume questions. So this is a prediction market. People have actual money trying to figure out what that price of oil will be. And a human with no prior knowledge, paired with even a modest AI, but with this right set of behavior. So why did I drag you through all that nerdy stuff? Because what predicted? What is the human capital I'm talking about? Well, working memory span is a classic, fluid intelligence, perspective-taking, the ability to understand how, what other people are thinking, theory of mind, predicted ability to use AI to make these predictions, curiosity, intellectual humility.

• 5:29Speaker 03

  So when you had a prediction of your own and the machine said, no, did you just take its answer? Did you push back? Did you change? Did you learn? So we looked at that behavior, and I'm finally getting to the answer to your question. We said, could we make the worst-performing AI of all time? You put it on any benchmark, it does as bad as any could be. GPT-1. We're going to, in this case, we took an open-source LMA model, and we trained it to never give answers. It is Socrates. It only gives context in questions. So it does terrible. Because it refuses to give answers.

• 6:13Speaker 03

  But amazingly, twice as many, instead of 5%, upwards of 20% of participants, switched into cyborg mode and did this amazing, not just superhuman, but super-AI performance. And of course, the great thing is, as the AIs get smarter, so does the hybrid intelligence. So. That actual experimental result that we can see what makes humans amazing, and we could think about what that means for parenting, education, workforce. But we could also see what about AIs make humans amazing? Why are our benchmarks about what AIs can do all by themselves?

• 6:56Speaker 03

  Why aren't they about how they make us better? And as I said, it turns out giving you the answer is almost the worst thing these machines can do.

• 7:09Brian Keating?

  You talk about cultivating a failure resume.

• 7:11Speaker 03

  Yeah.

• 7:12Brian Keating?

  Which, which I took, you know, just a slight bit of a counter, you know, take on, which was just a, you know, that's great for Silicon Valley and, you know, fail early, fail often. I'm so sick of hearing that, you know, from the Google days. It's great when you have a $4 trillion valuation, right? But if you have a small company or a small businesswoman, right? So you have these companies. Do you really want them to be failing often? Or would you like them to not fail at all and learn from other people's failures?

• 7:35Speaker 03

  In the perfect world, we would never fail. We always know what the right answer is. But note, and you've sort of asked me two separate questions. One is what I really meant by a failure resume, which is, listen, it's hard for me to literally get out of my head. I'm a neuroscientist. I think of a lot of high level human behavior in that sense. We've got this thing called our anterior cingulate, ACC. Back in the day, we used to call the ACC the oh shit network. Uh, cause if you had someone in an experiment, like they had to really quickly make decisions. If they made a decision and like they're immediately knew they were wrong. Oh shit, oh shit.

• 8:20Speaker 03

  Then you'd see their ACC light up in like an fMRI. So all this neuroimaging.

• 8:26Brian Keating?

  Again, you don't really want that from your pilot, right?

• 8:28Speaker 03

  And you, clearly you don't want people making mistakes. Except if that network doesn't fire.

• 8:36Speaker 03

  Where does its signals go? To a variety of places, but one of the places it goes is into your amygdala and into your nucleus accumbens. What is the nucleus accumbens doing? That's your reward center. It's getting predictive errors. So endogenous opioids, to bring you that pleasure. But I actually just wrote about this recently, maybe it's my newsletter for next week, about curiosity, is maybe a better way to think about dopamine is it is the prediction drug. It's not the pleasure drug. People don't, you give them a dose of exogenous, like an injection of opioids to a mouse, or you can do similar things with humans, they, there's no evidence of pleasure.

• 9:20Speaker 03

  You don't feel pleasure. You just want to do a thing. So when you get those error signals, implicitly, your brain made a prediction about the world. And now your experience is, uh-oh, that wasn't quite right. That error signal is how you learn and how you train. You never get that error signal? By definition, you do not learn. So, you know, I mentioned John Hopfield won the Nobel Prize in Physics a couple of years ago, my grand, grand advisor. So did the work of the team working on protein folding, get the chemistry award, and that was for reinforcement learning. Well, guess where we figured out reinforcement learning from? Not AI, came right out of the brain, studying rats solving mazes.

• 10:05Speaker 03

  No ACC, no error signal, no learning. I will add one additional addendum for the CEOs of the world is you are too cautious. I get to run lots of cool research, and I will keep this very tight. I got a really interesting pair of calls in April of 2020. It was Amazon and Facebook, and they both said, we just send everyone home, and we don't know what to do. We don't know how to be innovative through a camera. And so I got data from two of the biggest data sets in the world, Amazon workforce and Facebook in general. To do things you're never supposed to be able to do, which is track everyone.

• 10:47Speaker 03

  And but particularly, I'm interested in what makes the smartest, most innovative teams. And there's a lot of people doing this research, so I'm far from the only one. But we got to see this massive data set. And what we see is innovative teams are very much risk takers. Like, not incremental innovation, but transformative innovation was the step change behaviors. They never got there on the first try. They built off of failure. Again, super long story short, what we found is in science, in popular music, pick any domain

• 11:28Speaker 03

  you want, we are far too risk averse for sort of a theoretically optimal Bayesian innovation agent. As soon as someone has a good enough answer, we all start herding around those safe answers and stop exploring. We actually went so far as to call it the information exploration paradox. The more information is available, like, say, free information from an AI, the less we explore. Even scientists do this. That really scared me. And so this idea of a failure diary wasn't keep track of all the mistakes you've ever made. It was keep track and tie those mistakes to the eventual success that they led to.

• 12:12Speaker 03

  Train your brain to connect, oh, that didn't work out, to now I understand it better.

• 12:22Brian Keating?

  Why did you say it's scary that scientists, just a second ago?

• 12:25Speaker 03

  It's scary that scientists show this same very human failing because our job is to explore the unknown. Here's a thing that maybe only people like you and I could really share as an experience. But when I originally worked with BERT, that was like the first big language model, this is Google's early model, and then GPT, and nowadays, all of these different models. My immediate experience is, this is a lot like working with my grad students. My grad students are brilliant. They know everything. They're a brilliant kid who, for five to seven years, their whole life is about this one esoteric question. Right, without spouses, or kids, or pets. And, yeah, nothing else.

• 13:10Speaker 03

  They know it better than me. They never needed me to learn the facts about that question. Not, forget a world witch AI, or the internet. You could have just gone over to Geisel Library, or our libraries up at Berkeley, and learned about it on your own. Our job is not teaching facts. That may be shocking to you. The job of science itself is not a bunch of facts. Science is exploring the unknown. Science is what happens when the facts have run out, and you don't know what happens next. Whether that's in physics, or neuroscience, and psychology, or any field. And my job with my students, who know everything but understand nothing,

• 13:54Speaker 03

  is to teach understanding. What do you do when the answers end, and you don't even know what the next question is? Let's call that ill-posed problems. When you have questions that have answers, these are well-posed problems. The job of science is the ill-posed problem. When more papers come out within a sub-discipline of science over the last 20 to 30 years, scientists stop reading as many papers. They stop citing new papers as much. The existing high-profile individuals with lots of citations getting even more cited. And then this is the scary part. The correlation, this is something you could only do in the age of AI,

• 14:39Speaker 03

  because how else would you read all of these papers? The correlation between the quality of new papers from new breakthrough researchers, and the chance that they become the hit song of the summer, if you will, goes down. So this is why it's scary to me. If the people whose fundamental job is to explore the unknown, which in a world with AI, I'm gonna kind of pointedly say, maybe that's all of our jobs now, within our domain. Exploring the unknown is the one thing humans are uniquely well-suited to do in an AI-driven world. Then it scares me that even scientists are doing this over the last few decades than they ought to. And so then a lot of what I write about in the book, particularly in

• 15:24Speaker 03

  the last sort of second half, last third of the book is, well, how do you push against that? There's a chapter titled, How to Robot Proof Your Kids. There's a chapter titled, How to Robot Proof Yourself. How to Robot Proof Your Company or Community. I don't remember which I actually titled that one. And I just wanted to do something I would almost never do, which is to say, here are some concrete steps for how to counteract this deeply human thing. We're not bad for not exploring. Everybody shows this terrible behavior, but we have to fight against that. If you think like the people in my experiment I described

• 16:05Speaker 03

  earlier, we called them the automators versus the cyborgs, the ones that just asked AI for an answer, smart, elite students, I'm scared.

• 16:16Speaker 02

  Vivian actually wrote about this exact problem, and the data she collected changes how you think about your own kids.

• 16:22Brian Keating?

  This is a parenting book, you know, a stealth parenting book, parenting book in disguise. It's, it's full of, as I say, red meat or white tofu for you Berkeley denizens, you know, up there, but it's, it's shock full of technical goodness. But one thing that keeps popping out is the sensitivity and really a tenderness towards children. And it's obvious your upbringing and, and, and your life in general, and your, your current, as you said, your son and a lot of the things that have been done, you know, not.

• 16:50Speaker 00

  This episode is brought to you by Indeed. You're ready to level up your business, but the pressure to find the right person to make that happen is intense. Indeed sponsored jobs can help carry the load. It boosts your job post to help it reach quality talent fast. Cut through the chaos with Indeed sponsored jobs. Get a $75 sponsored job credit at indeed.com/podcast. Terms and conditions apply. Hiring now, then this is a job for Indeed sponsored jobs.

• 17:19Brian Keating?

  I would say without a tremendous justification, you know, kind of makes me think about all the ways we could be using AI for good. And one of the ways I thought is, why the hell would we want to robot proof our kids? Especially when they're, according to the UNICEF, there's 100 million child slave labors in the world, some of them unspeakable. I'm not going to talk about that. I'll get too emotional about it, but why not? I mean, what if we could replace them with robots? Vivian, what's wrong with that?

• 17:43Speaker 03

  So let's be clear. I grew up, I grew up in a little valley in central California. The valley is called Corral de Tierra, but John Steinbeck wrote a book about it called The Pastures of Heaven. So according to a Nobel Prize winner, I grew up in the pastures of heaven, which not coincidentally is west of east of Eden. Pastures of Heaven was meant as an ironic description. It was beautiful, but every day in the Salinas Valley around California, the most productive farmland in the world, an army of human beings marches out, bends over in those fields and provides the bounty.

• 18:26Speaker 03

  If we knew what they could do, if we took that away, 100%, all of those heads of lettuce should be picked by a robot. A human being shouldn't do that. What I actually talk about in robot proof is not something like everyone should have a universal basic income and just sit around and somehow we'll all be artists and scientists. Guess what? We don't pay artists anything right now. So if you want to be an artist, what are you waiting for? So the idea that the point here is you shouldn't want to do amazing things. I think it's right in the spirit of what you're talking about. Every single kid on this planet is amazing.

• 19:11Speaker 03

  Every single one. I don't say that lightly, nor do I say it in the sense that everyone gets to live that amazing life. Absolutely not. The barriers between birth or even, you know, how your parents met early on in their lives and who you get to be is phenomenal. But I have a chapter in there, or maybe it's like a section, and the title is If Kids Were Bonds, where we built an economic model and we just said, what if we took everything we knew, like Nobel Prize winner James Heckman and Raj Chetty, who's probably on my list for an economics Nobel someday.

• 19:56Speaker 03

  We just took their work, some of the work I've been able to do in my life, and took things we knew worked to change the direction of someone's life, and invested in that at scale for every kid, say, in America. Or because of work I've done in the past, every kid in South Africa, every kid in India. I mean, the returns to the US in our estimate was 1.8 trillion dollars from almost 15 years ago. We have an amazing economy here. That's still only like 10% of the US economy at the time. But a 10% boost, trillions of dollars, would be, who would walk, even if you were selfish in this question?

• 20:36Speaker 01

  Vinal at his highest.

• 20:36Speaker 03

  I don't want to spend my tax money on someone else's kid. What if you looked at what it would bring to your life 20 or 30 years from now? And it was the most, if kids were bonds, they'd be the backbone of the world economy. There is no guaranteed payoff that's better than that. So in writing a book that's notionally about AI, I'm really writing a book about kids or about anyone who's around today and what it takes. So when I talk about robot proof, I don't mean, you know, what should Sarah Connor teach her kids to fight Terminators, although I'll say, my AI, my literal AI professor here at UC San Diego,

• 21:15Speaker 03

  John Batalli, who was stoned every single day, as far as I can tell of his life. But I loved him and he was an amazing guy. He taught the AI class in the know your enemy vein of artificial intelligence. But, you know, rather than Cylons, what I really mean is, and like, this book is the answer to a question. What qualities about human go up in value as machines become more intelligent?

• 21:46Brian Keating?

  And how to achieve that?

• 21:47Speaker 03

  And how to, you know, first is just naming it. What are these qualities? It's not the university you go to, although it's it. So let's just say, once we've identified these things, then it unlocks other things. Actually, then, like conditioned on that, let's be nerdy again. The university you go to matters a lot. Conditioned on that, knowing how to do hard, technical things, ranging from earlier, like factorizing a polynomial to harder, like building AI itself or building rockets. Like, in a sense, knowing how to do that without these foundational qualities. I mentioned some of them because they were in that experiment I described earlier.

• 22:29Speaker 03

  I call the meta learning in the book, like the qualities that help you learn how to learn. Other people nowadays call them durable skills or foundational skills. What I don't like is soft skills or 21st century skills, as though in 75 years, you better not know these anymore. Because, one, they're very measurable. I talk a lot in the book about the experience.

• 22:53Brian Keating?

  The soft skills are measurable, you're saying?

• 22:53Speaker 03

  So that's what I'm saying is, at one point, I was the chief scientist of one of the first companies doing AI and hiring. And we built a dataset of 122 million people. A lot of that data came from LinkedIn. The first time I ever met Reid Hoffman, I introduced myself and he said, oh, I know you. I don't like you.

• 23:12Brian Keating?

  That might not be such a bad thing with Reid's positioning nowadays.

• 23:15Speaker 03

  So we had all this data and my job of my team was to predict how good you were at a job you've never held. And it was fascinating and amazing because I'd never done work. I'd started a couple of education companies. I'd been a theoretical neuroscientist and psychologist before that. Here's this new challenge. And the thing was, again, if you just looked only at one university you attended and nothing else, predicted a lot, or what skills you claimed on your LinkedIn profile, didn't actually predict much of anything. But if then we did the hard job, are you resilient?

• 23:54Speaker 03

  The psychological construct of resilient. How likely are you to find success after experiencing failure? Do you have good perspective-taking skills? Do you know, understand other people's perspective on the same problem? What is your analogical reasoning like? Self-assessment. We can run through this list of a few dozen different psychological constructs that were measurable, that were highly predictive of long-term life outcomes, not just career outcomes. Insulin sensitivity, central body mass, all-cause mortality, size of your friendship network, and yes, lifetime income, lifetime earnings. Think of anything you'd want to be true about you when you're 65.

• 24:34Speaker 03

  Walking speed at age 65, maybe my favorite life outcome variable of all time, strongly predicted by the psychological construct of purpose. Do you have something in your life that's bigger than you, would take more than a lifetime to complete? So when you look at all these constructs, that again, we often think of as soft. But then my job as a total nerd is how do I measure it? In concrete behavior-based ways? How do we measure it's not just its correlation, but in some cases demonstrate its causal influence on long-term life outcomes? And again, not just economic outcomes. And then finally, because otherwise, who cares? Are these things changeable?

• 25:19Speaker 03

  If we're talking about your child, is fluid intelligence, working memory span, numeracy, literacy changeable? Why do you think everyone says read to your kids? But actually, even better than that, have adult-like discursive conversations with your kids. Challenge them, like bring that up fast. Emotional intelligence, like purpose and resilience, grit, growth mindset, highly predictive of long-term life outcomes. As far as we could tell from our data set, not only changeable when you're a kid, pretty much changeable all throughout your lifetime, but not easily. Like these, this isn't a lecture. Dr. Ming doesn't get up in front of 100 students in a lecture hall and says,

• 26:03Speaker 03

  here are the facts about resilience. So when you're looking at building meta-learning, foundational skills, durable skills, and what I talk about in the book is, and resilience is a great example, the only way to become more resilient is to experience failure. And for a parenting lesson or a leadership lesson, then you as the parent need to be there and catch them on the other side of that failure, but not walk them to success. Catch them just enough that a rough rule of thumb is about 80%. They can't always succeed or you don't grow. And if they fail too much, the exact opposite happens.

• 26:44Speaker 03

  It's like this, this edge, but you can see it happen. It takes time. This isn't like a six.

• 26:51Brian Keating?

  I want to ask you about the, the most strikingly moving part of the book, except for the fact that I want to scream out and say, Vivian, why don't you make a billion dollars by creating Tinder and Grindr and stuff? 20 years ago, as a product that you made called Sexy Face. Now, this is the ultimate in AI machine. At that time, really, machine learning wasn't like GPTs that we're using today, but it was a very early way of utilizing machine intelligence, partnering with humans to make a super cyborg that did good, not like I would have done, which is to make billions of dollars, creating Tinder, as I said. Tell us about Sexy Face, Vivian.

• 27:28Speaker 03

  I will say, in self condemnation and self-defense, I have never found a business plan I couldn't make worse with a little heart. I've started many companies. It's hard. So I'm not going to look down my nose at anyone whose goal is to make an amazing business. That is hard enough as it is. But if you were on a mission, you truly want to change the world, then that's what you're doing. You don't get to pivot. You don't get to realize, oh, but if we just made this one compromise. So the chapter in the book is not the original version. In the original version, I offer a deep self-parody

• 28:11Speaker 03

  because it starts with me bragging about this amazing idea I had for a product called Sexy Face. I'm going to get you laid. And I walk through, you know, for free. We'll have you select these faces and this on. Online game. This was back in like 2012. Yeah, explain to them what it is for the. And so you pick these faces. Back then, we were pulling off of Flickr and Facebook because this is the Wild West and you could just grab data from anywhere. And you'd pick it. And our promise was we'd find everyone you think is sexy for free. And for $5, we'll find everyone who you think, who thinks you're sexy.

• 28:56Speaker 03

  So this is, in my self-defense, I'm not the world's worst person. This is what you call Trojan. So once you did a round or two of this, and the scariest thing is that it worked. I mean, forget the where AI is today. This was, again, like 2011, 2012, we're working on this. And then it confesses, actually, this is just a mind-reading game. So pick any face category you want to, like, I don't know, Southeast Asian, mutton chops, and a sense of ennui. As long as you're consistent in how you make the choices. In the same game, it was 18 random faces pulled out of our dataset.

• 29:36Speaker 03

  It would find the faces you think is sexy. It was sort of a fun machine learning game to play, but even that wasn't why we did it. We did it because there's this book, this book that's produced by the UN. The UN High Commission for Refugees. It's a book with a million photographs in it. And it's the face of every orphan refugee camp in a refugee camp somewhere in the world. In this case, in around 2012 and 11. I don't mean a million faces in the history of the UN. A million faces that year, kids that were in these camps.

• 30:15Speaker 03

  And the reason we built this thing and had this phenomenally sleazy game was because people's choices were training what arguably was a very early version of a deep neural network. So they were training our model, not about faces, but about how people perceive faces. What's a happy face? What's a sad face? What's a cute face? Because then what we found is.

• 30:44Speaker 03

  Some uncle, you know, if you put this, the time on this right, some uncle in Syria hasn't heard from his sister's family in years and he's fearing the worst. So he drives and drives and drives to a camp across the border in Jordan. And he goes to the refugee camp there. You got to cross the border to be a refugee. Otherwise you're an internally displaced person because that matters. So you go across the border and they give you the book and you start leafing through this book, hoping you don't blink on the page where maybe your niece is there. So we made this thing that you could put on a tablet and you play a version of the game with all of these faces

• 31:25Speaker 03

  of these kids. And if your niece is in a camp anywhere in the world, in about three to five minutes, you found her. And so we did this project and it was amazing. I'm, I, I've gotten to do some truly amazing projects, particularly these philanthropic projects in my career. And despite where this project ended up and the challenges we experienced with it, and the fact that one of my projects was for my own son, this is about the thing I'm most proud of in my entire career. Not any of my startups, not my scientific publications. It was this project. You cannot imagine the life of an orphan refugee in a refugee camp

• 32:08Speaker 03

  in a, outside a war zone, the chance to give them back their life again is something kind of in a very different context I had for me. But also that story. I learned how to build AI models of faces here at UC San Diego.

• 32:28Speaker 00

  This episode is brought to you by Indeed. You're ready to level up your business, but the pressure to find the right person to make that happen is intense. Indeed sponsored jobs can help carry the load. It boosts your job post to help it reach quality talent fast. Cut through the chaos with Indeed sponsored jobs. Get a $75 sponsored job credit at indeed.com/podcast. Terms and conditions apply. Hiring now? Then this is a job for Indeed sponsored jobs.

• 32:57Speaker 03

  On a scientific project funded by the CIA within the broad swaths of Terry Sanoski's labs, and then later I got to use what I learned here at UC San Diego to reunite orphan refugees. And for another project, I got to build a system for Google Glass to help autistic kids learn how to read facial expressions. There's a lot of bleak stories about AI. Some of them are legitimate and justified. But there's also these amazing human stories of what can be done if we choose to use it that way. One of the cool things we found in our innovation research was you could take a super high performing scientific team

• 33:42Speaker 03

  and that has published groundbreaking research. And the longer they work together, the more they publish, but the less impactful their publications get. One new person joins that team, and just like that, it pops again.

• 33:57Brian Keating?

  You talk about diversity, but it's not what we mean around here. We have an equity, diversity, inclusion office. Talk about what you mean by diversity.

• 34:03Speaker 03

  I mean, I don't want to shy away from all forms of diversity. But in our case, we're looking at very high dimensional metrics. So psychological diversity, socioeconomic diversity, skill sets. The interesting thing in this research literature is not just that diverse teams were more effective, but no, it was a team in which, let's say a Nobel Prize winner and an undergraduate intern were working together, that when they were collaborating, that disappeared. And you could just, for example, in one paper, they just look at turn taking in collaborative documents. In our research, we looked at turn taking on a camera.

• 34:47Speaker 03

  How often was a face the biggest face on the screen? Just that, we'll get a little nerdy. Doing measures of inequality on just that number alone.

• 35:00Speaker 03

  Predicted how innovative a scientific team was, the more equitable that turn taking. And so then you combine this wide definition diversity with radically flat hierarchies, or sort of turn-taking behavior, or just listening. Who has a good idea right now? And what's interesting is you take that further into an experimental setting, and you look at how do you incentivize people to listen to one another? I will lean into a classic measure, which is gender. Often, in a lot of studies, it finds in heavily

• 35:44Speaker 03

  sort of male teams that the women often don't get listened to. Great paper out of Stanford several years ago, they used an AI system to read every dissertation published since 1971, 1.8 million papers. And the less represented women were in the field of research that they analyzed, the more innovative and sort of breakthrough the ideas their dissertation brought. But also, what they found was, the less likely it was to be taken up by their peers, and the worse their career outcomes.

• 36:17Brian Keating?

  That would never happen in astronomy, but I'm just kidding.

• 36:19Speaker 03

  Of course not. But the point for me isn't just that somehow one single person with diversity, it is instead, are you building a family, a community, a lab, where people are truly bringing something different? So, all of that, let's live it. I have one interview questions. You want to be in my lab or one of my companies, pitch me a mad science project. There's, I don't ask you anything else. You know this ahead of time? Prepare if you want to. I don't really care. I never prefer for anything anymore. I know my research. I don't, what is there to prepare? So, we come in, it's not a dissertation defense. I don't

• 37:04Speaker 03

  grill you. We take an hour together, and we try to figure out how to make it work. The only thing I then asked myself is, did we have a better idea together than I would have had by myself? I don't need you to know how to program. I don't need you to know about brains or AI. Math is harder to learn later in life, but to the quirk of my life, it is a thing, I am, if nothing else, a proof that that is a doable thing. I can't teach you to have an idea I wouldn't have had. The value of that, especially now that we live in a world where the answer to all of those well-posed problems are free in your pocket, essentially for free.

• 37:43Brian Keating?

  Yeah.

• 37:44Speaker 03

  It is what you would uniquely say that makes you valuable. It's what your child would uniquely say, even unique compared to you, that makes you valuable.

• 37:55Brian Keating?

  It is inescapable for me to think about, there's a statement by Einstein. Einstein had a lot of shortcomings, okay? He was a horrible father, husband, you know, married his cousin, abandoned his oldest son who had mental illness. It turns out, never saw him for 30 years, even though he's rich and he could travel, he was in Europe many, anyway. It's not a discourse on Einstein, and we've talked about him in glowing lionistic terms already. But he did say, when, he actually didn't ask these questions, like, what would it look like if I was traveling on a light beam and I looked at myself in a mirror? What would I see? He said, he was very close to his father, and he said, it was good I didn't ask my father that question, because what would have happened was, he would have given me the answer of the day, which was by definition wrong, right? Because it took Einstein at 25, in his miracle year in 1905, 20 years later, for him to

• 38:39Brian Keating?

  discover the true answer to that question. Therefore, if he had asked that question and gotten a response from the, you know, Gemini of the day, which would have been his dad, he would have gotten the wrong answer by definition. And so doing, it really illuminates the central, you know, one of the core theses of the book, which is, it's not, I thought if you just read the subtitle, you know, in an age of, what is it again, of when the machines have all the answers, I would have said, if you just thought they'd ask better questions. But no, it's not about asking, because that's like prompt engineering. And you know what? It's kind of fatiguing. I can do it for an hour, you're much better at all this stuff, you have so many actionable things in here, it's, it's really, you know, I hate like cookbooks and recipes, but this is like, you're gonna learn so much about best practice from, from one of the gurus,

• 39:24Brian Keating?

  geniuses of our time. And, you know, I only wish the book came out earlier, but then if it came out earlier, I'd be like Einstein, you know, maybe, and the only way I could be like, I'd ask better questions, but I wouldn't go through, the destroying the gray matter is just like destroying your muscle at the gym to build it back stronger.

• 39:38Speaker 03

  Here is to ask myself a setup question, but it's one I've gotten over the years. I very self-indulgently recently shared a social media post in which I posted a bunch of predictions about AI in the future. And then twist, I, those were all dated from like 2014 and I cited the articles that they were from. Yes, we live in a world now where the AI can kind of do it all by itself, whereas before someone had to build it. But the fundamentals haven't changed. What it can do, you just don't have to be able to build those models yourself anymore. And so a lot of this started when I started about thinking about writing this book over 10 years ago.

• 40:22Speaker 03

  And it was only really that I feel like this story, AI will do all the boring stuff so you can have fun. That's where it started to scare me. So I get this question, Dr. Ming, isn't this just like the printing press, the typewriter, the calculator, the computer? And no, it isn't. And, and I actually take a little time in the book. There's a title, this is not the industrial revolution is the title of one of the chapters. Cause I don't, can't tell you how many times I've been on a panel on a stage with someone who says, ah, don't worry. This is just like the industrial revolution. And I think, do you know anything?

• 41:02Speaker 03

  There's a British diplomat who wrote in like 1860, 1850, the plains of India are bleached white with the bones of Indian weavers. All put not out of business, out of life by the British Midlands, just that. It transformed the world, just like AI. Astonishing, powerful and potential, huge benefit to the world, but it has consequences. If we zombie walk our way into a future where it has all the answers and we don't, what's the point of us? But I don't just mean that from a leave space open for humanity.

• 41:43Speaker 03

  There is a technology that has already come and has had a measurable negative impact on human cognition. And that is GPS. And let's be clear, I use Google Maps all over the world. I love it. I travel a lot and like that, I'm a navigation native. But what I no longer do is follow its directions. Because I made this prediction about 15 years ago. People were not happy with me for saying this, but I said, in 10 to 20 years, we will see a statistically significant increase in early onset dementia. And the research is still accumulating, but it fairly strongly to date supports the story

• 42:25Speaker 03

  that people that use GPS more show worse and earlier memory decline effects. GPT is the new GPS. If, in both cases, you use it as a substitute for you. You don't need Google Maps to navigate. You need Google Maps to do things you literally couldn't have done yourself, which is instantly know that street's closed, this is Maps. So I actually give one regular lecture a year at Berkeley. They're smart enough to keep me away from the undergrads. And in that, I challenge them to come up with a better version of Google Maps. What I say is, for any technology, this is for an engineering and entrepreneurship course,

• 43:08Speaker 03

  not only should your technology make you better when you're using it, you should be better than where you started when you turn it off again.

• 43:15Brian Keating?

  That's what it means to enhance your life.

• 43:17Speaker 03

  And for someone who does a lot of work in neurotechnologies, that really means a lot to me. I don't want an implant that does my thinking for me. I want an implant that makes my thinking better. You know, in the true neurotechnologies world, first off, we're only talking about people that have Alzheimer's or massive stroke. So you've lost your language. Well, I don't want to take away your reasoning too. I just want you to be able to speak again. And there's some cool technologies upcoming in that space. So I don't want to replace, I want to augment. I don't want to automate, I want to augment. I don't want to sell you robots. I want to make you a cyborg. That's what I'm hoping to do with the book and with my general research.

• 44:00Speaker 03

  And when we looked at these questions and people's behavior, we end up with some sometimes shockingly simple ones. I mean, when I say that to these UC Berkeley, UC San Diego students, I've done this here as well. They come up with amazing AI-driven, like it gives you clues, it turns navigating through Paris into a game, all of which is great. Here's what I do. I do it even in Berkeley, which I know like the back of my hand nowadays. I look up how to get where I'm going and I stick it in my pocket and I think to myself, how can I beat Google there? That way I've gotten the benefit of what AI can do that I cannot, collecting all that information and giving me that, what I couldn't have done otherwise.

• 44:42Speaker 03

  But I'm still thinking about it. I'm thinking, what do I know about Berkeley? That the collective wisdom of Google does not, that at this time of day, on this time of year, that left turn it wants me to do is not going to work out well. And even if I'm not right, I thought about it.

• 45:00Brian Keating?

  You gamify it and that's pleasurable and you have a reward.

• 45:03Speaker 03

  To bring this full circle to the question of real innovation, how do we go beyond? Oh, there's some small molecule that we've already identified, it's there in the research literature, it's just no one's thought of using it in quite this way. To, there's this quirk about photons hitting metal plates. And that's the, there's nothing else. We figured everything else out and suddenly the world is transformed as soon as we go deep there. How do you make that deep breakthrough? I'm not saying AI could never do this, but I am saying right now, it doesn't matter how many extra parameters we add in to existing transformer models. Or even reinforcement learning models.

• 45:49Speaker 03

  Model-free, sort of a-causal learning is never going to give you this aha moment of here's something no one's ever done before. But I think what is true, and comes right out of this experiment, I've cited a couple of times now, is when the AI can bring all of that data to bear on a question, and then the human can say, ah, but what about? And not ignore the AI, which unfortunately is what a lot of doctors do, but also not just do what the AI says, which unfortunately is what almost everybody does, but instead, find that cyborg dynamic. But what about? And then you, it explores the what about

• 46:32Speaker 03

  for you. I hate to put it this way, because it's such a cheesy, classic Hollywood example, but I loved the image of Tony Stark talking to Jarvis in Avengers Endgame, solving time travel. Not because there was anything realistic about the science behind it, but that, you know, run this model for me, deploy this tool. He talked to it. He explored the long tails of possibility. It explored the probability density of likelihood, the real world. And

• 47:14Speaker 03

  the two worked at it. That's like the closest thing I've seen in big media that really captures what it feels like for me to work with one of these models.

• 47:27Brian Keating?

  Well, you mentioned your tip to people out there in terms of GPS navigation. I want to give one out there that I use every, every time I'm in the car with my wife, which is to turn off the voice on the GPS. And that way I don't have two women yelling at me. Okay, sorry, Vivian, I had to use that. Now, we're coming to the end. You said every scientist is a storyteller. And you said at the very outset that all stories should be an hour or so. Sure, coming up on the hour before we land the hovercraft at all. We can't not talk about, you know, these people that are impossibly malevolent, possibly malicious, whether it's Sam Altman saying, look at the cost to train your kid over 20 years. That's a lot more than to train LLM, which I find very dystopian and very sociopathic, perhaps. I don't know him personally. I'd love to talk to him. I have talked to Elon Musk on the podcast and

• 48:12Speaker 00

  This episode is brought to you by Indeed. You're ready to level up your business, but the pressure to find the right person to make that happen is intense. Indeed sponsored jobs can help carry the load. It boosts your job post to help it reach quality talent fast. Cut through the chaos with Indeed sponsored jobs. Get a $75 sponsored job credit at indeed.com/podcast. Terms and conditions apply. Hiring now? Then this is a job for Indeed sponsored jobs.

• 48:41Brian Keating?

  Well, I know he's sort of the prominent person working on things that are, you know, I can't imagine not of interest to you, from neuro implants to optimists to the optimist robot, which might be, you know, he already has fleets of cars that have AI, you know, collecting data about us and about the world. What are your thoughts on him? And, you know, not his personal life. I mean, we already talked about, you know, evil, bad fathers. I don't, I don't want to get into that. And I actually did confront him on one of his kids on the podcast, which is remote a couple, about a year or two ago. But, but tell me, what are your thoughts about embodied, you know, it seems like that will be the next kind of frontier.

• 49:16Speaker 03

  I, let's be clear. The questions that interest him clearly interest me too. I'm not going to have a lot of positive things to say about Elon Musk as a human being. And Peter Thiel is like a Bond villain, but he is a Bond villain that he's an actual threat. He knows how to make like startupville work. Just dismissing people because you disagree with them, apart from being like the exact opposite of what I argue if you are in my book, is then you're throwing out whatever powerful insights they're actually bringing into the world. You're right. Einstein is not a perfect person and Richard Feynman was not a perfect person. None of us are.

• 49:57Speaker 03

  In fact, my next book will be titled Small Sacrifices and the subtitle is The Science, Economics and Story of Purpose. And the anchors of the book is an experiment in which I got everyone to do things that they had already said were morally wrong. And another one in which we found that people helping one another for no obvious benefit actually predicted the helpers' life outcomes, their health outcomes, and even their economic outcomes. So, understanding the economics of that and why it doesn't match with liberal economic theory is worth understanding. So, we, we are like some weird quantum mechanical

• 50:41Speaker 03

  superposition of the worst version of ourselves and the best version of ourselves, all of these versions. There are no single-edged swords out there. And the right context will bring any of that out. Which is why, in the book, what I'm arguing for is, use the AI to create the context that makes you the best version of yourself. So, I don't think Elon Musk is the best version of himself. I note, some fans of him have gone from calling him the smartest man in the world, to the smartest industrialist, to the greatest salesman. And I can't deny any of those. And I, neurotechnologies, I love. I think BCIs are maybe the most boring form of neurotechnology. Like, I can type

• 51:22Speaker 03

  without my fingers. Alright, yeah, that, but there's so much more we can do. That is so exciting in this world. And if you don't, like, research this space. It's fascinating. And if I want to know what his company or others are up to, well, his company is in particular. I just wait a month, he fires everybody, and I can go ask the people that used to work. The question is, I was told this wonderful story by Ed Catmull. So, Ed, maybe has retired, but he, he, the founder of Pixar and the longtime sort of CEO and president, back from when it was a supercomputing company and then it slowly morphed. Steve Jobs owned Pixar. He didn't make his, he made money from Apple, but he made his money

• 52:06Speaker 03

  from Disney buying Pixar. And Ed had this amazing story. I've heard all these stories. I met Elon very briefly once, but I, I know how his places work. I wish he was a better person, because I admire so much of what he's trying to build. And- Aspects of how he runs his companies. But here's one I do not. And it is this contrast between Steve Jobs and Elon Musk. Ed had this story. So he had this, what I think is one of the best books about the sort of business of creativity, which is Creativity, Inc. That, really good, has a little bit of the whiff of Silicon Valley.

• 52:42Brian Keating?

  Hey, geography, hey, Jobs.

• 52:45Speaker 03

  Nonetheless, I got to talk about, he's writing a new book and we chatted about it. And he shared these stories about Steve. And he said, there were two ways to get fired from the board of Pixar. Cause it was at will for Steve Jobs, because he owned the company effectively. It was agree with him too much and agree with him too little. It was horrible. You know how many times I've heard the story of people that worked directly with Steve saying, I would say a things and Steve said, you're wrong, you're an idiot, you're fired.

• 53:15Brian Keating?

  Right, he wasn't gentle, alright.

• 53:16Speaker 03

  You know, they're in the Caribbean, the next week, just relaxing. And their phone rings and Steve says, you know, I've thought about it. You were actually right. Come in, we'll chat about this afternoon. And he'd say, well, Steve, I'm in St. Bart's, like, I can't. And he says, well, you can chat about it with me this afternoon or never again. So he'd admit that he's wrong and still be an asshole about it. But he'd admit that he's wrong and he'd populate his boards with people that would disagree with him, the right amount. That's not what Elon does.

• 53:49Brian Keating?

  Okay, so we've talked about the book many times. We haven't done what we're supposed to do in a Bayesian framework, which is to judge a book by its cover, which they tell you not to do. But who are they? I don't even know who they are, but they know who they are.

• 54:12Brian Keating?

  Vivian, take us through the title, the subtitle, and this lovely color cover art.

• 54:18Speaker 03

  I mean, I think the one thing that you can immediately take away, even before you start reading the words, is the color scheme, black and yellow. Clearly, if this is an evolved thing, it's almost certainly poisonous. You shouldn't eat this. It might have a bad sting.

• 54:35Brian Keating?

  It is good food for thought.

• 54:36Speaker 03

  Yeah, so there's other ways to consume it.

• 54:38Brian Keating?

  Although, if they buy more books, you know, and they eat them.

• 54:42Speaker 03

  All right, I don't want to dissuade you from making a salad out of my book, but I don't think that's the best way to make use of it. And I'm always terrible with dates. Let's call it 2014. I got invited to the Obama-era Department of Education.

• 55:00Brian Keating?

  Pre-Linda McMahon, or?

• 55:04Speaker 03

  The Department of Education, for those of you viewing this today, that was this thing that used to exist. So I got invited there, and the minute I walked in the door, I was asked, "Dr. Ming, how do we robot-proof our kids?" The first thing I thought is, that's going to be the title of a book someday. Although, I will say this, my publisher thought that sounded a little too much like a parenting book, so that became the title of a chapter instead, "How to Robot-Proof Your Kids." Anyone that's ever run a company, being a parent and being a CEO, aren't wildly different exercises if you're really invested in getting the most

• 55:44Speaker 03

  out of your employees. So we made this change, which I actually am fond of, not because I didn't like "How to Robot-Proof Your Kids," but because the subtitle here, "When Machines Have All the Answers, Build Better People," kind of echoes a little bit. My brilliant students have all the answers. They know everything about their research question. Why am I there for an hour a week answering their... because they understand nothing, and I'm trying to get the understanding across. Well, my experience when I first used BERT and then used a variety of other models over the years is, AI knows everything.

• 56:27Speaker 03

  Except here, it knows everything. And increasingly hallucinations are less and less of an issue, but it understands nothing. We can get in very nerdly. Why I say that in a sort of hard way, like the difference between model-based reasoning and model-free reasoning and what's going on in these machines. Let's be super clear. Large language models, agentic AI, is intelligent. It's intelligent in ways we are intelligent. But we have other forms of intelligent, if you will, that we are able to leverage that it isn't, which in a way is great. Because now our machine intelligence and human intelligence

• 57:12Speaker 03

  become very complementary. We bring something it lacks. It brings something, all the facts that we lack. Putting the two together does this amazing thing. So when machines have all the answers, build better people. I was getting the initial results of my experiment showing that it was human capital, not AI benchmarks, that predicts cyborgs, hybrid intelligence. And right when they were saying, could we have a broader, more inclusive title for the book? And so I pitched this one at my publisher. And, you know, they loved it. And I thought, well, I do have this story, what it means to be a parent and to care about kids

• 57:56Speaker 03

  and what the world we're leaving for them, that they're gonna have to build for. I also, I also wanted to be clear. I've spent 30 years now building these, nearly 30 years building these models. I've gotten to do amazing things with them. I believe in what AI can do if we choose to use it in that way. And also, we changed the cover art. The original cover art was a person like standing over a destroyed army of robots. And I really wanted to make it clear, AI doesn't have to be the enemy of this story. I think the enemy here, and I'll be pointed about this, you know, we have spent

• 58:37Speaker 03

  over the last couple of years, trillions of dollars now, in aggregate, training machines that do not need us, you know, building AIs based on benchmarks that don't involve a human being at all. How well can they solve math Olympiad problems? How well can they answer every question off of every bar exam and every medical licensing board exam? That's not valueless, but what value does it hold for us? Where is the benchmark that says, or the story for CEOs, which is, you want to get more value out of the AI that OpenAI

• 59:19Speaker 03

  and Google and Anthropic, who I, I think deserve some credit right now, because they're, part of what they're doing is publishing a lot of very realistic research about the results of their own models. If they're selling you this idea that AI will do all of the boring work for you, and then you get to do the fun stuff.

• 59:39Brian Keating?

  Painting and the poetry.

• 59:40Speaker 03

  That is 100% not what we see in our experiments. In our experiments, those cyborgs, the humans and the AIs are doing it together. The boring stuff, the fun stuff, the creative, the routine, they're just bringing that relative strength, and the well-posed versus the ill-posed. And I'm worried, again, that this, we're selling the story that we're going to sell you an army of minions, and it will do everything you want, you just have to sit back and do nothing. That is a truly terrible story for the future.

• 1:00:15Brian Keating?

  You know, I'm not as broad and discursive a thinker as you. I only care about venal things like, how can I get more grant funding? But no, seriously, how can we improve physics? That's my main quest with AI. And I've asked this to many people, and I said, you know, in 1907, Einstein had what he called his happiest thought. He said, this was a thought that titillated me, unlike any other thought I've ever had. And that was, person in free fall would experience no gravitational force. And I'm like, okay, well, that's really interesting on a couple of different benchmarks. Because A, can a robot have a happiest thought? A, that's A. And then B, can a, even an embodied robot, can it, I don't even know what to call it. Can it experience the sensation that you and I have had thousands of times? And it's always better with your kids. You go over a roller coaster, you go over a bump in the car.

• 1:01:00Brian Keating?

  Isn't that amazing? Can you have that sensation that led to this breakthrough? That led to Einstein's equivalence principle, which paved the way from special relativity to general relativity, the cosmological explosion that we have today? Can we do it? I see no evidence. To me, the real Turing test, I call it the Keating test, because I like to name it. Like the heating metal, hold up the heating metal, Vivian, which you are the latest recipient of, which comes with a magnet, which, and a meteorite. There's Arthur C. Clarke on the front and picture the monolith on the back. But Vivian, you know, to me, the real test is not the Turing test. I mean, it seems to me we crushed that years ago, probably thanks in part to your work. But it's, it's can AI construct? First of all, can it reconstruct, recapitulate physics that, you know, was, was cutting edge? Say Einstein's theory of general relativity from the orbit of Mercury,

• 1:01:44Brian Keating?

  which was known for a hundred years before Einstein came up with it. So he kind of retrodicted it. Can it redo that? A. And then B, can it do something new? Could it predict, oh, there's a fifth law of nature sitting right there? And that's that, that I call the Keating test. And Evan and I are working on a paper in Dimas. Hassebus also came up with this test a couple of weeks ago, you know, after me, maybe he was watching these videos. I brought it up three years ago. Evan and I have been working on for a while. Got to publish that, Evan. But the fact of can it come up with novelty? Can it do that, that inscrutable physics? They are the, the, the ill-posed questions. I don't know. Are you optimistic?

• 1:02:14Speaker 03

  So interestingly enough, my 13th company, if you toss in all the nonprofits as well. So we do our philanthropic work through the human trust. But my latest is the Possibility Institute, and we're working on meta-science.

• 1:02:33Speaker 03

  Understanding innovation itself. So there's a lot of funding for AI in science right now, as I'm sure you appreciate. And I'm going to describe a truly valuable and highly worthwhile, but almost all of this funding is, let's have these agentic models read every pharmacological study ever published and look for essentially things we already know but haven't realized yet. Like, oh, there's this really interesting drug interaction. So if you're a middle-aged, black male and these drugs interact in these interesting ways and we see a reduction in your cholesterol levels. That's hugely economically valuable to these, because you don't have to rerun the studies, all this, but has it discovered anything?

• 1:03:18Speaker 03

  Well, I mean, we sort of get into a complex epistemological question here. What I'm interested in is what you are getting at, which is photoelectric effect, special relative, general relative, like, this guy did it three goddamn times. That, and not that no one else was thinking about the questions when, you know, Einstein had his moments, but he was the one. And, and, and that idea that I said I inherited from my own advisors, science is a story. He figured out how to turn his insights into stories that even, well, you, of course,

• 1:04:01Speaker 03

  but anybody could go through his thought experiments about those space elevators and all the rest of them and understand, oh, wait a minute, what if time varied with elevation and you were up here and someone was down there and time dilated? Like, it's suddenly these, you'd never understand the math behind it if you weren't, your field of research, but you could get what he was talking about. And, you know, I am not the world's most intelligent person. I thought I was supposed to be when I was a little kid. And I thought I was supposed to win Nobel Prizes. And when it became very clear that that wasn't true, I gave up on life. You got the Keating Prize, come on. Boy, did, yes, I've got my own.

• 1:04:44Speaker 03

  Well, I'd much rather have the monolith here in front of me.

• 1:04:51Speaker 03

  And tell poems about trees. But to be able to actually understand where truly Schumpeterian disruptive innovation in science and beyond, in policy, in culture, comes from overwhelmingly, it comes from people that are different and have different ideas. Neither science, despite this great man idea, that isn't how any of this stuff runs. Even among people that have amazing breakthrough ideas. The way I run my labs, forgive me for in any way implying I deserve to be in this firmament, but it is hard working for me. Not because I'm mean.

• 1:05:37Speaker 03

  I often describe it as like an episode of House. I need my employees to pitch me ideas. How if we are going to change the education system in Kenya? Because they did everything the World Bank says. Their international test scores, the PISA scores go up every year. No one's hiring Kenyans on the global talent markets. Dr. Ming, what's wrong? We need to change this. I need you to pitch me ideas. Even if you're fresh out of university and your whole career has been giving the right answer to test questions and making your professors happy. That's not what I'm after. I need you to have the courage to tell me that I'm wrong and the guts to pitch an idea that maybe even you think

• 1:06:22Speaker 03

  probably isn't right. Not because I need you to be right. I need us to be less wrong. I need us to explore all the possible ideas so that that amazing transformational idea, not the one that's in the zeitgeist right now, not the one that's in the self-help books, something that sounds crazy, except maybe 10 years from now, someone will make a discovery and it turns out, oh, wow, they were right all along. That's my job and I pay for all my philanthropic work myself. So I've got no vested interest in this than us making a positive difference in the life of these Kenyan school kids or in the life of the orphan refugees or my diabetic son.

• 1:07:06Speaker 03

  I just want us to make progress. And to make progress, you have to be wrong. And if you're relying on the right answer from AI, or the right answer from your peers, or even just from only your internal voice, like this thing that I worry about with Elon, then you were never going to break through to those amazing transformative answers that no one was ever thinking about before. Another lovely compliment someone gave is, I just want to follow you around and catch the sparks coming off. But those sparks happen because we get together with people

• 1:07:48Speaker 03

  that are different enough that it's challenging. Not that it's broken, our trust is broken, but that it's challenging, that my students have the courage to say, Vivian, I think you're not right on this one. And the resilience, when I explain to them in detail why I am right, to push through and say, either, you know what, you've convinced me, or I still think I'm right. Let me try this anyways. My dissertation, wildly braggy, but I'm going to offer it because it's the best support I have in my personal life. My dissertation that ended up being a nature paper,

• 1:08:31Speaker 03

  I was explicitly told by everyone on my committee, including my advisor, not to do it.

• 1:08:37Speaker 03

  And I just simply went and did it anyways behind their back. And it isn't because I'm a genius. The work was inspired by many other people. It was simply that I saw the problem differently than they did. They were, and it's been well proven over their careers, were geniuses. I was just coming out this differently than them. I could see it differently. That's what I'm trying to suck out of the minds of the young people in my labs. So I want that. I want that for every single kid.

• 1:09:09Brian Keating?

  Well, Dr. Vivian Ming, proud alumna of UC San Diego. We're so glad that you came back, came down from the Bay Area and congratulations on this book. As I said, it's a parenting book in disguise, but it's an extremely important book for this, you know, for the time that we're at. I find I'm learning a lot. I'm talking to people, AI experts and talk to the Yan Le Kuns and the Anil and the Swamis. But more and more, I'm getting inspired by people like Rebecca Newberger-Goldstein, who was just on talking about meaning and searching for meaning. And I joked about her new book, it should have been called Woman's Search for Meaning, but it's called The Mattering Instinct. And this book is, what is going to make us uniquely human? And what is the ultimate need of a human being? You know, Frankl said it was, it was really meaning. And

• 1:09:51Brian Keating?

  without that, what are we? But with only that, you know, what, what are we going to be capable of? So I think it's partnering with, with the robots. And I think you're right. We're trying to create this almost new species of cyborg. And, and maybe they will be benevolent to us and follow Asimov's laws of robots, but maybe we will define what they are and what we are in the future. So thank you so much for this book. I cannot recommend it highly enough.

• 1:10:15Speaker 03

  It was such a pleasure to be here. I've got my own dangerous yellow thing here. This was a blast.

• 1:10:21Brian Keating?

  Thank you so much. And join us next time on Into the Impossible for more great conversations. Thank you, Vivian.

• 1:10:26Speaker 02

  Vivian just showed us the smartest AI move is refusing to give you the answer. And if that changes how you think about intelligence, hit subscribe, drop a comment and let me know. What's one question you'd want a Socrates level AI to push you on? If you want more on what makes humans irreplaceable, check out my conversation with Max Tegmert. It's linked right here. Come on, click it. Prove that you're not a robot.

• 1:10:47Speaker 05

  Now at Kroger, your points add up to more ways to save every trip. Use them your way to take dollars off groceries at checkout or save at the pump. You can even save up to $35 on your next fill-up. Same points, more choices. And with low prices on fresh, quality food, plus digital and personalized offers tailored to how you shop, your dollar goes further. Redeem your points online or in the app. Kroger, fresh for everyone. Restrictions apply. See site or store for details.

• 1:11:18Speaker 06

  When you spend enough time around great companies, you notice that the best ones treat trust as a growth strategy, not a box to check. Vanta helps companies build and prove trust from day one. Its Agentic Trust Platform connects compliance, risk, and trust at enterprise scale. Vanta delivers a 526% return on investment over three years and pays for itself in just three months. Learn why over 16,000 of the fastest-growing companies use Vanta at vanta.com.