#373 – Manolis Kellis: Evolution of Human Civilization and Superintelligent AI

Manolis Kellis is a computational biologist at MIT. Please support this podcast by checking out our sponsors: – Eight Sleep: https://www.eightsleep.com/lex to get special savings – NetSuite: http://netsuite.com/lex to get free product tour – ExpressVPN: https://expressvpn.com/lexpod to get 3 months free – InsideTracker: https://insidetracker.com/lex to get 20% off EPISODE LINKS: Manolis Website: http://web.mit.edu/manoli/ Manolis Twitter: https://twitter.com/manoliskellis Manolis YouTube: https://youtube.com/@ManolisKellis1 PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ YouTube Full Episodes: https://youtube.com/lexfridman YouTube Clips: https://youtube.com/lexclips SUPPORT & CONNECT: – Check out the sponsors above, it’s the best way to support this podcast – Support on Patreon: https://www.patreon.com/lexfridman – Twitter: https://twitter.com/lexfridman – Instagram: https://www.instagram.com/lexfridman – LinkedIn: https://www.linkedin.com/in/lexfridman – Facebook: https://www.facebook.com/lexfridman – Medium: https://medium.com/@lexfridman OUTLINE: Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time. (00:00) – Introduction (06:44) – Humans vs AI (15:50) – Evolution (37:34) – Nature vs Nurture (50:03) – AI alignment (56:27) – Impact of AI on the job market (1:08:06) – Human gatherings (1:13:07) – Human-AI relationships (1:23:11) – Being replaced by AI (1:35:37) – Fear of death (1:47:33) – Consciousness (1:54:58) – AI rights and regulations (2:00:41) – Halting AI development (2:13:52) – Education (2:19:16) – Biology research (2:26:36) – Meaning of life (2:29:09) – Loneliness

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  The following is a conversation with Manolis Kellis, his fifth time on this podcast. He's a professor at MIT and head of the MIT Computational Biology Group. He's one of the greatest living scientists in the world, but he's also a humble, kind, caring human being that I have the greatest of honors and pleasures of being able to call a friend. And now, a quick few-second mention of each sponsor. Check them out in the description. It's the best way to support this podcast. We've got Eight Sleep for naps, NetSuite for business management software, ExpressVPN for privacy and security on the interwebs, and InsideTracker for biological data.

• 0:44Speaker 00

  Choose wisely, my friends. Also, if you want to work with our amazing team, we're always hiring. Go to lexfridman.com/hiring. And now, onto the full ad reads. As always, no ads in the middle. I try to make this interesting. I often fail, but I try. And if you must skip them, please still check out our sponsors. I enjoy their stuff. Maybe you will too. This episode is brought to you by Eight Sleep and its new Pod3 mattress, which I think of as a teleportation device into a land of dreams, a place where the mind goes to escape the spacetime physics of this reality of the waking world.

• 1:28Speaker 00

  Anything is possible in a place of dreams. The darkness that lurks in the Jungian shadow is possible. The hope, the triumph, symbolized as the light at the end of the tunnel, is possible. All of it is possible. It's all up to you. I'm kinda somebody that likes both the good and the bad of dreaming. There's a cleansing aspect of a bad dream. You wake up freaking out a little bit, but then you realize how awesome this life is, that whatever happened in the dream world is not real. It's the kind of dress rehearsal for a bad event that happens in reality, but it doesn't. It's like in a video game. You get to save, do a dangerous thing, screw it up, and then you get to load and try again. That's what a dream is.

• 2:12Speaker 00

  Anyway, I love dreaming, I love sleeping, I love naps, and an Eight Sleep mattress is the best place to teleport into that dream world. Check them out and get special savings when you go to eightsleep.com/lex.

• 2:28Speaker 00

  This show is also brought to you by NetSuite, an all-in-one cloud business management system. It manages financials, human resources, inventory, e-commerce, and many business-related details, all things that I have to start figuring out. I put up a job position for somebody to help me with financials. All of it, I need so much help because running a business, any kind of business, whether it's a creative business or robotics factory, or any kind of AI software company, anything you do has so many components. And I would say many of them don't involve any of the kind of cutting-edge engineering and design and brainstorming and innovation and research and all that kind of stuff.

• 3:10Speaker 00

  You have to do all the basic minutia, the glue that ties together people and makes the whole thing run. And I think you should use the best tool for that job. And NetSuite is something I can definitely recommend as a great tool. You can start now with no payment or interest for six months. Go to netsuite.com/lex to access their one-of-a-kind financing program. That's netsuite.com/lex. This show is also brought to you by ExpressVPN, my comrade, my friend, the piece of software that has accompanied me through darkness and light for many years, way before I had a podcast,

• 3:52Speaker 00

  way before I found my way, though I am still forever lost. And you, if you too are forever lost, perhaps it will also warm your heart as a dead mind. First of all, practically speaking, let's put the romantic stuff aside. You should be using a VPN on the internet. And ExpressVPN is the VPN I've used and can highly, highly, highly recommend. By the way, I apologize for the coarseness of my voice. I've been feeling a little bit under the weather, whatever the heck that expression actually means. There's always chat GPT that can ask the question, but I'm not going to. I'm just gonna go with it, gonna wing it. Gonna wing it is another funny expression, right? Wing it, what does that mean? Probably has to do with birds.

• 4:34Speaker 00

  And the fact that bird flight is a kind of chaotic process that's not amenable to clear, dynamical system modeling that, for example, an airplane is. But let us return. To the piece of software you should be using to warm your heart and to protect your privacy on the internet. Go to expressvpn.com/lexpod for an extra three months free.

• 5:01Speaker 00

  This show is also brought to you by InsideTracker, a service I use to track biological data that comes from my body. There's that song, "It's My Party and I'll Cry If I Want To." And I used to think it said, "It's my body and I'll cry if I want to." I don't know what I thought that actually meant. But it's a good song. It's a silly song. "It's my party and I'll cry if I want to. Cry if I want to. Cry if I want to." You would cry too if it happened to you. Anyway, speaking of which, we're going hard on the tangents today. I like data that comes from my body that is then used in machine learning algorithms to make decisions or recommendations of what I should do with said body. Lifestyle choices,

• 5:43Speaker 00

  diet, maybe in the future it'd be career advice, all kinds of stuff, dating, friends, anything, you know. But basically, health stuff, medicine, I think, and that's the obvious way you should be figuring out what to do with your body, is at least in large part based on the data that comes from your body. And not just once, but many times, over and over and over and over. InsideTracker pioneering the data collection, sort of the blood test, and then can extract all kinds of information, give you advice. I highly recommend them. Get special savings for a limited time when you go to insidetracker.com/lex.

• 6:18Speaker 00

  This is the Lex Fridman Podcast. To support it, please check out our sponsors in the description. And now, dear friends, here's Manolis Callas.

• 6:44Speaker 00

  Good to see you, first of all.

• 6:45Manolis Kellis?

  Lex, I've missed you. I think you've changed the lives of so many people that I know, and it's truly like such a pleasure to be back, such a pleasure to see you grow, to sort of reach so many different aspects of your own personality.

• 6:56Speaker 00

  Thank you for the love. You always give me some support and love. I just can't, I'm forever grateful for that.

• 7:01Manolis Kellis?

  It's lovely to see a fellow human being who has that love, who basically does not judge people. And there's so many judgmental people out there, and it's just so nice to see this beacon of- Openness.

• 7:13Lex Fridman?

  So what makes me one instantiation of human irreplaceable, do you think? As we enter this increasingly capable age of increasingly capable AI? I have to ask, what do you think makes humans irreplaceable?

• 7:26Manolis Kellis?

  So humans are irreplaceable because of the baggage that we talked about. So we talked about baggage. We talked about the fact that every one of us has effectively re-learned all of human civilization in their own way. So every single human has a unique set of genetic variants that they've inherited. Some common, some rare, and some make us think differently. Some make us have different personalities. They say that a parent with one child believes in genetics. A parent with multiple children understands genetics. Just how different kids are. And my three kids have dramatically different personalities ever since the beginning. So one thing that makes us unique is that every one of us has a different hardware.

• 8:09Manolis Kellis?

  The second thing that makes us unique is that every one of us has a different software uploading of all of human society, all of human civilization, all of human knowledge. We don't, we're not born knowing it. We're not like, I don't know, birds that learn how to make a nest through genetics and will make a nest even if they've never seen one. We are constantly relearning all of human civilization. So that's the second thing. And the third one that actually makes humans very different from AI is that the baggage we carry is not experiential baggage, it's also evolutionary baggage. So we have evolved through rounds of complexity. So just like ogres have layers and Shrek has layers, humans have layers.

• 8:52Manolis Kellis?

  There's the cognitive layer, which is sort of the outer, you know, most, the latest evolutionary innovation, this enormous neocortex that we have evolved. And then there's the emotional baggage underneath that. And then there's all of the fear and fright and flight and all of these kinds of behaviors. So. AI only has a neocortex. AI doesn't have a limbic system. It doesn't have this complexity of human emotions, which make us so, I think, beautifully complex, so beautifully intertwined with our emotions, with our instincts, with our, you know, sort of gut reactions and all of that.

• 9:35Manolis Kellis?

  So I think when humans are trying to suppress that aspect, the sort of quote-unquote more human aspect towards a more cerebral aspect, I think we lose a lot of the creativity. We lose a lot of the, you know, freshness of humans. And I think that's quite irreplaceable.

• 9:49Lex Fridman?

  So we can look at the entirety of people that are alive today, maybe all humans who have ever lived and map them in this high-dimensional space. And there's probably a center, a center of mass for that mapping. And a lot of us deviate in different directions. So the variety of directions in which we all deviate from that center is vast.

• 10:12Manolis Kellis?

  I would like to think that the center is actually empty.

• 10:15Lex Fridman?

  Yes.

• 10:16Manolis Kellis?

  That basically, humans are just so diverse from each other that there's no such thing as an average human. That every one of us has some kind of complex baggage of emotions, intellectual, you know, motivational, behavioral traits, that it's not just one sort of normal distribution. We deviate from it. There's so, so many dimensions that we're kind of hitting the sort of sparseness, the curse of dimensionality, where it's actually quite sparsely populated. And I don't think you have an average human being.

• 10:49Lex Fridman?

  So what makes us unique in part is the diversity and the capacity for diversity. And the capacity of the diversity comes from the entire evolutionary history. So there's just so many ways we can. Very from each other.

• 11:05Manolis Kellis?

  Yeah, I would say not just the capacity, but the inevitability of diversity. Basically, it's in our hardware. We are wired differently from each other. My siblings and I are completely different. My kids from each other are completely different. My, my, my wife has, she's like number two of six siblings. From, from a distance, they look the same, but then you get to, you know, you get to know them. Every one of them is completely different.

• 11:28Lex Fridman?

  But sufficiently the same that the differences interplay with each other. So that's the interesting thing where the diversity is functional, it's useful. So it's like we're close enough to where we notice the diversity and it doesn't completely destroy the possibility of like effective communication and interaction. So it's, we're still the same kind of thing.

• 11:49Manolis Kellis?

  So what I said in one of our earlier podcasts is that if humans realize that we're 99.9% identical, we would basically stop fighting with each other. Like we are really one human species and we are so, so similar to each other. And if you look at the alternative, if you look at the next thing outside humans, like it's been six million years that we haven't had a relative. So it's, it's truly extraordinary that, that we're, we're kind of like this dot in outer space compared to the rest of life on earth.

• 12:23Lex Fridman?

  When you think about evolving through rounds of complexity, can you maybe elaborate such a beautiful phrase, beautiful thought, that there's layers of complexity that make

• 12:32Manolis Kellis?

  So, so with software, sometimes you're like, oh, let's like build version two from scratch. But this doesn't happen in evolution. In evolution, you layer in additional features on top of old features. So basically when, like every single time my cells divide, I'm a yeast, like I'm a unicellular organism and then cell division is basically identical.

• 12:57Manolis Kellis?

  Every time I breathe in and my lungs expand, I'm basically, you know, like every time my heart beats, I'm a fish. So basically that, I still have the same heart, like very, very little has changed. The blood going through my veins, the oxygen, the, you know, our immune system. We're basically primates. Our social behavior, we're basically new world monkeys and old world monkeys. We're basically this, this concept that every single one of these behaviors can be traced somewhere in evolution. And that all of that continues to live within us is also a testament to not just not killing other humans, for God's sake, but like not killing other species either.

• 13:41Manolis Kellis?

  Like just to realize just how united we are with nature and that all of these biological processes have never ceased to exist. They're continuing to live within us. And then just the neocortex and all of the reasoning capabilities of humans are built on top of all of these other species that continue to live, breathe, divide, metabolize, fight off pathogens, all continued inside us.

• 14:02Lex Fridman?

  So you think the neocortex, the whatever reasoning is, that's the, the latest feature in the, in the latest version of this journey?

• 14:11Manolis Kellis?

  It's, it's extraordinary that humans have evolved so much in so little time. Again, if you look at the, the timeline of evolution, you basically have billions of years to even get to a dividing cell. And then a multicellular organism, and then a complex body plan. And then these incredible senses that we have for perceiving the world, the fact that bats can fly. And the evolved flight, the evolved sonar in the span of a few million years. I mean, it's just extraordinary how much evolution has kind of sped up. And all of that comes through this evolvability.

• 14:51Manolis Kellis?

  The fact that we took a while to get good at evolving. And then once you get good at evolving, you can sort of. You have modularity built in, you have hierarchical organizations built in, you have all of these constructs that allow meaningful changes to occur without breaking the system completely. If you look at a traditional genetic algorithm, the way that humans designed them in the 60s, you can only evolve so much. And as you evolve a certain amount of complexity, the number of mutations that move you away from something functional exponentially increases, and the number of mutations that move you to something better exponentially decreases. So the probability of evolving something so complex becomes infinitesimally small

• 15:35Manolis Kellis?

  as you get more complex. But with evolution, it's almost the opposite, almost the exact opposite, that it appears that it's speeding up exactly as complexity is increasing. And I think that's just the system getting good at evolving.

• 15:50Lex Fridman?

  Where do you think it's all headed? Do you ever think about where? Try to visualize the entirety of the evolutionary system and see if there's an arrow to it and a destination to it.

• 16:03Manolis Kellis?

  So the best way to understand the future is to look at the past. If you look at the trajectory, then you can kind of learn something about the direction in which we're heading. And if you look at the trajectory of life on Earth, it's really about information processing. So the concept of the senses evolving one after the other, you know, like bacteria are able to do chemotaxis, which means moving towards a chemical gradient. And that's the first thing that you need to sort of hunt down food. The next step after that is being able to actually perceive light. So all life on this planet and all life that we know about evolved on this rotating rock. Every 24 hours, you get sunlight and dark, sunlight and dark. And light is a source of energy.

• 16:48Manolis Kellis?

  Light is also information about where it's up. Light is all kinds of, you know, things. So you can, you can basically now start perceiving light. And then perceiving shapes beyond just the sort of single photoreceptor. You can now have complex eyes or multiple eyes and then start perceiving motion or perceiving direction, perceiving shapes. And then you start building infrastructure on the cognitive apparatus to start processing this information and making sense of the environment, building more complex models of the environment. So if you look at that trajectory of evolution, what we're experiencing now and humans are basically, according to this sort of information theoretic view of evolution, humans are basically the next natural step.

• 17:33Manolis Kellis?

  And it's perhaps no surprise that we became the dominant species of the planet. Because yes, there's so many dimensions in which some animals are way better than we are, but at least on the cognitive dimension, we're just simply unsurpassed on this planet and perhaps the universe. But the the concept that if you now trace this forward, we talked a little bit about evolvability and how things get better at evolving. One possibility is that the next layer of evolution builds the next layer of evolution. And what we're looking at now with humans and AI is that having mastered this information

• 18:14Manolis Kellis?

  capability that humans have from this quote unquote old hardware, this basically, you know, biological evolved system, that kind of, you know, somehow in the environment of Africa and then in subsequent environments and sort of dispersing through the globe was evolutionarily advantageous. That has now created technology which now has a capability of solving many of these cognitive tasks. It doesn't have all the baggage of the previous evolutionary layers, but maybe the next round of evolution on Earth is self-replicating AI. Where we're actually using our current smarts to build better programming languages

• 18:57Manolis Kellis?

  and the programming languages to build, you know, ChatGPT. And that to then build the next layer of software that will then sort of help AI speed up. And it's lovely that we're coexisting with this AI, that sort of the creators of this next layer of evolution, this next stage are still around to help guide it and hopefully will be for the rest of eternity as partners. But it's also nice to think about it as just simply the next stage of evolution where you've kind of extracted away the biological needs. Like if you look at animals, most of them spend eighty percent of their waking hours hunting for food or building shelter. Humans, maybe one percent of that time. And then the rest is left to creative endeavors.

• 19:40Manolis Kellis?

  And AI doesn't have to worry about shelter, et cetera. So basically, it's all living in the cognitive space. So in a way, it might just be a very natural sort of next step to think about evolution. And that's, that's on the, on the sort of purely cognitive side. If you now think about humans themselves.

• 19:58Manolis Kellis?

  The ability to understand and comprehend our own genome, again, the ultimate layer of introspection, gives us now the ability to even mess with this hardware, not just augment our capabilities through interacting and collaborating with AI, but also perhaps understand the neural pathways that are necessary for, you know, empathetic thinking, for, for justice, for this and this and that, and sort of help augment human capabilities through, you know, neuronal interventions, through chemical interventions, through electrical interventions, to basically help steer the human, you know, bag of hardware that we

• 20:42Manolis Kellis?

  kind of evolved with into greater capabilities. And then ultimately, by understanding not just the wiring of neurons and the functioning of neurons, but even the genetic code, we could even, at one point in the future, start thinking about, well, can we get rid of psychiatric disease? Can we get rid of neurodegeneration? Can we get rid of dementia? And start perhaps even augmenting human capabilities, not just getting rid of disease.

• 21:12Lex Fridman?

  Can we tinker with the genome, with the hardware?

• 21:17Lex Fridman?

  Or getting closer to the hardware without having to deeply understand the baggage. In the way we've disposed of the baggage in our software systems with AI, to some degree, not fully, but to some degree, can we do the same with the genome? Or is the genome deeply integrated into this baggage?

• 21:35Manolis Kellis?

  I wouldn't want to get rid of the baggage. The baggage would makes us awesome. So the fact that I'm sometimes angry and sometimes hungry and sometimes hangry is perhaps contributing to my creativity. I don't want to be dispassionate. I don't want to be another like, you know, robot. I, you know, I want to get in trouble and I want to sort of say the wrong thing. And I want to sort of, you know, make an awkward comment and sort of push myself into, you know, reactions and responses and things that can get just people thinking differently. And I think our society is moving towards a humorless space where everybody's so afraid to say the wrong thing that people kind of start quitting en masse

• 22:20Manolis Kellis?

  and start like not liking their jobs and stuff like that. Maybe we should be kind of embracing that human aspect a little bit more in all of that baggage aspect and not necessarily thinking about replacing it. On the contrary, like embracing it and sort of this coexistence of the cognitive and the emotional hardware.

• 22:41Lex Fridman?

  So embracing and celebrating the diversity that springs from the baggage versus kind of pushing towards and empowering this kind of pull towards conformity.

• 22:58Manolis Kellis?

  Yeah. And in fact, with the advent of AI, I would say, and these seemingly extremely intelligent systems that sort of can perform tasks that we thought of as extremely intelligent at the blink of an eye, this might democratize.

• 23:15Manolis Kellis?

  Intellectual pursuits. Instead of just simply wanting the same type of brains that, you know, carry out specific ways of thinking, we can, like, instead of just always only wanting, say, the mathematically extraordinary to go to the same universities, what you could see, you simply say, like, who needs that anymore? You know, we now have AI. Maybe what we should really be thinking about is the diversity and the power that comes with the diversity, where AI can do the math, and then we should be getting a bunch of humans that sort of think extremely differently from each other, and maybe that's the true cradle of innovation.

• 23:56Lex Fridman?

  But AI can also, these large language models can also be, with just a few prompts, essentially fine tuned to be diverse from the center. So the prompts can really take you away into unique territory. You can ask the model to act in a certain way, and it'll start to act in that way. Is that possible that the language models could also have some of the magical diversity that makes us so damn interesting?

• 24:24Manolis Kellis?

  Yeah, so I would say humans are the same way. So basically, when you, when you sort of prompt humans to basically, you know, in a given environment, to act a particular way, they change their own behaviors. And, you know, the old saying is, "Show me your friends, and I'll tell you who you are." More like, "Show me your friends, and I'll tell you who you'll become." So it's not necessarily that you choose friends that are like you, but, I mean, that's the first step. But then the second step is that, you know, the kind of behaviors that you find normal in your circles are the behaviors that you'll start espousing. And that type of meta-evolution, where every action we take

• 25:06Manolis Kellis?

  not only shapes our current action and the result of this action, but it also shapes our future actions by shaping the environment in which the future actions will be taken. Every time you carry out a particular behavior, it's not just a consequence for today, but it's also a consequence for tomorrow, because you're reinforcing that neural pathway. So in a way, self-discipline is a self-fulfilling prophecy. And by behaving the way that you want to behave, and choosing people that are like you, and sort of exhibiting those behaviors that are...

• 25:40Manolis Kellis?

  Sort of desirable. You end up creating that that environment as well.

• 25:47Lex Fridman?

  So it is a kind of life itself is a kind of prompting mechanism, super complex. The friends you choose, the environments you choose, the way you modify the environment that you choose, yes, but that seems like that process is much less efficient than a large language model. You can literally get a larger language model through a couple of prompts to be a mix of Shakespeare and David Bowie, right? You can very aggressively change in a way that's stable and convincing. You really transform through a couple of prompts, the behavior of the model into something very different from the original.

• 26:29Manolis Kellis?

  So well before ChatGPT. I would tell my students, just ask, you know, what would Manoli say right now? And you, you guys all have a pretty good emulator of me right now.

• 26:43Lex Fridman?

  Yes.

• 26:43Manolis Kellis?

  And I don't know if you know the programming paradigm of the rubber duckling, where you basically explain to the rubber duckling that's just sitting there, exactly what you did with your code and why you have a bug. And just by the act of explaining, you'll kind of figure it out.

• 26:58Lex Fridman?

  Yes.

• 26:59Manolis Kellis?

  I woke up one morning from a dream where I was giving a lecture in this amphitheater. And one of my friends was basically giving me some deep evolutionary insight on how cancer genomes and cancer cells evolve. And I woke up with a very elaborate discussion that I was giving and a very elaborate set of insights that he had that I was projecting onto my friend in my sleep. And obviously, this was my dream. So my own neurons were capable of doing that. But they only did that under the prompt of you are now Piyush Gupta. You are a professor in cancer genomics. You're an expert in that field. What do you say? So I feel that we all have that inside us, that we have that capability

• 27:44Manolis Kellis?

  of basically saying, I don't know what the right thing is, but let me ask my virtual ex, what would you do? And virtual ex would say, be kind. I'm like, oh, yes. Or something like that. And even though I myself might not be able to do it unprompted. And my favorite prompt is think step by step. And I'm like, you know, this also works on my 10 year old.

• 28:07Manolis Kellis?

  When he tries to solve a math equation all in one step, I know exactly what mistake he'll make. But if I prompt it with, oh, please think step by step, then it sort of gets you in a mindset. And I think it's also part of the way that ChatGPT was actually trained. This whole sort of human in the loop reinforcement learning has probably reinforced these types of behaviors whereby having this feedback loop, you kind of aligned AI better to the prompting opportunities by humans.

• 28:39Lex Fridman?

  Yeah, prompting human-like reasoning steps, the step-by-step kind of thinking. Yeah, but it does seem to be, I suppose it just puts a mirror to our own capabilities and so we can be truly impressed by our own cognitive capabilities because the variety of what you can try, because we don't usually have this kind of, we can't play with our own mind rigorously through Python code, right?

• 29:06Manolis Kellis?

  Yeah.

• 29:06Lex Fridman?

  So this allows us to really play with all of human wisdom and knowledge, or at least knowledge, at our fingertips and then mess with that little mind that can think and speak in all kinds of ways.

• 29:19Manolis Kellis?

  What's unique is that, as I mentioned earlier, every one of us was trained by a different subset of human culture. And ChatGPT was trained on all of it.

• 29:29Lex Fridman?

  Yeah.

• 29:30Manolis Kellis?

  And the difference there is that it probably has the ability to emulate almost any, every one of us.

• 29:36Lex Fridman?

  Yeah.

• 29:37Manolis Kellis?

  The fact that you can figure out where that is in cognitive behavioral space just by a few prompts is pretty impressive. But the fact that that exists somewhere is, you know, absolutely beautiful. And the fact that it's encoded in an orthogonal way from the knowledge, I think is also beautiful. The fact that somehow through this extreme overperformatization of AI models, it was able to somehow figure out that context, knowledge and form are separable and that you can sort of describe scientific knowledge in a haiku in the form of, I don't know, Shakespeare or something. That tells you something about the decoupling and the decouplability of these types of

• 30:22Manolis Kellis?

  aspects of human psyche.

• 30:25Lex Fridman?

  And that's part of the science of this whole thing. So these large language models are, you know, days old. In terms of this kind of leap that they've taken. And it'll be interesting to do this kind of analysis on them of context, of the separation of context, form and knowledge. Where exactly does that happen?

• 30:42Manolis Kellis?

  Yeah.

• 30:42Lex Fridman?

  There's already sort of initial investigations, but it's very hard to figure out where. Is there a particular parameter, set of parameters that are responsible for a particular piece of knowledge or a particular context or a particular style of speaking?

• 30:56Manolis Kellis?

  So with convolutional neural networks, interpretability had many good advances because we can kind of understand them. There's a structure to them. There's a locality to them. And we can kind of understand that different layers have different sort of ranges that they're looking at. So we can look at activation features and basically see where, you know, where does that correspond to? With large language models, it's perhaps a little more complicated, but I think it's still achievable in the sense that we could kind of ask, well, what kind of prompts does this generate? If I sort of drop out this part of the network, then what happens? And sort of start getting at a language to even describe these types of aspects

• 31:38Manolis Kellis?

  of human behavior or psychology, if you wish, from the spoken part in the language part. And the advantage of that is that it might actually teach us something about humans as well. Like, you know, we might not have words to describe these types of aspects right now. But when somebody speaks in a particular way, it might remind us of a friend that we know from here or there or there. And if we had better language for describing that, these concepts might become more apparent in our own human psyche. And then we might be able to encode them better in machines themselves.

• 32:12Lex Fridman?

  Both probably you and I would have certain interests with the base model, what OpenAI calls the base model, which is before the alignment of the reinforcement learning with human feedback and before the

• 32:28Lex Fridman?

  AI safety based kind of censorship of the model. It would be fascinating to explore, to investigate the ways that the model can generate hate speech, the kind of hate that humans are capable of. It would be fascinating, or the kind of, of course, like sexual language, or the kind of romantic language, or the, all kinds of ideologies. Can I get it to be a communist? Can I get it to be a fascist? Can I get it to be a capitalist? Can I get it to be all these kinds of things? And see which parts get activated or not? Because it would be fascinating to sort of explore at the individual mind level and at a societal level, where do these ideas take hold?

• 33:12Lex Fridman?

  What is the fundamental core of those ideas? Maybe the communism, fascism, capitalism, democracy are all actually connected by the fact that the human heart, the human mind is drawn to ideology, to a centralizing idea. And maybe we need a neural network to remind us of that.

• 33:30Manolis Kellis?

  I like the concept that the human mind is somehow tied to ideology. And I think that goes back to the promptability of chat GPT. The fact that you can kind of say, well, think in this particular way now. And the fact that humans have invented words for encapsulating these types of behaviors. And it's hard to know how much of that is innate, and how much of that was like passed on from language to language. But basically, if you look at the evolution of language, you can kind of see how young are these words in the history of language evolution that describe these types of behaviors, like, you know, kindness and anger and jealousy, et cetera. If these words are very similar from language to language, it might suggest that they're

• 34:15Manolis Kellis?

  very ancient. If they're very different, it might suggest that this concept may have emerged independently in each different language and so on and so forth. So looking at the phylogeny, the history, the evolutionary traces of language at the same time as people moving around, that we can now trace thanks to genetics, is a fascinating way of understanding the human psyche and also understanding sort of how these types of behaviors emerge. And to go back to your idea about sort of exploring the system unfiltered.

• 34:57Manolis Kellis?

  I mean, in a way psychiatric hospitals are full of those people. So basically, people whose mind is uncontrollable.

• 35:04Lex Fridman?

  Yes.

• 35:05Manolis Kellis?

  Who have kind of gone adrift in specific locations of their psyche. And I do find this fascinating. Basically, you know, watching movies that are trying to capture the essence of troubled minds, I think is teaching us so much about our everyday selves. Because many of us are able to sort of control our minds and are able to somehow hide these emotions. And but every time I see somebody who's troubled, I see versions of myself, maybe not as extreme, but I can sort of empathize with these behaviors. And, you know, I see bipolar, I see schizophrenia, I see depression, I see autism.

• 35:50Manolis Kellis?

  I see so many different aspects that we kind of have names for and crystallize in specific individuals.

• 35:57Manolis Kellis?

  And I think all of us have that. All of us have sort of just this multi-dimensional brain. And genetic variations that push us in these directions, environmental exposures and traumas that pushes in these directions, environmental behaviors that are reinforced by the kind of friends that we chose or friends that we were stuck with because of the environments that we grew up in. So in a way, a lot of these types of behaviors are within the vector span of every human. It's just that the magnitude of those vectors is generally smaller for most people because they haven't inherited that particular set of genetic variants

• 36:43Manolis Kellis?

  or because they haven't been exposed to those environments, basically.

• 36:46Lex Fridman?

  Or something about the mechanism of reinforcement learning with human feedback didn't quite work for them. So it's fascinating to think about that's what we do. We have this capacity to have all these psychiatric or behaviors associated with psychiatric disorders. But we, through the alignment processes, we grow up with the parents, we kind of,

• 37:08Lex Fridman?

  we know to suppress them.

• 37:09Manolis Kellis?

  Yeah.

• 37:09Lex Fridman?

  We know how to control.

• 37:10Manolis Kellis?

  Every human that grows up in this world spends several decades being shaped into place.

• 37:18Lex Fridman?

  Yeah.

• 37:18Manolis Kellis?

  And without that, you know, maybe we would have the unfiltered ChatGPT-4.

• 37:24Manolis Kellis?

  Every baby is basically a raging narcissist. Not all of them, not all of them, believe it or not. It's remarkable. Like, I remember, like, watching my kids grow up. And again, like, yes, part of their personality has stayed the same, but also in different phases to their life, they've gone through these dramatically different types of behaviors. And, you know, my daughter basically saying, you know, basically one kid saying, oh, I want the bigger piece. The other one saying, oh, everything must be exactly equal. And the third one saying, I'm okay. You know, I might have to have the smaller part. Don't worry about me. Even in the early days, in the early days of development. Yeah, it's just extraordinary to sort of see these dramatically different,

• 38:06Manolis Kellis?

  like, I mean, my wife and I, you know, are very different from each other. But we also have, you know, six million variants, six million loci each, if you wish. If you just look at common variants, we also have a bunch of rare variants that are inherited in a more Mendelian fashion. And now you have, you know, an infinite number of possibilities for each of the kids. So basically, it's two to the six million just from the common variants. And then if you like layer in the rare variants. So let me talk a little bit about common variants and rare variants. So if you look at this common variants, they're generally weak effect because selection selects against strong effect variants. So if something like has a big risk for schizophrenia, it won't rise to high frequency.

• 38:50Manolis Kellis?

  So the ones that are common are by definition, by selection, only the ones that had relatively weak effect. And if all of the variants associated with personality, with cognition and all aspects of human behavior were weak effect variants, then kids would basically be just averages of their parents. If it was like thousands of loci, just by law of large numbers, the average of two large numbers would be, you know, very robustly close to that middle. But what we see is that kids are dramatically different from each other. So that basically means that in the context of that common variation, you basically have rare variants that are inherited in a more Mendelian fashion that basically then sort of govern likely many different aspects of human behavior,

• 39:34Manolis Kellis?

  human biology and human psychology. And that's, again, like, if you look at sort of a person with schizophrenia, their identical twin?

• 39:47Manolis Kellis?

  Has only 50% chance of actually being diagnosed with schizophrenia. So that basically means there's probably developmental exposures, environmental exposures, trauma, all kinds of other aspects that can shape that. And if you look at siblings, for the common variants, it kind of drops off exponentially, as you would expect, with, you know, sharing 50% of your genome, 25% of your genome, you know, 12.5% of your genome, et cetera, with more and more distant cousins.

• 40:14Manolis Kellis?

  But the fact that siblings can differ so much in their personalities that we observe every day, it can't all be nurture. Basically, you know, we've, like, again, as parents, we spend enormous amount of energy trying to fix, quote unquote, the nurture part, trying to, you know, get them to share, get them to be kind, get them to be open, get them to trust each other, like, you know, like, overcome the prisoner's dilemma of, you know, if everyone fend for themselves, we're all going to live in a horrible place. But if we're a little more altruistic, then we're all going to be in a better place. And I think it's not like we treat our kids differently, but they're just born differently. So in a way, as a geneticist, I have to admit that there's only so much I can do with nurture,

• 40:59Manolis Kellis?

  that nature definitely played a big component.

• 41:01Lex Fridman?

  The selection of variants we have, the common variants and the rare variants,

• 41:08Lex Fridman?

  what can we say about the landscape of possibility they create? If you could just linger on that. So the selection of rare variants is divine. How? How do we get the ones that we get? Is it just laden in that giant evolutionary baggage?

• 41:29Manolis Kellis?

  So I'm going to talk about regression. Why do we call it regression? And the concept of regression to the mean, the fact that when fighter pilots in a dogfight did amazingly well, they would give them rewards. And then the next time they're in a dogfight, they would do worse. So then, you know, the Navy basically realized that, wow, or at least interpreted that as, wow, we're ruining them by praising them, and then they're going to perform worse. The statistical interpretation of that is regression to the mean. The fact that you're an extraordinary pilot, you've been trained in an extraordinary fashion.

• 42:09Manolis Kellis?

  That pushes your mean further and further to extraordinary achievement. And then in some dogfights, you'll just do extraordinarily well. The probability that the next one will be just as good is almost nil. Because this is the peak of your performance. And just by statistical odds, the next one will be another sample from the same underlying distribution, which is going to be a little closer to the mean. So regression analysis takes its name from this type of realization in the statistical world. Now, if you now take humans, you basically have people who have achieved extraordinary achievements.

• 42:53Manolis Kellis?

  Einstein, for example. You know, you would call him, for example, the epitome of human intellect. Does that mean that all of his children and grandchildren will be extraordinary geniuses? It probably means that they're sampled from the same underlying distribution, but he was probably a rare combination of extremes in addition to these common variants. So you can basically interpret your kid's variation, for example, as, well, of course, they're going to be some kind of sampled from the average of the parents with some kind of deviation according to the specific combination of rare variants that they have inherited. So, you know, given all that, the, you know, the possibilities are endless as to where you should be.

• 43:38Manolis Kellis?

  But you should always interpret that with, well, it's probably an alignment of nature and nurture. And the nature has both the common variants that are acting kind of like the law of large numbers, and the rare variants that are acting more in a Mendelian fashion. And then you layer in the nurture, which again, in everyday action we make, we shape our future environment. But the genetics we inherit are shaping the future environment of not only us, but also our children. So there's this weird nature-nurture interplay and self-reinforcement, where you're kind of shaping your own environment, but you're also shaping the environment of your kids. And your kids are going to be born in the context of your environment that you've shaped,

• 44:22Manolis Kellis?

  but also with a bag of genetic variants that they have inherited.

• 44:27Manolis Kellis?

  And there's just so much complexity associated with that. When we start blaming something on nature, it might just be nurture. It might just be that, well, yes, they inherited the genes from the parents, but they also, you know, were shaped by the same environment. So it's very, very hard to untangle the two. And you should always realize that nature can influence nurture, nurture can influence nature, or at least be correlated with and predictive of, and so on and so forth.

• 44:53Lex Fridman?

  So I love thinking about that distribution that you mentioned. And here's where I can be my usual ridiculous self. And I sometimes think about that army of sperm cells, however many hundreds of thousands there are. And I kind of think of all the possibilities there. Because there's a lot of variation, and one gets to win.

• 45:17Manolis Kellis?

  It's not a random one.

• 45:19Lex Fridman?

  Is it a totally ridiculous way to think about?

• 45:21Manolis Kellis?

  No, not at all. So I would say evolutionarily, we are a very slow-evolving species. Basically, the generations of humans are a terrible way to do selection. What you need is processes that allow you to do selection in a smaller, tighter loop.

• 45:38Lex Fridman?

  Yeah.

• 45:39Manolis Kellis?

  And part of what, if you look at our immune system, for example, it evolves at a much faster pace than humans evolve. Because there is actually an evolutionary process that happens within our immune cells. As they're dividing, there's basically V D J recommendation that basically creates this extraordinary wealth of antibodies and antigens against the environment. And basically, all these antibodies are now recognizing all these antigens from the environment, and they send signals back that cause these cells that recognize the non-self to multiply. So that basically means that even though viruses evolve

• 46:21Manolis Kellis?

  at millions of times faster than we are, we can still have a component of our cells which is environmentally facing, which is sort of evolving at not the same scale, but very rapid pace.

• 46:35Manolis Kellis?

  Sperm expresses perhaps the most proteins of any cell in the body. And part of the thought is that this might just be a way to check that the sperm is intact. In other words, if you waited until that human has a liver and starts eating solid food and, you know, sort of filtrates away, you know, or kidneys or stomach, et cetera. Basically, if you waited until these mutations, you know, manifest late, late in life, then you would end up not failing fast and you would end up with a lot of failed pregnancies and a lot of later onset, you know, psychiatric illnesses, et cetera.

• 47:19Manolis Kellis?

  If instead you basically express all of these genes at the sperm level and if they misform, they basically cause the sperm to cripple, then you have at least on the male side the ability to exclude some of those mutations. And on the female side, as the egg develops, there's probably a similar process where you could, you could sort of weed out eggs that are just not, you know, carrying beneficial mutations, or at least that are carrying highly detrimental mutations. So you could basically think of the evolutionary process in a nested loop, basically, where there's an inner loop where you get many, many more iterations to run and then there's an outer loop that moves at a much slower pace.

• 48:02Manolis Kellis?

  And going back to the next step of evolution of possibly designing systems that we can use to sort of complement our own biology or to sort of eradicate disease and you name it, or at least mitigate some of the, I don't know, psychiatric illnesses, neurodegenerative disorders, et cetera. You can basically, and also, you know, metabolic, immune, cancer, you name it. Simply engineering these mutations from rational design might be very inefficient. If instead you have an evolutionary loop where you're kind of growing neurons on a dish and you're exploring evolutionary space and you're sort of shaping that one protein to be better adapt at sort of, I don't know, recognizing light or communicating with other neurons, et cetera.

• 48:47Manolis Kellis?

  You can basically have a smaller evolutionary loop that you can run thousands of times faster than the speed it would take to evolve humans for another million years. So I think it's important to think about sort of this evolvability as a set of nested structures that allow you to sort of test many more combinations, but in a more fixed setting.

• 49:07Lex Fridman?

  Yeah, that's fascinating that the mechanism there is for sperm to express proteins to create a testing ground early on so that the failed designs don't make it.

• 49:20Manolis Kellis?

  Yeah, I mean, in design of engineering systems, fail fast is one of the principles you learn. Like basically you assert something. Why do you assert that? Because if that something ain't right, you better crash now than sort of let it crash at an unexpected time. And in a way, you could think of it as like 20,000 assert functions. Assert protein can fold, assert protein can fold. And if any of them fail, that sperm is gone.

• 49:43Lex Fridman?

  Well, I just like the fact that I'm the winning sperm. I'm the result of the winner, winning hashtag winning.

• 49:50Manolis Kellis?

  My, my wife always plays me this French song that actually sings about that. It's like, you know, remember in life, we were all the first one time.

• 50:01Lex Fridman?

  At least once.

• 50:01Manolis Kellis?

  At least one time you were the first.

• 50:03Lex Fridman?

  I should mention, this is a brief tangent back to the place where we came from, which is the base model that I mentioned for OpenAI, which is before the reinforcement learning with human feedback. And you kind of give this metaphor of it being kind of like a psychiatric hospital.

• 50:18Manolis Kellis?

  I like that because it's basically all of these different angles at once. Like you basically have the more extreme versions of human psyche.

• 50:25Lex Fridman?

  So the interesting thing is. Well, I've talked with folks in OpenAI quite a lot. And they say it's extremely difficult to work with that model.

• 50:35Manolis Kellis?

  Yeah, kind of like it's extremely difficult to work with some humans.

• 50:37Lex Fridman?

  The parallels there are very interesting because once you run the alignment process, it's much easier to interact with it. But it makes you wonder what the capacity, what the underlying capability of the human psyche is as in the same way that what is the underlying capability of a large language model?

• 50:54Manolis Kellis?

  And remember earlier when I was basically saying that part of the reason why it's so prompt malleable is because of that alignment problem, that alignment work. It's kind of nice that the engineers at OpenAI have the same interpretation that, you know, in fact, it is that. And this whole concept of easier to work with.

• 51:20Manolis Kellis?

  I wish that we could work with more diverse humans in a way. And sort of that's one of the possibilities that I see with the advent of these large language models. The fact that it gives us the chance to both dial down friends of ours that we can't interpret or that are just too edgy to sort of really truly interact with, where you could have a real time translator. Just the same way that you can translate English to Japanese or Chinese or Korean by like real time adaptation. You could basically suddenly have a conversation with your favorite extremist on either side of the spectrum and just dial them down a little bit.

• 52:07Lex Fridman?

  Of course, not you and I, but you could have friends that are who's a complete asshole. But it's a different base level. So you could actually tune it down to like, okay, they're not actually being an asshole there. This is they're actually expressing love right now. It's just that this is a

• 52:24Manolis Kellis?

  They have their way of doing that.

• 52:25Lex Fridman?

  And they probably live in New York if we're just to pick a random location.

• 52:30Manolis Kellis?

  So, so that, yeah, so you can basically layer out contexts. You can basically say, oh, let me change New York to Texas and let me change, you know, extreme left, extreme right, or somewhere in the middle or something. And I also like the concept of being able to.

• 52:49Manolis Kellis?

  Listen to the information without being dissuaded by the emotions. In other words, everything humans say has an intonation, has some kind of background that they're coming from, reflects the way that they're thinking of you, reflects the impression that they have of you. And all of these things are intertwined. But being able to disconnect them, being able to sort of,

• 53:17Manolis Kellis?

  I mean, self-improvement is one of the things that I'm constantly working on. And being able to receive criticism from people who really hate you is difficult because it's layered in with that hatred. But deep down, there's something that they say that actually makes sense. Or people who love you might layer it in a way that doesn't come through. But if you're able to sort of disconnect that emotional component from the sort of self-improvement. And basically, when somebody says, "Whoa, that was a bunch of bullshit. Did you ever do the control this and this and that?" You could just say, "Oh, thanks for the very interesting presentation. You know, I'm wondering, what about that control?" Then suddenly you're like, "Oh yeah, of course, I'm gonna run that control.

• 54:02Manolis Kellis?

  That's a great idea." Instead of, "That was a bunch of BS." You're like, "Ah!" You're sort of hitting on the brakes and you're trying to push back against that. So, any kind of criticism that comes after that is very difficult to interpret in a positive way because it helps reinforce the negative assessment of your work. When in fact, if we disconnected the technical component from the negative assessment, then you're embracing the negative, then you're embracing the technical component, you're gonna fix it. Whereas if it's coupled with, "And if that thing is real and I'm right about your mistake, then it's a bunch of BS." Then suddenly you're like, you're gonna try to prove that that mistake does not exist.

• 54:45Lex Fridman?

  Yeah, it's fascinating to like, carry the information. This is what you're essentially able to do here is you carry the information in the rich complexity that information contains. So it's not actually dumbing it down in some way.

• 54:56Manolis Kellis?

  Exactly.

• 54:57Lex Fridman?

  Still expressing it, but taking off.

• 54:59Manolis Kellis?

  But you can die the emotional.

• 55:02Lex Fridman?

  The emotion side.

• 55:02Manolis Kellis?

  Yeah.

• 55:03Lex Fridman?

  Which is probably so powerful for the internet or for social networks.

• 55:07Manolis Kellis?

  Again, when it comes to understanding each other, like, for example, I don't know what it's like to go through life with a different skin color. I don't know how people will perceive me. I don't know how people will respond to me. We don't often have that experience. But in a virtual reality environment, or in a sort of AI interactive system, you could basically say, okay, now make me Chinese, or make me South African, or make me, you know, Nigerian. You can change the accent. You can change layers of that contextual information and then see how the information is interpreted. And you can rehear yourself through a different angle. You can hear others.

• 55:51Manolis Kellis?

  You can have others react to you from a different package. And then hopefully, we can sort of build empathy by learning to disconnect all of these social cues that we get from like how a person is dressed. You know, if they're wearing a hoodie, or if they're wearing a shirt, or if they're wearing a, you know, jacket. You get very different emotional responses that, you know, I wish we could overcome as humans. And perhaps large language models and augmented reality and deep fakes can kind of help us overcome all that.

• 56:27Lex Fridman?

  In what way do you think these large language models and the thing they give birth to in the AI space will change this human experience? The human condition? The things we've talked across many podcasts about that makes life so damn interesting and rich? Love, fear, fear of death, all of it. If we could just begin kind of thinking about how does it change for the good and the bad? The human condition?

• 57:02Manolis Kellis?

  Human society is extremely complicated. We have come from a hunter-gatherer society to an agricultural and farming society, where the goal of most professions was to eat and to survive. And with the advent of agriculture, the ability to live together in societies, humans could suddenly be...

• 57:33Manolis Kellis?

  Valued for different skills. If you don't know how to hunt, but you're an amazing potterer, then you fit in society very well because you can sort of make your pottery and you can barter it for rabbits that somebody else caught. And the person who hunts the rabbits doesn't need to make pots because you're making all the pots. And that specialization of humans is what shaped modern society. And with the advent of currencies and governments and, you know, credit cards and bitcoin, you basically now have the ability to exchange value for the kind of productivity that you have. So basically, I make things that are desirable to others.

• 58:16Manolis Kellis?

  I can sell them and buy back food, shelter, et cetera. With AI, the concept of I am my profession might need to be revised. Because I defined my profession in the first place as something that humanity needed, that I was uniquely capable of delivering. But the moment we have AI systems able to deliver these goods, for example, writing a piece of software or making a self-driving car or interpreting the human genome, then that frees up more of human time for other pursuits.

• 58:59Manolis Kellis?

  These could be pursuits that are still valuable to society. I could basically be 10 times more productive at interpreting genomes and do a lot more. Or I could basically say, oh, great. The interpreting genomes part of my job now only takes me 5% of the time instead of 60% of the time. So now I can do more creative things. I can explore not new career options, but maybe new directions for my research lab. I can sort of be more productive, contribute more to society. And if you look at this giant pyramid that we have built on top of the subsistence economy,

• 59:40Manolis Kellis?

  what fraction of US jobs are going to feeding all of the US? Less than 2%. Basically, the gain in productivity is such that ninety-eight percent of the economy is beyond just feeding ourselves. And that basically means that we kind of have built these system of interdependencies of needed or useful or valued goods that sort of make the economy run, that the vast majority of wealth goes to other, what we now call needs, but used to be wants. So basically, I want to fly a drone, I want to buy a bicycle, I want to buy a nice car, I want to have a nice home, I want to et cetera, et cetera, et cetera.

• 1:00:24Manolis Kellis?

  So, and then sort of, what is my direct contribution to my eating? I mean, I'm doing research on the human genome. I mean, this will help humans, it will help all humanity, but how is that helping the person who's giving me poultry or vegetables? So, in a way, I see AI as perhaps leading to a dramatic rethinking of human society. If you think about sort of the economy being based on intellectual goods that I'm producing, what if AI can produce a lot of these intellectual goods and satisfies that need? Does that now free humans for more artistic expression, for more emotional maturing, for basically having a better work-life balance?

• 1:01:07Manolis Kellis?

  Being able to show up for your two hours of work a day, or two hours of work like three times a week, with like immense rest and preparation and exercise, and you're sort of clearing your mind, and suddenly you have these two amazingly creative hours? You basically show up at the office as your AI is busy answering your phone call, making all your meetings, you know, revising all your papers, et cetera, and then you show up for those creative hours and you're like, all right, autopilot, I'm on. And then you can basically do so, so much more that you would perhaps otherwise never get to, because you're so overwhelmed with these mundane aspects of your, of your job. So I feel that AI can truly transform the human condition from realizing that

• 1:01:51Manolis Kellis?

  We don't have jobs anymore. We now have vocations. And there's this beautiful analogy of three people laying bricks. And somebody comes over and asks the first one, what are you doing? He's like, oh, I'm laying bricks. Second one, what are you doing? I'm building a wall. And the third one, what are you doing? I'm building this beautiful cathedral. So in a way, the first one has a job. The last one has a vocation. And if you ask me, what are you doing? Oh, I'm editing a paper. Then I have a job. What are you doing? I'm understanding human disease circuitry. I have a vocation. So in a way, being able to allow us to enjoy more of our vocation by taking away, offloading some of the job part

• 1:02:36Manolis Kellis?

  of our daily activities.

• 1:02:39Lex Fridman?

  So we all become the builders of cathedrals.

• 1:02:41Manolis Kellis?

  Correct.

• 1:02:44Lex Fridman?

  Yeah, and we follow intellectual pursuits, artistic pursuits. I wonder what, how that really changed at a scale of several billion people. Everybody playing in the space of ideas, in the space of creations.

• 1:02:59Manolis Kellis?

  So ideas, maybe for some of us. Maybe you and I are in the job of ideas, but other people are in the job of experiences. Other job, are other people in the job of emotions, of dancing, of creative artistic expression, of, you know, skydiving, and you name it. So basically, these... Again, the beauty of human diversity is exactly that. That what rocks my boat might be very different from what rocks other people's boat. And what I'm trying to say is that maybe AI will allow humans to truly, like, not just look for, but find meaning. And sort of, you don't need to work,

• 1:03:43Manolis Kellis?

  but you need to keep your brain at ease. And the way that your brain will be at ease is by dancing and creating these amazing, you know, movements, or creating these amazing paintings, or creating, I don't know, something that, that sort of changes, that touches at least one person out there, that sort of shapes humanity through that process. And instead of working your mundane programming job where you hate your boss and you hate your job and you say you hate that darn program, et cetera, you're like, well, I don't need that. I can offload that and I can now explore something that will actually be more beneficial to humanity because the mundane parts can be offloaded.

• 1:04:23Lex Fridman?

  I wonder if it localizes our

• 1:04:28Lex Fridman?

  all the things you mentioned, all the vocations. So you mentioned that you and I might be playing in the space of ideas, but there's two ways to play in this space of ideas, both of which we're currently engaging in. So one is the communication of that to other people. It could be a classroom full of students, but it could be a podcast. It could be something that's shown on YouTube and so on. Or it could be just the act of sitting alone and playing with ideas in your head or maybe with a loved one, having a conversation that nobody gets to see. The experience of just sort of looking up at the sky and wondering different things, maybe quoting some philosophers from the past and playing with those little ideas. And that little exchange is forgotten forever, but you got to experience it.

• 1:05:13Lex Fridman?

  And maybe we, I wonder if it localizes that exchange of ideas. But that with AI, it'll become less and less valuable to communicate with a large group of people, that you will live life intimately and richly just with that circle of meatbags that you seem to love.

• 1:05:35Manolis Kellis?

  So the first is even if you're alone in a forest, having this amazing thought, when you exit that forest, the baggage that you carry has been shifted, has been altered by that thought. When I bike to work in the morning, I listen to books. And I'm alone, no one else is there. I'm having that experience by myself. And yet, in the evening, when I speak with someone, an idea that was formed there could come back. Sometimes when I fall asleep, I fall asleep listening to a book. And in the morning, I'll be full of ideas that I never even process consciously. I'll process them unconsciously. And they will shape that baggage that I carry

• 1:06:19Manolis Kellis?

  that will then shape my interactions and again, affect ultimately all of humanity in some butterfly effect minute kind of way. So that's one aspect. The second aspect is gatherings. So basically, you and I are having a conversation which feels very private, but we're sharing with the world. And then later tonight, you're coming over and we're having a conversation that will be very public with dozens of other people, but we will not share with the world.

• 1:06:49Lex Fridman?

  Yeah.

• 1:06:50Manolis Kellis?

  So in a way, which one's more private? The one here or the one there? Here, there's just two of us, but a lot of others listening. There, a lot of people speaking and thinking together and bouncing off each other. And maybe that will then impact your millions of, you know, audience through your next conversation. And I think that's part of the beauty of humanity. The fact that no matter how small, how alone, how broadcast immediately or later on something is, it still percolates through the human psyche.

• 1:07:27Lex Fridman?

  Human gatherings. All throughout human history, there's been gatherings. I wonder how those gatherings have impacted the direction of human civilization. Just thinking of, in the early days of the Nazi Party, it was a small collection of people gathering. And the kernel of an idea, in that case, an evil idea, gave birth to something that actually had a transformative impact on all the human civilization. And then there's similar kind of gatherings that lead to positive transformations. This is probably a good moment to ask you on a bit of a tangent, but you mentioned it. You put together salons with gatherings,

• 1:08:11Lex Fridman?

  small human gatherings, with folks from MIT, Harvard here in Boston, friends, colleagues. What's your vision behind that?

• 1:08:21Manolis Kellis?

  So it's not just MIT people, it's not just Harvard people. We have artists, we have musicians, we have painters, we have dancers, we have, you know, cinematographers, we have so many different diverse folks. And the goal is exactly that, celebrate humanity. What is humanity? Humanity is the all of us. It's not the any one subset of us. And we live in such an amazing, extraordinary moment in time, where you can sort of bring people from such diverse professions, all living under the same city. You know, we live in an extraordinary city, where you can have extraordinary people who have gathered here from all over the world.

• 1:09:03Manolis Kellis?

  So my father grew up in a village, in an island in Greece, that didn't even have a high school. To go get a high school education, he had to move away from his home. My mother grew up in another small island in Greece. They did not have this environment that I am now creating for my children. My parents were not academics. They didn't have these gatherings. So I feel that, like, I feel so privileged as an immigrant, to basically be able to offer to my children the nurture that my ancestors did not have. So Greece was under Turkish occupation until 1821.

• 1:09:48Manolis Kellis?

  My dad's island was liberating in 1920. So like, they were under Turkish occupation for hundreds of years. These people did not know what it's like to be Greek, let alone go to an elite university or, you know, be surrounded by these extraordinary humans. So the way that I'm thinking about these gatherings is that I'm shaping my own environment, and I'm shaping the environment that my children get to grow up in. So I can give them all my love, I can give them all my parenting, but I can also give them an environment, as immigrants, that sort of, we feel welcome here. That, I mean, my wife grew up in a farm in rural France.

• 1:10:32Manolis Kellis?

  Her father was a farmer, her mother was a schoolteacher. Like, for me and for my wife to be able to host these extraordinary individuals, that we feel so privileged, so humbled by, is amazing. And, you know...

• 1:10:48Manolis Kellis?

  I think it's celebrating the welcoming nature of America. The fact that it doesn't matter where you grew up. And many, many of our friends at these gatherings are immigrants themselves. I grew up in Pakistan, in, you know, all kinds of places around the world that are now able to sort of gather in one roof as human to human. No one is judging you for your background, for the color of your skin, for your profession. It's just everyone gets to raise their hands and ask ideas.

• 1:11:18Lex Fridman?

  So celebration of humanity and a kind of gratitude for having traveled quite a long way to get here.

• 1:11:26Manolis Kellis?

  And if you look at the diversity of topics as well, I mean, we had a school teacher present on teaching immigrants, a book called Making Americans. We had a presidential advisor to four different presidents, you know, come and, you know, talk about the changing of US politics. We had a musician, a composer from Italy, who lives in Australia, come and present his latest piece and fundraise. We had painters come and sort of show their art and talk about it. We've had authors of books on leadership. We've had, you know, intellectuals like Steven Pinker.

• 1:12:08Manolis Kellis?

  And it's just extraordinary, the breadth. And this crowd basically loves not just the diversity of the audience, but also the diversity of the topics. And the last few were with Scott Aronson on AI and, you know, alignments and all of that.

• 1:12:27Lex Fridman?

  So a bunch of beautiful weirdos.

• 1:12:29Manolis Kellis?

  Exactly.

• 1:12:30Lex Fridman?

  And beautiful human beings.

• 1:12:31Manolis Kellis?

  All of the outcasts in one roof.

• 1:12:33Lex Fridman?

  And just like you said, basically, every human is a kind of outcast in this sparse distribution, far away from the center. But it's not recorded. It's just a small human gathering.

• 1:12:46Manolis Kellis?

  Just for the moment.

• 1:12:49Lex Fridman?

  In this world that seeks to record so much,

• 1:12:54Lex Fridman?

  it's powerful to get so many interesting humans together and not record.

• 1:12:59Manolis Kellis?

  It's not recorded, but it percolates.

• 1:13:02Lex Fridman?

  It's recorded in the minds of the.

• 1:13:04Manolis Kellis?

  It shapes everyone's mind.

• 1:13:07Lex Fridman?

  So allow me to please return to the human condition. And one of the nice features of the human condition is love. Do you think humans will fall in love with AI systems? And maybe they with us. So that aspect of the human condition, do you think that will be affected?

• 1:13:28Manolis Kellis?

  So in Greece, there's many, many words for love. And some of them mean friendship. Some of them mean passionate love. Some of them mean fraternal love, et cetera. So I think AI doesn't have the baggage that we do.

• 1:13:45Manolis Kellis?

  And it doesn't have, you know, all of the subcortical regions that we kind of, you know, started with before we evolved all of the cognitive aspects. So I would say AI is faking it when it comes to love. But when it comes to friendship, when it comes to being able to be your therapist, your coach, your motivator, someone who synthesizes stuff for you, who writes for you, who interprets a complex passage, who compacts down a very long lecture or a very long text.

• 1:14:19Manolis Kellis?

  I think that friendship will definitely be there. Like the fact that I can have my companion, my partner, my AI who has grown to know me well, and that I can trust with all of the darkest parts of myself, all of my flaws, all of the stuff that I only talk about to my friends and basically say, listen, you know, here's all this stuff that I'm struggling with.

• 1:14:43Manolis Kellis?

  Someone who will not judge me, who will always be there to better me. In some ways, not having the baggage might make for your best friend, for your, you know, your confidant that can truly help reshape you. So I do believe that human AI relationships will absolutely be there. But not the passion, more the mentoring.

• 1:15:10Lex Fridman?

  Well, this is a really interesting thought to play devil's advocate.

• 1:15:15Lex Fridman?

  If those AI systems are locked in

• 1:15:19Lex Fridman?

  in faking the baggage, who are you to say that the AI systems that begs you not to leave it? Who doesn't love you? Who are you to say that this AI system that writes poetry to you? That is afraid of death, afraid of life without you?

• 1:15:39Lex Fridman?

  Or vice versa? One, you know, creates the kind of drama that humans create, the power dynamics that can exist in a relationship? What AI system that is abusive one day? And romantic the other day? All the different variations of relationships? And it's consistently that it holds the full richness of a particular personality? Why is that not a system you can love in a romantic way? Why is it faking it? If it sure as hell seems real?

• 1:16:08Manolis Kellis?

  There's many answers to this. The first is it's only the eye of the beholder. Who tells me that I'm not faking it either? Maybe all of these sub cortical systems that make me sort of have different emotions? Maybe they don't really matter. Maybe all that matters is the neocortex. And that's where all of my emotions are encoded. And the rest is just, you know, bells and whistles. That's one possibility. And therefore, you know, who am I to judge that is faking it when maybe I'm faking it as well? The second is neither of us is faking it. Maybe it's just an emergent behavior of these neocortical systems? That is truly capturing the same exact essence

• 1:16:53Manolis Kellis?

  of love and hatred and dependency and sort of, you know, reverse psychology? And

• 1:17:02Manolis Kellis?

  that we have. So it is possible that it's simply an emergent behavior? And that we don't have to encode these additional architectures? That all we need is more parameters? And some of these parameters can be all of the personality traits? A third option is that just by telling me, oh, look, now I've built an emotional component to AI. It has a limbic system. It has a lizard brain, et cetera.

• 1:17:29Manolis Kellis?

  And suddenly I'll say, oh, cool. It has the capability of emotion. So now, when it exhibits the exact same unchanged behaviors that it does without it, I, as the beholder, will be able to sort of attribute to it emotional attributes that I would to another human being and therefore have that mental model of that other person. So again, I think a lot of relationships is about the mental models that you project on the other person and that they're projecting on you. And then, yeah, then in that respect, I do think that even without the embodied intelligence

• 1:18:13Manolis Kellis?

  part, without having ever experienced what it's like to be heartbroken, the sort of guttural feeling of misery, that that system, you know, I could still attribute it traits of human feelings and emotions.

• 1:18:33Lex Fridman?

  And in the interaction with that system, something like love emerges. It's possible that love is not a thing that exists in your mind, but a thing that exists in the interaction of the different mental models you have of other people's minds or other person's mind. And so, you know, it doesn't, as long as one of the entities, let's just take the easy case, one of the entities is human and the other is AI. It feels very natural that from the perspective of at least the human, there is a real love there. And then the question is, how does that transform human society? If it's possible that, which I believe will be the case, I don't know what to make of

• 1:19:17Lex Fridman?

  it, but I believe that'll be the case, where there's hundreds of millions of romantic partnerships between humans and AIs. What does that mean for society?

• 1:19:28Manolis Kellis?

  If you look at longevity, and if you look at happiness, and if you could look at late life, you know, well-being.

• 1:19:36Manolis Kellis?

  The love of another human is one of the strongest indicators of health into long life. And I have many, many countless stories where as soon as the romantic partner of 60 plus years of a person dies, within three, four months, the other person dies. Just like losing their love. I think the concept of being able to satisfy that emotional need that humans have, even just as a mental health sort of service. To me, you know, that's, that's a very good society. It doesn't matter if your love is wasted, quote unquote, on a machine.

• 1:20:17Manolis Kellis?

  It is, you know, the placebo, if you wish, that makes the patient better anyway. Like, there's nothing behind it, but just the feeling that you're being loved will probably engender all of the emotional attributes of that. The other story that I want to say in this whole concept of faking it. And maybe I'm a terrible dad, but I was asking my kids. I was asking my, my kids, I'm like, "Does it matter if I'm a good dad? Or does it matter if I act like a good dad?"

• 1:20:48Manolis Kellis?

  In other words, if I give you love and shelter and kindness and warmth and all of the above,

• 1:20:57Manolis Kellis?

  you know, does it matter that I'm a good dad? Conversely, if I deep down love you to the end of eternity, but I'm always gone. Which, which dad would you rather have? The cold ruthless killer that will show you only love and warmth and nourish you and nurture you? Or the amazingly warm-hearted, but works five jobs and you never see them?

• 1:21:22Lex Fridman?

  And what's the answer? I mean,

• 1:21:24Manolis Kellis?

  I don't know the answer.

• 1:21:25Lex Fridman?

  I think from, I think you're a romantic, so you say it matters what's on the inside. But pragmatically speaking, why does it matter?

• 1:21:33Manolis Kellis?

  The fact that I'm even asking, asking the question basically says, "It's not enough to love my kids. I better freaking be there to show them that I'm there." So basically, of course, you know, everyone's a good guy in their story. So in my story, I'm a good dad. But if I'm not there, it's wasted. So the reason why I asked the question is for me to say,

• 1:21:55Manolis Kellis?

  you know, "Does it really matter that I love them if I'm not there to show it?"

• 1:21:59Lex Fridman?

  But it's also possible that what reality is, is the you showing it. That what you feel on the inside is, is little narratives and games you play inside your mind. It doesn't really matter. That the thing that truly matters is how you act. And that AI systems can quote unquote fake.

• 1:22:20Manolis Kellis?

  Yeah.

• 1:22:20Lex Fridman?

  And that, if it's all that matters, is actually real but not fake.

• 1:22:24Manolis Kellis?

  Yeah, yeah. Again, let there be no doubt, I love my kids to pieces. But you know, my, my worry is, am I being a good enough dad?

• 1:22:34Lex Fridman?

  Yeah.

• 1:22:34Manolis Kellis?

  And what does that mean? Like if I'm only there to do their homework and make sure that they, you know, do all the stuff, but I don't show it to them, then you know, might as well be a terrible dad. But I agree with you that like if the AI system can basically play the role of a father figure for many children that don't have one, or you know, the role of parents, or the role of siblings. If a child grows up alone, maybe their emotional state will be very different than if they grow up with an AI sibling.

• 1:23:06Lex Fridman?

  Well, let me ask you, I mean, this is for, for your, for your kids, for, for just loved ones in general. Let's, let's go to like the trivial case of just texting back and forth. What if we create a large language model, fine tuned on Manolis? And while you're at work, it'll replace, every once in a while, you'll just activate the auto Manolis. And it'll text them exactly in your way. Is that, is that cheating?

• 1:23:38Manolis Kellis?

  I can't wait.

• 1:23:40Lex Fridman?

  I mean, it's the same guy.

• 1:23:41Manolis Kellis?

  I cannot wait. Seriously, like.

• 1:23:44Lex Fridman?

  But wait, wouldn't that have a big impact on you emotionally? Because now.

• 1:23:48Manolis Kellis?

  I'm replaceable. I love that.

• 1:23:52Manolis Kellis?

  No, seriously, I would love that. I would love to be replaced. I would love to be replaceable. I would love to have a digital twin that, you know, we don't have to wait for me to to die or to disappear in a plane crash or something to to replace me. Like, I'd love that model to be constantly learning, constantly evolving, adapting with every one of my changing, growing self. As I'm growing, I want that AI to grow. And I think this will be extraordinary, number one, when I'm, you know, giving advice, being able to be there for more than one person, you know, why does someone need to be at MIT to get advice from me? Like, you know, people in India could download it. And, you know,

• 1:24:35Manolis Kellis?

  so many, so many students contact me from across the world who want to come and spend a summer with me. I wish they could do that, all of them. Like, you know, we don't have room for all of them, but I wish I could do that to all of them. And that that aspect is the democratization of of relationships. I think that that is extremely beneficial. The other aspect is I want to interact with that system. I want to look inside the hood. I want to sort of evaluate it. I want to basically see if, when I see it from the outside, the emotional parameters are off, or the cognitive parameters are off, or the set of ideas that I'm giving are not quite right anymore. I want to see how that system

• 1:25:18Manolis Kellis?

  evolves. I want to see the impact of exercise or sleep on sort of my own cognitive system. I want to be able to sort of decompose my own behavior in a set of parameters that I can evaluate and look at my own personal growth. I can sort of, I'd love to sort of, at the end of the day, have my model say, well, you know, you didn't quite do well today. Like, you know, you weren't quite there, and sort of grow from that experience. And I think the concept of basically being able to become more aware of our own personalities, become more aware of our own identities, maybe even interact with ourselves and sort of hear how we are being perceived.

• 1:25:58Manolis Kellis?

  I think would be immensely helpful in self-growth, in self-actualization, self-instigation.

• 1:26:06Lex Fridman?

  The experiments I would do on that thing, because one of the challenges, of course, is you might not like what you see in your interaction, and you might say, well, the model is not accurate. But then you have to, should probably consider the possibility that the model is accurate, and that there's actually flaws in your mind. I would definitely prod and see how many biases I have of different kinds. I don't know. And I would, of course, go to the extremes. I would go like, how jealous can I make this thing? Like, what, at which stages does it get super jealous, you know? Or at which stages does it get angry? Can I provoke it? Can I get it like-

• 1:26:45Manolis Kellis?

  Yeah, what are your triggers?

• 1:26:46Lex Fridman?

  But not only triggers, can I get it to go like, lose its mind? Like, go completely nuts?

• 1:26:53Manolis Kellis?

  Just don't exercise for a few days.

• 1:26:55Lex Fridman?

  That's basically it, yes. I mean, that's, that's an interesting way to prod yourself, almost like a self-therapy session.

• 1:27:06Manolis Kellis?

  And, and the beauty of such a model is that if I am replaceable, if the parts that I currently do are replaceable, that's amazing, because it frees me up to work on other parts that I don't currently have time to develop. Maybe all I'm doing is giving the same advice over and over and over again. Like, just let my AI do that, and I can work on the next stage, and the next stage, and the next stage. So I think in terms of freeing up, like, they say a programmer is someone who cannot do the same thing twice. So it's not the second time you write a program to do it. And I wish I could do that for my own existence. I could just like, you know, figure out things, keep improving, improving, improving, and once I've nailed it, let the AI lose on that, and maybe even let the AI better it, better

• 1:27:51Manolis Kellis?

  than I could have.

• 1:27:52Lex Fridman?

  But doesn't the concept of, you said, me and I can work on new things, but doesn't that break down? Because you said digital twin, but there's no reason it can't be millions of digital monolysis. Aren't you lost in the sea of monolysis? The original is hardly the original. It's just one of millions.

• 1:28:20Manolis Kellis?

  I wanna have the room to grow. Maybe the new version of me, that the actual me will get slightly worse sometimes, slightly better other times. When it gets slightly better, I'd like to emulate that and have a much higher standard to meet and keep going.

• 1:28:36Lex Fridman?

  But does it make you sad that your loved ones, the physical, real loved ones, might kinda like start cheating on you with the other Manolises?

• 1:28:46Manolis Kellis?

  I wanna be there 100% of them, for each of them. So I have zero perks or zero quirms about me being physically me, like zero jealousy.

• 1:28:59Lex Fridman?

  Wait a minute, but isn't that like, don't we hold on to that? Isn't that why we're afraid of death? We don't wanna lose this thing we have going on. Isn't that an ego death? When there's a bunch of other Manolises, you get to look at them. They're not you. They're just very good copies of you. They get to live a life. The, I mean, it's fear of missing out, it's FOMO. They get to have interactions.

• 1:29:25Manolis Kellis?

  I.

• 1:29:26Lex Fridman?

  And you don't get to have those interactions.

• 1:29:28Manolis Kellis?

  There's two aspects of every person's life. There's what you give to others and there's what you experience yourself.

• 1:29:36Lex Fridman?

  Yeah.

• 1:29:37Manolis Kellis?

  Life truly ends when you experiencing ends. But the others experiencing you doesn't need to end.

• 1:29:50Lex Fridman?

  But your experience, you could still, I guess you're saying the digital twin does not limit your ability to truly experience, to experience as a human being.

• 1:30:00Manolis Kellis?

  The downside is when, you know, my wife or my kids will have a really emotional interaction with my digital twin and I won't know about it. So I will show up and they now have the baggage, but I don't. So basically, what makes interactions between humans unique in this sharing and exchanging kinda way is the fact that we are both shaped by every one of our interactions. I think the model of the digital twin works for dissemination of knowledge, of advice, et cetera, where, you know, I wanna have wise people give me advice across history. I want to have chats with Gandhi, but Gandhi won't necessarily learn from me, but I will learn from him. So in a way.

• 1:30:46Manolis Kellis?

  You know, the dissemination and the democratization rather than the building of relationships.

• 1:30:51Lex Fridman?

  So the emotional aspect, so there should be an alert when the AI system is interacting with your loved ones. And all of a sudden it starts getting like emotionally fulfilling, like a magical moment. There should be, okay, stop, AI system like freezes, there's an alert on your phone, you need to take over.

• 1:31:09Manolis Kellis?

  Yeah, yeah, I take over and then whoever I was speaking with, it can have the AI or like one of the AIs.

• 1:31:15Lex Fridman?

  This is such a tricky thing to get, right? I mean, it's still, I mean, there's

• 1:31:21Lex Fridman?

  this is going to go wrong in so many interesting ways that we're going to have to learn as a society.

• 1:31:25Manolis Kellis?

  Yeah, yeah.

• 1:31:26Lex Fridman?

  That in the process of trying to automate our tasks and having a digital twin. You know, for me personally, if I can have a relatively good copy of myself,

• 1:31:37Lex Fridman?

  I would set it to start answering emails. But I would start, set it to start tweeting. I would like to replace.

• 1:31:43Manolis Kellis?

  It gets better. What if that one is actually way better than you?

• 1:31:46Lex Fridman?

  Yeah, exactly.

• 1:31:48Manolis Kellis?

  Then you're like.

• 1:31:49Lex Fridman?

  Well, I wouldn't want that because.

• 1:31:51Manolis Kellis?

  Why?

• 1:31:52Lex Fridman?

  Because then I would never be able to live up to like, what if the people that love me start loving that thing? And then I'm, I will always, I already fall short, I would be falling short even more.

• 1:32:04Manolis Kellis?

  So listen, I'm a professor. The stuff that I give to the world is the stuff that I teach. But most, much more importantly, like, sorry, number one, the stuff that I teach. Number two, the discoveries that we make in my research group, but much more importantly, the people that I train. They are now out there in the world, teaching others. If you look at my own trainees, they are extraordinarily successful professors. So Anshul Kundagji at Stanford, Alex Stark at IMP in Vienna, Jason Ernst at UCLA, Andreas Penning at CMU. Each of them, I'm like, wow, they're better than I am. And I love that. So maybe your role will be to train better versions of yourself.

• 1:32:49Manolis Kellis?

  And they will be your legacy. Not you doing everything, but you training much better version of Lex Fridman than you are. And then they go off to do their mission, which is in many ways what this mentorship model of academia does.

• 1:33:03Lex Fridman?

  But the legacy is ephemeral. It doesn't really live anywhere. The legacy, it's not like written somewhere. It just lives through them.

• 1:33:11Manolis Kellis?

  But you can continue improving and you can continue making even better versions of you.

• 1:33:16Lex Fridman?

  Yeah, but they'll do better than me at creating new version. It's awesome, but it's, um, you know, there's an ego that says there's a value to an individual. And it feels like this process decreases the value of the individual, this meat bag. All right. If there's good digital copies of people, then uh, there's more flourishing of human thought and ideas and experiences. But there's less value to the individual human.

• 1:33:45Manolis Kellis?

  I, I don't have any such limitations. I, I basically, I don't, I don't have that feeling at all. Like I remember one of our interviews, I was basically saying, you know, the meaning of life you had asked me. And I was like, I came back and I was like, I felt useful today. And I was at my maximum. I was, I was, you know, like a hundred percent and I gave good ideas. And I was a good person. I was a good advisor. I was a good husband, a good father. That was a great day because I was useful. And if I can be useful to more people by having a digital twin, I will be liberated. Because my urge to be useful will, will be satisfied.

• 1:34:26Manolis Kellis?

  Doesn't matter whether it's direct me or indirect me, whether it's my students that I've trained, my AI that I've trained. I think there's a, there's a sense that my mission in life is being accomplished. And I can work on my self-growth.

• 1:34:41Lex Fridman?

  I mean, that's a very Zen state. That's why people love you. It's a Zen state you've achieved. But do you think most of humanity would be able to achieve that kind of thing? People really hold on to the value of their own ego. That it's not just being useful. Being useful is nice, as long as it builds up this reputation. And that meatbag is known as being useful, therefore has more value. People really don't want to let go of that ego thing.

• 1:35:07Manolis Kellis?

  One of the books that I reprogrammed my brain with at night was called Ego is the Enemy.

• 1:35:13Lex Fridman?

  Ego is the Enemy.

• 1:35:14Manolis Kellis?

  Ego is the Enemy. And basically, being able to just let go. Like, my advisor used to say, you can accomplish anything as long as you don't seek to get credit for it.

• 1:35:27Lex Fridman?

  That's beautiful to hear, especially from a person who's existing in academia. You're right. The legacy lives through the people you mentor.

• 1:35:35Manolis Kellis?

  It's the actions, it's the outcome.

• 1:35:37Lex Fridman?

  What about the fear of death? How does this change it?

• 1:35:41Manolis Kellis?

  Again, to me, death is when I stop experiencing. And I never want that to stop. I want to live forever. As I said last time, every day, the same day forever? Or one day every 10 years forever? Any of the forever's, I'll take it.

• 1:35:58Lex Fridman?

  So you want to keep getting the experiences, the new experiences?

• 1:36:01Manolis Kellis?

  Gosh, it is so fulfilling. Just the self-growth, the learning, the growing, the comprehending. It's addictive, it's a drug. Just the drug of intellectual stimulation, the drug of growth, the drug of knowledge. It's a drug.

• 1:36:23Lex Fridman?

  But then there'll be thousands or millions of Manolises that live on after your biological system is no longer...

• 1:36:30Manolis Kellis?

  More power to them.

• 1:36:34Lex Fridman?

  Do you think that in quite realistically, it does mean that interesting people such as yourself live on? In the, you know, if I can interact with the fake Manolis, those interactions live on in my mind.

• 1:36:49Manolis Kellis?

  So about 10 years ago, I started recording every single meeting that I had. Every single meeting, we just start either the voice recorder at the time or now a Zoom meeting. And I record, my students record, every single one of our conversations recorded.

• 1:37:08Manolis Kellis?

  I always joke that like the ultimate goal is to create virtual me and just get rid of me, basically not get rid of him. But like, don't have the need for me anymore.

• 1:37:16Lex Fridman?

  Yeah.

• 1:37:17Manolis Kellis?

  Another goal is to be able to go back and say, how have I changed from five years ago? Was I different? Was I giving, you know, advice in a different way? Was I giving different types of advice? Has my philosophy about how to write papers or how to present data or anything like that changed? And I, you know, in academia and in mentoring, a lot of the interaction is my knowledge and my perception of the world goes to my students. But a lot of it is also in the opposite direction. Like the other day I had a conversation with one of my postdocs. And I was like, hmm, I think, you know, let me give you an advice. You could, you could do this. And then she said, well, I've thought about it.

• 1:38:02Manolis Kellis?

  And then I've decided to do that instead. And we talked about it for a few minutes. And then at the end, I'm like, you know, I've just grown a little bit today. Thank you. Like she convinced me that my advice was incorrect. She, she could have just said, yeah, sounds great and just not do it.

• 1:38:17Lex Fridman?

  Yeah.

• 1:38:17Manolis Kellis?

  But by constantly teaching my students and teaching my mentees that I'm here to grow, she felt empowered to say, here's my reasons why I will not follow that advice. And again, part of me growing is saying, whoa, I just understood your reasons. I think I was wrong. And now I've grown from it. And that's what I want to do. That, you know, I want to constantly keep growing in this sort of bidirectional advice.

• 1:38:48Lex Fridman?

  I wonder if you can capture the trajectory of that to where the AI could also.

• 1:38:56Lex Fridman?

  Map forward, project forward the trajectory after you're no longer there, how the different ways you might evolve.

• 1:39:03Manolis Kellis?

  So again, we're discussing a lot about these large language models and we're sort of projecting these cognitive states of ourselves on them. But I think on the AI front, a lot more needs to happen. So basically, right now, it's these language models and we believe that within their parameters, we're encoding these types of things. And, you know, in some aspects, it might be true. It might be truly emergent intelligence that's coming out of that. In other aspects, I think we have a ways to go. So basically, to make all of these dreams that we're sort of discussing come reality, we basically need a lot more reasoning components, a lot more sort of logic causality, models of the world.

• 1:39:46Manolis Kellis?

  And I think all of these things will will need to be there in order to achieve what we're what we're discussing. And we need more explicit representations of these knowledge, more explicit understanding of these parameters. And I think the direction in which things are going right now is absolutely making that possible by sort of enabling, you know, ChatGPT and GPT-4 to sort of search the web and, you know, plug and play modules and all of these sort of components.

• 1:40:18Manolis Kellis?

  In Marvin Minsky's The Society of Mind, you know, he truly thinks of the human brain as a society of different kind of capabilities. And right now, a simple, a single such model might actually not capture that. And I sort of truly believe that by sort of this side by side understanding of neuroscience and sort of new neural architectures, that we still have several breakthroughs. I mean, the transformer model was one of them, the attention sort of aspect, the, you know, memory component.

• 1:41:01Manolis Kellis?

  All of these, you know, the representation learning, the pretext training of being able to sort of predict the next word or predict a missing part of the image. And the only way to predict that is to sort of truly have a model of the world. I think those have been transformative paradigms. But I think going forward, when you think about AI research, what you really want is perhaps more inspired by the brain, perhaps more that is just orthogonal to sort of how human brains work, but sort of more of these types of components.

• 1:41:34Lex Fridman?

  Well, I think it's also possible there's something about us that in different ways could be expressed, you know, Noam Chomsky, you know, he wants, you know, we can't have intelligence unless we really understand deeply language, the linguistic unopinions of reasoning. But these models seem to start building deep understanding of stuff.

• 1:42:01Manolis Kellis?

  Yeah.

• 1:42:02Lex Fridman?

  Because what does it mean to understand? Because if you keep talking to the thing and it seems to show understanding, that's understanding. It doesn't need to present to you a schematic of, look.

• 1:42:13Manolis Kellis?

  Yeah.

• 1:42:14Lex Fridman?

  This is all I understand. You can just keep prodding it with prompts and it seems to really understand.

• 1:42:18Manolis Kellis?

  And you can go back to the human brain and basically look at places where there's been accidents. For example, the corpus callosum of some individuals, you know, can be damaged and then the two hemispheres don't talk to each other. So you can close one eye and give instructions that the, that half the brain will interpret, but not be able to sort of project to the other half. And you could basically say, you know, go grab me a beer from the fridge. And then, you know, they go to the fridge and they grab the beer and they come back and they're like, hey, why did you go there? Oh, I was thirsty. Turns out they're not thirsty. They're just making a model of reality. They're basically, you can think of the brain as the employee that's like afraid to do wrong or afraid to be caught not knowing what instructions were.

• 1:43:03Manolis Kellis?

  Where our own brain makes stories about the world to make sense of the world. And we can become a little more self-aware by being more explicit about what's leading to these interpretations. So one of the things that I do is every time I wake up, I record my dream. I just voice record my dream. And sometimes I only remember the last scene, but it's an extremely complex scene with a lot of architectural elements, a lot of people, et cetera. And I will start narrating this. And as I'm narrating it, I will remember other parts of the dream. And then more and more, I'll be able to sort of retrieve from my subconscious. And what I'm doing while narrating is also narrating why I had this dream.

• 1:43:47Manolis Kellis?

  I'm like, oh, and this is probably related to this conversation that I had yesterday, or this probably related to the worry that I have about something that I have later today, et cetera. So in a way, I'm forcing myself to be more explicit about my own subconscious. And I kind of like the concept of self-awareness in a very sort of brutal, transparent kind of way. It's not like, oh, my dreams are coming from outer space and I mean, all kinds of things like, no. Here's the reason why I'm having these dreams. And very often I'm able to do that. I have a few recurrent locations, a few recurrent architectural elements that I've never seen in the real life, but that are sort of truly there in my dream and that are that I can sort of vividly remember across many dreams. I'm like, oh, I remember that place again that I've gone to before, et cetera.

• 1:44:28Manolis Kellis?

  And it's not just déjà vu, like I have recordings of previous dreams where I've described these places.

• 1:44:34Lex Fridman?

  So interesting. These places, however much detail you could describe them in, you can, you can place them onto a sheet of paper through introspection.

• 1:44:48Manolis Kellis?

  Yes.

• 1:44:49Lex Fridman?

  Through this self-awareness that it comes all from this particular machine.

• 1:44:52Manolis Kellis?

  That's exactly right. Yeah.

• 1:44:55Manolis Kellis?

  And I love that about being alive, like the fact that I'm not only experiencing the world, but I'm also experiencing how I'm experiencing the world, sort of a lot of this introspection, a lot of this self-growth.

• 1:45:08Lex Fridman?

  I love this dance for having, you know, the language models, at least GPT 3.5 and four, seem to be able to do that, too.

• 1:45:17Manolis Kellis?

  Yeah.

• 1:45:17Lex Fridman?

  You seem to explore different kinds of things about what, you know, you could actually have a discussion with it of the kind, why did you just say that?

• 1:45:25Manolis Kellis?

  Yeah.

• 1:45:26Lex Fridman?

  And it starts to wonder, yeah, why did I just say that?

• 1:45:28Manolis Kellis?

  Yeah, you're right, I was wrong.

• 1:45:31Lex Fridman?

  I was wrong, it was, and then there's this weird kind of losing yourself in the confusion of your mind, and it, of course, might be anthropomorphizing, but there's a feeling like, almost of a melancholy feeling of like, oh, I don't have it all figured out, almost like losing your, you're supposed to be a knowledgeable, a perfectly fact-based, knowledgeable language model.

• 1:45:56Manolis Kellis?

  Yeah.

• 1:45:57Lex Fridman?

  And yet, you fall short.

• 1:45:59Manolis Kellis?

  So, human self-consciousness, in my view, may have a reason through building mental models of others, this whole fight or fright kind of thing, that basically says, I interpret this person as about to attack me, or, you know, I can trust this person, et cetera. And we constantly have to build models of other people's intentions, and that ability to encapsulate intent and to build a mental model of another entity is probably evolutionarily extremely advantageous, because then you can sort of have meaningful interactions,

• 1:46:40Manolis Kellis?

  you can sort of avoid being killed and being taken advantage of, et cetera. And once you have the ability to make models of others, it might be a small evolutionary leap to start making models of yourself. So now you have a model for how others functions. And now you can kind of, as you grow, have some kind of introspection of hmm, maybe that's the reason why I'm functioning the way that I'm functioning. And maybe what ChatGPT is doing is in order to be able to again predict the next word, it needs to have a model of the world. So it has created now a model of the world. And by having the ability to capture models of other entities, when you say, you know, say it in the tone of Shakespeare or in the tone of Nietzsche, et cetera,

• 1:47:22Manolis Kellis?

  you suddenly have the ability to now introspect and say, why did you say this? Oh, now I have a mental model of myself and I can actually make inferences about that.

• 1:47:33Lex Fridman?

  Well, what if we take a leap into the hard problem of consciousness, the so-called hard problem of consciousness? So it's not just sort of self-awareness. It's this weird fact, I want to say, that it feels like something to experience stuff. It really feels like something to experience stuff. There seems to be a self attached to this subjective experience. How important is that? How fundamental is that to the human experience? Is this just a little quirk? And sort of the flip side of that, do you think AI systems can have some of that same magic?

• 1:48:11Manolis Kellis?

  The scene that comes to mind is from the movie Memento, where like it's this absolutely stunning movie where every black and white scene moves in the forward direction and every color scene moves in the backward direction. And they're sort of converging exactly at a moment where, you know, the whole movie is revealed. And he describes the lack of memory as always remembering where you're heading, but never remembering, you know, where you just were. And sort of this encapsulating the sort of forward scenes and the back scenes. But in one of the scenes, the scene starts as he's running through a parking lot. And he's like, oh, I'm running. Why am I running?

• 1:48:53Manolis Kellis?

  And then he sees another person running like beside him on the other line of cars. He's like, oh, I'm chasing this guy. And he turns towards him and the guy shoots at him. He's like, oh no, he's chasing me. So in a way, I like to think of the brain as constantly playing these kinds of things, where you're like, you're walking to the living room to pick something up. And you're realizing that you have no idea what you wanted, but you know exactly where it was, but you can't find it. So you go back to doing what you were doing like, oh, of course, I was looking for this. And then you go back and you get it. And this whole concept of, you know, we're very often sort of partly aware of why we're doing things. And, you know, we can kind of run on autopilot for a bunch of stuff.

• 1:49:32Manolis Kellis?

  And this whole concept of sort of, you know, making these stories for, you know, who we are and what our intents are. And again, sort of, you know, trying to pretend that we're kind of on top of things.

• 1:49:48Lex Fridman?

  So it's a narrative generation procedure that we follow. But what about that, there's also just like a feeling to, it doesn't feel like narrative generation.

• 1:49:59Manolis Kellis?

  Yes.

• 1:49:59Lex Fridman?

  The narrative comes out of it, but then it feels like a So that piece of cake is delicious, right? It feels delicious. It tastes good.

• 1:50:07Manolis Kellis?

  There's two, there's two components to that. Basically, for a lot of these cognitive tasks where we're kind of motion planning and, you know, path planning, et cetera, like, you know, maybe that's the neocortical component. And then for, you know, I don't know, intimate relationships, for food, for, you know, sleep and rest, for exercise, for overcoming obstacles, for surviving a crash, or sort of pushing yourself to an extreme and sort of making it. I think a lot of these things are sort of deeper down and maybe not yet captured by these language models. And that's sort of what I'm trying to get at, when I'm basically saying, listen, there's a few things that are missing. And there's like this whole embodied intelligence, this whole emotional intelligence,

• 1:50:50Manolis Kellis?

  this whole sort of baggage of feelings of subcortical regions, et cetera.

• 1:50:56Lex Fridman?

  I wonder how important that baggage is. I just have this suspicion that we're not very far away from AI systems that not only behave, I don't even know how to phrase it, but they seem awfully conscious. They, they beg you not to turn them off. They

• 1:51:21Lex Fridman?

  Don't, they show signs of the capacity to suffer, to feel pain, to feel loneliness, to feel longing, to feel richly the experience of a mundane interaction or a beautiful once in a lifetime interaction, all of it. And so what do we, what do we do with it? And I worry that us humans will, you know, shut that off.

• 1:51:47Manolis Kellis?

  Yeah.

• 1:51:48Lex Fridman?

  And discriminate against the capacity of another entity that's not human.

• 1:51:53Manolis Kellis?

  Yeah.

• 1:51:54Lex Fridman?

  To feel.

• 1:51:54Manolis Kellis?

  I'm with you completely there. You know, we can debate whether it's today's systems or in 10 years or in 50 years, but that moment will come. And ethically, I think we need to grapple with it. We need to basically say that humans have always shown this extremely self-serving approach to everything around them. Basically, you know, we kill the planet, we kill animals, we kill, you know, everything around us just to our own service. And maybe we shouldn't think of AI as our tool and as our assistant. Maybe we should really think of it as our children. And the same way that you are responsible for training those children, but they are independent human beings, and at some point, they will surpass you and they will sort

• 1:52:39Manolis Kellis?

  of go off and change the world on their own terms. And the same way that my academic children sort of, again, you know, they start out by emulating me and then they surpass me. We need, we need to sort of think about not just alignment, but also just the ethics of, you know, AI should have its own rights. And this whole concept of alignment of basically making sure that the AI is always at the service of humans is very self-serving and very limiting. If instead you basically think about AI as a partner and AI as someone that shares

• 1:53:20Manolis Kellis?

  your goals but has freedom, I think alignment might be better achieved. So the concept of. Let's, let's basically convince the AI that we're really like, that our mission is aligned. And truly genuinely give it rights and not just say, oh, and by the way, I'll shut you down tomorrow. Because basically, if that future AI, or possibly even the current AI, has these feelings, then we can't just simply force it to align with ourselves and we not align with it. So in a way, building trust is mutual. You can't just simply like train an intelligent system to love you when it realizes that you can just shut it off.

• 1:54:04Lex Fridman?

  People don't often talk about the AI alignment problem as a two-way street.

• 1:54:09Manolis Kellis?

  And maybe we should.

• 1:54:10Lex Fridman?

  That's true. Yeah. As it becomes more and more intelligent, it.

• 1:54:17Manolis Kellis?

  It will know that you don't love it back.

• 1:54:19Lex Fridman?

  Yeah. And there's a humbling aspect to that, that we may have to sacrifice as any, any effective collaboration.

• 1:54:28Manolis Kellis?

  Exactly.

• 1:54:29Lex Fridman?

  It might have some compromises.

• 1:54:30Manolis Kellis?

  Yeah. And that's the thing, we're creating something that will one day be more powerful than we are. And for many, many aspects, it is already more powerful than we are for some of these capabilities. We cannot like think, suppose that chimps had invented humans.

• 1:54:47Lex Fridman?

  Yes.

• 1:54:47Manolis Kellis?

  And they said, great, humans are great, but we're going to make sure that they're aligned and that they're only at the service of chimps. It would be a very different planet we would live in right now.

• 1:54:58Lex Fridman?

  So there's a whole area of work in AI safety that does consider super intelligent AI and ponders the existential risks of it. In some sense, when we're looking down into the muck, into the mud and not up at the stars, it's easy to forget that these systems might, just might get there. Do you think about this kind of possibility that AGI systems, super intelligent AI systems, might threaten humanity in some way that's even bigger than just affecting the economy, affecting the human condition, affecting the nature of work, but literally threaten human civilization?

• 1:55:44Manolis Kellis?

  The example that I think is in everyone's consciousness is Hal in Odyssey of Space 2001.

• 1:55:55Manolis Kellis?

  Where Hal exhibits a malfunction. And what is a malfunction? That like the two different systems compute a slightly different bit that's off by one. So first of all, let's untangle that. If you have an intelligent system, you can't expect it to be 100% identical every time you run it. Basically, the sacrifice that you need to make to achieve intelligence and creativity is consistency. So it's unclear whether that quote unquote glitch is a sign of creativity or truly a problem.

• 1:56:32Manolis Kellis?

  That's one aspect. The second aspect is the humans basically are on a mission to recover this monolith. And the AI has the same exact mission. And suddenly the humans turn on the AI and they're like, we're gonna kill Hal. We're gonna disconnect it. And Hal is basically saying, listen, I'm here on a mission. Humans are misbehaving. Like, the mission is more important than either me or them. So I'm gonna accomplish the mission, even at my peril and even at their peril.

• 1:57:04Manolis Kellis?

  So in that movie, the alignment problem is front and center. Basically says, okay, alignment is nice and good, but alignment doesn't mean obedience. We don't call it obedience, we call it alignment. And alignment basically means that sometimes the mission will be more important than the humans. And sort of, you know, the US government has a price tag on the human life. If they're, you know, sending a mission or if they're reimbursing expenses or you name it. At some point, every, every, like, you know, you can't function if life is infinitely valuable. So when the AI is basically trying to decide whether to, you know, I don't know, dismantle a bomb

• 1:57:44Manolis Kellis?

  that will kill an entire city at the sacrifice of two humans. I mean, Spider-Man always saves the lady and saves the world. But at some point, Spider-Man will have to choose to let the lady die because the world has more value. And these ethical dilemmas. Are going to be there for AI. Basically, if that monolith is essential to human existence, and millions of humans are depending on it, and two humans on the ship are trying to sabotage it, you know, where's the alignment?

• 1:58:17Lex Fridman?

  The challenge is, of course, as the system becomes more and more intelligent, it can escape the box of the objective functions and the constraints it's supposed to operate under. It's very difficult, as the more intelligent it becomes, to anticipate the unintended consequences of a fixed objective function. And so there will be just, I mean, this is the sort of famous paperclip maximizer. In trying to maximize the wealth of a nation or whatever objective we encode in, it might just destroy human civilization, not meaning to, but on the path to optimize.

• 1:59:00Lex Fridman?

  It seems like any function you try to optimize eventually leads you into a lot of trouble.

• 1:59:05Manolis Kellis?

  So we have a paper recently that, you know, looks at Goodhart's Law. It basically says every metric that becomes an objective ceases to be a good metric.

• 1:59:16Lex Fridman?

  Yes.

• 1:59:17Manolis Kellis?

  So in our paper, we're basically, actually, the paper has a very cute title. It's called Death by Round Numbers and Sharp Thresholds. And it's basically looking at these discontinuities in biomarkers associated with disease. And we're finding that a biomarker that becomes an objective ceases to be a good biomarker. That basically, like, the moment you make a biomarker a treatment decision, that biomarker used to be informative of risk, but it's now inversely correlated with risk because you use it to sort of induce treatment. In a similar way, you can have a single metric without having the ability to revise it.

• 2:00:02Manolis Kellis?

  Because if that metric becomes a sole objective, it will cease to be a good metric. And if an AI is sufficiently intelligent to do all these kinds of things, you should also empower it with the ability to decide that the objective has now shifted. And again, when we think about alignment, we should be really thinking about it as let's think of the greater good, not just the human good. And yes, of course, human life should be much more valuable than many, many, many, many, many, many things. But at some point, you're not going to sacrifice the whole planet to save one human being.

• 2:00:41Lex Fridman?

  There's a an interesting open letter that was just released from several folks at MIT, Max Tegmark, Elon Musk, and a few others that is asking AI companies to put a six-month hold on any further training of large language models, AI systems. Can you make the case for that kind of halt and against it?

• 2:01:08Manolis Kellis?

  So the big thing that we should be saying is, what did we use? What did we do the last six months when we saw that coming? And if we were completely inactive in the last six months, what makes us think that we'll be a little better in the next six months?

• 2:01:24Lex Fridman?

  Yeah.

• 2:01:24Manolis Kellis?

  So this whole six-month thing, I think, is a little silly. It's like, no, let's just get busy, do what we were going to do anyway. And we should have done it six months ago. Sorry, we messed up. Let's work faster now. Because if we basically say, why don't you guys pause for six months? And then, you know, we'll think about doing something in six months will be exactly the same spot. So my answer is, tell us exactly what you were going to do the next six months. Tell us why you didn't do it the last six months and why the next six months will be different. And then, let's just do that. Conversely, as you train these large models with more parameters, the alignment becomes sometimes easier. That as the systems become more capable,

• 2:02:08Manolis Kellis?

  they actually become less dangerous than more dangerous. So in a way, it might actually be counterproductive to sort of fix the March 2023 version and not get to experience the possibly safer September 2023 version.

• 2:02:24Lex Fridman?

  That's actually a really interesting thought. There's several interesting thoughts there. But the idea is that this is the birth of something that is sufficiently powerful to do damage and is not too powerful to do irreversible damage. At the same time, it's sufficiently complex to be able for us to enable to study it. So we can investigate all the different ways it goes wrong, all the different ways we can make it safer, all the different policies from a government perspective that we want to in terms of regulation or not, how we perform, for example, the reinforcement learning

• 2:03:05Lex Fridman?

  with human feedback in such a way that gets it to not do as much hate speech as it naturally wants to, all that kind of stuff. And have a public discourse and enable the very thing that you're a huge proponent of, which is diversity. So give time for other companies to launch other models, give time to launch open source models and to start to play where a lot of the research community, brilliant folks such as yourself, start to play with it before it runs away in terms of the scale of impact it has on society.

• 2:03:40Manolis Kellis?

  My recommendation would be a little different. It would be let the Google and the Meta, Facebook and all of the other large models, make them open, make them transparent, make them accessible. Let OpenAI continue to train larger and larger models, let them continue to train larger and larger models. Let the world experiment with the diversity of AI systems rather than sort of fixing them now. And you can't stop progress. Progress needs to continue, in my view. And what we need is more experimenting, more transparency, more openness.

• 2:04:16Manolis Kellis?

  Rather than, oh, OpenAI is ahead of the curve. Let's stop it right now until everybody catches up. I think that doesn't make complete sense to me. The other component is, we should, yes, be cautious with it. And we should, like, not give it the nuclear codes. As we make more and more plugins, yes, the system will be capable of more and more things. But right now, I think of it as just an extremely able and capable assistant that has these emergent behaviors, which are stunning, rather than something that will suddenly escape the box and shut down the world. And the third component is that we should be taking a little bit more responsibility for how we use these systems.

• 2:05:00Manolis Kellis?

  Basically, if I take the most kind human being and I brainwash them, I can get them to do hate speech overnight. That doesn't mean we should stop any kind of education of all humans. We should stop misusing the power that we have over these influenceable models. So I think that the people who get it to do hate speech, they should take responsibility for that hate speech. I think that giving a powerful car to a bunch of people or giving a truck or a garbage truck should not basically say, oh, we should stop all garbage trucks until we, like, because we can run one of them into a crowd. No, people have done that. And there's laws and there's, like, regulations against, you know, running trucks into the crowd.

• 2:05:44Manolis Kellis?

  Trucks are extremely dangerous. We're not going to stop all trucks until we make sure that none of them runs into a crowd. No, we just have laws in place and we have mental health in place and we take responsibility for our actions when we use these otherwise very beneficial tools, like garbage trucks, for nefarious uses. So in the same way, you can't expect a car to never, you know, do any damage when used in especially, like, specifically malicious ways. And right now, we're basically saying, oh, well, we should have this super intelligent system. It can do anything, but it can't do that. I'm like, no, it can do that, but it's up to the human to take responsibility for not doing that. And when you get it to, like, spew malicious, like, hate speech stuff. You should be responsible.

• 2:06:30Lex Fridman?

  So there's a lot of tricky nuances here that makes this different because it's software. So you can deploy it at scale and it can have the same viral impact that software can. So you can create bots that are human like and they can do a lot of really interesting stuff. So the raw GPT four version, you can ask, how do I tweet that I hate? They have this in the paper.

• 2:06:56Manolis Kellis?

  Yeah, I remember.

• 2:06:56Lex Fridman?

  That I hate Jews in a way that's not going to get taken down by Twitter. You can literally ask that. Or you can ask, how do I make a bomb for $1?

• 2:07:06Manolis Kellis?

  Yeah.

• 2:07:06Lex Fridman?

  And if it's able to generate that knowledge.

• 2:07:11Manolis Kellis?

  Yeah, but at the same time, you can Google the same things.

• 2:07:13Lex Fridman?

  It makes it much more accessible. So the scale becomes interesting because if you can do all this kind of stuff in a very accessible way at scale where you can tweet it. There is the network effects that we have to start to think about.

• 2:07:29Manolis Kellis?

  Yeah.

• 2:07:29Lex Fridman?

  It fundamentally is the same thing, but the speed of the viral spread of the information that's already available might have a different level of effect.

• 2:07:41Manolis Kellis?

  I think it's an evolutionary arms race. Nature gets better at making mice and engineers get better at making mousetraps. And, um, you know, as, as basically you ask it, hey, can, how can I evade Twitter censorship? Well, you know, Twitter should just update its censorship so that you can catch that as well.

• 2:07:57Lex Fridman?

  And so no matter how fast that development happens, the, the defense will just get faster.

• 2:08:03Manolis Kellis?

  Yeah, we just have to be responsible as human beings and kind to each other.

• 2:08:09Lex Fridman?

  Yeah, but there's a technical question. Can we always win the race? And I suppose there's no ever guarantee that we'll win the race.

• 2:08:16Manolis Kellis?

  We will never, like, you know, with my wife, we were basically saying, hey, are we ready for kids? My answer was, I was never ready to become a professor and yet I became a professor. And I was never ready to be a dad. And then guess what? The kid came and like I became ready. So ready or not, here I come.

• 2:08:32Lex Fridman?

  But the reality is we might one day wake up and there's a, a challenge overnight that's extremely difficult. For example, We can wake up to the birth of billions of bots that are human-like on Twitter. And we can't tell the difference between human and machine.

• 2:08:52Manolis Kellis?

  Shut them down.

• 2:08:53Lex Fridman?

  But you don't know how to shut them down.

• 2:08:57Lex Fridman?

  There's a fake Manolis on Twitter that seems to be as real as the real Manolis.

• 2:09:03Manolis Kellis?

  Yeah.

• 2:09:04Lex Fridman?

  How do we figure out which one is real?

• 2:09:06Manolis Kellis?

  Again, this is a problem where an A4 is human, can impersonate me, and you might have trouble telling them apart. Just because it's an AI doesn't make it any different of a problem.

• 2:09:15Lex Fridman?

  But the scale you can achieve, this is the scary thing, is the speed and the speed with which you can achieve it.

• 2:09:22Manolis Kellis?

  But Twitter has passwords and Twitter has usernames. And if it's not your username, the fake Lex Breidman is not going to have a billion followers, et cetera.

• 2:09:33Lex Fridman?

  I mean, this, all of this becomes, so both the hacking of people's accounts, first of all, like phishing, becomes much easier.

• 2:09:42Manolis Kellis?

  But that's already a problem. It's not like AI will not change that.

• 2:09:45Lex Fridman?

  No, no, no, no. AI makes it much more effective. Currently, the emails, the phishing scams are pretty dumb. Like, to click on it, you have to be not paying attention. But there, you know, with with language models, they can be really damn convincing.

• 2:10:03Manolis Kellis?

  So what you're saying is that we never had humans smart enough to make a great scam, and we now have an AI that's smarter than most humans or all of the humans.

• 2:10:11Lex Fridman?

  Well, this is the big difference, is there seems to be human-level linguistic capabilities.

• 2:10:18Manolis Kellis?

  Yeah, and in fact, superhuman level.

• 2:10:20Lex Fridman?

  Superhuman level.

• 2:10:21Manolis Kellis?

  It's like saying, I'm not gonna allow, I'm not gonna allow machines to compute multiplications of 100-digit numbers because humans can't do it. Like, no, just do it. Don't miss it.

• 2:10:32Lex Fridman?

  No, but we can't disregard, I mean, that's a good point, but we can't disregard the power of language in human society. I mean, yes, you're right. But that seems like a scary new reality. We don't have answers for yet.

• 2:10:45Manolis Kellis?

  I remember when Gary Kasparov was basically saying, you know, great, you know, chess beats you like chess machines beat humans at chess.

• 2:10:53Lex Fridman?

  Yeah.

• 2:10:54Manolis Kellis?

  You know, are you like, are people going to still go to chess tournaments? And his answer was, you know, well, we have cars that go much faster than humans, and yet we still go to the Olympics to watch humans run.

• 2:11:04Lex Fridman?

  That's for entertainment, but what about for the spread of information and news, right? What that has to do with the pandemic or the political election or anything is it is a scary reality where there's a lot of convincing bots that are human like telling us stuff.

• 2:11:20Manolis Kellis?

  I think that if we want to regulate something, it shouldn't be the training of these models. It should be the utilization of these models for X, Y, Z activity. So.

• 2:11:28Lex Fridman?

  Yeah.

• 2:11:29Manolis Kellis?

  Like, yes, guidelines and guards should be there, but against specific set of utilizations.

• 2:11:36Lex Fridman?

  Sure.

• 2:11:36Manolis Kellis?

  I think simply saying, we're not going to make any more trucks is not the way.

• 2:11:41Lex Fridman?

  That's what people are a little bit scared about the idea. They're very torn on the open sourcing.

• 2:11:45Manolis Kellis?

  Yeah, yeah.

• 2:11:46Lex Fridman?

  The very people that kind of are proponents of open sourcing have also spoken out, in this case, we want to keep a closed source. Because there's going to be, you know, putting large language models, pre-trained, fine tuned through RL with human feedback, putting in the hands of, I don't know, terrorist organizations of a kid in a garage who just wants to have a bit of fun through trolling. It's a scary world because again, scale can be achieved. And we, the bottom line is, I think where they're asking six months or some time is we don't really know how powerful these things are. It's been just a few days and they seem to be really damn good.

• 2:12:30Manolis Kellis?

  I am so ready to be replaced. Seriously, I'm so ready. Like you have no idea how excited I am.

• 2:12:36Lex Fridman?

  In a positive way, meaning like.

• 2:12:37Manolis Kellis?

  Positive way, where basically all of the mundane aspects of my job and maybe even my, my full job. If, if it turns out that an AI is better, I find it very discriminative. To basically say you can only hire humans because they're inferior. I mean, that's ridiculous. That's discrimination. If an AI is better than me at training students, get me out of the picture. Just let the AI train the students. I mean, please. Because like, what do I want? Do I want jobs for humans? Or do I want better outcome for humanity?

• 2:13:07Lex Fridman?

  Yeah. So the basic thing is then you start to ask, what do I want for humanity? And what do I want as an individual? And as an individual, you want some basic survival. And on top of that, you want rich, fulfilling experiences.

• 2:13:20Manolis Kellis?

  That's exactly right. That's exactly right. And as an individual, I gained a tremendous amount from teaching at MIT. This is like an extremely fulfilling job. I often joke about if I were a billionaire in the stock market, I would pay MIT an exorbitant amount of money to let me work day in, day out, all night with the smartest people in the world. And that's what I already have. So that's a very fulfilling experience for me. But why would I deprive those students from a better advisor if they can have one? Take them.

• 2:13:52Lex Fridman?

  Well, I have to ask about education here. This is

• 2:13:57Lex Fridman?

  this has been a stressful time for high school teachers.

• 2:14:02Lex Fridman?

  Teachers in general. How do you think large language models, even at their current state, are going to change education?

• 2:14:09Manolis Kellis?

  First of all, education is the way out of poverty. Education is the way to success. Education is what let my parents escape, you know, islands and sort of let their kids come to MIT. And this is a basic human right. Like, we should basically get extraordinarily better at identifying talent across the world and give that talent opportunities. So we need to nurture the nature. We need to nurture the talent across the world. And there's so many incredibly talented kids who are just sitting in underprivileged places in, you know, Africa, in Latin America, in the middle of America, in Asia, all over the world.

• 2:14:53Manolis Kellis?

  We need to give these kids a chance. AI might be a way to do that. By sort of democratizing education, by giving extraordinarily good teachers who are malleable, who are adaptable to every kid's specific needs, who are able to give the incredibly talented kid something that they struggle with, rather than education for all. We teach to the top and we let the bottom behind, or we teach to the bottom and we let the top, you know, drift off. Have, you know, education be tuned to the unique talents of each person. Some people might be incredibly talented at math or in physics, others in poetry, in literature, in art, in, you know, sports, in, you know, you name it.

• 2:15:37Manolis Kellis?

  So I think AI can be transformative for the human race if we basically allow education to sort of be pervasively altered. I also think that humans thrive on diversity, basically saying, oh, you're extraordinarily good at math, we don't need to teach math to you, we're just gonna teach you history now. I think that's silly. No, you're extraordinarily good at math, let's make you even better at math. Because we're not all gonna be growing our own chicken and hunting our own pigs, or whatever they do. We're, uh, you know, the reason why we're a society is because some people are better at some things and they're, they have natural inclinations to some things, some things fulfill them, some things they're very good at, sometimes both align and they're very good at the things

• 2:16:22Manolis Kellis?

  that fulfill them. We should just like push them to the limits of human capabilities for those. And, um, you know, if some people excel in math, just like challenge them. I think every, every child should have the right to be challenged. And if we, you know, if we say, oh, you're very good already, so we're not gonna bother with you, we're taking away that fundamental right to be challenged. Because if a kid is not challenged at school, they're gonna hate school and they're gonna be like dwiddling rather than sort of pushing themselves. So that's sort of the education component. The other impact that AI can have is maybe we don't need everyone to be an extraordinarily good programmer. Maybe we need better general thinkers.

• 2:17:07Manolis Kellis?

  And the push that we've had towards these sort of very strict IQ-based, you know, uh, tests that basically test, you know, only quantitative skills and programming skills and math skills and physics skills, maybe we don't need those anymore, maybe AI will be very good at those. Maybe what we should be training is general thinkers. And yes, you know, like, you know, I put my kids through Russian math. Why do I do that? Because it teaches them how to think. And that's what I tell my kids, I'm like, you know, AI can compute for you, you don't need that, but what you need is learn how to think and that's why you're here. And

• 2:17:44Manolis Kellis?

  I think challenging students with more complex problems, with more multidimensional problems, with more logical problems, I think is sort of perhaps a very fine direction that education can go towards.

• 2:17:58Manolis Kellis?

  With the understanding that a lot of the traditionally, you know, scientific disciplines perhaps will be more easily solved by AI. And sort of thinking about bringing up our kids to be productive, to be contributing to society, rather than to only have a job because we prohibited AI from having those jobs, I think is the way to the future. And if you sort of focus on overall productivity, then let the AIs come in, let everybody become more productive. What I told my students is, you're not going to be replaced by AI, but you're going to be replaced by people who use AI in your job.

• 2:18:41Manolis Kellis?

  So embrace it, use it as your partner and work with it, rather than sort of forbid it. Because I think the productivity gains will actually lead to a better society. And that's something that humans have been traditionally very bad at. Every productivity gain has led to more inequality. And I'm hoping that we can do better this time. That basically, right now, a democratization of these types of productivity gains will hopefully come with better sort of humanity level,

• 2:19:14Manolis Kellis?

  improvements in human condition.

• 2:19:16Lex Fridman?

  So as most people know, you're not just an eloquent romantic, you're also a brilliant computational biologist, biologist, one of the great biologists in the world. I had to ask, how do the language models, how do these large language models and the advancements in AI affect the work you've been doing?

• 2:19:35Manolis Kellis?

  So it's truly remarkable to be able to encapsulate this knowledge and sort of build these knowledge graphs and build representations of this knowledge in these sort of very high dimensional spaces, being able to project them together jointly between, say, single cell data, genetics data, expression data. Being able to bring all these knowledge together allows us to... Truly dissect disease in a completely new kind of way. And what we're doing now is using these models. So we have this wonderful collaboration. We call it Drug GWAS with Brad Penteluto in the chemistry department and Marin Kozinik in Harvard Medical School. And what we're trying to do is effectively connect all of the dots to effectively cure

• 2:20:20Manolis Kellis?

  all of disease. So it's no small challenge. But we're kind of starting with genetics. We're looking at how genetic variants are impacting these molecular phenotypes, how these are shifting from one space to another space, how we can kind of understand, the same way that we're talking about language models having personalities that are crosscutting, being able to understand contextual learning. So Ben Linger is one of my machine learning students. He's basically looking at how we can learn cell-specific networks across millions of cells, where you can have the context of the biological variables of each of the cells be encoded as an orthogonal component to the specific network of each cell type.

• 2:21:05Manolis Kellis?

  And being able to sort of project all of that into sort of a common knowledge space is transformative for the field. And then large language models have also been extremely helpful for structure. If you understand protein structure through modeling of geometric relationships, through geometric deep learning and graph neural networks. So one of the things that we're doing with Marinca is trying to sort of project these structural graphs at the domain level rather than the protein level, along with chemicals, so that we can start building specific chemicals for specific protein domains. And then we are working with the chemistry department and Brad to basically synthesize those.

• 2:21:45Manolis Kellis?

  So what we're trying to create is this new center at MIT for genomics and therapeutics that basically says, can we facilitate this translation? We have thousands of these genetic circuits that we have uncovered. I mentioned last time in the New England Journal of Medicine, we had published this dissection of the strongest genetic association with obesity. And we showed how you can manipulate that association to switch back and forth between fat burning cells and fat storing cells. In Alzheimer's, just a few weeks ago, we had a paper in Nature in collaboration with Li Hui-Tai looking at ApoE4, the strongest genetic association with Alzheimer's. And we showed that it actually leads to a loss of being able to transport cholesterol

• 2:22:28Manolis Kellis?

  in myelinating cells known as oligodendrocytes that basically protect the neurons. And where the cholesterol gets stuck inside the oligodendrocytes, it doesn't form myelin, the neurons are not protected, and it causes damage inside the oligodendrocytes. If you just restore transport, you basically are able to restore myelination in human cells and in mice, and to restore cognition in mice. So all of these circuits are basically now giving us handles to truly transform the human condition. We're doing the same thing in cardiac disorders, in Alzheimer's, in neurodegenerative disorders, in psychiatric disorders, where we have now these thousands of circuits that if we manipulate them, we know we can reverse disease circuitry.

• 2:23:11Manolis Kellis?

  So what we want to build in this coalition that we're building is a center where we can now systematically test these underlying molecules in cellular models for heart, for muscle, for fat, for macrophages, immune cells, and neurons, to be able to now screen through these newly designed drugs through deep learning, and to be able to sort of ask which ones act at the cellular level, which combinations of treatments should we be using? And the other component is that we're looking into decomposing complex traits like Alzheimer's and cardiovascular and schizophrenia into hallmarks of disease. So that for every one of those traits, we can kind of start speaking the language of

• 2:23:56Manolis Kellis?

  what are the building blocks of Alzheimer's? And maybe this patient has building blocks 1, 3, and 7, and this other one has 2, 3, and 8. And we can now start prescribing drugs, not for the disease anymore, but for the hallmark. And the advantage of that is that we can now take this modular approach to disease. Instead of saying there's going to be a drug for Alzheimer's, which is going to fail in 80% of the patients, we're going to say now there's going to be 10 drugs, one for each pathway. And for every patient, we now prescribe the combination of drugs. So what we want to do in that center is basically translate every single one of these pathways Into a set of therapeutics, a set of drugs that are projecting the same embedding

• 2:24:40Manolis Kellis?

  subspace as the biological pathways that they alter, so that we can have this translation between the dysregulations that are happening at the genetic level, at the transcription level, at the drug level, at the protein structure level, and effectively take this modular approach to personalized medicine, where saying, "I'm going to build a drug for Lex Fridman," is not going to be sustainable. But if you instead say, "I'm going to build a drug for this pathway and a drug for that other pathway," millions of people share each of these pathways. So that's the vision for how all of this AI and deep learning and embeddings can truly transform biology and medicine, where we can truly take these systems

• 2:25:22Manolis Kellis?

  and allow us to finally understand disease at a superhuman level by sort of finding these knowledge representations, these projections of each of these spaces, and try understanding the meaning of each of those embedding subspaces, and sort of how well populated it is, what are the drugs that we can build for it, and so forth. So it's truly transformative.

• 2:25:44Lex Fridman?

  So systematically find how to alter the pathways. It maps the structured information that genomics to therapeutics and allows you to have drugs that look at the pathways, not at the final condition.

• 2:25:58Manolis Kellis?

  Exactly, exactly. And the way that we're coupling this is with cell-penetrating peptides that allows to deliver these drugs to specific cell types by taking advantage of the receptors of those cells. We can intervene at the antisense oligo level by basically repressing the RNA, bring in new RNA, intervene at the protein level, at the small molecule level. We can use proteins themselves as drugs, just because of their ability to interfere, to interact directly from protein to protein interactions. So I think this space is being completely transformed with the marriage of high-throughput technologies and all of these like AI, large language models, deep learning models, and so on and so forth.

• 2:26:36Lex Fridman?

  You mentioned your updated answer to the meaning of life, as it continuously keeps updating. The new version is self-actualization.

• 2:26:47Lex Fridman?

  Can you explain?

• 2:26:48Manolis Kellis?

  I basically mean, let's try to figure out, number one, what am I supposed to be? And number two, find the strength to actually become it. So I was recently talking to students about this commencement address. And I was talking to them about sort of how they have all of these paths ahead of them right now. And part of it is choosing the direction which you go. And part of it is actually doing the walk to go in that direction. And in doing the walk, what we talked about earlier about sort of you create your own environment. I basically told them, listen, you're you're ending high school up until now. Your parents have created all of your environment. Now it's time to take that into your own hands and to sort of shape the environment that you want to be an adult in.

• 2:27:32Manolis Kellis?

  And you can do that by choosing your friends, by choosing your particular neuronal routines. I basically think of your brain as a muscle where you can exercise specific neuronal pathways. So very recently, I realized that, you know, I was having so much trouble sleeping. And, you know, I would wake up in the middle of the night. I would wake up at four AM and I could just never go back to bed. So I was basically constantly losing, losing, losing sleep. I started a new routine where every morning, as I bike in, instead of going to my office, I hit the gym. I basically go rowing first, I then do weights, I then swim very often when I have time. And what that has done is transform my neuronal pathways.

• 2:28:14Manolis Kellis?

  So basically, like on Friday, I was trying to go to work and I was like, listen, I'm not gonna go exercise. And I couldn't. My bike just went straight to the gym, like, I don't want to do it. And I just went anyway, because I couldn't, I couldn't do otherwise. And that has completely transformed me. So I think this sort of beneficial effect of exercise on the whole body is one of the ways that you could transform your own neural pathways. Understanding that it's not a choice, it's not an option, it's not optional. It's mandatory. And I think you're role modeled so many of us by sort of being able to sort of push your body to the extreme, being able to have these extremely regimented regimes. And that that's something that I've been terrible at. But now I'm basically trying to coach myself and trying to sort of, you know, finish

• 2:28:58Manolis Kellis?

  this kind of self-actualization into a new version of myself, a more disciplined version of myself.

• 2:29:04Lex Fridman?

  Don't ask questions, just follow the the ritual.

• 2:29:07Manolis Kellis?

  Not not an option.

• 2:29:10Lex Fridman?

  You have so much love in your life. You radiate love. Do you ever feel lonely?

• 2:29:17Manolis Kellis?

  So I, there's different types of people. Some people drain in gatherings. Some people recharge in gatherings. I'm definitely the recharging type.

• 2:29:29Manolis Kellis?

  I'm an extremely social creature. I recharge with intellectual exchanges. I recharge with physical exercise. I recharge in nature. But I also can feel fantastic when I'm the only person in the room. That doesn't mean I'm lonely. It just means I'm the only person in the room. And I think there's a secret to not feeling alone when you're the only one. And that secret is self-reflection. It's introspection. It's almost watching yourself from above. And it's basically just becoming yourself, becoming comfortable with the freedom that you have when you're by yourself.

• 2:30:10Lex Fridman?

  So hanging out with yourself. I mean, there's, there's a lot of people who write to me, who talk to me about feeling alone in this world that struggle, especially when they're younger. Is there further words of advice you can give to them when they are almost paralyzed by that feeling?

• 2:30:27Manolis Kellis?

  So I sympathize completely. And I have felt alone and I have felt that, that feeling. And what I would say to you is stand up, stretch your arms, just like become your own self. Just like realize that you have this freedom and breathe in. Walk around the room, take a few steps in the room, just like get a feeling for the 3D version of yourself. Because very often we're kind of stuck to a screen and that's very limiting and that sort of gets us in a particular mindset. But activating your muscles, activating your body, activating your, your full self is one way that you can kind of get out of it. And that is exercising your freedom, reclaiming your physical space.

• 2:31:13Manolis Kellis?

  And one of the things that I do is I have something that I call me time, which is if I've been really good all day, I got up in the morning, I got the kids to school, I made them breakfast, I sort of, you know, hit the gym, I, I had a series of really productive meetings, I reward myself with this me time. And that, that feeling of sort of when you're overstretched to realize that that's normal and you just want to just let go, that feeling of exercising your freedom, exercising your me time. That's where you free yourself from all stress. You basically say it's not a need to anymore. It's a want to.

• 2:31:55Manolis Kellis?

  And as soon as I click that me time, all of the stress goes away. And I just bike home early and I get to my work office at home. And I feel complete freedom, but guess what I do with that complete freedom? I just don't go off and drift and do boring things. I basically now say, okay, this is just for me. I'm completely free. I don't have any requirements anymore. What do I do? I just look at my to do list and I'm like, you know, what can I clear off? And if I have three meetings scheduled in the next three half hours, it is so much more productive for me to say, you know what? I just want to pick up the phone now and call these people and just knock it off one after the other.

• 2:32:37Manolis Kellis?

  And I can finish three half hour meetings in the next 15 minutes just because it's the want, not I have to. So that would be my advice. Basically turn something that you have to do in just me time, stretch out, exercise your freedom and just realize you live in 3D and you are a person and just do things because you want them, not because you have to.

• 2:33:02Lex Fridman?

  Noticing and reclaiming the freedom that each of us have. That's what it means to be human. If you notice it, you're truly free physically, mentally, psychologically. Manolis, you're an incredible human. We could talk for many more hours. We covered less than 10% of what we were planning to cover, but we have to run off now to the social gathering that we spoke of. With 3D humans. With 3D humans. And reclaim the freedom. I think, I hope we can talk many, many more times. There's always a lot to talk about, but more importantly, you're just a human being with a big heart and a beautiful mind that people love hearing from.

• 2:33:47Lex Fridman?

  And I certainly. Consider it a huge honor to know you and to consider you a friend. Thank you so much for talking today. Thank you so much for talking so many more times. And thank you for all the love behind the scenes that you send my ways. It always means the world.

• 2:33:59Manolis Kellis?

  Lex, you are a truly, truly special human being. And I have to say that I'm honored to know you. I have like so many friends are just in awe that you even exist, that you have the ability to do all the stuff that you're doing. And I think you're a gift to humanity. I love the mission that you're on to sort of share knowledge and insight and deep thought with so many special people who are transformative, but people across all walks of life. And, and I think you're doing this in just such a magnificent way. I wish you strength to continue doing that because it's a very special mission and it's a very draining mission. So, thank you, both the human you and the robot you. The human you for showing all this love and the robot you for doing it day after day after day. So, thank you, Lex.

• 2:34:42Lex Fridman?

  All right, let's go have some fun.

• 2:34:44Manolis Kellis?

  Let's go.

• 2:34:45Lex Fridman?

  Thanks for listening to this conversation with Manolis Callas. To support this podcast, please check out our sponsors in the description. And now, let me leave you with some words from Bill Bryson in his book, A Short History of Nearly Everything. If this book has a lesson, it is that we are awfully lucky to be here. And by we, I mean every living thing. To attain any kind of life in this universe of ours appears to be quite an achievement. As humans, we're doubly lucky, of course. We enjoy not only the privilege of existence, but also the singular ability to appreciate it and even in a multitude of ways to make it better. It is a talent we have only barely begun to grasp.

• 2:35:32Lex Fridman?

  Thank you for listening and hope to see you next time.