Rage Against The Machines: Yuval Noah Harari On Surviving AI, The History Of Information, And The Future Of Humanity

Yuval Noah Harari is a renowned historian, bestselling author of “Sapiens” and “Homo Deus,” and the mind behind the new book, “Nexus.” This conversation explores AI’s impact on society through Yuval’s unique historical lens. We discuss AI as “alien intelligence,” information’s role in shaping political systems, embracing uncertainty, institutional trust, and finding clarity amid rapid change. His analysis of our collective human psyche in the AI era is profound and revelatory. Yuval is a treasure trove of wisdom. This one is enlightening and sobering. Enjoy! Show notes + MORE Watch on YouTube Newsletter Sign-Up Today’s Sponsors: Roka: Unlock 20% OFF your order with code RICHROLL 👉ROKA.com/RICHROLL Whoop: Get a FREE one month trial 👉join.whoop.com/roll AG1: Get a FREE bottle of Vitamin D3+K2 AND 5 free AG1 Travel Packs 👉drinkAG1.com/richroll On: High-performance shoes & apparel crafted for comfort and style 👉on.com/richroll Bon Charge: Get 15% OFF my favorite wellness tools & more 👉boncharge.com/richroll Airbnb: Your home might be worth more than you think. Find out how much 👉 airbnb.com/host Check out all of the amazing discounts from our Sponsors 👉 richroll.com/sponsors Find out more about Voicing Change Media at voicingchange.media and follow us @voicingchange Learn more about your ad choices. Visit podcastchoices.com/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Rich Roll?

  Eating well rarely falls apart because of one big failure. It's the daily question that wears you down. Like, what am I actually gonna make tonight? What's in the fridge? And it's exactly why we built the Plant Power Meal Planner. It's a personalized, plant-based meal planning program that matches you with recipes based on your taste, your allergies, your cooking skills, and how much time you actually have. You build, through this program, a balanced, nutrient-dense plan for your entire household in a few minutes. Then it generates a grocery list for you with one click that plugs right into our delivery partners. All the recipes in the program are built by dietitians with culinary training. Plus, you get your own food coach to help you problem-solve along the way.

• 0:44Rich Roll?

  It's kind of an amazing thing. For listeners of the show, all you special people, we're offering an exclusive $20 off an annual subscription right now. To get it, go to meals.richroll.com, take your quick personalization quiz, and enter promo code RICHROLL20 at checkout.

• 1:05Yuval Noah Harari?

  Most people around the world are still not aware of what is happening on the AI front. It can invent medicines and treatments we never thought about, but it can also invent weapons that go beyond our imagination. You're changing the basis of everything. It's no wonder there is an earthquake in the structure that is built on top of it.

• 1:27Rich Roll?

  I got news for you, people. The rise of the machines is already upon us. So what exactly do we need to understand about the rapid ascent of artificial intelligence? What is this revolution augur for the future of the human species? To gain clarity amidst the confusion, I'm joined today by Yuval Noah Harari, a world-renowned historian and mega bestselling author whose landmark books on the history and future of humanity have sold an astonishing 45 million copies and made him the public intellectual of our time.

• 2:01Yuval Noah Harari?

  This is the first time that we are basically about to enter a non-human culture. The big question is whether we will force it to slow down, or it will force us to speed up until the moment we collapse and die.

• 2:16Rich Roll?

  His latest book and the terrain for today's conversation is Nexus, an absolutely essential read that makes quite a compelling case for why artificial intelligence will be the biggest disruption in the history of civilization.

• 2:31Yuval Noah Harari?

  AIs can make decisions. They are not just tools in our hands, they are agents, creating new realities. It's very difficult to appreciate the dangers, because the dangers, they are kind of alien. In the Hollywood scenario, you have the killer robots shooting people. In real life, it's the humans pulling the trigger, but the AI is choosing the targets.

• 2:59Rich Roll?

  Thank you for coming. I appreciate you being here today. I'm excited to unpack what I think is a really revelatory book, a very important book that speaks to perhaps the most vital issue of our time. And in reflecting upon it, I was thinking back on Homo Deus, which came out in 2015, 16. And in that book, you address AI, but at that time, it was as if you were sounding an alarm on a future story that had yet to be written, right?

• 3:31Yuval Noah Harari?

  Yeah.

• 3:31Rich Roll?

  And perhaps it came off a bit Cassandra, you know, in that moment. And I'm curious, as we find ourselves now in 2024, eight, nine years later, it's as if not only are we, you know, kind of on the cusp of this new revolution, we're mired in it in a way that perhaps even is far more intense than even you predicted at that time.

• 3:54Yuval Noah Harari?

  Yeah, I mean, things have been moving much, much faster than I think any of us predicted. And you know, in 2016, AI was like this tiny cloud on the horizon that might arrive in decades or even centuries. And here we are in 2024, and the storm is kind of upon us. And I think maybe the most important thing is really to understand what AI is. Because now there is so much hype around AI that it's becoming difficult for people to understand what is AI. Now, everything is AI, you know, especially in the markets, in the investment world. They attach the tag AI to just about anything in order to sell it.

• 4:38Yuval Noah Harari?

  So you know, your coffee machine is now a coffee machine. It is an AI coffee machine, and your shoes are AI shoes. And what is AI? So, you know, the key thing to understand is that AIs are able to learn and change by themselves, to make decisions by themselves, to invent new ideas by themselves. If a machine cannot do that, it's not really an AI. So a coffee machine that just makes you coffee automatically, but by a pre-programmed way, and it never learns anything new, it's just an automatic machine. It's not an AI. It becomes an AI if, as you approach the coffee machine, the machine, before you press any button,

• 5:22Yuval Noah Harari?

  addresses you and says to you, "I've been watching you for the last weeks or months, and based on everything I've learned about you and your facial expression and the time of day and so forth, I predict you would like an espresso. So I already took the liberty to make a cup for you." It made the decision independently, and it's really an AI. If it then tells you, "Actually, I've invented a new machine, and a new beverage, a new drink that no human ever thought about before. I call it best presso, and I think it's better than espresso you would like more. And I took the liberty to prepare a cup for you."

• 6:03Yuval Noah Harari?

  Then it's really an AI, something that can make decisions and invent new ideas by itself. And therefore, by definition, something that we cannot predict how it will develop and evolve, and for good or for bad. It can invent medicines and treatments we never thought about, but it can also invent weapons and dangerous strategies that go beyond our imagination.

• 6:29Rich Roll?

  You characterize AI not as artificial intelligence, but as alien intelligence. You give it a different term. Can you explain the difference there and why you've landed on that word?

• 6:41Yuval Noah Harari?

  Traditionally, the acronym AI stood for artificial intelligence. But with every passing year, AI becomes less artificial and more alien. Alien, not in the sense that it's coming from outer space, it's not. We create it. But alien in the sense it analyzes information, makes decisions, invents new things in a fundamentally different way than human beings. Again, artificial is from artifact. It gives us the impression that this is an artifact that we control, and this is misleading. Because, yes, we designed the kind of baby AIs. We gave them the ability to learn and change by themselves, and then we release them to the world,

• 7:26Yuval Noah Harari?

  and they do things that are not under our control, that are unpredictable. And in this sense, they are alien. And again, I mean, humans are organic entities, like other animals. We function organically. For instance, we function by cycles. Day and night, summer and winter, we're sometimes active, sometimes we need to rest, we need to sleep. AIs are alien in the sense that they are not organic. They function in a completely different way, not by cycles, and they don't need to rest, and they don't need to sleep. And now, as they take over more and more parts of reality, parts of society,

• 8:09Yuval Noah Harari?

  there is a kind of tug-of-war of who would be forced to adapt to whom. Would the inorganic AIs be forced to adapt to the organic cycles of the human body, of the human being? Or would humans be pressured into adopting this kind of inorganic lifestyle? And starting with the simplest thing, that AI are always on, but people need time to be off. So if you think even about something like the financial markets. Traditionally, if you look at Wall Street, it's open only Mondays to Fridays, 9:30 in the morning to 4 o'clock in the afternoon. It's off for the night. It's off for the weekends. It takes vacations on Christmas, on Independence Day.

• 8:54Yuval Noah Harari?

  And now, as algorithms and AIs are taking over the markets, they're always on. And this puts pressure on human bankers and investments and so forth. You can't take a minute off, because then you're left behind. So in this sense, they are alien, not in the sense that they came from Mars.

• 9:12Rich Roll?

  To understand artificial intelligence and to understand what is actually happening and where we're heading, the thesis of this latest book requires us to understand the nature of information itself and the formative ways in which the evolution of information networks are inextricable from the evolution and progress of humankind. So I'm curious about how you discovered that lens into kind of understanding the nature of artificial intelligence and why it's important to contextualize what is occurring right now through that perspective.

• 9:49Yuval Noah Harari?

  It's actually something I began exploring in previous books. The idea is that information is the most fundamental stratum, most fundamental basis of human society and of human reality. Because the human superpower is the ability to cooperate in very large numbers. If you compare us to chimpanzees, to elephants, to hyenas, individually, there are some things I can do that chimpanzee can't, and vice versa. Our big advantage is not on the individual level. The really big advantage is that chimpanzees can cooperate in, you know, a few dozen chimpanzees, like 50 chimpanzees can cooperate, maybe 100. But with humans, with Homo sapiens, there is no limit.

• 10:34Yuval Noah Harari?

  We can cooperate in thousands, in millions, in billions. If you think about the world trade network, like the food we eat, the shoes we wear, everything we consume, it sometimes comes from the other side of the world. So if you have eight billion people cooperating, and this is our big advantage over the chimpanzees and all the other animals, what makes it possible for us to cooperate with millions and billions of other human beings? It's information. Information is what holds all these large-scale systems together. And to understand human history is to a large extent to understand the flow of information. And I'll give an example.

• 11:16Yuval Noah Harari?

  If you think, for instance, about the difference between democracies and dictatorships. We tend to think about it as a difference or as a conflict between values, between ethical systems. Democracies believe in freedom, dictatorships believe in hierarchies, things like that. And which is true, as far as it goes. But on a deeper level, information flows differently. In democracies and dictatorships, it's a different shape, a different kind of an information network. In a dictatorship, all decisions are made centrally. Dictatorships come from dictate. One person dictates everything. Putin dictates everything in Russia. Kim Jong-un dictates everything in North Korea.

• 12:00Yuval Noah Harari?

  So all the information flows to a single hub, where all the decisions are being made and sent back as orders. So it's a very centralized information network. A democracy, on the other hand, if you look at it in terms of you're in outer space, looking at the flow of information in the United States, you will see several centers in the country. Washington, the political center. New York, the financial center. Los Angeles, there may be autistic center. But there is no single center that dictates everything. You have several centers. And you also have lots and lots of smaller hubs and centers where decisions are constantly being made.

• 12:44Yuval Noah Harari?

  Private corporations, private businesses, voluntary associations, individuals making lots of decisions, constantly exchanging information without that information ever having to pass through the center, through Washington, or even through New York, or even through Los Angeles. So just look, you don't know anything about the values of the people. You just imagine you're in outer space, in some spaceship or satellite, just observing the flow of information down below the planet. You will see that North Korea is very different in formation flow than the United States. And this is crucial to understand. And when you look at thousands of years of history

• 13:29Yuval Noah Harari?

  and how history changes and different regimes rise and fall, understanding what kind of information technology is available is a key to understanding which political systems or economic systems win. For most of history, a large-scale democracy like the United States was simply impossible. If you think about the ancient world, the only examples we know of democracy are small city-states like Republican Rome or like ancient Athens, or even smaller tribes. We don't have any example of a large-scale democracy of millions of people spread over a vast territory that functioned democratically. Now, we know the stories, for instance,

• 14:14Yuval Noah Harari?

  about the fall of the Roman Republic and the rise of the Caesars, of the emperors, of the autocrats. But it's really not the fault of Augustus Caesar or Nero or any of the other emperors that Rome became an autocratic empire.

• 14:31Yuval Noah Harari?

  Simply, there was no way that the information technology necessary to maintain a large-scale democracy, which is bigger than just the city of Rome, like the whole of Italy, or the whole of the Mediterranean. Democracy is a conversation. And how can millions of people, spread over thousands of kilometers, converse and decide whether to go to war with the Persian Empire? What to do about the immigration crisis on the Danube? With all these Germans trying to get in? You can't have a conversation because you don't have the information technology. And you know, if it was just the fault of Caesar, that Rome became an autocratic empire, we should have seen some other examples of a large-scale democracy

• 15:15Yuval Noah Harari?

  in India, in China, somewhere, but nowhere. We only begin to see large-scale democracies in the late modern era, after the rise of new information technologies, which were not available to the Romans, like the printed newspaper, and then the telegraph, and the radio, and television, and so forth. Once you have these technologies, you begin to see large-scale democracies like the United States. And one final point. Why is it so important to understand this? Once you understand that democracy is actually built on top of information technology, you also begin to understand the current crisis of democracy. Because, you know, now all over the world, not just in the US, we have a crisis of democracy.

• 16:00Yuval Noah Harari?

  And to a large extent, this is because there is a new information technology, social media, algorithms, AIs. And it's like, you know, you're changing the basis of everything. So it's no wonder there is an earthquake in the structure that is built on top of it.

• 16:17Rich Roll?

  So we have this idea that the advent or the improvement of information systems and information technology is part and parcel of the empowerment of democratic systems across the world. But built into that is this sort of indelible misconstrual of information, this assumption or presumption that more information is better and leads to truth and knowledge and wisdom. And your book kind of puts the lie to that and tells a very different story around not only the definition of information, but its purpose.

• 16:56Yuval Noah Harari?

  Yeah, I mean, information isn't truth. Information is connection. It's something that holds a lot of people together. And unfortunately, what we see in history, that it's often much easier to connect people, to create social order with the help of fiction and fantasy and propaganda and lies than with the truth. So most information is not true. The truth is a very rare subset of the information in the world. The problem of truth is that the truth, first of all, is costly, whereas fiction is very cheap. If you want to write a truthful history book

• 17:40Yuval Noah Harari?

  about the Roman Empire, for instance, you need to invest a lot, a lot of energy, time, money. You need to study Latin. You probably need to study Greek, ancient Greek. You need to do archaeological excavations and find these ancient, whether inscriptions or pottery or weapons, and analyze them. Very costly and difficult. To write a fictional story about the Roman Empire? Very easy, you just write anything you want and it's there on the page or on the internet. The truth is often also very complicated, because reality is complicated. You want to give a truthful explanation for why the Roman Republic failed or why the Roman Empire eventually failed. Very complicated.

• 18:22Yuval Noah Harari?

  Whereas fiction can be made as easy as as simple as possible. And people tend to prefer simple explanations over complicated ones. And finally, the truth can be painful, unattractive. We often don't want to know the truth about ourselves, whether as individuals, which is why we go to therapy for many years to know the things we don't want to know about ourselves, and also on the level of entire nations. You know, each nation has its own dark episodes, its own skeletons or cemeteries in the closet that people don't want to know about. A politician that, you know, in an election campaign would just tell people the truth, the whole truth and nothing but the truth, is unlikely to win many votes.

• 19:06Yuval Noah Harari?

  So in this competition between the truth, which is costly and complicated and sometimes painful, and fiction, which is cheap and simple and you can make it very attractive, fiction tends to win. And if you look at, you know, the large-scale systems, networks in history, they're often built on fictions, not on the truth. Maybe I give one example. If you think about visual information, like portraits, paintings, photographs. So what is the most common portrait in the world? What is the most famous face in the history of humanity? It is the face of Jesus.

• 19:51Yuval Noah Harari?

  I mean, there are more portraits of Jesus than of any other person in the history of the world. Billions and billions produced over centuries in cathedrals and churches and homes, and fully 100% of them are fictional. There is not a single authentic, truthful portrait of Jesus anywhere. We have no portrait of him from his own lifetime. The Bible doesn't say a single word about how he looked like. There is not a single word in the Bible, whether Jesus was tall or short, dark hair, or blond, or bald, nothing. All the images, and you know, it's one of the most famous faces in history, it all comes from the human imagination.

• 20:35Yuval Noah Harari?

  And it's still very successful in inspiring people and uniting people, could be for good purposes, you know, charity and building hospitals and helping the poor, but could also be for bad purposes: crusades, persecutions, inquisitions. But either way, the immense power of a fictional image to unite people. And going, looking at what's happening today in the world, so you have these, you know, big tech companies and social media companies that they tell us that all information is always good. So let's remove all restrictions on the flow of information and flood the world with more and more information. And more information would mean more truth,

• 21:18Yuval Noah Harari?

  more knowledge, more wisdom. And this is simply not true. Most information is actually junk. If you just flood the world with information, the truth will sink to the bottom. It will not rise to the top, again, because it's costly and complicated.

• 21:35Yuval Noah Harari?

  And you look around, we have this flood of information. We have the most sophisticated information technology in history. And people are losing the ability to hold a conversation, to talk and listen to one another. You know, in the United States, Republicans and Democrats are barely able to talk to each other. And it's not an American phenomenon. You see the same thing in Brazil, in France, in the Philippines, all over the world. Because again, the basic misconception is that more information is always good for us. It's like thinking that more food is always good for us.

• 22:11Rich Roll?

  And most information is junk information.

• 22:14Yuval Noah Harari?

  Yeah.

• 22:14Rich Roll?

  And what's curious to me about all of this is that on some level, what you're saying is there's nothing new about this. There is this idea that suddenly we've found ourselves in a post-truth world. And part of what you're saying is, it's kind of always been that way.

• 22:29Yuval Noah Harari?

  Yeah.

• 22:30Rich Roll?

  But the qualitative difference right now is not by definition, these platforms that allow us to share information as much as it is the algorithms that empower them, that make the decisions about what we're seeing and when we're seeing it.

• 22:44Yuval Noah Harari?

  Yeah, I mean, this is maybe the first place you see the power of AIs to make independent decisions in a way that reshapes the world. When I said earlier that, you know, AIs can make decisions. And AIs, they are not just tools in our hands. They are agents, creating new realities. So you may think, okay, this is a prophecy for the future, a prediction about the future. But it's already in the past. Because even though social media algorithms, they are very, very primitive AIs. Now, you know, the first generation of AIs, they still reshaped the world with the decisions they made. In social media, Facebook, Twitter, TikTok, all that,

• 23:29Yuval Noah Harari?

  the ones that make the decision what you will see at the top of your newsfeed or the next video that you'll be recommended, it's not a human being sitting there making these decisions. It's an AI, it's an algorithm. And these algorithms were given a relatively simple and seemingly benign goal by the corporations. The goal was increase user engagement, which means in simple English, make people spend more time on the platform. Because the more time people spend on TikTok or Facebook or Twitter or whatever, the company makes more money. It sells more advertisements. It harvests more data that it can then sell to third parties.

• 24:12Yuval Noah Harari?

  So more time on the platform, good for the company. This is the goal of the algorithm. Now, engagement sounds like a good thing. Who doesn't want to be engaged? But the algorithms then experimented on billions of human guinea pigs and discovered something, which was of course discovered even earlier by humans, but now the algorithms discovered it. The algorithms discovered that the easiest way to increase user engagement, the easiest way to grab people's attention and keep them glued to the screen is by pressing the greed or hate or fear button in our minds. You show us some hate-filled conspiracy theory and we become very angry, we want to see

• 24:57Yuval Noah Harari?

  more, we tell about it to all our friends, user engagement goes up. And this is what they did over the last 10 or 15 years. They flooded the world with hate and greed and fear, which is why again the conversation is breaking down. Very hard to hold the conversation with all this hate and fear.

• 25:17Rich Roll?

  Sure, yeah, it's a function of unintended consequences that on some level is no different than Nick Bostrom's alignment problem, thought experiment about paperclips. Like this is the exact same thing. And I think it speaks to not only human ignorance, but human hubris around this powerful technology. I think you know, you talk so much about stories and how indelible they are in terms of crafting our reality, but one of those stories is we know what we're doing, we can handle it, we understand the consequences, we know the downside here and we're making sure that what we're putting out into the world is is safe and consumer-friendly when

• 25:57Rich Roll?

  you know, on some level they know it's not, but also they have no idea, you know, what will become of it as a result. And so we're just in this frontier, this unregulated frontier where anything goes at the moment.

• 26:12Yuval Noah Harari?

  Yeah, I mean, and I think it's important what you said that these are kind of unintended consequences. Like, the people who manage the social media companies, they are not evil. They didn't set out to destroy democracy or to flood the world with hate and so forth. They just really didn't foresee that when they give the algorithm the goal of increasing user engagement, the algorithm will start to promote hate. And one of the first places that this happened- But let me just interject quickly on that. Now, now that they know that that's the case, it's not as if they're backtracking. That's true. I mean, now they know- They're not exactly regulation-friendly at the moment. No, absolutely not. All right, sorry, go ahead. You're right.

• 26:55Yuval Noah Harari?

  Now they know and they are not doing nearly enough. But initially, when they started this whole ball rolling, they really didn't know. And one of the places you saw it for the first time, this was, you know, eight years ago when I published a whole model, this was happening, I didn't pay attention to it either. In Myanmar, Burma, the country formerly known as Burma, Facebook was basically the internet and certainly the biggest social media platform. And in the 2010s, the algorithms of Facebook in Myanmar, they deliberately spread terrible conspiracy theories and fake news about the Rohingya minority in Myanmar, which led

• 27:38Yuval Noah Harari?

  to an ethnic, of course, it was not the only reason, there was deep-seated hatred towards Rohingya much before, but this kind of propaganda campaign online on Facebook contributed to an ethnic cleansing campaign- Sure. -between 2016 and 2017, 2018, in which thousands of Rohingya were killed, tens of thousands were raped, and hundreds of thousands were expelled. You now have close to a million Rohingya refugees in Bangladesh and elsewhere. And this was fueled to a large extent by these conspiracy theories and fake news on Facebook. And at the time, the executive of Facebook had no, I mean, they didn't know even the Rohingya existed.

• 28:22Yuval Noah Harari?

  It's not like it was a conspiracy of Facebook against them. For the whole of Myanmar- A country where Facebook had millions and millions of users, they by 2018, this is after they got reports of the of the ethnic cleansing campaign, they had just a handful of humans trying to kind of regulate the actions of millions of users and the algorithms. And they didn't even speak Burmese. Like when the algorithm chose, okay, I'll show people this hate-filled conspiracy theory video in Burmese, nobody in Facebook headquarters spoke Burmese. They had no idea what the algorithm was promoting.

• 29:08Yuval Noah Harari?

  The key thing is is not to absolve the humans from responsibility. It's to understand that even very primitive AIs, and we are talking about, you know, like eight years ago, not things like ChatGPT today. Still, the decisions made by these algorithms to promote certain content had far-reaching and terrible consequences. In Myanmar, they were not just producing conspiracy theories. They're producing, there are millions of users producing, you know, cooking lessons and biology lessons and sermons on compassion from Buddhist monks and conspiracy theories. And the algorithms made the decision to promote the conspiracy theories.

• 29:49Yuval Noah Harari?

  And this is just kind of a warning of look what happens with even very primitive AIs. And the AIs of today, which are far more sophisticated than in 2016, they too are still just the very early stages of the AI evolutionary process. Then we can think about it like the evolution of of animals. Until you get to humans, you have four billion years of evolution. You start with microorganisms like amoebas, and it took billions of years of evolution to get to dinosaurs and mammals and humans. Now, AIs are at present at the beginning of a parallel process.

• 30:30Yuval Noah Harari?

  The ChatGPT and so forth, they are the amoebas of the AI world. But AI evolution is not organic. It's inorganic, it's digital, and it's millions of times faster. So where it took billions of years to get from amoebas to dinosaurs, it might take just 10 or 20 years to get from the AI amoebas of today to AI T-Rex in 2040 or 2050.

• 30:57Rich Roll?

  Maybe even less.

• 30:58Yuval Noah Harari?

  Maybe even less.

• 30:58Rich Roll?

  We're talking about, I don't think our brains are organized properly to really comprehend the accelerated speed at which this is self-learning and iterating and improving upon itself. Like this, it's a compounding thing that is astronomical. Meanwhile, trillions of dollars are being spent to build these server farms with these Nvidia chips. And there's so much power required to keep these things going. They're talking about nuclear power. I mean, this is like, this is a whole new world. And yet, in talking about it, it still feels somewhat like an academic exercise. Because for myself, or somebody who might be watching or listening,

• 31:39Rich Roll?

  their experience with AI comes in the form of ChatGPT or some of these helpful tools. Like, I like my algorithm. It shows me the kind of products that I want to buy without having to search for it. And a simple example would be preparing for this podcast. Like, I listened to your book on audiobook, and I'm doing what I usually do, pulling up a bunch of tabs and, you know, like, just collating a bunch of information on you and the book and the message that you're putting out. But I did something I had never done before, which is I got a PDF of Nexus and I uploaded it to a tool called Notebook LM. And that tool then synopsized the entire book and created a chatbot where I could ask it questions about your book

• 32:23Rich Roll?

  and ask it to elaborate on certain concepts. And it will even create a podcast conversation between two people about the subject matter of the book. So even this conversation is at risk, right?

• 32:35Yuval Noah Harari?

  It's now irrelevant, yeah.

• 32:36Rich Roll?

  And I'm like, wow, that's kind of a remarkably helpful tool. And it's easy to, to, you know, just not really appreciate or connect with the downside risk and power of these tools and where they're leading us. So I think what I'm saying is, I guess the point I'm trying to make is consumers, like all of us, we're being lured into a trust of something so powerful we can't comprehend and are ill-equipped to be able to kind of cast our gaze into the future and imagine where this is leading us.

• 33:10Yuval Noah Harari?

  Absolutely. I mean, part of it is that there is enormous positive potential in AI. It's not like it's all doom and gloom. There is really enormous positive potential if you think about the implications for healthcare, that, you know, AI doctors available 24 hours a day that know our entire medical history and have read every medical paper that was ever published and can tailor their advice, their treatment to our specific life history and our blood pressure, our genetics. It can be the biggest revolution in healthcare ever. If you think about self-driving vehicles. So every year, more than a million people die all over the world in car accidents. Most of them are caused by human error, like people drinking and then driving or falling

• 33:55Yuval Noah Harari?

  asleep at the wheel or whatever. Our self-driving vehicles are likely to save about a million lives every year. This is amazing. You think about climate change. So yes, developing the AIs will consume a lot of energy, but they could also find new sources of energy, new ways to harness energy that could be our best shot at preventing ecological collapse. So there is enormous positive potential. We shouldn't deny that, we should be aware of it. And on the other hand, it's very difficult to appreciate the dangers because the dangers, again, they are kind of alien. Like if you think about nuclear energy, yeah, it also had positive potential, nuclear, cheap nuclear energy, but people had a very good grasp of the danger, nuclear war. Anybody can understand the danger of that.

• 34:40Yuval Noah Harari?

  With AI, it's much more complex because the danger is not straightforward. The danger is really, I mean, we've seen the Hollywood science fiction scenarios of the big robot rebellion, that one day a big computer or the AI decides to take over the world and kill us or enslave us. And this is extremely unlikely to happen anytime soon. Because the AIs are still a kind of very narrow intelligence. Like the AI that can summarize a book, it doesn't know how to act in the physical world outside. You have AIs that can fold proteins, you have AIs that can play chess, but we don't have this kind of general AI that can just find its way around the world and build a robot army and whatever.

• 35:25Yuval Noah Harari?

  So people, it's hard to understand so what's so dangerous about something which is so kind of narrow in its abilities? And I would say that the danger doesn't come from the big robot rebellion, it comes from the AI bureaucracies. Already today, and more and more, we will have not one big AI trying to take over the world. We will have millions and billions of AIs constantly making decisions about us everywhere. You apply to a bank to get a loan, it's an AI deciding whether to give you a loan. You apply to get a job, it's an AI deciding whether to give you a job. You're in court, or you're found guilty of some crime, the AI will decide whether you go for six months or three years or whatever. Even in armies,

• 36:09Yuval Noah Harari?

  we already see now in the war in Gaza and with the war in Ukraine, AI make the decision about what to bomb. And in the Hollywood scenario, you have the killer robots shooting people. In real life, it's the humans pulling the trigger, but the AI is choosing the targets, is telling them what to... This is much more complex than the standard scenario.

• 36:39Rich Roll?

  Every point of connection with bureaucracy then becomes turned over to an algorithm that makes decisions in a black box without the opportunity for rebuttal or conversation, right? So we're outsourcing all of these decisions and creating like an autocratic diaspora of decision makers, right? And that in turn, like you can imagine over time, like what emerges from that is is like a godhead or a pantheon of gods, where there's an authoritarian regime that's dispersed across this in which we are relenting our agency over to these machines and trusting that they're making the right decisions, but not knowing how those decisions are being made.

• 37:22Rich Roll?

  Even the engineers who are creating the algorithm don't know. And there's something, you know, kind of innately terrifying about that.

• 37:29Yuval Noah Harari?

  Again, it's not authoritarian in the sense that there is a single human being that is pulling all the levers. No, it's the AIs. Like, the bank has this AI that decides who is qualified to get a loan. And if they tell you, "We decided not to give you a loan", and you ask the bank, "Why not?", and the bank says, "We don't know", I mean, the computer says, "No", I mean, the algorithm says, "No", we don't understand why the algorithm says no, but we trust the algorithm. And this is likely to spread to more and more places. The key thing is, it's not that the bank is hiding something from you. It's really that the AIs make decisions in a very different way than human beings, on a basis of a lot more data.

• 38:12Yuval Noah Harari?

  So if the bank really wanted to explain to you why they refused to give you a loan, like, let's say there is a law, the government passes a law of a right to an explanation. If the bank refused to give you a loan, you can apply, they must give you an explanation. So the explanation, well, people feel that it will be kind of, I don't know, racist bias, or homophobic bias, like in the old days, that the algorithm saw that you're black, or you're Jewish, or you're gay, and this is why it refused to give you a loan. It won't be like that. I mean, the bank will send you an entire encyclopedia, and millions of pages, saying, "This is why the computer refused to give you a loan", the computer took into account thousands and thousands of data points about you,

• 38:57Yuval Noah Harari?

  each one based on statistics, on millions of previous cases. And now you can go over these millions of pages if you like, and if you want to challenge, okay, but it's not the kind of old-style racism or whatever.

• 39:14Rich Roll?

  Sure. A new version of the terms and conditions that we just click on without reading, right? Except extrapolated a hundredfold. In addition to that, with all of these data points, I can't help but think that, you know, these machines, the veracity of the information that these machines provide us with is only as reliable as the data sets that it has been provided with. And right now...

• 39:43Rich Roll?

  We're tiptoeing into a situation where the internet is being rapidly degraded because it's being populated more and more by AI content. Now, when you go to Google and you search, the first thing you see is a sort of an AI kind of summary of your query as opposed to links. And this in turn is undermining the business model of legacy media and all forms of media. So as those continue to die on the vine, more and more of the internet will be a result of AI-generated content. And then it becomes a recursive thing in which it's feeding upon its own inputs to make decisions.

• 40:24Rich Roll?

  And with that, you can imagine a degradation of the data set upon which it is making those decisions.

• 40:32Yuval Noah Harari?

  Exactly. Even if you think about something like music. So AI that now creates music, it basically ate the whole of human music. For thousands of years, humans produced music or art or theater, whatever. Within a year, the current AIs just ate the whole of it and digested it and start now creating new music or new texts or new images. And the first kind of generation of AI texts or music, this is based on previous human culture. But with each passing year, the AIs will be eating their own products. Because as you know, the humans share in music production or the humans share in text

• 41:14Yuval Noah Harari?

  production or image production will go lower and lower. Most images, most music will be produced, at least in part, by AI. And this will be the new food that the AI eats. And then you have exactly what you described, this recursive pattern. And where it will lead us, we have no idea. I mean, another way to think about it, this is the first time that we are basically about to enter a non-human culture.

• 41:41Yuval Noah Harari?

  Like humans are our cultural entities. We live cocooned inside culture. Like all this music and art and also finance and also religion. This is all part of culture. And for tens of thousands of years, the only entities that produced culture were other humans. So all the songs you ever heard were produced by humans. All the religious mythologies you ever heard came from the human imagination. Now there is an alien intelligence, a non-human intelligence, that will increasingly produce songs and music, mythology, financial strategies, political ideas. Even before we rush to decide, is it good, is it bad?

• 42:24Yuval Noah Harari?

  Just stop and think about the meaning of living in a non-human culture or a culture which is, I don't know, 40% or 70% non-human. It's not like going to China and seeing a different human culture. It's like really alien culture here on Earth.

• 42:41Rich Roll?

  Yeah, my human mind bristles at that. I start thinking about like this bias I have around the originality of human thought and emotion. And this kind of assumption that AI will never be able to fully mimic the human experience, right? There's something indelible about what it means to be human that the machines will never be able to fully replicate. And when you talk about, you know, information, the purpose of information being to create connection, a big piece there is intimacy, like intimacy between human beings. So information is meant to create connection, but now we have so much information and we're feeling very disconnected. So there's something broken in this system.

• 43:25Rich Roll?

  And I think it's driving this loneliness epidemic. But on the other side, it's making us value like intimacy, maybe a little bit more than we were previously. And so I'm curious about where intimacy kind of fits into this, you know, post-human world in which culture is being dictated by machines. I mean, human beings are wired for that kind of intimacy. And I think our radar or our kind of ability to, you know, identify it when we see it is part of what makes us human to begin with.

• 43:57Yuval Noah Harari?

  Maybe the most important part. I think the key distinction here that is often lost is the distinction between intelligence and consciousness.

• 44:07Yuval Noah Harari?

  That intelligence is the ability to pursue goals and to overcome problems and obstacles on the way to the goal. The goal could be a self-driving vehicle trying to get from here to San Francisco. The goal could be increasing user engagement. And an intelligent agent knows how to overcome the problems on the way to the goal. This is intelligence. And this is something that AI is definitely acquiring. In at least certain fields, AI is now much more intelligent than us. Like in playing chess, much more intelligent than human beings. But consciousness is a different thing than intelligence.

• 44:49Yuval Noah Harari?

  Consciousness is the ability to feel things: pain, pleasure, love, hate. When the AI wins a game of chess, it's not joyful. If there is a tense moment in the game, it's not clear who is going to win. The AI is not tense. It's only the human player which is tense or frightened or anxious. The AI doesn't feel anything. Now, there is a big confusion because in humans, and also in other mammals, in other animals, in dogs and pigs and horses and whatever, intelligence and consciousness go together. We solve problems based on our feelings. Our feelings are not something that kind of evolution is decoration.

• 45:32Yuval Noah Harari?

  It's the core system through which mammals make decisions and solve problems is based on our feelings. So we tend to think that consciousness and intelligence must go together. And in all these science fiction movies, you see that as the computer or robot becomes more intelligent, then at some point, it also gains consciousness. It falls in love with the human or whatever. And we have no reason to think like that.

• 46:01Rich Roll?

  Yeah, consciousness is not a mere extrapolation of intelligence.

• 46:05Yuval Noah Harari?

  Absolutely not.

• 46:05Rich Roll?

  It's a qualitatively different thing.

• 46:07Yuval Noah Harari?

  Yeah, and again, if you think in terms of evolution, so yes, the evolution of mammals took a certain path, a certain road, in which you develop intelligence based on consciousness. But so far, what we see with computers, they took a different route. Their road develops intelligence without consciousness. I mean, computers have been developing, you know, for sixty, seventy years now. They are now very intelligent, at least in some fields, and still zero consciousness. Now, this could continue indefinitely. Maybe they are just on a different path. Maybe eventually they will be far more intelligent than us in everything and still will have

• 46:51Yuval Noah Harari?

  zero consciousness, will not feel pain, or pleasure, or love, or hate. You know, the same way that if you think about birds and airplanes. So airplanes did not become like birds. Airplanes don't fly using feathers and so forth. They fly in a completely different way. It's not like that at a certain point, when the airplane flies fast enough, suddenly the feathers will appear. No. And it could be the same with intelligence and consciousness, that it will be more and more intelligent without feelings ever appearing. Now, what adds to the problem is that there is nevertheless a very strong commercial

• 47:30Yuval Noah Harari?

  and political incentive to develop AIs that mimic feelings, to develop AIs that can create intimate relations with human beings, that can cause human beings to be emotionally attached to the AIs. Even if the AIs have no feelings of themselves, they could be trained, they are already trained, to make us feel that they have feelings. And to start developing relationships with them. Why is there such an incentive? Because intimacy is, on the one hand, maybe the most cherished thing that a human can have.

• 48:14Yuval Noah Harari?

  You know, just on the way here, we were listening to Barbara Streisand singing, "Our people who need people are the luckiest people in the world." That intimacy is not a liability. It's not something bad that, "Oh, I need this." No, it's the greatest thing in the world. But it's also, potentially, the most powerful weapons, weapon in the world. If you want to convince somebody to buy a product, if you want to convince somebody to vote for a certain politician or party, intimacy is like the ultimate weapon. I mean, so far in history, there was a big battle for attention. How to grab human attention? Also, we talked about earlier in social media, how to get human attention. And there were ways, like, I don't know,

• 48:59Yuval Noah Harari?

  in Nazi Germany, Hitler could force everybody to listen to his speech on radio. So he had command of attention. But not of intimacy. There was no technology for Hitler, or Stalin, or anybody else, to mass-produce intimacy. Now, with AIs, it is possible, technically, to mass-produce intimacy. You can create all these AIs that will interact with us, and they will understand our feelings, because, again, feelings are also patterns. You can predict a person's feelings by watching them for weeks and months, and learning their patterns, and facial expression, and tone of voice, and so forth. And then, if it's in the wrong hands, it could be used to manipulate us like never before.

• 49:44Rich Roll?

  Sure, it's our ultimate vulnerability, this beautiful thing that makes us human becomes this great weakness that we have. Because as these AIs continue to self-iterate, their capacity to mimic consciousness and human intimacy will reach such a degree of fidelity that it will be indistinguishable to the human brain, and then, humans become like these unbelievably easy-to-hack machines, who can be directed wherever the AI chooses to direct them.

• 50:18Yuval Noah Harari?

  Yeah, it's not a prophecy. We can take actions today to prevent this. We can have regulations about it. We can, for instance, have a regulation that AIs are welcome to interact with humans, but on condition that they disclose that they are AIs. If you talk with an AI doctor, that's good, but the AI should not pretend to be a human being. You know, I'm talking with an AI. I mean, it's not that there is no possibility that AI will develop consciousness. We don't know. I mean, there could be that AIs will really develop consciousness.

• 50:54Rich Roll?

  But does it matter if it's mimicking it to such a degree of fidelity? Does it even, in terms of like how human beings interact with it, does it matter?

• 51:00Yuval Noah Harari?

  For the human beings, no. I mean, and this is the problem. I mean, because we don't know if they really have consciousness or they're only very, very good at mimicking consciousness. So the key question is ultimately political and ethical. If they have consciousness, if they can feel pain and pleasure and love and hate, this means that they are ethical and political subjects. They have rights. That you should not inflict pain on an AI the same way you should not inflict pain on a human being. That what they like, what they love, might be as important as what human beings desire. So they should also vote in elections. And they could be the majority. Because you know, you can have a country,

• 51:44Yuval Noah Harari?

  a hundred million humans and 500 million AIs. So do they choose the government in this situation? Now, you know, in the United States, interestingly enough, there is actually an open legal path for AIs to gain rights. It's one of the only countries in the world where this is the case. Because in the United States, corporations are recognized as legal persons with rights. Until today, this was a kind of legal fiction. Like, according to US law, Google is a person. It's not just a corp-, it's a person. And as a person, it also has freedom of speech. This is the Supreme Court ruling for 2010 of Citizens United. Now, until today, this was just legal fiction.

• 52:26Yuval Noah Harari?

  Because every decision made by Google was actually made by some human being. An executive, a lawyer, an accountant. Google could not make a decision independent of the humans. But now you have AIs. So imagine the situation when you incorporate an AI. Now this AI is a corporation. And as a corporation, US law recognizes it as a person with certain rights like freedom of speech. Now, it can earn money, it can go online, for instance, and offer its services to people and earn money. Then it can open a bank account and invest its money in the stock exchange. And if it's very smart and very intelligent, it could become the richest person in the US.

• 53:10Yuval Noah Harari?

  Now imagine, the richest person in the US is not a human, it's an AI. And according to US law, one of the rights of this person is to make political contributions, donations. This was the main reason behind Citizens United in 2010. So this AI now makes billions of dollars of contributions to politicians in exchange for expanding AI rights. And the legal path in the US is completely open. You don't need any new law to make this happen.

• 53:43Rich Roll?

  That's like, that's a plot of a movie.

• 53:46Yuval Noah Harari?

  Yeah, when, you know, we're in LA.

• 53:49Rich Roll?

  Yeah, I mean, wow, that's so wild to contemplate. What are the differences in the ways in which the advent of this powerful technology is impacting democratic systems and authoritarian systems?

• 54:04Yuval Noah Harari?

  So both systems have a lot to gain and have a lot to lose. Again, the AI, it's the most powerful technology ever created. It's not a tool, it's an agent. So you have millions and billions of new agents, are very intelligent, very capable, that can be used to create the best healthcare system in the world, but also the most lethal army in the world, or the worst secret police in the world. If you think about authoritarian regimes, so throughout history, they always wanted to monitor their citizens around the clock, but this was technically impossible. Even in the Soviet Union, you know, you have 200 million Soviet citizens, you can't follow

• 54:47Yuval Noah Harari?

  them all the time because the KGB didn't have 200 million agents. And even if the KGB somehow got 200 million agents, that's not enough. Because, you know, in the Soviet Union, it's still basically... Paper bureaucracy, the secret police. If a secret agent followed you around 24 hours a day, at the end of the day, they write a paper report about you and send it to KGB headquarters in Moscow. So imagine, every day, KGB headquarters is flooded with 200 million paper reports. Now, to be useful for anything, somebody needs to read and analyze them. They can't do it, they don't have the analysts. Therefore, even in the Soviet Union,

• 55:31Yuval Noah Harari?

  some level of privacy was still the default for most people. For technical reasons. Now, for the first time in history, it is technically possible to annihilate privacy. A totalitarian regime today doesn't need millions of human agents if he wants to follow everybody around. You have the smartphones and cameras and drones and microphones everywhere. And you don't need millions of human analysts to analyze this ocean of information, you have AI. And this is already beginning to happen. This is not a future prediction. In many places around the world, you begin to see the formation of this totalitarian surveillance regime. It's happening in my country, in Israel.

• 56:15Yuval Noah Harari?

  Israel is building this kind of surveillance regime in the occupied Palestinian territories to follow everybody around all the time. And also in our region, in Iran, since the Islamic Revolution in 1979, they had the hijab laws, which says that every woman, when she goes out walking or even driving in her private car, she must wear the hijab, the headscarf. And until today, the regime had difficulty enforcing the hijab laws because they didn't have, you know, millions of police officers that you can place on every street, a police officer. If a woman drives without a headscarf, immediately, she's arrested and fined or whatever.

• 57:00Yuval Noah Harari?

  In the last few years, they switched to relying on an AI system. Iran is now crisscrossed by surveillance cameras with facial recognition software, which recognizes automatically if in the car that just passed by the camera, the facial recognition software can identify that this is a woman, not a man, and she's not wearing the hijab, and identify her identity, find her phone number, and within half a second, they send her an SMS message saying, "You broke the hijab law, your car is impounded, your car is confiscated, stop the car by the side of the road."

• 57:43Yuval Noah Harari?

  This is daily occurrence today in Tehran and Isfahan and other parts of Iran. And this is based on AI. And it's not like there is a report that goes to the court, and some human judge goes over the data and decides what to do. The AI like immediately decides, "Okay, the car is confiscated." And this can happen in more and more places around the world, like even in the US. You know, if you think about all the debate about abortion. Without going into the debate itself, the people who think, rightly or wrongly, but they think that abortion is murder,

• 58:21Yuval Noah Harari?

  they have a very strong incentive to build a similar surveillance system for American women. You know, to stop murder. Like, you can build this surveillance system that can identify, "Yesterday, you were pregnant, today or not, what happened in between?" So it's not just a problem, you know, for Iran, or for the Palestinians, or the Chinese. This can come to the US as well.

• 58:48Rich Roll?

  And to prevent them from crossing state lines, things like that.

• 58:51Yuval Noah Harari?

  Yeah? Like, okay, you went from, I don't know, Texas to California, you were pregnant, you came back, you're not pregnant, what happened in California?

• 59:00Rich Roll?

  So it feels like AI is this incredible tool to consolidate power around authoritarian regimes, but it also has its pitfalls, too. Like, it's not the perfect tool.

• 59:11Yuval Noah Harari?

  It also frightens the autocrats. Because the one thing that human dictators always feared most was not a democratic revolution. The one thing they feared most is a powerful subordinate that they can't control and that might manipulate them or take power from them. If you can look at the Roman Empire, not a single Roman emperor was ever toppled by a democratic revolution. Never happened. But many of them lost their life or their power to a subordinate. You know, a general that rebelled against them, a provisional governor, their brother, their wife, that took power from them.

• 59:53Yuval Noah Harari?

  This is the greatest fear of every dictator, also today. And so if you think about AI, so if you're a human dictator and you now give this immense power to an AI system, where is the guarantee that this system will not turn against you and either eliminate you or just turn you into a puppet? I mean, what we also know about dictators, it's relatively easy to manipulate these people if you can whisper in their ear.

• 1:00:22Rich Roll?

  Right.

• 1:00:22Yuval Noah Harari?

  Because they are very paranoid. And the easiest people to manipulate are the paranoid people.

• 1:00:28Rich Roll?

  And we have our AI corporation in the United States that can deploy billions of dollars towards bots and whatever else to, you know, create that paranoia or enhance it.

• 1:00:38Yuval Noah Harari?

  Yeah, and you really just need to hack one person. You know, for an AI to take power in the US, very complicated. It's such a distributed system. Like, OK, the AI can learn to manipulate the president, but it also needs to manipulate the senators and the congress members and the state governors and the Supreme Court. Like, what would the AI do as a Senate filibuster? It's difficult. But if you want to take power in a dictatorship, you just need to learn to manipulate a single person.

• 1:01:07Rich Roll?

  Hmm.

• 1:01:08Yuval Noah Harari?

  So the dictators are not all happy about the AIs. And we're already beginning to see it, for instance, with chatbots. That they are very concerned because, you know, you can design a chatbot, which will be completely loyal to the regime. But once you release it to the internet to start interacting with people in real life, it changes. I mean, remember what we talked earlier, that AI is defined by the ability to learn and change by itself. So even if Putin creates like the Putinist chatbot that always says that Putin is great and Putin is right and Russia is great and so forth. But then you release it to the real world,

• 1:01:52Yuval Noah Harari?

  it starts observing things in the real world. For instance, it notices that, you know, in Russia, the invasion of Ukraine is officially not a war. It's called a special military operation. And if you say that it's a war, you go to prison for up to, I think, three years or something like that. Because it's not a war. It's a special military operation. Now, what do you do? If a very intelligent chatbot that you released, you know, connect the dots and says, no, it's not a special military operation. It's a war. Would you send a chatbot to prison? What can you do? And, you know, democracies, of course, also have a problem with chatbot saying things we don't like. They can be racist. They can be homophobic, whatever. But the thing about democracy,

• 1:02:37Yuval Noah Harari?

  it has a relatively wide margin of tolerance, even for anti-democratic speech. Dictatorships have zero margin for dissenting views. So they have a much bigger problem with how to control these unpredictable chatbots.

• 1:03:09Rich Roll?

  How are you interpreting the current moment, given that we're on the cusp of an election here in the United States? And, you know, there's a lot of discourse around the existential threat to democracy that we may be facing. What role is AI playing in this? What should we understand about the impact of this technology on us as citizens and voters?

• 1:03:36Yuval Noah Harari?

  At present, I don't think that AI has... Again, social media has, of course, a huge impact on the political discourse and thereby on the results of the elections. But I don't see AI really kind of changing or manipulating the elections in November. It's too close. The big question is, whoever wins the elections, maybe the most important decisions that person has to make will be about AI. Because of the extremely rapid pace that this technology is developing. You know, you look at where ChatGPT was a year ago, you look at what things are now in 2024, what will be the state of AI in 2027, 2028?

• 1:04:20Yuval Noah Harari?

  So, you know, I watched the presidential debate. Most people, their main takeaway was about the cats and the dogs. It's the most memorable thing from the debate. I mean, you know, whoever wins, maybe will have to make some of the most important decisions in history about the relations. If you're worried about immigration, it's not the immigrants that will, you know, replace the taxi drivers. It's the immigrants that will replace the bankers that you should be worried about. And it's the AIs, not somebody coming from south of the border. And who do you trust to make these momentous decisions? Now, and if you think specifically about the threats to democracy.

• 1:05:02Yuval Noah Harari?

  So one thing we learned from history is that democracies always, since, again, ancient Athens, they always had this one single big problem or weakness. That democracy is basically a kind of a deal, that you give power to somebody for a limited time period, for four years, on condition they give it back. And then you can make a different choice. Like, we tried this, it didn't work, let's try something else. This ability to say, let's try something else, this is democracy. And it's based on that you give power and you expect to get it back after four years.

• 1:05:43Rich Roll?

  The peaceful transfer at the end of that term.

• 1:05:45Yuval Noah Harari?

  What happens if you give power to somebody who then doesn't give it back? They now have the power. They have the power to also stay in power. That was always the biggest danger in democracy. So for me, the issue in the US elections, it's you can discuss the economic policies, the foreign policies, you like this, you like that. There is discussion to be had. But you have your one person, Donald Trump, and that has, you know, you have a record for the previous time that this person doesn't want to give power back. And he is willing to go a long way, including potentially inciting violence, to avoid giving power back. And you want to give him so much power?

• 1:06:29Yuval Noah Harari?

  That doesn't sound like a very, a very good idea. So for me, this is the kind of the number one issue in the elections. Everything else is of marginal importance in comparison.

• 1:06:40Rich Roll?

  Yeah, I mean, I think it challenges our, our, our predilections around the stability of democracy and is forcing us to really embrace the fact that it is a delicate dynamic that is, you know, informed by collective action by the people. And in reflecting upon, you know, this technology also, you know, the story of technology is one in which our ability to legislate around it and regulate it always falls, you know, way behind the pace of advancement. And now we're in a situation where the pace of advancement is like nothing we've ever seen before, which calls into question our ability to not only, you know, kind of put

• 1:07:24Rich Roll?

  guardrails around it, but to even understand what is actually happening. The history of information systems is one of collective human cooperation. And yet we're in a, a situation right now where it feels like cooperation is being challenged, not only nationally here in the United States, but internationally. And so as we kind of begin to talk about how we're going to triage this or, or find solutions, like where do you land in terms of our capacity to collectively come together as a global community to figure out solutions and then put them into motion so that we don't tiptoe into some kind of dystopia?

• 1:08:09Yuval Noah Harari?

  So there is a lot to unpack here. So first of all, when we think about cooperation, as we said earlier, this was always our biggest advantage as a species, that we cooperate better than anybody else. We can construct these even global networks of trade that no other animal even understands. Like if you think about, I don't know, horses. So horses never figured out money. They were bought and sold, but they never understood what are these things that the humans are exchanging. And this is why horses could never unite against us or could never manipulate us, because they'd never figured out how the system works, that one person is giving me to another person

• 1:08:51Yuval Noah Harari?

  in exchange for a few shiny metal things or some pieces of paper. AI is different. It understands money better than most people. Like, most people don't understand how the financial system really works. And financial AIs in fintech, they already surpass most human beings, not all human beings, but most human beings in their understanding of money. So we are now confronting, again, millions and billions of new agents that potentially can use our own systems against us, that they, computers can now collaborate using, for instance, the financial system more efficiently than humans can.

• 1:09:33Yuval Noah Harari?

  So the whole issue of cooperation is changing. And computers also learn how to use the communication systems to manipulate us, like in social media. So they are cooperating where we are losing the ability to cooperate. And that should raise the alarm. Now, and the thing is, it's very difficult to understand what is happening. If we want humans around the world to cooperate on this, to build guardrails, to regulate the development of AI, first of all, you need humans to understand what is happening. Secondly, you need the humans to trust each other.

• 1:10:12Yuval Noah Harari?

  And most people around the world are still not aware of what is happening on the AI front. You have a very small number of people in just a few countries, mostly the US and China and a few others, who understand. Most people in Brazil, in Nigeria, in India, they don't understand. And this is very dangerous, because it means that a few people, many of them are not even elected by the US citizen. They are just, you know, private companies. They will make the most important decisions. And the even bigger problem is that even if people start to understand, they don't trust each other. Like, I had the opportunity to talk to some of the people who are leading the AI revolution,

• 1:10:57Yuval Noah Harari?

  which is still led by humans. It is still humans in charge. I don't know for how many more years, but as of 2024, it's still humans in charge. And you meet with these, you know, entrepreneurs and business tycoons, and politicians also in the US, in China, in Europe, and they all tell you the same thing, basically. They all say, "We know that this thing is very, very dangerous, but we can't trust the other humans." If we slow down, how do we know that our competitors will also slow down? Whether our business competitors, let's say here in the US, or our Chinese competitors across the ocean.

• 1:11:41Yuval Noah Harari?

  And you go and talk with the competitors, they say the same thing. "We know it's dangerous. We would like to slow down to give us more time to understand, to assess the dangers, to debate regulations, but we can't. We have to rush even faster, because we can't trust the other corporation, the other country. And if they get it before we get it, it will be a disaster." And so you have this kind of paradoxical situation where the humans can't trust each other, but they think they can trust the AIs. Because when you talk with the same people and you tell them, okay, I understand you can't trust the Chinese or you can't trust OpenAI, so you need to move faster developing this super AI.

• 1:12:25Yuval Noah Harari?

  How do you know you could trust the AI? And then they tell you, oh, I think that will be okay. I think we've figured out how to make sure that the AI will be trustworthy and under our control. So you have this very paradoxical situation when we can't trust our fellow humans, but we think we can trust.

• 1:12:44Rich Roll?

  And layered on top of that is an incentive structure, of course, that further engenders distrust in this arms race, right? Like, the prize goes to the breakthrough developers and those will be rewarded and remunerated in ways that are, you know, perhaps unprecedented, right?

• 1:13:02Yuval Noah Harari?

  Absolutely.

• 1:13:03Rich Roll?

  So the breakthroughs and what's on the other side of that is so enticing that any discourse around regulation or anything else that might slow it down becomes not only a national security threat, but also an entrepreneurial threat, right? So everything is motivating rapid acceleration at the cost of transparency and regulation and all these other things, all these checks and balances that we really need right now. And I don't know, like, you know, how you're feeling about this, but it leaves me a little cold and pessimistic. Like, you're a historian, like, the story of humankind is all gas, no brakes, you know?

• 1:13:46Rich Roll?

  Like, let's just, we're plowing forward and we'll deal with the consequences when they come. Like, we're not wired adequately to really appreciate the long-term consequences of our behavior. We're kind of, you know, looking right in front of us and making decisions based on how it's going to impact us in the immediate future and very little else.

• 1:14:06Yuval Noah Harari?

  Yeah, I mean, throughout history, the problem is people are very good at solving problems, but they tend to solve the wrong problems. Like, they spend very little time deciding what problem we need to solve. Like, 5% of the effort goes on choosing the problem. Then 95% of the effort goes in solving the problem we focus on. And then we realize, oh, we actually solved the wrong problem, and it just creates new problems down the road that we now need to... And then we do it again. And, you know, wisdom often comes from silence, from taking time, from slowing down. Let's really understand the situation before we rush to make a decision.

• 1:14:51Yuval Noah Harari?

  And, you know, it starts on the individual level, that so many people, for instance, think, oh, my main problem in life is that I don't have enough money. And then they spend the next 50 years making lots of money. And even if they succeed, they wake up at a certain point and said, oops, I think I chose the wrong problem. I think it wasn't, yeah, I need some money, but it wasn't my main problem in life. And we are perhaps doing it collectively as a species, the same thing. You know, you go back to something like the agricultural revolution. So people thought, okay, we don't have enough food. Let's produce more food with agriculture. We'll domesticate wheat and rice and potatoes. We'll have lots more food. Life will be great. And then they domesticate these plants and also some animals, cows, chickens, pigs, whatever.

• 1:15:37Yuval Noah Harari?

  And they have lots of food, and they start building these huge agricultural societies with towns and cities. And then they discover a lot of new problems they did not anticipate. For instance, epidemics. Hunter-gatherers did not suffer almost any infectious diseases, because most infectious diseases came to humans from domesticated animals. And they spread in the dense towns and cities. Now, if you live in a hunter-gatherer band, you don't hold any chickens or pigs. So it's very unlikely some virus will jump from a wild chicken to you. And even if you got some new virus, you have just like 20 other people in your band, and you move around all the time.

• 1:16:22Yuval Noah Harari?

  Maybe you infect five others and like three die, and that's the end of it. But once you have these big agricultural cities, then you get the epidemics. People thought they were building paradise for humans. Turned out, they were building paradise for germs. And human life expectancy and human living conditions for most humans actually goes down. If you're a king or a high priest, it's okay. But for the average person, it was actually a bad move. And the same thing happens again and again throughout history. And it can happen now on a very, very big scale with AI. In a way, it goes back to this issue of organic and inorganic. That organic systems are slow, they need time.

• 1:17:07Yuval Noah Harari?

  And this AI is an inorganic system which accelerates beyond anything we can deal with. And the big question is whether we will force it to slow down or it will force us to speed up until the moment we collapse and die. I mean, if you force an organic entity to be on all the time and to move faster and faster and faster, eventually it collapses and dies.

• 1:17:33Rich Roll?

  One of the things I heard you say that really struck me was this. It's a quote. "If something ultimately destroys us, it will be our own delusions." So can you elaborate on that a little bit and how that applies to what we've been talking about?

• 1:17:50Yuval Noah Harari?

  Yeah, I mean, the AIs, at least of the present day, they cannot escape our control and they cannot destroy us unless we allow them or unless we kind of order them to do that. We are still in control. But because of our, you know, political and mythological delusions, we cannot trust the other humans. And we think we need to develop these AIs faster and faster and give them more and more power because we have to compete with the other humans. And this is the thing that could really destroy us. And, you know, it's very unfortunate because we do have a track record

• 1:18:31Yuval Noah Harari?

  of actually being quite successful of building trust between humans. It just takes time. I mean, if you think about again the long arc of human history. So these hunter-gatherer bands, tens of thousands of years ago, they were tiny, couple of dozen individuals. And even though the next steps like agriculture, they had their downside, again, like epidemics. People did learn over time how to build much larger societies, which are based on trust. If you now live in the United States or in some other country, you are part of a system of hundreds of millions of people

• 1:19:15Yuval Noah Harari?

  who trust each other in many ways which were really unimaginable in the Stone Age. Like, you don't know 99.99% of the other people in the country. And still, you trust them with so much. I mean, the food you eat, mostly you did not go to the forest to hunt and gather it by yourself. You rely on strangers to provide the food for you. Most of the tool you use are coming from strangers. Your security, you rely on police officers, on soldiers that you never met in your life. They are not your cousins, they are not your next-door neighbors, and still they protect your life. So yes, if you now go to the global level, okay, we still don't know how to trust the Chinese.

• 1:20:00Yuval Noah Harari?

  And the Israelis still don't know how to trust the Iranians and vice versa. But it's not like we are stuck while we were in the Stone Age. We've made immense progress in building human trust and we are rushing to throw it all away. Because it just, again, it takes time. It will not happen tomorrow.

• 1:20:20Rich Roll?

  Yeah, I mean, I think it's urgent that we find a way back to repairing some institutional trust, right? Like, that has been degraded in recent times, and I think without that, we stand very little chance as a democratic republic of surviving and solving these kinds of problems.

• 1:20:41Yuval Noah Harari?

  Absolutely. If you ask in brief, what is the key to building trust between millions of strangers, the key is institutions. Because you can't build a personal intimate relationship with millions of people. So it's only institutions, whether it's courts, or police forces, or newspapers, or universities, or healthcare systems, that build trust between people. And unfortunately, we now see this, again, another epidemic of distrust in institutions on both the right and the left. It is fueled by a very cynical worldview, which basically

• 1:21:22Yuval Noah Harari?

  says that the only reality is power, and humans only want power, and all human interactions are power struggles. So whenever somebody tells you something, you need to ask whose privileges are being served, whose interests are being advanced. And any institution is just an elite conspiracy to take power from us. So journalists, they are not really interested in knowing the truth about anything, they just want power. And the same for the scientists, and the same for the judges. And if this goes on, then all trust in institutions collapses, and then society collapses. And the only thing that can still function in that situation

• 1:22:03Yuval Noah Harari?

  is a dictatorship. Because dictatorships don't need trust, they are based on terror. So people who attack institutions, they often think, "Oh, we are liberating the people from these authoritarian institutions, they are actually paving the way for a dictatorship." And the thing is, that this view is not just very cynical, it's also wrong. Humans are not these power-crazy demons.

• 1:22:29Yuval Noah Harari?

  All of us want power to some extent, that's true, but that's not the whole truth about us. Humans are really interested in knowing the truth about ourselves, about our lives, about the world, on a very deep level, because you can never be happy if you don't know the truth about your life. Because you will not know what are the sources of misery. Again, you will focus on your life. If you don't know the truth, you waste all your life trying to solve the wrong problems. And this is true of also of journalists and judges and scientists. Yes, there is corruption in every institution. This is why we need a lot of institutions to keep each other and one another in check. But if you destroy all trust in institutions,

• 1:23:15Yuval Noah Harari?

  what you get is either anarchy or a dictatorship. And again, it's a good exercise every now and then to stop and think about how every day we are protected by all kinds of institutions. Like when people talk with me about the deep state, you know, this conspiracy about the deep state, I immediately think about the sewage system. The sewage system is the deep state. It's a deep, uh, system of tunnels and pipes and pumps, which is a state built under our houses and streets and neighborhoods and saves our life every day. Because it keeps our sewage separate from our drinking water.

• 1:23:59Yuval Noah Harari?

  You know, you go to the toilet, you do your thing, it goes down into the deep state, which keeps it separate from the drinking water. Uh, if I can tell one historical anecdote, where did it come from? So, you know, after the Cultural Revolution, you have big cities. They are paradise for germs, hotbeds for epidemics. This continues really until the 19th century. London in the 19th century was the biggest city in the world and one of the most dirty and polluted and a hotbed for epidemics. And in the middle of the 19th century, there is a cholera epidemic and people in London are dying from cholera. And then you have this bureaucrat, medical bureaucrat, Jon Snow. Not the guy from Games of Thrones, a real Jon Snow,

• 1:24:43Yuval Noah Harari?

  who did not fight dragons and zombies, but actually did save millions of lives.

• 1:24:49Yuval Noah Harari?

  Because he went around London with lists, and he interviewed all the people who got sick or died. If somebody died from cholera, he would interview their family. Tell me, where did this person get their drinking water from? And he made these long lists of hundreds and thousands of people. And by analyzing these lists, he pinpointed a certain well on Broad Street in Soho in London, where everybody, almost everybody who got sick on cholera, they had a zip of water from that well at a certain stage. And he convinces the municipality to disable the pump of the well, and the epidemic stops. And then they investigate, they discover that the well was dug about a meter away

• 1:25:34Yuval Noah Harari?

  from a cesspit, and sewage water from the cesspit got into the drinking water. And today, if you want to dig a well or a cesspit in London or in Los Angeles, you have to fill so many forms and to get all these bureaucratic permits, and it saves our lives.

• 1:25:52Rich Roll?

  And how does that relate to this idea of the deep state? I'm trying to tether those two notions together.

• 1:25:58Yuval Noah Harari?

  Again, the people who believe the conspiracy theories about the deep state, they say that all these state bureaucracies, they are elite conspiracies against the common people, trying to take over power, trying to destroy us. And in most cases, no, the people in these, you know, to manage a sewage system, you need plumbers, you also need bureaucrats. Again, you need to apply for a license to dig a well. And it is matched by all these kind of state bureaucrats, and it's a very good thing. Because again, there is corruption in these places sometimes. This is why we keep also courts. You can go to court. This is why we keep newspapers, so they can expose corruption in the cities, in the municipalities,

• 1:26:42Yuval Noah Harari?

  sewage department. But most of the time, most of these people are honest people who are working very hard every day to keep our sewage separate from our drinking water and to keep us alive.

• 1:26:56Rich Roll?

  And by extrapolation, there are all of these bureaucracies that are working in our interest in invisible ways that we take for granted.

• 1:27:03Yuval Noah Harari?

  Exactly.

• 1:27:03Rich Roll?

  Basically, right. You've often said clarity is power. And I think your superpower is your ability to kind of stand at 10,000 feet and look down on humanity and the planet and identify what's most important in these macro trends that help us make sense of what's happening now. And I'd like to kind of end this with some thoughts on how you cultivate that clarity through meditation and your very kind of like profound practice of mindfulness and information deprivation, I should say, right?

• 1:27:41Yuval Noah Harari?

  Yeah, information fast.

• 1:27:42Rich Roll?

  Yeah.

• 1:27:43Yuval Noah Harari?

  Starting maybe with the idea of an information fast. So I think this is important today for every person to go on an information diet. That this idea that more information is always good for us is like thinking that more food is always good for us, it's not true. And the same way that the world is full of junk food that we'd better avoid, the world is also full of junk information that we have better avoid. Information which is artificially filled with greed and hate and fear. Information is the food of the mind. And we should be as mindful as what we put into our minds as of what we put into our mouths. But it's not just about limiting consumption.

• 1:28:28Yuval Noah Harari?

  It's also about digesting. It's also about detoxifying. Like, we go throughout our life and we take in a lot of junk, whether we like it or not, that fills our mind. And I meditate two hours every day, so I can tell you there is a lot of junk in there. A lot of hate and fear and greed that I picked up over the years. And it's important to take time to simply digest the information and to also detoxify, to kind of let go of all this hatred and anger and fear and greed which is in our minds.

• 1:29:09Yuval Noah Harari?

  So I began, when I was doing my PhD in Oxford, a friend recommended that I go on a meditation retreat, or a Vipassana meditation. And for a year, he kind of nagged me to go on a meditation. And I said, "No, this is kind of mystical mambo jumbo. I don't want to..." And eventually, I went. And it was amazing, because it was the most remote thing for mysticism that I could imagine. Because it was a 10-days retreat, and on the very first evening of the retreat, the teacher, Sengenka, the only instruction he gave, he didn't tell me to kind of visualize some goddess, or do this man, nothing. He just said, "What is really happening right now? Bring your attention to your nostrils, to your nose,

• 1:29:54Yuval Noah Harari?

  and just feel whether the breath is going in, or whether the breath is going out." That's the only exercise. Like, a pure observation of reality. What amazed me was my inability to do it. Like, I would bring my attention to the nose, and try to feel, is it going in, is it going out? And after about 5 seconds, some thought, some memory, some fantasy would arise in the mind, and would just hijack my attention. And for the next 2 or 3 minutes, I would be rolling in this fantasy or memory, until I realized, "Hey, I actually need to observe my breath." And I would come back to the breath. Again, 5 seconds, maybe 10 seconds, I will be able to, "Oh, now it's coming in, it's coming in. Oh, now it's going out, it's going out."

• 1:30:39Yuval Noah Harari?

  And again, some memory would come and hijack me. And I realized first that I know almost nothing about my mind. I have no control of my mind. And my mind is just like this factory that constantly produces fantasies and illusions and delusions that come between me and reality. Like, if I can't observe the breath going in and out of my nostrils, because some fantasy comes up, what hope do I have of understanding AI, or understanding the conflict in the Middle East, without some mind-made illusion or fantasy coming between me and reality?

• 1:31:21Yuval Noah Harari?

  And for the last 24 years, I have this daily exercise of I devote two hours every day to just what is really happening right now. I sit with closed eyes and just try and focus, let go of all the mind-made stories, and feel what is happening to the breath, what is happening to my body, the reality of the present moment. I also go for a long meditation retreat, usually every year, of between 30 days and 60 days of meditation. Because again, one of the things you realize, there is so much noise in the mind, that just to calm it down to the level that you can really start meditating seriously, it

• 1:32:02Yuval Noah Harari?

  takes three or four days of continuous meditation. Just so much noise. So long retreats, they enable to have this really deep observation of reality, which is impossible. Most of life we spend like detached from reality.

• 1:32:20Rich Roll?

  Sure, two hours a day, that's a commitment. Even in the midst of all the book promotion craziness.

• 1:32:29Yuval Noah Harari?

  Yeah, so before I came here, I usually do it one in the morning, one in the afternoon or evening.

• 1:32:34Rich Roll?

  What a beautiful thing. And obviously, your ability to think clearly and write so articulately about these ideas is very much a product of this practice.

• 1:32:45Yuval Noah Harari?

  Absolutely. I mean, without the practice, I would not be able to write such books, and I would not be able to deal with the kind of, all the publicity and all the interviews and, you know, this roller coaster of positive and negative feedback from the world all the time. I would say one important thing, this is not necessarily for everybody. Because I meditate and I have meditator friends and so forth, I mean, different things work for different people. There are many people that I wouldn't recommend to meditate two hours a day or to go for a 10-days meditation retreat, because they are different, their body, their minds are different. For them, perhaps going on a 10-days hike in the mountains would be better.

• 1:33:28Yuval Noah Harari?

  For them, perhaps devoting two hours a day to music, to say, playing, or to creating, or going to psychotherapy would have better results. Humans are really different in many ways from one another, there is no one size fits all. So if you never try meditation, absolutely try it out. And give it a real chance. It's not like you go for like a few hours and it doesn't work. Okay, give it up. Like, give it a real chance. But keep in mind that, again, different minds are different. So find out what really works for you. And whatever it is, that's the important part. Whatever it is, invest in it.

• 1:34:07Rich Roll?

  I have to release you back to your life. But maybe we can end this with just a concise thought about what it is that you want people to take away from this book. Like, what is most vital and crucial for people to understand about what you're trying to communicate?

• 1:34:24Yuval Noah Harari?

  But information isn't truth. Truth is, it's a costly, rare, and precious thing. It is the foundation of knowledge and wisdom and of benign beneficial societies. You can build terrible societies without the truth. But if you want to build a good society and you want to build a good personal life, you must have a strong basis in the truth. And it's difficult. Again, because most information is not the truth. And invest in it. It's worthwhile to have a practice, whatever it is, that gets you connected with reality, that gets you connected with the truth.

• 1:35:05Rich Roll?

  Thank you for coming here today. I really appreciate you taking the time to share your wisdom and experience. I think Nexus, your latest book, is, as I said at the outset, a crucial, vital book that everybody should read. We're entering into a very interesting time. And we are well advised to be as best prepared as we possibly can. And I appreciate the work that you do. And thank you again.

• 1:35:32Yuval Noah Harari?

  Thank you.

• 1:35:33Rich Roll?

  I only graced the surface of the outline that I created, so hopefully you can come back because I got a million more questions. I could have talked to you for hours.

• 1:35:39Yuval Noah Harari?

  Next time I'm in L.A., I'll be happy to.

• 1:35:42Rich Roll?

  Thanks, Dan. Appreciate it. Cheers.

• 1:36:03Rich Roll?

  That's it for today. Thank you for listening. I truly hope you enjoyed the conversation. To learn more about today's guest, including links and resources related to everything discussed today, visit the episode page at richroll.com where you can find the entire podcast archive, my books, Finding Ultra, Voicing Change, and The Plant Power Way, as well as The Plant Power Meal Planner at meals.richroll.com. If you'd like to support the podcast, the easiest and most impactful thing you can do is to subscribe to the show on Apple Podcasts, on Spotify, and on YouTube, and leave a review and/or comment. This show just wouldn't be possible without the help of our amazing sponsors who keep this podcast running wild

• 1:36:48Rich Roll?

  and free. To check out all their amazing offers, head to richroll.com/sponsors. And sharing the show or your favorite episode with friends or on social media is, of course, awesome and very helpful. And finally, for podcast updates, special offers on books, The Meal Planner, and other subjects, please subscribe to our newsletter, which you can find on the footer of any page at richroll.com. Today's show was produced and engineered by Jason Camiolo. The video edition of the podcast was created by Blake Curtis with assistance by our creative director, Dan Drake. Portraits by Davy Greenberg. Graphic and social media assets courtesy of Daniel Solis. And thank you Georgia Whaley for copywriting and website

• 1:37:31Rich Roll?

  management. And of course, our theme music was created by Tyler Pyatt, Trapper Pyatt, and Harry Mathis. Appreciate the love, love the support. See you back here soon. Peace. Plants. Namaste.