Yuval Noah Harari: This Election Will Tear The Country Apart! AI Will Control You By 2034! The Dark Truth Behind Meta & X!

Can humanity handle AI or will it be our downfall? Yuval Noah Harari looks back at history to guide us through this uncertain journey ahead. Yuval Noah Harari is a best-selling author, public intellectual and Professor of History at the Hebrew University of Jerusalem. He is the author of multi-million bestseller books such as, ‘Sapiens: A Brief History of Humankind’ and ‘Homo Deus: A Brief History of Tomorrow’. In this conversation, Yuval and Steven discuss topics such as, how AI is disconnecting people, the best way to control fake news, how institutions drive trust, and how Trump could change democracy. Follow Yuval: Instagram - https://g2ul0.app.link/7iXk5TnLAMb Twitter - https://g2ul0.app.link/eaKRt5rLAMb You can order Yuval’s book ‘NEXUS: A Brief History of Information Networks from the Stone Age to AI’, here: https://g2ul0.app.link/Wae95KONAMb Watch the episodes on Youtube - https://g2ul0.app.link/DOACEpisodes My new book! 'The 33 Laws Of Business & Life' is out now - https://g2ul0.app.link/DOACBook Get your hands on the brand new Diary Of A CEO Conversation Cards here: https://appurl.io/iUUJeYn25v Follow me: https://beacons.ai/diaryofaceo Learn more about your ad choices. Visit megaphone.fm/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  Humans are still more powerful than the AIs. The problem is that we are divided against each other, and the algorithms are using our weaknesses against us. And this is very dangerous. Because once you believe that people who don't think like you are your enemies, democracy collapses, and then the election becomes like a war. So if something ultimately destroys us, it will be our own delusions, not the AIs.

• 0:23Steven Bartlett?

  We have a big election in the United States.

• 0:24Speaker 00

  Yes, democracy in the States is quite fragile. But the big problem is, what if...

• 0:30Steven Bartlett?

  Surely that will never happen.

• 0:32Speaker 00

  Yuval Noah Harari, the author of some of the most influential non-fiction books in the world today, and is now at the forefront of exploring the world-shaping power of AI and how it is beyond anything humanity has ever faced before.

• 0:44Steven Bartlett?

  The biggest social networks in the world, they're effectively going to go for free speech. What is your take on that?

• 0:48Speaker 00

  The issue is not the humans, the issue is the algorithms. So let me unpack this. In the 2010s, there was a big battle between algorithms for human attention. Now, the algorithms discover, when you look at history, the easiest way to grab human attention is to press the fear button, the hate button, the greed button. The problem is that there was a misalignment between the goal that was defined to the algorithm and the interests of human society. But this is how it becomes really disconcerting. Because if so much damage was done by giving the wrong goal to a primitive social media algorithm, what would be the result with AI in 20 or 30 years?

• 1:24Steven Bartlett?

  So what's the solution?

• 1:26Speaker 00

  We've been in this situation many times before in history, and the answer is always the same, which is...

• 1:32Steven Bartlett?

  Are you optimistic?

• 1:33Speaker 00

  I try to be a realist.

• 1:42Steven Bartlett?

  10 years ago, you made a video that was titled, "Why Humans Run the World." It's a very well-known TED Talk that you did.

• 1:52Steven Bartlett?

  After reading your new book, Nexus, I wanted to ask you a slightly modified question, which is, do you still believe that 10 years from now, humans will fundamentally be running the world?

• 2:05Speaker 00

  I'm not sure. It depends on the decisions we all take in the coming years. But there is a chance that the answer is no. That in ten years, um, algorithms and AIs will be running the world. I'm not having in mind some kind of Hollywoodian science fiction scenario of one big computer kind of conquering the world. It's more like a bureaucracy of AIs. That we will have millions of AI bureaucrats everywhere. You know, in the banks, in the government, in businesses, in universities, making more and more decisions about our lives. That, um, everyday decisions, whether to give us a loan, whether to accept us to a job.

• 2:47Speaker 00

  Uh, and we will find it more and more difficult to understand the logic, the rationale, why the algorithm refused to give us a loan. Why the algorithm accepted somebody else, uh, for the job. And, um, you know, you could still have democracies with people voting for this president or this prime minister. But, um, if most of the decisions are made by AIs and humans, including the politicians, have difficulty understanding the reason why the AIs are making a particular decision. Then power will gradually shift from humanity to these new alien intelligences. Alien intelligences?

• 3:32Speaker 00

  Yeah, I prefer to think about AI. And I know that the acronym is artificial intelligence. But I think it's more accurate to think about it as an alien intelligence, not in the sense of coming from outer space, in the sense that it makes decisions in a fundamentally different way than than human minds. Artificial means or have the sense that we design it, we control it, something artificial is made by humans. With each passing year, AI is becoming less and less artificial and more and more alien. Yes, we still design the kind of baby AIs. But then they learn and they change and they start making unexpected decisions

• 4:17Speaker 00

  and they start coming up with new ideas which are an alien to the human way of doing things. You know, there is this famous example with the game of Go. That in 2016, AlphaGo defeated the world champion, Lee Sedol. But the amazing thing about it was the way it did it. Because humans have been playing Go for 2,500 years.

• 4:41Steven Bartlett?

  A board game.

• 4:42Speaker 00

  A board game, a strategy game developed in ancient China and considered one of the basic arts that any cultivated civilized person in East Asia had to know. And tens of millions of Chinese and Koreans and Japanese played Go for centuries. Entire philosophies developed around the game of how to play it. It was considered a good preparation for politics and for life. And people thought that they explored the entire realm, the entire geography, landscape of Go. And then AlphaGo came along and showed us that actually,

• 5:24Speaker 00

  for 2,500 years, people were exploring just a very small bit, a very small part of the landscape of Go. There are completely different strategies of how to play the game that not a single human being came up with in more than 2,000 years of playing it. And AlphaGo came up with it in just a few days. So this is alien intelligence. And you know, if it's just a game, then but the same thing is likely to happen in finance, in medicine, in religion, for better or for worse.

• 5:59Steven Bartlett?

  You wrote this book, Nexus. Nexus. How do you pronounce it?

• 6:03Speaker 00

  Nexus.

• 6:04Steven Bartlett?

  Nexus.

• 6:05Speaker 00

  I'm not an expert on pronunciation, so.

• 6:09Steven Bartlett?

  You could have written many a book. You're someone that's, I think, broadly curious about the nature of life, but also the nature of history. For you to write a book that is so detailed and comprehensive, there must have been a pretty strong reason why this book had to come from you now. And why is that?

• 6:27Speaker 00

  Because I think we need a historical perspective on the AI revolution. I mean, there are many books about AI. This is Nexus is not a book about AI. It's a book about the long-term history of information networks. I think that to understand what is really new and important about AI, we need perspective of thousands of years to go back and look at previous information revolutions, like the invention of writing and the printing press and the radio. And only then you really start to understand what is happening around us right now. One thing you understand, for instance, is that AI is really different.

• 7:10Speaker 00

  People compare it to previous revolutions, but it's different because it's the first technology ever in human history that is able to make decisions independently and to create new ideas independently. A printing press could print my book, but it could not write it. It could just copy my ideas. An atom bomb could destroy a city, but it can't decide by itself which city to bomb or why to bomb it. And AI can do that. And you know, there is a lot of hype right now around AI, so people get confused because they now try to sell us everything as AI. Like, you want to sell this table to somebody?

• 7:54Speaker 00

  Oh, it's an AI table. And this water, this is AI water. So people, what is AI? Everything is AI. No, not everything. There is a lot of automation out there, which is not AI. If you think about a coffee machine that makes coffee for you, it does things automatically, but it's not an AI. It's pre-programmed by humans to do certain things, and it can never learn or change by itself. A coffee machine becomes an AI. If you come to the coffee machine in the morning and the machine tells, hey, based on what I know about you, I guess that you would like an espresso.

• 8:36Speaker 00

  It learns something about you and it makes an independent decision. It doesn't wait for you to ask for the espresso. And it's really AI. If it tells you, and I just came up with a new drink. It's called Boffi, and I think you would like it. That's really AI. When it comes up with completely new ideas that we did not program into it and that we did not anticipate. And this is a game changer in history. It's bigger than the printing press. It's bigger than the atom bomb.

• 9:09Steven Bartlett?

  You said we need to have a historical perspective in it. Do you consider yourself to be a historian?

• 9:14Speaker 00

  Yes, that's my profession is a historian. That's kind of, this is my training. I was originally a specialist in medieval military history. I wrote about the Crusades and the Hanoverians war and the strategy and logistics of the English armies that invaded France in the 14th century. This was my first articles. And this is the kind of perspective or of knowledge that I also bring to try and understand what's happening now with AI.

• 9:45Steven Bartlett?

  Because most people's understanding of what AI is comes from them playing around with a large language model like ChatGPT or Gemini or Grok or something. That's like their understanding of it. You can ask it a question and it gives you an answer. That's really what people think of AI as. And so it's easy to be a bit complacent with it or to see this technological shift as being trivial. But when you start talking about information and the like disruption of the flow of information and information networks, and when you bring it back through history and you give us this perspective on the fact that information effectively glues us all together, then it starts to become, for me, I think about it completely differently.

• 10:26Speaker 00

  I mean, there are two ways I think about it. I mean, one way is that when you realize that, as you said, that information is the basis for everything, when you start to shake the basis, everything can collapse or change or something new could come up. For instance, democracies are made possible only by information technology. Democracy in essence is a conversation. A group of people conversing, talking, trying to make decisions together. Dictatorship is that somebody dictates everything. One person dictates everything, that's dictatorship. Democracy is a conversation. Now, in the Stone Age, hunter-gatherers living in small bands, they were mostly democratic.

• 11:08Speaker 00

  Whenever the band needed to decide anything, they could just talk with each other and decide. As human societies grew bigger, it just became technically difficult to hold the conversation. So, the only examples we have from the ancient world for democracies are small city-states, like Athens or Republican Rome. These are the two most famous examples, not the only one, but the most famous. And even the ancients, even philosophers like Plato and Aristotle, they knew, once you go beyond the level of a city-state, democracy is impossible. We do not know of a single example from the pre-modern world of a large-scale democracy.

• 11:52Speaker 00

  Millions of people spread over a large territory, conducting their political affairs democratically. Why? Not because of this or that dictator that took power. Because democracy was simply impossible. You cannot have a conversation between millions of people when you don't have the right technology. Large-scale democracy becomes possible only in the late-modern era. When a couple of information technologies appear, first the newspaper, then telegraph and radio and television, and they make large-scale democracy possible. So democracy, it's not like you have democracy and on the side you have these information technologies. No, the basis of democracy is information technology.

• 12:37Speaker 00

  So if you have some kind of earthquake in the information technology, like the rise of social media or the rise of AI, this is bound to shake democracy. Which is now, what we see around the world is that we have the most sophisticated information technology in history, and people can't talk with each other. The democratic conversation is breaking down. And every country has its own explanation, like you talk to Americans, what's happening there? Between Democrats and Republicans, why can't they agree on even the most basic facts? And they give you all these explanations about the unique conditions of American history and society, but you see the same thing in Brazil. You see the same thing in France, in the Philippines.

• 13:20Speaker 00

  So it can't be the unique conditions of this or that country. It's the underlying technological revolution. And the other thing that history kind of that I bring from history is how even relatively small technological changes, seemingly small changes, can have far-reaching consequences. Like you think about the invention of writing. Originally, it was basically people playing with mud. I mean, writing was invented for the first, it was invented many times in many places, but the first time, in ancient Mesopotamia, people take clay tablets, which is basically pieces of mud, and they take a stick,

• 14:03Speaker 00

  and they use the stick to make marks in the clay, in the clay, in the mud. And this is the invention of writing. And this had a profound effect. To give just one example, you think about ownership. What does it mean to own something like I own a house, I own a field? So previously, before writing, to own a field, if you live in a small Mesopotamian village, like seven thousand years ago, you own a field. This is a community affair. It means that your neighbors agree that this field is yours and they don't pick fruits there and they don't graze their sheep there because they agree it's yours. It's a community agreement.

• 14:48Speaker 00

  Then comes writing and you have written documents and ownership changes its meaning. Now to own a field or a house means that there is some piece of dry mud somewhere in the archive of the king with marks on it that says that you own that field. So suddenly, ownership is not a matter of community agreement between the neighbors. It's a matter of which document sits in the archive of the king. And it also means, for instance, that you can sell your land to a stranger without the permission of your neighbors, simply by giving the stranger

• 15:29Speaker 00

  this piece of dry mud in exchange for gold or silver or whatever. So what a big change. A seemingly simple invention like using a stick to draw some signs on a piece of mud. And now think about what AI will do to ownership. Like maybe ten years down the line, to own your house means that some AI says that you own it. And if the AI suddenly says that you don't own it, for whatever reason that you don't even know, that's it, it's not yours.

• 16:04Steven Bartlett?

  That that mark on that piece of mud was also the invention of sort of written language. And I think. I was thinking about when I was reading your book about how language holds our society together, not in the way that we we often might assume, as in me having a conversation with you, but passwords, poetry, like banking, it's like our whole society is secured by language.

• 16:29Speaker 00

  Yeah.

• 16:30Steven Bartlett?

  And the first thing that the AIs have mastered is with large language models is the ability to replicate that, which is which made me I think about all the things that in my life are actually held together with language, even my relationships now, because I don't see my friends. My friends live in Dubai and America and Mexico, so we conversate in a language, our relationships are held together in language. And as you said, democracies are held together in language. And now there's a more intelligent force that's mastered that.

• 17:00Speaker 00

  Yeah, it was so unexpected, like, you know, five years ago, people said AI will master this or that, self-driving vehicles, but language, nah, this is such a complicated problem. This is the human masterpiece, language, it will never master language. And ChatGPT came and it said, you know, I'm a words person and I'm simply amazed by the quality of the texts that these large language language models produce. It's not perfect, but they really understand the semantic field of words. They can string words together and sentences to form a coherent text, but that's really

• 17:45Speaker 00

  remarkable. And as you said, I mean, this is the basis for everything, like I give instructions to my bank with language. If AI can generate text and audio and image, then how do I communicate with the bank in a way which is not open to manipulation by an AI?

• 18:05Steven Bartlett?

  But the tempting part in that sentence is you don't like communicating with your bank anyway, as in grueling them being on the phone, waiting for another human.

• 18:16Steven Bartlett?

  So the temptation is, you know, I don't like speaking to my bank anyway, so I'm gonna let the AIs do that. I'm gonna invest.

• 18:21Speaker 00

  If I can trust them. I mean, the big question is, I mean, why does the bank want me to call personally to make sure that it's really me? It's not somebody else telling the bank, oh, make this transfer to, to, I don't know, Cayman Islands. It's really me. And how do you make sure? How do you build this trust? I mean, the whole of finance for thousands of years is just one question, trust. All these financial devices, money itself is really just trust. It's not made from gold or silver or paper or anything. It's how do you create trust between strangers? And therefore, most financial inventions, in the end, they are linguistic and symbolic inventions. It's not, you don't need some complicated physics.

• 19:05Speaker 00

  It's complicated symbolism. And now AI might start creating new financial devices and will master finance because it mastered language. And like you said, I mean, we now communicate with other people, our friends, all over the world. You know, in the 2010s, there was a big battle between algorithms for human attention. We're just discussing it before the podcast, like, how do we get the attention of people? But there is something even more powerful out there than attention, and that's intimacy. If you really want to influence people, intimacy is more powerful than attention.

• 19:46Steven Bartlett?

  How are you defining intimacy in this regard?

• 19:49Speaker 00

  Someone that you have a long-term acquaintance with, that you know personally, that you trust, that to some extent that you love, that you care about. And until today, it was utterly impossible to fake.

• 20:06Speaker 00

  Intimacy and to mass produce intimacy. You know, dictators could mass produce attention. You know, once you have, for instance, radio, you can tell all the people in Nazi Germany or in the Soviet Union, the great leader is giving a speech. Everybody must turn their radio on and listen. So you can mass produce attention. But this is not intimacy. You don't have intimacy with the great leader. Now with AI, you can, for the first time in history, at least theoretically, mass produce intimacy with millions of bots, maybe working for some government, uh, faking intimate relationships with us, which will be hard to, to know that this is a bot and not a human being.

• 20:52Steven Bartlett?

  Hmm. It's interesting because when I, I've had so many conversations with relationship experts and a variety of people that speak to the decline in human to human intimacy and the rise in loneliness and us becoming more sexless as a society and all of these kinds of things. So it's, it's almost with the decline in human to human intimacy and human to human connection and the rise of this sort of art, the possibility of artificial intimacy. It begs the question what the future might look like in a world where people are lonelier than ever, more disconnected than ever, but still have the same Maslowian need for that connection and that feeling of, you know, love and longing.

• 21:34Steven Bartlett?

  And maybe this is why we're seeing a rise in polarization at the same time because people are desperately trying to belong somewhere and the algorithm is like reinforcing my echo chamber. So I'm, you know, and it's,

• 21:50Steven Bartlett?

  but I don't know how that ends.

• 21:52Speaker 00

  Yeah, it, I don't think it's deterministic. It depends on the decision we make individually and as a society. Uh, there are of course also wonderful things that this technology can do for us. Uh, the ability of AI to hold a conversation, the ability to understand your emotions. It can potentially mean that we will have lots of AI teachers and AI, uh, doctors and AI therapists that can give us better healthcare services, better education services than ever before.

• 22:28Speaker 00

  Instead of being, you know, a kid in a class of forty other kids, that the teacher is barely able to give attention to this particular child and understand his or her specific needs and his or her specific personality, you can have an AI tutor that is focused entirely on you and that is able to give you a quality of education which is really unparalleled.

• 22:54Steven Bartlett?

  I had this debate with my friend on the weekend. He's got two young kids who are one years old and three years old. And we were discussing in the future, in sort of sixteen years' time, where would you rather send your child? Would you rather send your child to be taught by a human in a classroom, as you've described, with lots of people, lots of noise, where they're not getting personalized learning? So if the classroom are more intelligent, they're being left behind. If they're more intelligent, they're being dragged back. Or would you rather your child sat in front of a screen, potentially, or a humanoid robot, and was given a really personalized, tailored education? That was probably significantly cheaper than, say, private education or university.

• 23:34Speaker 00

  You need the combination. I mean, I think that for many of the lessons, it will be better to go with the AI tutor, which you don't even have to sit in front of a screen. You can go to the park and get a lesson on ecology, just listening as you walk. But you will need large groups of kids for break time. Because very often, you learn that the most important lessons in school are not learned during the lessons. They are learned during the breaks. And this is something that should not be automated. You would still need large group of children together with human supervision for that.

• 24:17Steven Bartlett?

  The other thing I thought about a lot when I was reading your book is this idea that, I would assume, us having more information and more access to information would lead to more truth in the world, less conspiracy, more agreement. But that doesn't seem to be the case.

• 24:35Speaker 00

  No, not at all. Most information in the world is junk. I mean, I think the best way to think about it is it's like with food. That there was a time, like a century ago in many countries, where food was scarce. So people ate whatever they could get, especially it was full of fat and sugar. And they thought that more food is always good. Like if you ask your great grandmother, she would say, yes, more food is always good. And then we reach a time of abundance in, in, in food. And we have all this industrialized, processed food, which is artificially full of fat and sugar and salt and whatever. And it's obviously bad for us.

• 25:18Speaker 00

  The idea that more food is always good, no. And definitely not all this junk food. And the same thing has happened with information. That information was once scarce, so if you could get your hands on a book, you would read it, because there was nothing else. And now information is abundant. We are flooded by information, and much of it is junk information, which is artificially full of greed and anger and fear because of this battle for attention.

• 25:49Speaker 00

  And it's not good for us. So we basically need to go on an information diet. That, again, the first step is to realize that it's not the case that more information is always good for us. We need a limited amount, and we actually need more time to digest the information. And we have to be, of course, also careful about the quality of what we take in, because, again, of the abundance of junk information. And the, the basic misconception, I think, is this link between information and truth. That people think, okay, if I get a lot of information, this is the raw material of truth, and I, more information will mean more knowledge.

• 26:32Speaker 00

  And that's not the case, because even in nature, most information is not about the truth. The basic function of information in history, and also in biology, is to connect. Information is connection. And when you look at history, you see that very often, the easiest way to connect people is not with the truth. Because the truth is a costly and rare kind of information. It's usually easier to connect people with fantasy, with fiction. Why? Because the truth tends to be, not just costly, the truth tends to be complicated and it tends to be uncomfortable.

• 27:17Speaker 00

  And sometimes painful. If you think, you know, like in politics, a politician who would tell people the whole truth about their nation is unlikely to win the elections. Because every nation has this skeleton in the cupboard and all these dark sides and dark episodes that people don't want to be confronted with. So we see that politically, it's not, if you want to connect nations, religions, political parties, you often do it with fictions and fantasies.

• 27:52Steven Bartlett?

  And fear?

• 27:53Speaker 00

  Um.

• 27:54Steven Bartlett?

  I was thinking about Sapiens and the role that stories play in engaging our brains. And I was thinking a lot about the narratives. In the UK, we have a narrative where we're told that much of the cause of the problems we have in society, unemployment, other issues with crime, are because there's people crossing from France on boats. And it's a very effective narrative to get people to band together to march in the streets. And in America, obviously, the same narrative of the wall and the southern border, they're crossing our border in the millions. It's their rapists. They're not sending their good people. They're coming from mental institutions, has galvanized people together. And those people are now like marching in the streets, voting based on that story that is a fearful story.

• 28:37Speaker 00

  It's a very powerful story because it connects to something very deep inside us. And if you want to get people's attention, if you want to get people's engagement, so the fear button is one of the most efficient, most effective buttons to press in the human mind. And again, it goes back to the Stone Age. So if you live in a Stone Age tribe, one of your biggest worries is that the people from the other tribe will come to your territory and will take your food or will kill you. So this is a very ingrained fear in, not just in humans, in every social animal.

• 29:19Speaker 00

  They did experiments on chimpanzees that show that chimpanzees have also a kind of almost instinctive fear or disgust towards foreign chimpanzees from a different band. And politicians and religious leaders, and they learn how to play on these human emotions almost like you play on a piano. Now, originally, these feelings like disgust, they evolved in order to help us. You know, on the most basic level, disgust is there because, you know, especially as a kid, you want to experiment with different foods, but if you eat something that is bad

• 30:03Speaker 00

  for you, you need to, you know, puke it, you need to throw it out. So you have disgust protecting you. But then you have religious and political leaders throughout history hijacking this defensive mechanism and teaching people from a very young age to not just to fear, but to be disgusted by foreign people, by people who look different. And this is, again, as an adult, you can learn all the theories and you can educate yourself that this is not true, but still very deep in your mind if there is a part that is just, these people are disgusting, these people are dangerous.

• 30:48Speaker 00

  And we saw it throughout history, how many different movements have learned how to use these emotional mechanisms to motivate people.

• 31:03Steven Bartlett?

  We sit down at a very interesting time, Yuval, because two quite significant things have happened in the last, I think, year as it relates to information and many of the things we've been talking about. One of them is Elon Musk bought Twitter and his real mandate has been this idea of free speech. And as part of that mandate, he's unblocked a number of figures who were previously blocked on Twitter, a lot of them right-leaning people that were blocked for a variety of different reasons. And then also this week, Mark Zuckerberg released basically a letter publicly. And in that letter, he says that he regrets the fact that he cooperated so much with the FBI, the government, when they

• 31:45Steven Bartlett?

  asked him to censor things on Facebook. One particular story, he says he regrets doing that. And it looks like, if you read between what he's saying, well, he actually says explicitly, he says, "We're going to push back harder in the future if governments or anybody else asks us to censor certain messaging." Now, what I'm seeing is that Twitter, which is one of the biggest social networks in the world, and Meta, the biggest social network in the world, have now taken this stance, and effectively, they're going to let information flow. They're effectively going to go for this free speech narrative. Now, as someone that's used these platforms for a long time, specifically X or Twitter, it is crazy how different it is these days. There are things that I see every time I

• 32:24Steven Bartlett?

  scroll that I never would have seen before this free speech position. Now, I'm not taking a stance, whether it's good or bad, it's just very interesting. And there's clearly an algorithm that is now really, like, if I scroll, if I go on X right now, I will see someone being killed with a knife, I reckon, within 30 seconds. And I will see someone getting hit by a car. I will see extreme Islamophobia, potentially. But then I'll also see the other side. So it's not just something, I'll see all of the sides. And when you were talking earlier about, like, is that good for me? I had a flashback to my friend this weekend, it was my birthday, so me and my friends were together, just looking over at him, mindlessly scrolling these, like, horror videos on Twitter, as

• 33:08Steven Bartlett?

  he was sat on my left, thinking, God, he's, like, frying his dopamine receptors. I just, I just think this whole, I mean, like, free speech movement. What is your take on that, this idea of free speech and the role, you know?

• 33:20Speaker 00

  Only humans have free speech. Bots don't have free speech. The tech companies are constantly confusing us about this issue because the issue is not the humans, the issue is the algorithms. And let me explain what I mean. If the question is whether to ban somebody like Donald Trump from Twitter, I agree, this is a very difficult issue and we should be extremely careful about banning human beings, especially important politicians, from voicing their views and opinions. However much we dislike their opinions or them personally, it's a very serious matter to ban any human being from a platform. But this is not the problem.

• 34:03Speaker 00

  The problem on the platform is not the human users. The problem is the algorithms and the companies constantly shift the blame to the humans in order to protect their business interests. So let me unpack this. Humans create a lot of content all the time. They create hateful content, they create sermons on compassion, they create cooking lessons, biology lessons, so many different things. A flood of information. The big question is, then what gets human attention? Everybody wants attention. Now, the companies also want attention. The companies give the algorithms that run the social media platforms

• 34:46Speaker 00

  a very simple goal: increase user engagement. Make people spend more time on Twitter, more time on Facebook, engage more, sending more likes and recommending it to their friends. Why? Because the more time we spend on the platforms, the more money they make. Very, very simple. Now, the algorithms made a huge, huge discovery. By experimenting on millions of human guinea pigs, the algorithms discovered that if you want to grab human attention, the easiest way to do it is to press the fear button, the hate button, the greed button. And they started recommending to users

• 35:29Speaker 00

  to watch more and more content full of hate and fear and greed to keep them glued to the screen.

• 35:38Speaker 00

  And this is the deep cause of the epidemic of fake news and conspiracy theories and so forth. And the defense of the companies is, "We are not producing the content." Somebody, a human being, produced a hate-filled conspiracy theory about immigrants, and it's not us. It's like, a bit like, I don't know, the chief editor of The New York Times publishing a hate-filled conspiracy theory on the front of the first page of the newspaper. And when you ask him, "Why did you do it?" Or, "Are you blaming me? Look what you did." He says, "I didn't do anything. I didn't write the piece. I just put it on the front of The New York Times. That's all. That's nothing.

• 36:22Speaker 00

  It's not nothing." People are producing immense amount of content. The algorithms are the kingmakers. They are the editors now. They decide what gets viewed. Sometimes they just recommend it to you. Sometimes they actually autoplay it to you. Like, you chose to watch some video. At the end of the video, to keep you glued to the screen, the algorithm immediately, without you telling him, it, the algorithm, without you telling the algorithm, the algorithm auto-plays some kind of video full of fear or greed, just to keep you glued to the screen. It is the algorithm doing it.

• 37:03Speaker 00

  And this should be banned, or this should at least be supervised and regulated. And this is not free freedom of speech, because the algorithms don't have freedom of speech. Yet, the person who produced the hate-filled video, I would be careful about banning them. But that's not the problem. It's the recommendation which is the problem. The second problem is that a lot of the conversations now, online, are being overrun by bots. Again, if you look, for instance, at Twitter X as an example, so, people often want to know what is trending, which stories get the most attention.

• 37:47Speaker 00

  If everybody's interested in a particular story, I also want to know what everybody's talking about. And very often, it's the bots that are driving the conversation. Because a particular story initially gets a lot of traction, a lot of traffic, because a lot of bots retweet it. And then people see it and think, they don't know it's bots, they think it's humans. So they say, oh, lots of humans are interested in this, so I also want to know what's happening. And this draws more attention. This should be forbidden. Bots are very, basically, you cannot have AIs pretending to be human beings. This is fake humans, this is counterfeit humans.

• 38:30Speaker 00

  If you see activity online and you think it's human activity, but actually it's bot activity, this should be banned. And it doesn't harm the free speech of any human being, because it's a bot, it doesn't have freedom of speech.

• 38:48Steven Bartlett?

  I was thinking a lot about what you said about these algorithms are actually running, running the world. And, I mean, yeah, so if the algorithms are deciding what I see based on what I spend my time looking at, because they wanna make, you know, the platforms wanna make more money. And if I have a innate sort of predisposition to spend more time focused on things that scare me.

• 39:07Speaker 00

  Yeah.

• 39:08Steven Bartlett?

  Or then you just have to give me a couple of years, and every year that goes past, I'll become more fearful, more scared.

• 39:17Speaker 00

  It reinforces your own weaknesses. I mean, again, it's like the food industry. So the food industry discovered we liked food with a lot of salt and fat in it, and gives it more to us. And then it says, but this is what the customers want, what do you want from us? It's the same thing, but even worse with these algorithms, that because this is the food for the mind. Yes, humans have a tendency that if something is very frightening, or something fills them with anger, that they focus on it and they tell all their friends about it. But to artificially amplify it, it's not, it's just, it's just not good for our mental health and social health.

• 39:58Speaker 00

  It is using our own weaknesses against us instead of helping us deal with them.

• 40:05Steven Bartlett?

  Is it fair to say, now this is me just jumping to conclusions a little bit, but is it fair to say that in a world where you remove restrictions around blocking certain characters, right wing characters that are, their messages may be based on immigration, et cetera, you remove those restrictions, so they're all allowed on every platform, and then you program the algorithm to be focused on revenue, that eventually more people will become right wing? And I say that in part because it's, it's a right wing narrative to say that immigrants are bad and that, you know, I'm not saying that the left are innocent because they're absolutely not, but I'm saying that the fearful narratives, the fear seems to come more from the right, in my opinion.

• 40:49Steven Bartlett?

  Like especially in the UK, it was the fear comes from immigrants and these people are going to take your money and all these kinds of things.

• 40:56Speaker 00

  And I think the key issue is to, not to label it as a right or left issue, because again, democracy is a conversation, and you can have a conversation only if you have several different opinions. And it's, I think it should be okay to have a conversation about immigration, that people should be able to have different opinions about it. That's fine. The problem starts when one side vilifies and, and demonizes anybody who doesn't think, I mean, you see it to some extent from both sides, but in, in the case of immigration, so you would have these conspiracy theories that anybody who supports immigration, for

• 41:41Speaker 00

  instance, they want to destroy the country. They are part of this conspiracy to flood the country with immigrants and to change its nature and, and whatever. And this is the problem. That democracy, once you believe that people who don't think like you, they are not just your political rivals, they are your enemies. They are out to destroy you. They intend to destroy your way of life, your group. Then democracy collapses. Because there can be no way, between enemies, democracy doesn't work. It works if you think that the other side is wrong, but they are still essentially good people,

• 42:26Speaker 00

  who care about the country, who care about me, but they have different opinions. If you think that they are my enemies, they try to destroy me, then the election becomes like a war, because you're fighting for your survival. You would do anything to win the election, because your survival is at stake. If you lose, you have no incentive to accept the verdict. If you win, you only take care of your tribe and not of the enemy tribe. What if you don't believe the election is legitimate? Then democracy can't function. This is, again, the basic... Democracy can't exist in just any... It's like a delicate plant

• 43:07Speaker 00

  that needs certain conditions in order to survive and to flourish. And one condition, for instance, is that you have information technologies that allows a conversation. Another condition is that you trust the institutions. If you don't trust the institution of elections, it doesn't work. And a third condition is that you need to think that the people on the other side of the political divide, they are my rivals, but they are not my enemies. Now, the problem with what's happening now with democratic conversations is because of this tendency to go to more and more and more extremes, it creates the impression that the other side is an enemy.

• 43:52Speaker 00

  And this is a problem not just for the right, also for the left. That on both sides you see this feeling that the other side is an enemy and that its positions are completely illegitimate. And if we reach that point, then the conversation collapses. And it should be possible to have complex conversations and discussions about difficult issues like immigration, like gender, like climate change, without seeing the other side as an enemy, which was possible for generations. So why is it that now it seems to just become impossible

• 44:35Speaker 00

  to talk with the other side or to agree about anything?

• 44:40Steven Bartlett?

  We have a big election in the United States this year.

• 44:42Speaker 00

  Very big one, yeah.

• 44:44Steven Bartlett?

  Do you think a lot about it?

• 44:47Speaker 00

  Yes, yes, I mean, it seems like a very, it would be a coin toss, I mean, like fifty fifty.

• 44:55Speaker 00

  You know, elections become really an existential issue if there is a chance they will be the last elections. If one side is, intends to simply change the rules of the game if it comes to power, then it becomes existential. Because again, democracy works on the basis of self-correcting mechanisms. That this is the big advantage of democracy over dictatorship. In a dictatorship, a dictator can make a lot of good decisions, but sooner or later, they will make a bad decision. And there is no mechanism in a dictatorship to identify and correct such mistakes.

• 45:37Steven Bartlett?

  Like Putin.

• 45:38Speaker 00

  Yeah, there is just no mechanism in Russia that could say Putin made a mistake, he should go, he should let somebody else try a different course of action. This is the great advantage of democracy. You try something, it doesn't work, you try something else. But the big problem is, what if you choose someone who then changes the system, neutralizes its self-correcting mechanism, and then you cannot get rid of him anymore? This is what happened, for instance, in Venezuela. That originally Chavez and the Chavezista movement, they came to power democratically. People wanted to, hey, let's try this. And now in the last elections, a couple of weeks ago, uh, evidence is very, very clear that Maduro lost big time.

• 46:23Speaker 00

  But he controls everything, the election committee, everything, and he claims, no, I won. And they destroyed Venezuela. You know, it's something like a quarter of the population fled the country, which was one of the richest countries in South America before, and they just can't get rid of the guy.

• 46:44Steven Bartlett?

  Surely that will never happen in the West?

• 46:46Speaker 00

  Oh, don't say never in history. Uh, history can catch up with you, whoever you are.

• 46:53Steven Bartlett?

  That's one of the illusions we kind of...

• 46:55Speaker 00

  Venezuela was part of the West, in many ways, still is.

• 47:00Steven Bartlett?

  This is one of the illusions we live under, though. We think, oh, that that can never happen to the UK or the United States or Canada, these sort of, quote unquote, civilized nations.

• 47:11Speaker 00

  You know, according to some measurements, democracy in the United States is quite new and quite fragile. If you think about it in terms of who gets to vote, for instance. So, um, it's, yeah, it would be, again, I don't know what are the chances, but even if there is a 20% chance that a Trump administration would change the rules of the game of American democracy in such a way as to make it, for instance, by changing the rules about who votes or how do you count votes, uh, that it will become almost impossible to get rid of them. Uh, that's not, that's not out of the possible in historical terms.

• 47:58Steven Bartlett?

  Do you think it's possible that Trump will do that?

• 48:00Speaker 00

  Yes, I mean, you saw it on the 6th of January. I mean, the most sensitive moment in every democracy is the moment of transfer of power. And the magic of democracy is that democracy is meant to ensure a peaceful transfer of power. But as I said, like, you choose one party, you give them a try. After some time, if people say they didn't do a good job, let's try somebody else. And you know, we have people who hold, in the United States, they hold the biggest power in the world. The President of the United States have enough power to destroy human civilization. All these nuclear missiles, all this army, and he loses the election.

• 48:43Speaker 00

  And he says, okay, I give up all this power and I let the other guy try. This is amazing. And this is exactly what Trump didn't do. He, from the beginning, I mean, even from 2016, he refused, they asked him directly, if you lose the election, will you accept the results? And he said, no. And in 2020, he did not hand power peacefully, he tried to prevent it. And the fact that he is now running again, and I think to some extent, the lesson he got from the 6th of January is that I can basically get away with anything, at least with my people, with my base. But it was like a test, a try.

• 49:29Speaker 00

  If I do this extreme thing and they still support me afterwards, it basically means they will support me no matter what I do.

• 49:39Steven Bartlett?

  I'm wondering, in a world of such a fragile democracy, when information flows and networks are disrupted by something like AI, if misinformation and disinformation and the ability for me to make a video, I could make a video right now of Donald Trump speaking and saying something in his voice.

• 49:58Steven Bartlett?

  And I could help that video go viral. Like, how do you hold together? Democracy and communication, when you don't believe anything that you're seeing online. And we're just at the start of this now.

• 50:10Speaker 00

  We haven't seen anything yet. This is just really the first baby steps.

• 50:14Steven Bartlett?

  I'm gonna play a video on the screen right now so people can see. And for those listening, you'll just hear it. I'm gonna play a video that Isaac over there in the corner of the room, made of me speaking in this chair. And it wasn't me, and I didn't say it, and I wasn't in this chair. Hey there, this is AI Steve. Do you think I'll be able to take over the diary of a CEO one day? Leave your comments below. And it sounds exactly like me, identical, and it's not me. And I wonder this with, you know, most of us get our political information and our information generally now from social media.

• 50:45Speaker 00

  Yeah.

• 50:45Steven Bartlett?

  From, and if I can't believe anything that I'm seeing because it's all easy to make, some kid in Russia in their bedroom can make a video of the Prime Minister here. I don't know where we get our information from anymore, how we verify.

• 50:57Speaker 00

  The answer is institutions. We've been in this situation many times before in history. And the answer is always the same, institutions. You cannot trust the technology. You trust the institution that verifies the information. Think about it like with print. That you can write on a piece of paper, anything you want. You can write, "The Prime Minister of Britain said", and then you open quotation marks, and you put something into the mouth of the Prime Minister. You can write anything you want. And when people read it, they don't believe it. Or they shouldn't believe it. Just because it's written that the Prime Minister said it, doesn't mean that it's true.

• 51:39Speaker 00

  So how do we know which pieces of paper to believe as an institution? We would believe, or greater chance we will believe, if on the front page of the New York Times, or of the Sunday Times, or of the Guardian, you will have "The British Prime Minister said", open quotation marks, blah, blah, blah. Because we don't trust the paper or the ink. We trust the institution of the Guardian, or the Wall Street Journal, or whatever. With videos, we never had to do that, because nobody could fake them. So we trusted the technology. If we saw a video, we said, "Ah, this has to be true." But when it becomes very easy to fake videos, then we revert to the same principle as with print.

• 52:25Speaker 00

  We need an institution to verify it. If we see the video on the official website of CNN or of the Wall Street Journal, then we believe it, because we believe the institution backing it. And if it's just something on TikTok, we know that, you know, any kid can do that. Why should I believe it? So now we are in the transition period. We are still not used to it. So when we see a video of Donald Trump or Joe Biden, the video still gets to us, because we grew up in a time when it was impossible to fake it. But I think very quickly, people will realize, you can't trust videos. You can only trust the institutions.

• 53:08Speaker 00

  And the question is, will we be able to produce, to create, to maintain trust where the institutions fast enough to save the democratic conversation?

• 53:21Speaker 00

  Because if not, if you can't believe anything, this is the ideal for dictators.

• 53:27Speaker 00

  When you can't trust anything, the only system that works is a dictatorship. Because democracy works on trust, but dictatorship works on terror, on fear. You don't need to trust anything in a dictatorship. You don't trust anything. You fear. For democracy to work, you need to trust, for instance, that some information is reliable, that the election committee is impartial, that the courts are just. And if more and more institutions are attacked and people lose trust in them, then democracy collapses. But again, going back to information, so one option is that the old institutions,

• 54:11Speaker 00

  like newspapers and TV stations,

• 54:15Speaker 00

  they will be the institutions that we trust to verify certain videos, or we will see the emergence of new institutions. And again, the big question is whether we'll be able to develop trust in them. And I specifically say institutions and not individuals. No large-scale society, especially not a democratic society, can function without trustworthy bureaucratic institutions.

• 54:47Speaker 00

  And will those bureaucratic institutions be AI? That's the big question, because increasingly, AIs will be the bureaucrats. And what do you mean by bureaucrats? What's the word bureaucrat? What does that mean? Oh, that's a very important question, because human civilization runs on bureaucracy. Bureaucrats are essentially officials in government that try- Not just in government. It's, I mean, the origin of the word bureaucrat, it comes from French, from the 18th century. And bureaucracy is, is, means that the rule of the writing desk is to rule the world or to rule society with pen and papers and documents. Like the example we gave in the very beginning about ownership.

• 55:30Speaker 00

  So there, you own a house because there is a document in some archive that says that you own it. And a bureaucrat produced this document. And if you now need to retrieve it, then this is the job of a bureaucrat, to find the right document at the right time. And all big systems run on it. Hospitals and schools and corporations and banks and sports associations and libraries, they, they all run on these documents. And, and the bureaucrats who know how to read and write and find and file documents. One of our big problems is that it's, it's, it's difficult for us

• 56:14Speaker 00

  to understand bureaucratic systems, because they are a very recent development in human evolution.

• 56:21Speaker 00

  And this makes us suspicious about them. And we tend to believe all kinds of conspiracy theories about the deep state and about what's going on in all these bureaucracies. And it's really complicated and it's going to be more complicated as more of the decisions will be made by AI bureaucrats. An AI bureaucrat means that decisions like how much money to allocate to a particular issue will no longer be made by a human official. It will be made by an algorithm. And when people decide, why, when people ask, why is the switch system broken? Why didn't they, why didn't they give enough money to fix it?

• 57:07Speaker 00

  I don't know. The algorithm just decided to give the money to something else.

• 57:11Steven Bartlett?

  Why will bureaucracies be run by AI over people? Like, why will at some point a nation decide that in fact AI is better at making these decisions?

• 57:22Speaker 00

  First of all, it's not a future development. It's already happening. More and more of the decisions are being made by AIs. And this is just because the amount of information you need to take into account are enormous. And it's very difficult for humans to do it. It's much easier for the AIs to do it.

• 57:43Steven Bartlett?

  All these people, you know, bureaucrats, lawyers, accountants. It sounds like, I always wonder, you know, what are humans going to be left to do? In your book, you say that AI is going to far, AI is going so far beyond human intelligence that it should actually be referred to alien intelligence. And if it goes so far beyond human intelligence, it's my assumption that most of the work that we do is based on intelligence. So even like me doing this podcast now, this is me asking questions based on information that I've gathered, based on what I think I'm interested in, but also based on what I think the audience will be interested in. And

• 58:23Steven Bartlett?

  Compared to AI, I'm like a little monkey, like, you know what I mean? If AI has an IQ that is a hundred times mine and a source of information that is a fat million times bigger than mine, there's no need for me to do this podcast. I can get an AI to do it. And in fact, an AI can talk to an AI and deliver that information to a human. But then if we look at most industries, like being a lawyer, accountancy, I mean, a lot of the medical profession is based on information. Driving, I think that's the biggest employer in the world is the profession of driving, whether it's delivery or Uber or whatever it is. Where do humans belong in this complex?

• 59:00Speaker 00

  Anything which is just information in, information out is ripe for automation. These are the easiest jobs to automate.

• 59:10Steven Bartlett?

  Like being a coder?

• 59:11Speaker 00

  Like being a coder or again, like being an accountant, at least certain types of accountants, lawyers, doctors, they are the easiest to automate. If a doctor, the only thing they do is just take information in, all kinds of results of blood tests and whatever, and they information out, they diagnose the disease and they write a prescription, this will be easy to automate in the coming years and decades. But a lot of jobs, they require also social skills and motor skills. If your job requires a combination of skills from several different fields, it's not impossible, but it's much more difficult to automate it.

• 59:55Speaker 00

  So if you think about a nurse that needs to replace a bandage to a crying child, this is much, much harder to automate than just a doctor that writes a prescription. Because this is not just data. The nurse needs good social skills to interact with the child and motor skills to just replace the bandage.

• 1:00:18Speaker 00

  So this is harder to automate. And there will, even for people who just deal with information, there will be new jobs. The problem will be the retraining. And not just, you know, retraining in terms of acquiring new skills, but psychological retraining. How do you kind of reinvent yourself in a new profession? And do it not once, but again and again and again. Because as the AI revolution unfolds, and we are just at the very beginning of it, we haven't seen anything yet. So there will be old jobs disappearing, new jobs emerging, but the new jobs will rapidly change and vanish. And then there'll be a new wave of new jobs.

• 1:01:01Speaker 00

  And people will have to reinvent themselves four, five, six times to stay relevant. And this will create immense psychological stress.

• 1:01:11Steven Bartlett?

  So many of the big companies are also working at the same time on humanoid robots. There's this humanoid robot race going on. And by humanoid robots, I mean, you know, Tesla have their humanoid robot. I think it's called Optimus, which they're developing, and it'll cost, you know, X thousands of pounds. And I watched a video of it recently where it can do quite delicate sort of motor skill based stuff. So probably clean the house, it can probably work on the production line, it can probably put things in boxes.

• 1:01:39Steven Bartlett?

  And I just wonder, when we say, you know, people are going to lose their jobs, in a world where you have humanoid robots and you have intelligence that's beyond us. And you combine the two, where these humanoid robots are very, very intelligent. Like, I don't know what. I'm like, where did the unemployed go to? To find these new professions? Like, obviously, it's difficult to forecast the new professions of the future. History tells us that.

• 1:02:00Speaker 00

  Yeah.

• 1:02:01Steven Bartlett?

  But I can't, I can't figure out what the new professions are. I mean, my girlfriend does breathwork. I guess the breathwork part is quite easy to disrupt, but then she takes women away for retreats in Portugal and stuff. So I'm like, okay, she's going to kind of be safe because these women are going there to connect with humans and to be in this little special place offline intentionally. So retreats should probably be fine.

• 1:02:23Speaker 00

  Anything that, you know, there are things that we want in life, which are not just about solving problems. Like, I'm sick, I want to be healthy, I want my problem solved. But there are many things that we want to have a connection. Like, if you think about sports, robots or machines can run much faster than people.

• 1:02:48Speaker 00

  For a very long time now, and we just had the Olympics. And people are not very interested in seeing robots running against each other or against people. Because what really makes sports interesting in the end is the human weaknesses. And the ability of humans to to deal with their weaknesses. And and human athletes still have jobs. Even though, in in again, in many lines like running, you can have a machine run much faster than the world champion. I thought about this the other day. And uh uh and another example is is priests. Like, one of the easiest jobs to automate is the priesthood of at least certain religions.

• 1:03:31Speaker 00

  Because you just need to repeat the same texts and gestures again and again in in specific situations, like if you have a wedding ceremony. Then um you know, the priest just need to repeat the the same words. And there you are, you're married. Now, we don't think about priests as being in danger of being replaced by robots. Um because what we want from a priest is not just the mechanical repetition of certain words and gestures. We think that only another frail flesh and blood human

• 1:04:09Speaker 00

  who knows what is pain and love and and who can suffer, only they can connect us to the divine. So most people would not be interested in having their wedding conducted by a robot. Even though technically it's very easy to do it. Now, the the big question, of course, what happens if AI gains consciousness? This is like the trillion dollar question of of of AI consciousness. And then it's all bets are off. But that's a a a a different and very, very big discussion. I mean, whether it's possible, how would we know and and and so forth. Do you think it's possible? We have no idea. I mean, we don't understand what consciousness is. We don't know how it emerges in the organic brain.

• 1:04:53Speaker 00

  So we don't know if there is an essential connection between consciousness and organic biochemistry, so that it can't arise in an inorganic silicon-based computer. There is a big confusion, first of all, should be said again, between consciousness and intelligence. Intelligence is the ability to reach goals and solve problems. Consciousness is the ability to feel things like pain and pleasure and love and hate. Humans and other animals, we solve problems through our feelings. Our feelings are not something on the side.

• 1:05:35Speaker 00

  They are a main method for how to deal with the world, how to solve problems. Now, so far, computers, they solve problems in a completely different way than humans. Again, they are alien intelligence. They don't have any feelings. When they win a game of chess, they are not joyful. When they lose a game, they are not sad. They don't feel anything. Now, we don't know how organic brains produce these feelings of pain and pleasure and love and hate. So this is why we don't know whether an inorganic structure, based on silicon and not carbon,

• 1:06:17Speaker 00

  whether it will be able to generate such things or not. That's, I think, the biggest question in science. And so far, we have no answer.

• 1:06:29Steven Bartlett?

  Isn't consciousness just like a hallucination? Isn't it just like an illusion that I think I'm conscious because I've got a circuitry which tells me that I am effectively? It tells me through a bunch of like feelings and things that I'm conscious, like I think I'm looking at you now, I think I can see you.

• 1:06:45Speaker 00

  The feeling is real. I mean, even if we are all, it's like The Matrix. How do you know it's real? It's the only real thing in the world. I mean, there is nothing, I mean, everything else is just conjunction. We only experience our own feelings. What we see, what we smell, what we touch. This we actually experience, this is real. Then we have all these theories about why do I feel pain? Oh, it's because I stepped on a nail. There is such a thing in the world as a nail and whatever. It could be that we are all inside a big computer on the planet Zircon, run by super intelligent mice. If I spoke to an AI, I could get an AI to tell me that it feels pain and sadness.

• 1:07:27Speaker 00

  That's a big problem because there is a huge incentive to train AIs to pretend to be alive, to pretend to have feelings. And we see that there is a huge effort to produce such AIs. And in truth, because we don't understand consciousness, we don't have any proof, even that other humans have feelings. I feel my own feelings, but I never feel your feelings. I only assume that you're also a conscious being. And society grants a status of a conscious entity to, not only to humans, but also to some animals,

• 1:08:11Speaker 00

  not based on any scientific proof, but based on social convention. Like, most people feel that their dogs are conscious, that their dogs can feel pain and pleasure and love and so forth. So, society accepts, most societies, that dogs are sentient beings and they have some rights under the law. Now, as AI, even if AI has no feelings, no consciousness, no sentience whatsoever, but it becomes very good at pretending to have feelings and convincing us that it has feelings, then this will become a social convention that people will feel that their AI friend is a conscious being

• 1:08:56Speaker 00

  and therefore should be granted rights. And there is even already a legal path for how to do it. At least in the United States, you don't need to be a human being in order to be a legal person.

• 1:09:12Steven Bartlett?

  It's funny because you mentioned, you kind of alluded to the fact jokingly that we might just be in like a simulation. It was one of your like, well, maybe we're just in a simulation, but.

• 1:09:19Speaker 00

  Could be.

• 1:09:20Steven Bartlett?

  And it's funny because in a world of AI, I think my belief in that as a possibility has only increased. That this is in fact just a simulation because I've watched us go from when I was born, not really having internet access to now being able to kind of speak to this alien on my computer that can like now do things for me. And having virtual reality experiences, which are sometimes quite indistinguishable when my, you know, I fall into the trap of believing that I am inside squid games because I've got this headset on. And you play it forward and you play it forward and you play it forward and you imagine any rate of improvement. Then I hear the, the arguments for simulation theory and I go, do you know, probably if you play this forward a hundred years.

• 1:10:00Speaker 00

  Hmm.

• 1:10:02Steven Bartlett?

  You know, like at the rate we're on, the rate of trajectory we're on, then we will be able to create information networks and organisms that don't, in like a laboratory or in a computer, that don't necessarily realize.

• 1:10:19Speaker 00

  Yeah.

• 1:10:19Steven Bartlett?

  They're in the computer. Especially with like, what's going on with bio.

• 1:10:24Speaker 00

  It's already happening to some extent, you know, these information bubbles that more and more people live inside them. It's still not the whole physical world, but you get the same event and people on say, different parts of the political, political spectrum. They just can't agree on anything. They live in their own metrics. And you know, the, the, the, when, when, when the internet came along for the first time, the main metaphor was the web, the worldwide web. A web is something that connects everything. And now the main metaphor, which is, uh, the, the stimulate, this simulation theory is, is, is, is representing this new metaphor.

• 1:11:08Speaker 00

  The new metaphor is the cocoon. It's a web that turns on you and then closes you from all sides. So you can no longer see anything outside and there could be other cocoons with other people in there. And you have no way to get to them.

• 1:11:26Steven Bartlett?

  Yeah.

• 1:11:26Speaker 00

  No, nothing that happens in the world can connect you anymore because you're in different cocoons.

• 1:11:32Steven Bartlett?

  You've only got to look at someone else's phone. You've only got to look at someone else's Twitter or X or Instagram.

• 1:11:39Speaker 00

  Is this the same reality?

• 1:11:40Steven Bartlett?

  It is so different. I, do you know what I was talking about? Over the weekend, my friend was sat to my left scrolling. He clicked on the discovery section, which is where you find new content. I looked down at his phone and was like, it's all Liverpool Football Club. It's like the entire feed is Liverpool. And my entire feed is completely different. And I was just thinking, wow, he lives in a completely different world to me. Because he's a Liverpool fan, I'm a Manchester United fan. And, and it's, yeah, just, and to think about that, like, to think that when you open your phone, and many of us are spending up to nine hours a day on our mobile phones, you're experiencing a completely different window into a completely different world than I am.

• 1:12:19Speaker 00

  And, and this was, you know, this, this is a very ancient fear. Because, um, for instance, Plato wrote exactly about that. And the most famous parable, I think, from Greek philosophy is the, the allegory of the cave in which Plato imagines a theoretical scenario, an imaginary scenario of, of a group of prisoners chained inside a cave with their face to a blank wall in which shadows are being projected from behind them. And they mistake the shadows for reality. And he was basically describing, you know, people in front of a screen. Just mistaking the screen for reality.

• 1:13:01Speaker 00

  And you have the same thing in ancient India with Buddhists and Hindu sages talking about, uh, uh, Maya, which is the world of illusions. And the deep fear that maybe we are all trapped inside a world of illusions that the, the most important thing that we think in the world, uh, the, the wars we fight, we fight wars over illusions in our mind.

• 1:13:32Speaker 00

  And, uh, this is now becoming technically possible. Like previously, it was these philosophical thought experiments. Now, part of what is interesting as a historian about the present era is that a lot of ancient philosophical problems and discussions are becoming technical issues. That, yes, you can suddenly realise Plato's cave in your phone.

• 1:14:02Steven Bartlett?

  So scary. I find it really scary because you're right, like, I think right now, some people might say that they have some kind of grasp over like the ranking system or why something shows up when I search it or whatever. But as these intelligence aliens become more and more powerful, it's of course we would have less understanding because we're like handing over the decision making.

• 1:14:24Speaker 00

  In some industries, they are now completely the kingmakers. Like, I'm here on a book tour. I wrote Nexus, so I go from podcast to podcast, from TV station to TV station to talk about my book. But the entities I'm really trying to impress are the algorithms. Because if I can get the attention of the algorithms, the humans will follow.

• 1:14:56Speaker 00

  You know, that's our reality. We are basically kind of carbon creatures in a silicon world.

• 1:15:02Steven Bartlett?

  I used to think we were in control, though, and now I feel like the silicon's in control.

• 1:15:07Speaker 00

  Control is shifting. We are still in control to some extent. We are still making the most important decisions, but not for long. And this is why we have to be very, very careful about the decision we make in the next few years. Because in 10 years, in 20 years, it could be too late. By then, the algorithms will be making the most important decisions.

• 1:15:32Steven Bartlett?

  You talk about a couple of big dangers you see with the algorithms and AI and the sort of shift in disruption of information. One of them is this alignment problem. Which, how would you explain the alignment problem to me in a way that's simple to understand?

• 1:15:47Speaker 00

  So the classical kind of example is a thought experiment invented by the philosopher Nick Bostrom in 2014, which sounds crazy, but you know, bear with it. He imagines a super intelligent AI computer, which is bought by a paperclip factory. And the paperclip manager tells the AI, your goal, the reason I bought you, your goal, your entire existence, you're here to produce as many paperclips as possible. That's your goal. And then the AI conquers the entire world, kills all the humans,

• 1:16:29Speaker 00

  and turns the entire planet into factories for producing paperclips. And it even begins to send expeditions to outer space to turn the entire galaxy into just paperclip production industry. And the point of the thought experiment is that the AI did exactly what it was told. It did not rebel against the humans. It did exactly what the boss wanted. But of course, it was not... The strategy it chose was not aligned with the real intentions, with the real interests of the human factory manager, who just couldn't foresee that this will be the result.

• 1:17:11Speaker 00

  Now, this sounds like outlandish and ridiculous and crazy, but it already happened to some extent, and we talked about it. This is the whole problem with social media and user engagement. In the very same years that Nick Bostrom came up with this thought experiment in 2014, the managers of Facebook and YouTube, they told their algorithms, "Your goal is to increase user engagement." And the algorithms of social media, they conquered the world and turned the whole world into user engagement, which was what they were told to do. We are now very, very engaged.

• 1:17:54Speaker 00

  And again, they discovered that the way to do it is with outrage and with fear and with conspiracy theories. And this is the alignment problem. When Mark Zuckerberg told the Facebook algorithms, "Increase user engagement", he did not foresee and he did not wish that the result will be collapse of democracies, wave of conspiracy theories and fake news, hatred of minorities. He did not intend it. But this is what the algorithms did. Because there was a misalignment between the way that the algorithm, the goal that was defined to the algorithm,

• 1:18:38Speaker 00

  and the interests of human society, and even of the human managers of the companies that are deployed these algorithms. And this is still a small-scale disaster. Because the social media algorithms that created all this social chaos over the last 10 years, they are very, very primitive AI. This is like the amoebas of, if you think about the development of AI as an evolutionary process, for this is still the amoeba stage. The amoeba being the very simple. The very simple life forms, the beginning, like the single-cell life form.

• 1:19:24Speaker 00

  We are still, in evolutionary terms, organic evolution, we are like billions of years before we will see the dinosaurs and the mammals or the humans. But digital evolution is billions of times faster than organic evolution. So the distance between an AI amoeba and the AI dinosaurs could be covered in just a few decades. If ChatGPT is the amoeba, how would the AI Tyrannosaurus Rex would look like? And this is where the alignment problem becomes really disconcerting. Because if so much damage was done

• 1:20:07Speaker 00

  by giving kind of the wrong goal to a primitive social media algorithm, what would be the results of giving a misaligned goal?

• 1:20:18Speaker 00

  To a T-Rex AI in twenty or thirty years.

• 1:20:23Steven Bartlett?

  The issue at the heart of this is, you know, some people might think, okay, just give it a different goal. But when you're dealing with private companies who are listed on the stock market, there really is only one goal that keep that.

• 1:20:34Speaker 00

  Make money.

• 1:20:35Steven Bartlett?

  Exactly, that benefits survival. So all of the platforms have to say, you know, the goal of this platform is to make more money and to get more attention.

• 1:20:44Speaker 00

  Because also it's mathematically easy. And there is a huge, huge problem in how to define for AIs and algorithms, the the goal in a way they can understand. Now, the the great thing about make money or increase user engagement is that it's very easy to measure it mathematically. Uh, one day you have a million hours being watched on YouTube. Then next, a year later, it's two million. Very easy for the algorithm to see, hey, I'm making progress. But let's say that uh, that Facebook would have told its algorithm, increase user engagement in a way that doesn't undermine democracies. How do I measure that?

• 1:21:29Speaker 00

  Who knows what is the definition for the robustness of the of democracy? Nobody knows. So defining the goal for the algorithm as increase user engagement, but don't harm democracy, almost impossible. This is why they go for the kind of of of easy goals, which are the most dangerous.

• 1:21:50Steven Bartlett?

  But even in that scenario, if I told, if I'm the owner of a social network and I say increase user engagement, but don't harm democracy, the problem I have is my competitor, who leaves out the second part and just says increase user engagement, is gonna beat me. Because they're gonna have more users, more eyeballs, more revenue. Advertisers are gonna be happier, then my company is gonna falter, investors are gonna pull out.

• 1:22:11Speaker 00

  That's a question, because there are two things to take into consideration. First of all, you have governments. Governments can regulate. And they can penalize a a social media company that defines goals in a socially responsible way. Just as they penalize newspapers or TV stations or or or car companies that behave in an antisocial way. The other thing is that humans are not stupid and self-destructive. That if we we would like to have better products in the sense of also socially better products.

• 1:22:53Speaker 00

  And I I gave earlier the example with food diets. Like, think how much, yes, the food companies, they discovered that if they fill a product artificially with lots of fat and sugar and salt, people would like it. But people discovered that this is bad for their health. So you now have, for instance, a huge market for diet products, and people are becoming very aware of what they eat. The same thing can happen in the information market.

• 1:23:23Steven Bartlett?

  The cost, though, is like eighty, seventy, eighty percent of people in the US have like chronic disease and are obese and, you know, life expectancy is now, it looks like it's going the other way a little bit in the in the Western world. And and it's, I don't know, I just feel like with um with policing consumption of goods like alcohol, nicotine, food, seems much more simple than policing information and the flow of information. Beyond, you know, beyond racism or like inciting violence. I don't know how you police.

• 1:24:00Speaker 00

  Hey, we we already covered that the two most basic and powerful tools are to hold companies liable for the actions of their algorithms, not for the content that the users produce, but for the actions of the algorithms. I don't I don't think we should penalize Twitter or Facebook. If somebody posts a racist post, I would be very careful about penalizing Facebook for that. Because then who decides what is racism and so forth? But if the algorithm of of Facebook deliberately spreads some racist conspiracy theory, that's the algorithm. That's not human free speech.

• 1:24:45Steven Bartlett?

  How do you know it's a racist conspiracy theory, though?

• 1:24:47Speaker 00

  Okay, so now now we get to the to the difficult conversation, but this is something that we have the quotes for. And I would be very, very careful about having the courts judge on the content of the production of individual users. But when it comes to algorithms deliberately, routinely spreading a particular type of information, like a conspiracy theory, we can involve the courts. The key issue is who has liability? That it's the company that is liable for what the algorithm is doing and not the human individual liable for what they are saying.

• 1:25:28Speaker 00

  And another key distinction here is between private and public. Like, part of the problem is the erasure of the boundary between the two. I think that humans have a right to stupidity in private. That in your private space, with your friends and with your family, you have a right to stupidity. You can say stupid things. You can tell racist jokes. You can tell homophobic jokes. It's not good, it's not nice, but you're a human being. You're allowed to do that. But not in public. I mean, even for politicians, like as a gay person, if the prime minister tells a homophobic joke in private,

• 1:26:13Speaker 00

  I don't need to care about that. That's his or her business. But if they say it in public on television, that's a huge problem. Now, traditionally, it was very easy to distinguish private from public. You are in your private house with a group of friends. You say something stupid, that's private. It's nobody's business. You go to the town square and you stand on a pedestal and you shout something to thousands of people, that's public. Here, you can be punished if you say something racist or homophobic or outrageous. But it was easy for you to know. Now, the problem is, you go, let's say, on WhatsApp. You think you're just talking with two of your friends

• 1:26:57Speaker 00

  and you say something really stupid. And then it gets viral and it's all over the place. And I don't have an easy solution for that. But one...

• 1:27:12Speaker 00

  One measure which is adopted by some governments is, for instance, that people who have a large following, they are held to a different standard than people who don't. Even on the most basic thing of identifying yourself as a human being. We don't want that everybody would have to get some certification from the government to talk with their friends on WhatsApp. But if you have a hundred thousand followers online, we need to know that you are not a bot, that you're actually a human being. And again, this is not covered by freedom of speech because bots don't have freedom of speech.

• 1:27:52Steven Bartlett?

  It's slippery slope, right? Because I've, I've gone back and forth on this argument of anonymity and whether it's a good thing or a bad thing for social networks. And the rebuttal that I got when I leant to the side of IDing people is that like totalitarian governments will use that as a way to basically punish the people who are speaking.

• 1:28:10Speaker 00

  That totalitarian governments are doing it whether we like it or not. It's, it's not a question that if the British do it, then the Russians will say, okay, so we'll also do it. The Russians are doing it anyway.

• 1:28:21Steven Bartlett?

  Well, Americans start to do it. Well, they start to, if, if someone speaks out against Trump and he has access to their identity and information, can he go look at them and get them arrested?

• 1:28:30Speaker 00

  If we reach that point, when the courts will allow such a thing, then we are in very deep trouble already. And what we should realize is that with the surveillance technology now in existence, a totalitarian government has so many ways to know who you are, that it's, that's not the, the, the main issue.

• 1:28:54Steven Bartlett?

  You talked about the platforms being responsible for the consequences.

• 1:28:59Speaker 00

  Yes.

• 1:29:00Steven Bartlett?

  In the UK, over the last month, we've had, I don't know if you've heard, but we had riots and I think it was all triggered originally when there was news that broke that a, someone had murdered some young children.

• 1:29:13Speaker 00

  Yes.

• 1:29:14Steven Bartlett?

  And there was a confusion or a sort of misinformation around that person's religion. And that meant that people.

• 1:29:20Speaker 00

  That's an excellent example because, you know, if I personally privately say.

• 1:29:26Speaker 00

  To just two of my friends. I think the person who did it is X. I don't think we should be, you should be persecuted for that. I could say it in my private living room, and it's the same thing if I say it on WhatsApp or on Facebook. But if a Facebook algorithm picks up this piece of fake news and starts recommending it to more and more users, then Facebook is liable for the action of its algorithms. You can, you should be able to take it to court and say the algorithm deliberately recommended a piece of fake news.

• 1:30:05Speaker 00

  And again, if, if the fake news was produced by an influencer with a million followers, then it's also his, he is also liable for that. But if, if a private individual, in a private setting, uh, said something which is not true, it's fake news, and then an algorithm deliberately spread it, the main fault is with the algorithm. And the people who should be in jail are the managers of the company that owns this algorithm and not the individual who uttered the, the words. Going back to the riots issue, let's say that, I don't know, The Guardian, on the day of, of, of the riots,

• 1:30:49Speaker 00

  decided to pick up a piece of, of this fake news and publish it on its front page. And they now go, take the editor of The Guardian to court, and he says, but I didn't write it. I just found this piece of fake news and decided to put it on the front page of The Guardian. Now, it would be obvious to us that the editor did something very, very, very wrong. And he might, or she might have to sit in jail. And it's not the problem of the person who originally produced the piece of fake news. If you're the editor of one of the biggest newspapers in, in the country, and you decide to publish something on your front page, you had better be very, very sure

• 1:31:35Speaker 00

  that what you're publishing is the truth, especially if it can incite to violence.

• 1:31:39Steven Bartlett?

  How would a social network owner know that? How would they be able to verify that everything is true at that scale?

• 1:31:45Speaker 00

  Not everything. But if, uh, for instance, something is likely to lead to violence, and the very first, it, it, it's a precautionary principle. First of all, do no harm. Again, I'm not asking Facebook to censor the piece of fake news. I'm only asking it, don't get your algorithms to spread it on purpose in order to get user engagement and make a lot of money. If you're not sure about it, just don't spread it. It's as easy as that.

• 1:32:18Steven Bartlett?

  How does it know it's fake news versus it thinking that it's actually really important lifesaving news? So for example,

• 1:32:25Speaker 00

  That's the responsibility of the company. Again, like, how does the editor of The Guardian know, or of The Financial Times, or of The Sunday Times, how do they know if something is true? And if something should be published on the front page? If you are now managing a social media company, you are managing one of the most powerful newspapers in the world. And you should have the same kind of responsibilities and the same kind of expertise. If you have no idea how to judge whether an algorithm should recommend something to millions of people, you're in the wrong business. You know, if you can't stand the heat, get out of the kitchen. Don't run a social media company if you don't know what should be shown to millions of people.

• 1:33:10Steven Bartlett?

  One of the, it's very pertinent, because obviously Mark Zuckerberg's letter that he wrote this week says, "I was approached by the FBI who told me that Russia were trying to influence the elections, and they were given some information that there was this laptop story, Joe Biden, Hunter Biden, who is Joe Biden's son, had this laptop story, which Facebook didn't know if it was real or not. And they thought maybe it was a Russian plant, i.e. Russia had put the story there to try and make sure Joe Biden didn't win the elections. So Facebook deprioritized it, stopped it going viral and suppressed it. Turns out it was a real story, and it wasn't fake. And Mark Zuckerberg says he regrets suppressing it because it was in fact a real story.

• 1:33:55Steven Bartlett?

  And suppressing it, he kind of influenced the election to some degree.

• 1:34:00Steven Bartlett?

  So it's so complicated to the point that I just can't.

• 1:34:03Speaker 00

  It's complicated to run a big media company.

• 1:34:06Steven Bartlett?

  If you do.

• 1:34:07Speaker 00

  It's complicated to run the Wall Street Journal or Fox News. And then what happens if the FBI comes to Fox News or comes to the Wall Street Journal and tells them, look, there is this story planted by the Russians, don't encourage it. And later on, it turns out that it was wrong.

• 1:34:27Speaker 00

  Could happen. And as the manager of the Wall Street Journal, you need to deal with it. And do I trust the FBI? Under what conditions? Sometimes I should, sometimes I should be suspicious.

• 1:34:37Steven Bartlett?

  I feel like you're gonna end up in jail. If you're the editor of the Wall Street Journal, you're gonna end up in jail either way. Because either way, you're influencing elections. And if you influence.

• 1:34:46Speaker 00

  But that's the business. I mean, the real problem is when you have extremely powerful people like Zuckerberg or Elon Musk that pretend that they don't have power, that they don't have influence, that they don't shape elections. We know for centuries that the owners and editors of newspapers, they shape elections. And therefore, we hold them to certain standards. And now, the owners and managers of platforms like Twitter and YouTube and Facebook, they have more power than the New York Times or the Guardian or the Wall Street Journal. And they should be held to at least the same degree of accountability.

• 1:35:29Speaker 00

  And their shtick that, oh, we are just a platform, we just allow everybody to publish what they want, it doesn't work like that. And we don't accept it with traditional media. So why should we accept it with? That's the whole trick of these tech companies, that again, we have thousands of years of history and they tell us, oh, it doesn't apply to us. Like, if you have a traditional industry like cars, it's obvious to everybody, you cannot put a new car on the road unless you made some safety checks to make sure the car is safe. You cannot put a new medicine in the, on the market or a new vaccine on the market without safety. That's obvious, right?

• 1:36:10Speaker 00

  But when it comes to algorithms, no, no, no, no, that's a different set of rules. You can put any algorithm you want on the market, you don't need any safety rules. And even more basic than that, you think about something like theft. You have the 10 commandments, don't steal. And you know, people know, yes, you shouldn't steal until it comes to information. Ah, no, no, no, it doesn't apply to information. I can take your information and without your permission, do all kinds of things with it and sell it to third parties. And this is not stealing. Don't steal doesn't apply to my line of business. And this is what the tech giants have been doing in many cases over the last decade or two, telling us that history doesn't apply to them.

• 1:36:55Speaker 00

  That all the wisdom that humanity gained in a very painful way over centuries and thousands of years of dealing with dictatorships and with whatever, it doesn't apply to the new technology. And it does, it does apply.

• 1:37:11Steven Bartlett?

  Do you ever feel tempted to just log off? And just like go live in a field somewhere, maybe like a desert, maybe just create a little bit of a cult and...

• 1:37:20Speaker 00

  I do it every year.

• 1:37:21Steven Bartlett?

  Oh, really?

• 1:37:21Speaker 00

  Yeah, I take a long meditation retreat of between 30 days and 60 days. Like this year, I plan in December, after the book tour is over, to go 60 days for meditation retreat in India and just completely disconnect. No smartphone, no internet, not even books or writing paper. Just, just an information fast. Why? It's good for the mind. Again, like with food, too much in isn't good for us. We need time to digest and to detoxify. And it's true of the mind as well. If you just keep bombarding it with more, it's, you get addicted to the wrong things, you develop bad habits.

• 1:38:06Speaker 00

  And you need, or at least I need, time off in order to really kind of digest everything that happened and to decide what I want and what I don't want, what kind of habits, addictions I should, I should try to, to, to be rid of. And also to, you know, to get to know my own mind. When the mind is constantly bombarded by information from outside, you, it's so noisy, you cannot get to know it because there is so much noise. But when the noise is, goes away...

• 1:38:55Speaker 00

  Then you can start to understand what is the mind? How does it function? How does it work? Where do thoughts come from? What is fear? What is anger? When you're boiling with anger because of something you just you now read, you are focused on the object of your anger, but you can't understand the anger itself. The anger controls you.

• 1:39:19Speaker 00

  When you have an information fast, you can just observe what happens to me when I'm angry? What happens to my mind, to my body? How does it control me? And this is more important than any angry story in the world, to understand what anger actually is. It's very, very difficult. I mean, how many times do people stop and just, you know, try to get to know their anger? And not the object of the anger. This is we do all the time. We kind of replay. We heard something terrible that a politician we don't like. Like, I don't know, somebody is angry about Trump. So he would replay it again and like, oh, he said like this. He did like that. He will do this. He will do that. And you don't get to know your anger that way.

• 1:40:04Steven Bartlett?

  So interesting. I was playing out the scenarios in my head as you were speaking of this future where there's almost these two species of human. You have one species of human who are connected to the information highway through the internet, through the Neuralink in their brain. That's just like they're hooked. And the algorithm is feeding them information and they're acting upon it and they're feeding it. And then you have this other group of people who decided to reject that, who didn't get the Neuralink, who aren't trying to interface with AI and that are living in a tribe in some jungle somewhere. And I like, my girlfriend said this to me many years ago. She's going, I think there's going to be a split. And I kind of like, you know, whatever. But now I'm like, I can see why as things get more extreme, you go, you know what? I'm going to make a decision here.

• 1:40:48Steven Bartlett?

  And especially when I saw the Neuralink that Elon Musk's working on that allows you to control computers with your brain. I sat on the computer to control your brain also. Yeah, you're right. And she didn't think about that. But I just imagined, and this is a question for everyone listening, if there's you and me and I have the chip in my brain that now humans have in their brain that they're using to control computers with. I am a different species to you because I can control the, I can control my car downstairs. I can control the lights in this room. I can, I can ask my brain questions and get the answers. My IQ becomes 5,000. Yours is still 150 or 200. Yours is probably 250. But I'm a different species to you.

• 1:41:30Steven Bartlett?

  I have such a huge competitive advantage over you that if you don't get the chip,

• 1:41:37Steven Bartlett?

  then you're, you're screwed.

• 1:41:38Speaker 00

  That's speciation.

• 1:41:39Steven Bartlett?

  Yeah.

• 1:41:40Speaker 00

  Again, on a small scale, we saw it before in history. There are the people who adopted the written documents and the people who rejected it. And they are not with us anymore because the people who adopted the written document, they built these kingdoms and empires and they conquered everybody else. And we are in danger of the same thing happening. And this is not a good thing because it's not like life was better for the people with the documents. In many cases, life was better for the hunter gatherers who lived before.

• 1:42:13Steven Bartlett?

  So what's the solution? If I had to, you know, having read your book, brilliant book, Nexus, A Brief History of Information Networks from the Stone Age to AI.

• 1:42:24Steven Bartlett?

  What is the solution? How do we, how do we stop the alignment problems? Us all becoming paperclips, the social chaos, the misinformation, the, the silicon curtain, as you talk about in the book. How do we stop these things destroying our world? Is there, is there hope? Are you optimistic?

• 1:42:41Speaker 00

  The, the key is, is, is cooperation, is connection between humans. I mean, the humans are still more powerful than the AIs. The problem is that we are divided against each other and the algorithms unintentionally are increasing the divide. Again, this is the oldest rule of every empire is divide and rule.

• 1:43:05Speaker 00

  This was the rule of the Romans, of the British Empire. If you want to rule a place, you divide the people of that place against one another, and then it's easy to manipulate and control them. This is now happening to the entire human species with AI. That just as we had kind of, you know, the Iron Curtain in the Cold War, now we have the Silicon Curtain. Dividing not just China from the US, but also Democrats from Republicans, also one person from another person, and all of us from the AIs, which increasingly make the decisions about all that. We still have the power for, I don't know, five years, 10 years, 20 years,

• 1:43:48Speaker 00

  to make sure it doesn't go in dystopian direction. But for that, we need to cooperate. Are you optimistic?

• 1:43:55Speaker 00

  I try to be a realist. I mean, the last few, I mean, I just came from Israel, and I saw a country destroying itself, for no good reason whatsoever. It's a country that just pressed the self-destruct button. And for no good reason. And it can happen on a global scale. What do you mean it pressed the self-destruct button? It's not just the war between Israelis and Palestinians, but Israeli society turning against itself, greater and greater division and animosity. And it's like a dark hole of anger and of violence, which is sucking more and more people in.

• 1:44:40Speaker 00

  You know, all over the world, you now feel the shockwaves from this dark hole in the Middle East. And there is no good reason. There is no objective reason. If, I'll say something about the Israeli-Palestinian conflict. There is no objective reason for it. It's not like there is not enough land between the Mediterranean and the Jordan River that people have to fight for the little land there is, or that there is not enough food. There is enough food for everyone to eat. There is enough land to build houses and hospitals and schools for everyone. Why do people fight? Because of different stories in their minds. They have these different mythologies that God gave this whole place just to us. You have no right to be here.

• 1:45:25Speaker 00

  And they fight over that. And this is a local or regional tragedy, it can happen on a global scale. Again, if something ultimately destroys us, it will be our own delusions, not the AIs. The AIs, they get their opening because of our weaknesses, because of our delusions.

• 1:45:50Steven Bartlett?

  Yuval, thank you so much for writing a book. I think this book is one of the most well timed books that I've ever come across because of everything that's happening in the world right now. And it really helped me to understand that the problem isn't necessarily me versus you, if you're on the other side of the aisle. The problem is information, the networks of information that we consume, who's controlling those networks of information.

• 1:46:13Speaker 00

  Somebody is manipulating us to be on different sides, not just to be on different sides, but to see each other as enemies.

• 1:46:19Steven Bartlett?

  And right now, that's a person. But it might not be.

• 1:46:22Speaker 00

  Soon it might not be a person, no.

• 1:46:25Steven Bartlett?

  And understanding that, I think, helps us focus on the root cause of issues that are sometimes hard to identify. I think the problem is my neighbor. I think it's that person with different color skin. But actually, if you look one level deeper, it's the information networks and what I'm being exposed to that are brainwashing me and creating those stories. And as you talk about in your previous book, stories are ultimately what are running the world. And it's this wonderful, the nexus is just a wonderful book at a wonderful time that helps us to access this knowledge of the power of information and how it impacts democracy and relationships and society and business and everything in between in a way that I hope will lead to action. And

• 1:47:09Steven Bartlett?

  I think that is something to be optimistic about.

• 1:47:13Speaker 00

  Yeah, ultimately, I think most humans are good, good people. When you give people bad information, they made bad decisions. The problem is not with the humans, it's with the information.

• 1:47:29Steven Bartlett?

  Amen. Yuval, we have a closing tradition on this podcast where the last guest leaves a question to the next guest, not knowing who they're going to be leaving it for.

• 1:47:35Speaker 00

  Oh, okay.

• 1:47:36Steven Bartlett?

  And the question left for you is, what does it mean to be strong?

• 1:47:46Speaker 00

  Um.

• 1:47:50Speaker 00

  To to accept reality as it is. Uh, to deal with reality without trying to hide it, disappear it, uh, uh, put a veil over it.

• 1:48:04Steven Bartlett?

  So interesting.

• 1:48:07Steven Bartlett?

  I think you're right.

• 1:48:10Steven Bartlett?

  I think you're right. Certainly not the answer I would have given, but you know, you come to.

• 1:48:13Speaker 00

  What would you say?

• 1:48:15Steven Bartlett?

  Um.

• 1:48:19Steven Bartlett?

  Oh, what would I say?

• 1:48:23Steven Bartlett?

  I guess I probably would have spoken to like perseverance in the face of a lot of different difficulties. And one of those is in is information, but it's just that that idea of like persevering towards whatever your subjective goal is in the face of and in spite of a variety of different difficulties. Maybe that's strength. Um, so that could be raising a kid or it could be going to the gym or whatever. But I like your definition as well, because I think it's much more um important in the times we find ourselves in. And as on honestly, as a podcaster, you sometimes feel like you're caught right in the middle of it. Because I think everyone's trying to figure out if I'm like on the right wing, on the left wing, if I believe this, if I endorse every guest that I sit with. And you almost have to try and remain impartial. But it's very, very uh.

• 1:49:10Steven Bartlett?

  Difficult to for people to understand that because they want you to fit somewhere and they want.

• 1:49:17Speaker 00

  Because that's weakness. I mean, you have a lot of people who claim to be very strong.

• 1:49:22Steven Bartlett?

  Yeah.

• 1:49:22Speaker 00

  Who admire strength as as a value.

• 1:49:25Steven Bartlett?

  Yeah.

• 1:49:26Speaker 00

  But they can't deal with parts of reality that don't fit into their worldview or their desire.

• 1:49:34Steven Bartlett?

  Yeah.

• 1:49:35Speaker 00

  And they think that strength is I have the strength to just make these parts of reality disappear.

• 1:49:41Steven Bartlett?

  Yeah.

• 1:49:41Speaker 00

  And no, this is weakness. And I am sorry for going back to that, but this is also the war. Like what is war is trying to disappear a part of reality that you don't like. In this case, an entire people. I don't like these people. I don't think they should be in reality, so I try to make them disappear. And people say, oh, he's a very strong leader. He's not. He's a very weak leader. That a strong leader would be able to acknowledge, no, these people exist. They are part of reality. Let's now find out how do we live with them.

• 1:50:20Steven Bartlett?

  Amen. Your book Nexus, A Brief History of Information Networks from the Stone Age to AI, is a must read for everybody that listens to this podcast and has any interest in these subjects at all. It's endorsed by two of my favorite people, Mustafa Suleyman, but also Stephen Fry and Roy Stewart, who's a great person as well. And it's endorsed for a very good reason because it's a completely mind expanding book written from someone who only writes exceptional, culture shifting books. So I'm going to link it below. I highly recommend anybody that's listened to this conversation and that's interested in this subject matter to go and get this book right now. It's available right now for preorder and then it's shipping in five days from now when it releases. So be the first to read it and hopefully be the first to understand and action some of the things that you learn in this book.

• 1:51:05Steven Bartlett?

  Yuval, thank you so much for your time.

• 1:51:07Speaker 00

  Thank you.