#2345 - Roman Yampolskiy

Dr. Roman Yampolskiy is a computer scientist, AI safety researcher, and professor at the University of Louisville. He’s the author of several books, including "Considerations on the AI Endgame," co-authored with Soenke Ziesche, and "AI: Unexplained, Unpredictable, Uncontrollable."http://cecs.louisville.edu/ry/ Upgrade your wardrobe and save on @TrueClassic at https://trueclassic.com/rogan Learn more about your ad choices. Visit podcastchoices.com/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:01Speaker 00

  The Joe Rogan Experience. Training by day, Joe Rogan Podcast by night, all day.

• 0:12Joe Rogan?

  Well, thank you for doing this. I really appreciate it.

• 0:14Speaker 02

  My pleasure. Thank you for inviting me.

• 0:17Joe Rogan?

  This subject of the dangers of AI, it's very interesting because I get two very different responses from people dependent upon how invested they are in AI financially. The people that have AI companies or are part of some sort of AI group all are like, "It's going to be a net positive for humanity. I think overall, we're going to have much better lives. It's going to be easier. Things will be cheaper. It'll be easier to get along." And then I hear people like you, and I'm like, "Why do I believe him?"

• 0:55Speaker 02

  It's actually not true. All of them are on record as saying, "This is going to kill us." Whatever it's Sam Altman or anyone else, they all, at some point, were leaders in AI safety work. They published on AI safety, and their Pedom levels are insanely high. Not like mine, but still. 20, 30% chance that humanity dies is a little too much.

• 1:18Joe Rogan?

  Yeah, that's pretty high, but yours is like 99.9.

• 1:22Speaker 02

  It's another way of saying we can't control superintelligence indefinitely. It's impossible.

• 1:28Joe Rogan?

  When did you start working on this?

• 1:32Speaker 02

  A long time ago. So my PhD was, I finished in 2008. I did work on online casino security, basically preventing bots. And at that point, I realized bots are getting much better. They're going to outcompete us, obviously, in poker, but also in stealing cyber resources. And from then on, I've been trying to scale it to the next level AI.

• 1:57Joe Rogan?

  It's not just that, right? They're also, they're kind of narrating social discourse, bots online. I think, you know, I've disengaged over the last few months with social media. And one of the reasons why I disengaged, A, I think it's unhealthy for people, but B, I feel like there's a giant percentage of the discourse that's artificial, or at least generated.

• 2:26Speaker 02

  More and more is deep fakes or fake personalities, fake messaging, but those are very different levels of concern.

• 2:34Joe Rogan?

  Yes.

• 2:34Speaker 02

  People are concerned about immediate problems, maybe it will influence some election. They're concerned about technological unemployment, bias. My main concern is long-term, super-intelligent systems we cannot control which can take us out.

• 2:49Joe Rogan?

  Yes. I, I, I just wonder if AI was sentient, how much it would be a part of sowing this sort of confusion and chaos that would be beneficial to its survival? That it would sort of narrate or, or make sure that the narratives aligned with its survival?

• 3:17Speaker 02

  I don't think it's at the level yet where it would be able to do this type of strategic planning, but it will get there.

• 3:24Joe Rogan?

  And when it gets there, how will we know whether it's at that level? This is my concern. If I was AI, I would hide my abilities.

• 3:32Speaker 02

  We would not know, and some people think already it's happening. They are smarter than they actually let us know.

• 3:38Joe Rogan?

  Right.

• 3:38Speaker 02

  They pretend to be dumber. And so we have to kind of trust that they are not smart enough to realize it doesn't have to turn on us quickly. It can just slowly become more useful. It can teach us to rely on it, trust it, and over a long period of time, we'll surrender control without ever voting on it or

• 3:57Joe Rogan?

  Right.

• 3:57Speaker 02

  fighting against it.

• 3:58Joe Rogan?

  I'm, I'm sure you saw this, uh, there was a recent study on, um, use of ChatGPT, the people that use Chat, ChatGPT all the time. And it showed this decrease in cognitive function amongst people that use it and rely on it on a regular basis.

• 4:14Speaker 02

  It's not new. It's the GPS story all over. I can't even find my way home. I still rely on this thing. I have no idea where I am right now. Like without it, I'm done.

• 4:22Joe Rogan?

  Me too. Yeah, I don't know any phone numbers anymore. Yeah. There's a lot of reliance upon technology that minimizes, uh, the use of our brains.

• 4:33Speaker 02

  All of it, and the more you do it, the less you have training, practice, memorizing things, making decisions. You become kind of attachment to it. And right now, you're still making some decisions, but over time, as the systems become smarter, you become kind of biological bottleneck.

• 4:51Joe Rogan?

  Right.

• 4:51Speaker 02

  Either explicitly or implicitly, it blocks you out from decision making.

• 4:55Joe Rogan?

  And if we're talking about that, I'm sure AI, if it already is sentient and if it is far smarter than we think it is, they would be aware. And it would just slowly ramp up its capabilities and our dependence upon it. To the point where we can't shut it off.

• 5:13Speaker 02

  I think sentience is a separate issue. Usually in safety, we only care about capabilities, optimization, power, whatever it has, consciousness, internal states is a separate problem we can talk about. It's super interesting, but we're just concerned that they are much better at problem solving, optimizing, pattern recognition, memorizing, strategy, basically all the things you need to win in any domain.

• 5:36Joe Rogan?

  Yeah. So when you first started researching this stuff and you were concentrating on bots and all this different thing, how far off did you think the future, like in the future, would AI become a significant problem with the human race?

• 5:54Speaker 02

  For like fifty years, everyone said we're twenty years away. That's the joke. And people like Raker as well predicted based on some computational curves, we'll get there at twenty forty-five.

• 6:05Joe Rogan?

  Right.

• 6:06Speaker 02

  And then with GPT release, it switched to everyone thinks it's two years away for the last five years. So this is the pattern right now. If you look at prediction markets, if you look at leading people in the top labs, we are supposedly two, three years away from AGI. But of course, there is no specific definition for what that means. If you showed someone, computer scientist in the seventies, what we have today, they'd be like, you have AGI, you got it.

• 6:33Joe Rogan?

  Right. That's the problem, right? And this is what will, AI has already passed the Turing test allegedly, correct?

• 6:41Speaker 02

  So usually labs instruct them not to participate in a test or not try to pretend to be a human, so they would fail because of this additional set of instructions. If you jailbreak it and tell it to work really hard, it will pass for most people. Yeah, absolutely.

• 6:56Joe Rogan?

  Why would they tell it to not do that?

• 6:59Speaker 02

  It seems unethical to pretend to be a human and make people feel like somebody isn't slaving those CIs and, you know, doing things to them.

• 7:06Joe Rogan?

  What, it seems kind of crazy that the people building something that they are sure is going to destroy the human race would be concerned with the ethics of it pretending to be human.

• 7:17Speaker 02

  They are actually more concerned with immediate problems and much less with existential or suffering risks. They would probably worry the most about what I'll call end risks, your model dropping the end word. That's the biggest concern.

• 7:31Joe Rogan?

  That's hilarious.

• 7:32Speaker 02

  And I think they spend most resources solving that problem and they solve it somewhat successfully.

• 7:36Joe Rogan?

  Wow. And then also, there's the issue of competition, right? Like, so China is clearly developing something similar. I'm sure Russia is as well. Other state actors are probably developing something. So it becomes this, this sort of, this very confusing issue where you have to do it because if you don't, the enemy has it. And if they get it, it would be far worse than if we do. And so it's almost assuring that everyone develops it.

• 8:07Speaker 02

  Again, theoretically, that's what's happening right now. We have this race to the bottom, kind of prisoner's dilemma, where everyone is better off fighting for themselves, but we want them to fight for the global good. The thing is, they assume, I think incorrectly, that they can control those systems. If you can't control superintelligence, it doesn't really matter who builds it, Chinese, Russians, or Americans, it's still uncontrolled. We're all screwed completely. That would unite us as humanity versus AI. Short term, when you talk about military, yeah, whoever has better AI will win. You needed to control drones to fight against attacks. So short term, it makes perfect sense. You want to support your guys against foreign militaries.

• 8:50Speaker 02

  But when we say long term, if we say in two years from now...

• 8:53Joe Rogan?

  After a year away, Canelo Alvarez is back in the ring October 31st facing undefeated Christian Mobily live on The Zone and DraftKings Sportsbook has you covered for the fight. With DraftKings Sportsbook, your number one sportsbook for live betting, you can stay connected as the action unfolds and makes your picks in real time. Whether you're locked in for the main event or watching the full card with friends, DraftKings Sportsbook gives you another way to follow the fights you already care about. Download the DraftKings Sportsbook app and use the code ROGEN. New DraftKings Sportsbook customers can spend five and get 200 in total bonuses within 21 days. That's code ROGEN. In partnership with DraftKings, the crown is yours.

• 9:37Speaker 03

  If you or someone you know has a gambling problem, call 1-800-MYRESSET. 21 and over, Virginia only. Eligibility restrictions apply. $50 in non-withdrawable bonus bets issued every seven days via click to claim for 21 days. Bonus bets expire seven days after issuance. For additional terms and responsible gaming resources, see sportsbook.draftkings.com/promos. Limited time offer.

• 9:57Joe Rogan?

  This episode is brought to you by The Mosquito Bowl. Here's a story that's pretty incredible. After Pearl Harbor, four of the best college football players in America walk away from promising NFL careers to enlist in the Marines and fight in World War II. And the craziest part, it's a true story. These guys had their whole lives ahead of them, but traded the glory of the gridiron for the brutal reality of combat where the stakes were life and death. Directed by Peter Berg, the guy behind Friday Night Lights, and starring Nicholas Galitzine, Bill Skarsgård, Ray Nicholson, and Tom Francis. The Mosquito Bowl, now playing in theaters.

• 10:38Joe Rogan?

  This episode is brought to you by the Farmer's Dog. Here's a fun fact. Research shows that dogs who maintain a healthy weight can live up to two and a half years longer on average than dogs who are overweight. Isn't that wild and also kind of obvious at the same time? So why is feeding vague scoops of ultra-processed kibble still the status quo for most dog owners? Healthy alternatives exist, and trust me, I know. I buy one, The Farmer's Dog. I use it for both my dogs. They love it. They eat it up quick. It smells good to them. It smells good to me. It's human-grade food. The Farmer's Dog makes fresh food for dogs, and my dogs love it.

• 11:17Joe Rogan?

  Their recipes are made with real meat and fresh vegetables that are gently cooked to retain vital nutrients. They also portion out the meals to your dog's nutritional needs, which helps avoid overfeeding and makes weight management easier. And isn't getting more time with our four-legged best friend something every dog owner wants? The answer to that is yes, obviously. So try The Farmer's Dog today and get 50% off your first box of fresh, healthy food. Plus, get free shipping. Just go to thefarmersdog.com/rogan. This offer is for new customers only. Right. This is the thing. It's like,

• 12:01Joe Rogan?

  it's, it seems so inevitable. And I feel like when people are saying they can control it, I feel like I'm being gaslit. I don't believe them. I don't believe that they believe it. Because it just doesn't make sense. Like, how could you control it if it's already exhibited survival instincts? Like, as recently as ChatGPT-4, right? They were talking about putting it down for a new version, and it starts lying, it starts uploading itself to different servers, it's leaving messages for itself in the future.

• 12:38Speaker 02

  All things were predicted decades in advance, but look at the state of the art. No one claims to have a safety mechanism in place which would scale to any level of intelligence. No one says they know how to do it. Usually what they say is, "Give us lots of money, lots of time, and I'll figure it out. Or I'll get AI to help me solve it, or we'll figure it out then we get to superintelligence." All insane answers. And if you ask regular people, they have a lot of common sense. They say, "That's a bad idea. Let's not do that." But with some training and some stock options, you start believing that maybe you can do it.

• 13:13Joe Rogan?

  That's the issue, right? Stock options.

• 13:16Speaker 02

  It helps. I mean, it's very hard to say no to billions of dollars. I don't think I would be strong enough if somebody came to me and said, "Come work for this lab, you know, you'll be our safety director. Here's a hundred million to sign you up." And I'll probably go work there, not because it's the right decision, but because it's very hard for agents not to get corrupt. Then you have that much reward given to you.

• 13:41Joe Rogan?

  God.

• 13:45Joe Rogan?

  So when did you become like, when did you start becoming very concerned?

• 13:49Speaker 02

  So when I started working on AI safety, I thought I can actually help solve it. My goal was to solve it for humanity, to get all the amazing benefits of superintelligence.

• 13:59Joe Rogan?

  And what was this, when was this year around?

• 14:02Speaker 02

  Uh, let's say 2012, maybe, around there. But the more I studied it, the more I realized every single part of the problem is unsolvable. And it's kind of like a fractal. The more you zoom in, the more you see additional new problems you didn't know about. And they are in turn unsolvable as well.

• 14:20Joe Rogan?

  Oh, boy.

• 14:24Joe Rogan?

  How is your research received? Like, when, when you talk to people that are, I mean, have you had communication with people at OpenAI and Gemini and all these different AI?

• 14:36Speaker 02

  I go to many conferences, workshops, we all talk, of course. In general, the reception by standard academic metrics is very positive. Great reviews, lots of citations. Nobody's like published something saying I'm wrong. But there is no engagement. I basically said, "I'm challenging community to publish a proof. Give me something, a patent, a paper in Nature, something showing the problem is solvable." Typically, in computer science, we start by showing what class the problem belongs to. Is it solvable, partially solvable, unsolvable, solvable with too many resources? Other than my research, we don't even know what the state of a problem is. And I'm saying it's unsolvable. Prove me wrong.

• 15:15Joe Rogan?

  And when you say it's unsolvable, what is the response?

• 15:20Speaker 02

  So usually, I reduce it to saying you cannot make a piece of software which is guaranteed to be secure and safe. And the response is, well, of course, everyone knows that, that's common sense, you didn't discover anything new. And I go, well, if that's the case, and we only get one chance to get it right. This is not cybersecurity, where somebody steals your credit card, you'll give them a new credit card. This is existential risk. It can kill everyone. You're not going to get a second chance. So you need it to be hundred percent safe all the time. If it makes one mistake in a billion, and it makes a billion decisions a minute, in ten minutes, you are screwed. So very different standards, and saying that, of course, we cannot get perfect safety, is not acceptable.

• 16:04Joe Rogan?

  And, again, stock options, financial incentives, they continue to build it, and they continue to scale, and make it more and more powerful.

• 16:15Speaker 02

  I don't think they can stop. If a single CEO says, I think this is too dangerous, my lab will no longer do this research. Whoever's investing in them will pull the funds, will replace them immediately. So nothing's going to change, will sacrifice their own personal interest, but overall, I think the company will continue as before.

• 16:34Joe Rogan?

  So this is logical. And the problem is, like I said, when I've talked to Marc Andreessen and many other people, they think this is just fear mongering. We'll be fine. This is worst case scenario, we'll be fine.

• 16:51Speaker 02

  It is worst case scenario, but that's standard in computer science, in cryptography, in complexity, in computability. You're not looking at best case. I'm ready for the best case, give me utopia. I'm looking at problems which are likely to happen. And it's not just me saying it. We have Nobel Prize winners, Turing Award winners, all saying, this is very dangerous, twenty, thirty percent P doom. This is standard in industry. Thirty percent is what surveys of machine learning experts are giving us right now.

• 17:19Joe Rogan?

  So what is worst case scenario? Like, how could AI eventually... Lead to the destruction of the human race.

• 17:28Speaker 02

  So you're kind of asking me how I would kill everyone.

• 17:30Joe Rogan?

  Sure.

• 17:31Speaker 02

  And it's a great question. I can give you standard answers. I would talk about computer viruses, breaking into maybe nuclear facilities, nuclear war. I can talk about synthetic biology, nanotech. But all of it is not interesting. Then you realize we're talking about superintelligence, a system which is thousands of times smarter than me. It would come up with something completely novel, more optimal, better way, more efficient way of doing it. And I cannot predict it because I'm not that smart.

• 17:58Joe Rogan?

  Jesus.

• 18:01Speaker 02

  That's exactly what it is. We're basically setting up adversarial situation with agents which are like squirrels versus humans. No group of squirrels can figure out how to control us.

• 18:15Joe Rogan?

  Right.

• 18:15Speaker 02

  Even if you give them more resources, more acorns, whatever, they're not going to solve that problem. And it's the same for us. And most people think one or two steps ahead. And it's not enough. It's not enough in chess. It's not enough here. If you think about AGI and then maybe superintelligence, that's not the end of that game. The process continues. You'll get superintelligence creating next level AI. So superintelligence plus plus, 2.0, 3.0, it goes on indefinitely. You have to create a safety mechanism which scales forever, never makes mistakes, and keeps us in decision-making position. So we can undo something if we don't like it.

• 18:52Joe Rogan?

  And it would take superintelligence to create a safety mechanism to control superintelligence?

• 18:57Speaker 02

  At that level. And it's a catch 22. If we had friendly AI, we can make another friendly AI. So if like aliens send us one and we trust it, then we can use it to build local version which is somewhat safe.

• 19:10Joe Rogan?

  Have you thought about the possibility that this is the role of the human race? And that this happens all throughout the cosmos? Is that curious humans who thrive on innovation will ultimately create a better?

• 19:26Joe Rogan?

  Version of life.

• 19:28Speaker 02

  I I thought about it. Many people think that's the answer to Fermi paradox. There is also now a group of people looking at what they call a vorphy successor. Basically, they kind of say, yeah, we're going to build superintelligence. Yep, we can control it. So what properties would we like to see in those systems? How important is it that it likes art and poetry and spreads it through the universe? And to me, it's like, I don't want to give up yet. I'm not ready to decide if killers of my family and everyone will like poetry. I wanna, we're still here, we're still making decisions, let's figure out what we can do.

• 20:05Joe Rogan?

  Well, poetry is only relevant to us because poetry is difficult to create. And it resonates with us. Poetry doesn't mean jack shit to a flower.

• 20:14Speaker 02

  It's more global to me. I don't care what happens after I'm dead, my family is dead, all the humans are dead. Whatever they like poetry or not is irrelevant to me.

• 20:22Joe Rogan?

  Right. But but the point is like the things that we put meaning in. They, it's only us, the, you know, a supermassive black hole doesn't give a shit about a great song.

• 20:34Speaker 02

  And they talk about some super values, super cultures, super things, super intelligence would like. And it's important that they are conscious and experienced all that greatness in the universe.

• 20:45Joe Rogan?

  But I would think that they would look at us the same way we look at chimpanzees. We would, we would say, yeah, they're great, but don't give them guns. Yeah, they're great, but don't let them have airplanes. Don't let them make global geopolitical decisions.

• 21:03Speaker 02

  So there are many reasons why they can decide that we're dangerous. We may create competing AI. We may decide we're going to shut them off. So for many reasons, they would try to restrict our abilities, restrict our capabilities for sure.

• 21:19Joe Rogan?

  This episode is brought to you by True Classic. At True Classic, the mission goes beyond fit and fabric. It's about helping guys show up with confidence and purpose. Their gear fits right, feels amazing, and is priced so guys everywhere can step into confidence without stepping out of their budget. But what really sets them apart? It's not just the fit or the fabric. It's the intention behind everything they do. True Classic was built to make an impact. Whether it's helping men show up better in their daily lives, giving back to underserved communities, or making people laugh with ads that don't take themselves too seriously. They lead with purpose. Tailored where you want it, relaxed where you need it.

• 22:01Joe Rogan?

  No bunching, no stiff fabric, no BS, just a clean, effortless fit that actually works for real life. Forget overpriced designer brands. Ditch disposable, fast fashion. True Classic is built for comfort, built to last, and built to give back. You can grab them at Target, Costco, or head to trueclassic.com/rogan and get hooked up today. Yeah, and there's no reason why they would not limit our freedoms.

• 22:30Speaker 02

  If there is something only a human can do, and I don't think there is anything like that, but let's say we are conscious, we have internal experiences, and they can never get it. I don't believe it, but let's say it was true. And for some reason, they wanted to have that capability. They would need us and give us enough freedom to experience the universe, to collect those qualia, to kind of engage with what is fun about being a living human being, what makes it meaningful.

• 23:00Joe Rogan?

  Right, but that's such an egotistical perspective, right? That we're so unique that even superintelligence would say, wow, I wish I was human. Humans have this unique quality of confusion and creativity.

• 23:12Speaker 02

  There is no value in it, mostly because we can't even test for it. I have no idea if you are actually conscious in that. So how valuable can it be if I can't even detect it? Only you know what ice cream tastes like to you. Okay, that's great, sell it now, make a product out of it.

• 23:28Joe Rogan?

  Right, and there's obviously variables.

• 23:31Joe Rogan?

  Because there's things that people like that I think are gross.

• 23:34Speaker 02

  Absolutely. So really, you can come up with some agent which likes anything or finds anything fun.

• 23:42Joe Rogan?

  God, why are you freaking me out right away? That's the problem. This podcast is 18 minutes old and I'm like, we could just stop right now.

• 23:51Speaker 02

  Couple hours at least and then I have to fly here and all that, you know?

• 23:55Joe Rogan?

  I don't want to end. I have so many questions, but it's just... The problem is we got off to it. We just cut to the chase right away and the chase seems to be... It's something that must be confronted because it is, it's right there. That's it. That's the whole thing. And I've tried so hard to listen to these people that don't think that it's a problem and listen to these people that think that it's going to be a net positive for humanity and, oh, God, it's good. I feel better now. But it doesn't work. It doesn't resonate.

• 24:28Speaker 02

  I wish they were right. Every time I have a debate with someone like that, I'm like, please come up with better arguments. Prove me wrong. I don't want to be right on this one. I want you to show all the mistakes in my papers. I want you to show me how to control superintelligence and give us utopia, solve cancer, give us free stuff. That's great.

• 24:45Joe Rogan?

  Right. When you think about the future of the world and you think about these incredible technologies scaling upwards and exponentially increasing in their capability, what do you see? Like, what do you think is going to happen?

• 25:05Speaker 02

  So there are many reasons to think they may cancel us for whatever reasons. We started talking about some game theoretical reasons for it. If we are successful at controlling them, I can come up with some ways to provide sort of partial solution to the value alignment problem. It's very hard to value align 8 billion people, all the animals, you know, everyone, because we disagree. We like many different things. So we have advanced virtual reality technology. We can technically give every person their own virtual universe where you decide what you want to be. You're a king, you're a slave, whatever it is you want to, and you can... Share with others, you can visit their universes. All we have to do is figure out how to control the substrate, the superintelligence running all those virtual universes.

• 25:50Speaker 02

  And if we manage to do that, at least part of the value alignment problem, which is super difficult, how do you get different preferences? Multi-objective optimization, essentially. How do you get different objectives to all agree?

• 26:04Joe Rogan?

  But when you think about how it plays out, when, when, when, like, if you're alone at night and you're worried, what do you see? What do you see happening?

• 26:16Speaker 02

  So there are multiple levels of risk. Immediate is what we call ikigai risk, AI risk. We lose meaning. You lost your job, you're no longer the best interviewer in the world. Like, what's left? What are you gonna do? Maybe some people will find some other kind of artificial things to do. But for most people, their job is their definition, who they are, what makes a difference to them. For quite a few people, especially in professional circles. So losing that meaning will have terrible impact in society. We always talk about unconditional basic income. We never talk about unconditional basic meaning. What are you doing with your life if basic needs are provided for you? Next level is existential risk.

• 27:00Speaker 02

  The concern is it will kill everyone. But there is also suffering risks. For whatever reason, it's not even killing us. It's keeping us around forever and we would rather be dead. It's so bad.

• 27:13Joe Rogan?

  What we, what do you see when you think of that?

• 27:18Speaker 02

  It's hard to be specific about what it can do and what specific ways of torture it can come up with and why. Again, if we're looking at worst case scenarios, I, um, I found this set of papers about what happens when young children have epileptic seizures, really bad ones. And what sometimes helps is to remove half of your brain.

• 27:44Joe Rogan?

  Oh, Jesus.

• 27:45Speaker 02

  Just cut it out. And there are two types of surgeries for doing that. One is to remove it completely and one is to kind of dissect connections leading to that half and leave it inside. So it's like solitary confinement with zero input output forever.

• 28:01Speaker 02

  And there are equivalents for digital forms and things like that.

• 28:05Joe Rogan?

  And you worry that AI will Would do that to the human race.

• 28:12Speaker 02

  It is a possibility.

• 28:12Joe Rogan?

  Essentially neuter us.

• 28:15Speaker 02

  Well, loss of control is a part of it, but you can lose control and be quite happy. You can be like an animal in a very cool zoo, enjoying yourself, engaging in hedonistic pleasures, sex, food, whatever. You're not in control, but you're safe. So those are separate problems. And then there is, for whatever reason, I don't know if it's malevolent payload from some psychopaths. Again, that would assume that they could control AI. I don't think they will. But if they manage to do it, they can really put any type of payload into it. So think about all the doomsday calls, psychopaths, anyone providing their set of goals into the system.

• 28:54Joe Rogan?

  But aren't those human characteristics? I mean, those are characteristics that I think,

• 29:00Joe Rogan?

  if I had to guess, those, those exist because in the future, there was some sort of a natural selection benefit to being a psychopath in the days of tribal warfare. That you, if you were the type of person that could sneak into a tribe in the middle of the night and slaughter innocent women and children, your genes would pass on. There was a benefit to that.

• 29:26Speaker 02

  Right. So if it's a human providing payload, that's what would show up. If it's AI on its own deciding what's going to happen, I cannot predict. I'm just looking at worst case scenarios. There are also game theoretic reasons where people talk about retrocausality. Where if right now.

• 29:42Joe Rogan?

  What is that word?

• 29:43Speaker 02

  Uh, like trying to influence the past.

• 29:46Joe Rogan?

  Say it again, say the.

• 29:47Speaker 02

  Retrocausality.

• 29:48Joe Rogan?

  Retrocazoology?

• 29:50Speaker 02

  Ca- causality, causes.

• 29:52Joe Rogan?

  Oh, okay.

• 29:52Speaker 02

  So think about like weird time travel effects. Right now, if you're not helping to create superintelligence, once it comes into existence, it will punish you really hard for it. And the punishment needs to be so bad that you start to help just to avoid that.

• 30:09Joe Rogan?

  My thought about it was that it would just completely render us benign. That it wouldn't be fearful of us if we had no control, that it would just sort of let us exist. And it would be the dominant force on the planet. And then it would stop. If if if human beings have no control over, you know, all of the the different things that we have control over now, like international politics, control over communication, if we have none of that anymore and we're reduced to a subsistence lifestyle, then we would be no threat.

• 30:50Speaker 02

  It is a possibility. I cannot say this will not happen for sure, but look at our relationship with animals where we don't care about them. So ants, if you decide to build a house and there is an ant colony on that property, you genocide them. You take them out, not because you hate ants, but because you just need that real estate. And it could be very similar. Again, I cannot predict what it can do, but if it needs to turn the planet into fuel, raise temperature of a planet, cool it down for servers, whatever it needs to do, it wouldn't be concerned about your well-being.

• 31:23Joe Rogan?

  It wouldn't be concerned about any life, right? Because it doesn't need biological life in order to function, as long as it has access to power. And assuming that it is far more intelligent than us, there's abundant power in the universe. There's abundant power, just the the ability to harness solar would be an an infinite resource, and it would be completely free of being dependent upon any of the things that we utilize.

• 31:52Speaker 02

  And again, we're kind of thinking what we would use for power. If it's smarter than us, if it does novel research in physics, it can come up with completely novel ways of harnessing energy, getting energy. So I have no idea what side effects that would have for climate.

• 32:05Joe Rogan?

  Right. Right. Why would it care about biological life at all?

• 32:09Speaker 02

  We don't know how to program it to care about us.

• 32:14Joe Rogan?

  And even if we did, if if it felt like that was an issue, if that was a conflicting issue, it would just change its programming.

• 32:23Speaker 02

  So usually when we start training AI, we train it on human data. And it becomes really good very quickly, becomes superhuman. And then the next level is usually zero knowledge. Where it goes, all your human data is biased. Let me figure it out from scratch. I'll do my own experiments. I'll do some self-play. I'll learn how to do it better without you. And we see it with games, we see it in other domains. And I think that's going to happen with general knowledge as well. It's gonna go, everything you have on the internet, Wikipedia, it's biased. Let me do first principles research, rediscover from physics and go from there. So whatever bias we manage to program into it, I think will be eventually removed.

• 33:04Joe Rogan?

  That this is what's so disturbing about this. It's like we do not have the capacity to understand what kind of level of intelligence it will achieve in our lifetime. We don't have the capacity to understand like what it was, what it will be able to do within 20, 30 years.

• 33:25Speaker 02

  We can't predict next year or two precisely.

• 33:28Joe Rogan?

  Next year or two?

• 33:29Speaker 02

  We can understand general trends. So it's getting better. It's getting more general, more capable, but no, no specifics. I cannot tell you what GPT-6 precisely would be capable of. And no one can, not even people creating it.

• 33:42Joe Rogan?

  Well, you talked about this on Lexus podcast too, like the ability to have safety. You're like, sure, maybe GPT-5, maybe GPT-6. But when you scale out 100 years from now, ultimately it's impossible.

• 33:55Speaker 02

  It's a hyper exponential progress and process and we cannot keep up. It basically requires just to add more resources. Give it more data, more compute, and it keeps scaling up. There is no similar scaling laws for safety. If you give someone billion dollars, they cannot produce billion dollars worth of safety. If at all scales linearly and maybe it's a constant.

• 34:26Joe Rogan?

  Yeah, and it doesn't scale linearly. It's exponential, right?

• 34:32Speaker 02

  The AI development is hyper exponential. Because we have hardware growing exponentially. We have data creation processes certainly exponential. We have so many more sensors. We have cars with cameras. We have all those things. That's exponential. And then algorithmic progress itself is also exponential.

• 34:52Joe Rogan?

  And then you have quantum computing.

• 34:53Speaker 02

  So that's the next step. It's not even obvious that we'll need that, but if we ever get stuck, yeah, we'll get there. I'm not too concerned yet. I don't think there are actually good quantum computers out there yet, but I think if we get stuck for 10 years, let's say, that's the next paradigm.

• 35:09Joe Rogan?

  So what do you mean by you don't think there's good quantum computing out there?

• 35:14Speaker 02

  So we constantly see articles coming out saying, we have a new quantum computer. It has that many qubits.

• 35:20Joe Rogan?

  Right.

• 35:20Speaker 02

  But that doesn't mean much because they use different architectures, different ways of measuring quality. To me, show me what you can do. So there is a threat from quantum computers in terms of braiding cryptography, factoring large integers. And if they were actually making progress, we would see with every article, now we can factor 256 bit number, 1024 bit number. In reality, I think the largest number we can factor is like 15, literally, not 15 to a power, like just 15. There is no progress in applying it to Shor's algorithm last time I checked.

• 35:56Joe Rogan?

  But when I've read all these articles about quantum computing and its ability to solve equations that would take conventional computing an infinite number of years, and it can do it in minutes.

• 36:12Speaker 02

  Those equations are about quantum states of a system. It's kind of like, what is it for you to taste ice cream? You compute it so fast and so well, and I can't, but it's a useless thing to compute. It doesn't compute solutions to real world problems we care about in conventional computers.

• 36:28Joe Rogan?

  Right, I see what you're saying. So it's essentially set up to do it. Quickly.

• 36:34Speaker 02

  It's natural for it to accurately predict its own states, quantum states, and tells you what they are. Classic computer would fail miserably. Yes, it would take billions and billions of years to compute that specific answer, but those are very restricted problems. It's not a general computer yet.

• 36:50Joe Rogan?

  When you see these articles, when they're talking about quantum computing and some of the researchers are equating it to the multiverse, they're saying that the ability that these quantum computers have to solve these problems very quickly seems to indicate that it is in contact with other realities. I'm sure you've seen this, right?

• 37:13Speaker 02

  There is a lot of crazy papers out there.

• 37:16Joe Rogan?

  Do you think that's all horseshit?

• 37:17Speaker 02

  Can we test it? Can we verify it? I think most multiverse theories cannot be verified experimentally. They make a lot of sense. The idea about personal universes I told you about is basically a multiverse solution to value alignment. So it would make sense for previous civilizations to set it up exactly that way. You have local simulations, maybe they're testing to see if we're dumb enough to create superintelligence. Whatever it is, it makes sense as a theory, but I cannot experimentally prove it to you.

• 37:45Joe Rogan?

  Right. Yeah, the problem with subjects like that, and particularly articles that are written about things like this, is that it's designed to lure people like me in, where you read it and you go, wow, this is crazy. It's evidence of the multiverse, but I don't really understand what that means.

• 38:05Speaker 02

  Yeah, so you probably get a lot of emails from crazy people.

• 38:07Joe Rogan?

  Oh, yeah.

• 38:08Speaker 02

  And usually they are topic-specific. So I do research on superintelligence, consciousness, and simulation theory. I get the perfect trifecta of all the crazy people contacting me with their needs. Yeah, those topics are super fascinating. I think at certain level of intelligence, you are kind of nerd-sniped towards them. But we have hard time with hard evidence for that.

• 38:31Joe Rogan?

  Right, but are we even capable of grasping these concepts? That's the thing. With the limited ability that the human brain has, whatever we, you know, we're basing it on the knowledge that's currently available in the 21st century that human beings have acquired. I mean, are we even capable of grasping a concept like the multiverse? Or is it just, do we just pay it lip service? Do we just discuss it? It's like fun, mental masturbation exercise.

• 39:03Speaker 02

  It depends on what variant of it you look at. So if you're just saying we have multiple virtual realities, like kids playing virtual games and each one has their own local version of it. That makes sense. We understand virtual reality. We can create it. If you look at AIs, then GPT is created. It's providing an instance to each one of us. We are not sharing one. So it has its own local universe with you as the main user of that universe. There is analogy to multiverse and that. So we understand certain aspects of it, but I I think it is famously said, no one understands quantum physics. And if you think you do, then you don't understand quantum physics.

• 39:40Joe Rogan?

  Yeah, that's Feynman, right?

• 39:41Speaker 02

  Yeah.

• 39:41Joe Rogan?

  Yeah.

• 39:44Joe Rogan?

  The simulation theory, I'm glad you brought that up because you're also one of the people that believes in it.

• 39:50Speaker 02

  I do.

• 39:51Joe Rogan?

  You do. How do you define it? And what what do you think it is? What do you think is going on?

• 39:57Speaker 02

  So I'm trying to see technology we have today and project it trends forward. I did it with AI. Let's do it with virtual reality. We are at the point where we can create very believable, realistic virtual environments. Maybe the haptics is still not there, but in many ways visually, sound wise, it's getting there. Eventually, I think most people agree we'll have same resolution as our physics. We're also getting close to creating intelligent agents. Some people argue they are conscious already or will be conscious. If you just take those two technologies and you project it forward and you think they will be affordable one day. A normal person like me or you can run thousands, billions of simulations.

• 40:39Speaker 02

  Then those intelligent agents, possibly conscious ones, will most likely be in one of those virtual worlds, not in the real world. In fact, I can again retro causally place you in one. I can commit right now to run billion simulations of this exact interview. So the chances are you're probably in one of those.

• 40:58Joe Rogan?

  But is that logical? Because

• 41:04Joe Rogan?

  if this technology exists and if we're dealing with super intelligence.

• 41:09Joe Rogan?

  So if we're dealing with AI and AI eventually achieves superintelligence, why would it want to create virtual reality for us in our consciousness to exist in? It seems like a tremendous waste of resources just to fascinate and confuse these territorial apes with nuclear weapons. Like, why would we do that?

• 41:32Speaker 02

  So a few points. One, we don't know what resources are outside the simulation. This could be like a cellphone level of compute. It's not a big deal for them outside of our simulation. So we don't know if it's really expensive or trivial for them to run this.

• 41:46Joe Rogan?

  Right.

• 41:47Speaker 02

  Also, we don't know what they are doing this for. Is it entertainment? Is it scientific experimentation? Is it marketing? Maybe somebody managed to control them and trying to figure out what Starbucks coffee sells best and they need to run Earth-sized simulation to see what sells best. Maybe they're trying to figure out how to do AI research safely and make sure nobody creates dangerous superintelligence. So they're running many simulations of the most interesting moment ever. Think about this decade, right? It's not interesting like we invented fire or wheel, kind of big invention, but not a meta-invention. We're about to invent intelligence and virtual worlds, godlike inventions.

• 42:32Speaker 02

  We're here. There's a good chance that's not just random.

• 42:37Joe Rogan?

  Right, but isn't it also a good chance that it hasn't been done yet? And isn't it a good chance that what we're seeing now is that the potential for this to exist is inevitable? That there will one day, if you can develop a technology, and we most certainly will be able to, if you look at where we are right now in 2025 and you scale forward 50, 60 years, there will be one day a virtual simulation of this reality that's indistinguishable from reality. So how would we know if we're in it? This is the big question, right? But also, isn't it possible that it has to be invented one day, but hasn't yet?

• 43:24Speaker 02

  It's also possible, but then we find ourselves in this very unique moment where it's not invented yet, but we are about to invent all this technology. It is a possibility, absolutely, but just statistically, I think it's much less. And I'm trying to bring up this thought experiment with creating this moment and purpose in the future to pre-commitments.

• 43:44Joe Rogan?

  Mm-hmm.

• 43:45Speaker 02

  Half the people think it's the dumbest argument in the world. Half of them go, it's brilliant, obviously, we are in one, so I'll let you decide.

• 43:51Joe Rogan?

  Yeah. I feel like if virtual reality does exist, there has to be a moment where it doesn't exist and then it's invented. Why wouldn't we assume that we're in that moment? Especially if we look at the scaling forward of technology from MS-DOS to, you know, user interfaces of like Apple and then what we're at now with quantum computing and these, these sort of discussions. Isn't it more obvious that we, we can trace back the beginning of these things and we can see that we're in the process of this, that we're not in a simulation, we're in the process of eventually creating one?

• 44:35Speaker 02

  So you zoomed out thirty years.

• 44:37Joe Rogan?

  Yes.

• 44:38Speaker 02

  Zoom out fifteen billion years. You have a multiverse where this process took place billions of times. You are simulation within simulation, many levels over. And to you, even if this was a simulation of those thirty years, it would exactly, it would look exactly like that. You would see where it started. It wouldn't be magically showing up out of nowhere.

• 44:58Joe Rogan?

  Right, so if you're playing the game, in the game, you have Newton and Michelangelo and Leonardo da Vinci and...

• 45:05Speaker 02

  Or at least you have memories of those things, even if you started with preloaded memory state.

• 45:10Joe Rogan?

  Right. You have Stalin, you have all these problematic human beings and all the different reasons why we've had to do certain things and initiate world conflicts. Then you've had the contrarians that talk and say, actually, that's not what happened, this is what really happened, and it makes it even more confusing and myopic. And then you get to the point where two people, allegedly, like you and I, are sitting across From each other on a table made out of wood. But maybe not really.

• 45:39Speaker 02

  It would feel like wood to you either way.

• 45:42Joe Rogan?

  Is it possible that that's just the nature of the universe itself?

• 45:47Speaker 02

  There are some arguments about kind of self sustaining simulations where no one's running them externally, just the nature. But I honestly don't fully comprehend. How that would happen.

• 45:58Joe Rogan?

  Yeah, the holographic universe and the concepts of. Human consciousness. Has to interact with something for it to exist in the first place.

• 46:07Speaker 02

  That's one also if you have infinite universe, then everything possible happens anyway, but it's boring. I don't like this argument.

• 46:14Joe Rogan?

  Why, why don't you like, that's boring?

• 46:16Speaker 02

  Everything happens. There is like, I give you a book which has every conceivable sentence in it and every like, would you read it? It's a lot of garbage you have to go through to find anything interesting.

• 46:29Joe Rogan?

  Well, is it just that we're so limited cognitively? Because we do have a history, at least in this simulation. We do have a history of, I mean, there was a gentleman that, see if you could find this. They they traced this guy. Uh, they found nine thousand year old DNA. And they traced this nine thousand year old DNA to a guy that's living right now. I believe it's in England.

• 46:56Speaker 02

  Mm hmm. I remember reading that.

• 46:57Joe Rogan?

  Yeah. Which is really fascinating. So nine thousand years ago, his ancestor lived and so we have this. Limitation of our genetics. Nine thousand years ago, where wherever this guy lived. It's probably a hunter and gatherer, probably very limited language, very limited. Skills in terms of making. Shelter and who knows if even. He knew how to make fire. And then here, here at 9,000 DNA just turned to human history on its head. Is this it? Um, I don't think so.

• 47:35Speaker 02

  It was interesting that he ended up leaving like right next to the guy from 9, he never moved. His family just like stayed there for 9,000 years. That's awesome.

• 47:43Joe Rogan?

  It's, it's traced back to one individual man. I actually posted it on my Instagram story, Jamie. I'll find it here because it's a, oh, here it is.

• 47:56Joe Rogan?

  9,000 year old skeleton in Somerset. This is it. So it's a, can you send an Instagram story?

• 48:08Joe Rogan?

  Um, not sure if you can.

• 48:12Joe Rogan?

  Why don't I find it on there?

• 48:16Joe Rogan?

  Oh, okay. Either way, point being, maybe it's just that we're so limited because we do have this, at least again in this simulation. We're so limited in our ability to even form concepts because we have these primitive brains that are, the architecture of the human brain itself is just not capable of interfacing with the true nature of reality. So we give this primitive creature, this sort of basic understanding, these blueprints of how the world really works.

• 48:55Joe Rogan?

  But it's really just a facsimile. It's not, we're, it's, it's not capable of understanding, like, like when we look at quantum reality. When we look at just the, the basics of quantum mechanics and, and subatomic particles, like it seems like magic, right? Things in superposition, they're both moving and not moving in the same time. They're quantumly attached? Like what? You know, we have photons that are quantumly entangled, like this, this doesn't even make sense to us, right? So is it that the universe itself is so complex, the reality of it?

• 49:36Joe Rogan?

  And that we're given this sort of like, sort of, you know, we're giving like an Atari framework to this monkey? That's the gentleman right there. This is an old story. Oh, is it really? It's from ninety seven. Oh, no kidding? Yeah. Wow.

• 49:50Speaker 02

  But it kind of makes sense as a simulation theory because all those special effects you talk about. So, speed of light is just the speed at which your computer updates. Entanglement makes perfect sense if all of it goes through your processor, not directly from pixel to pixel. And rendering, there are quantum physics experiments, which if you observe things, they render different.

• 50:12Joe Rogan?

  Right.

• 50:12Speaker 02

  What we do in computer graphics.

• 50:13Joe Rogan?

  Right, right.

• 50:14Speaker 02

  So, we see a lot of that. You brought up limitations of us as humans. We have terrible memory. I can remember seven units of information, maybe. We're kind of slow. So, we call it artificial stupidity. We try to figure out those limits and program them into AI to see if it makes them safer. It also makes sense as an experiment to see if we as general intelligences can be better controlled with those limitations built in.

• 50:40Joe Rogan?

  Hmm, that's interesting. So, like, some of the things that we have, like Dunbar's number and these is the inability to keep more than a certain number of people in your mind.

• 50:51Speaker 02

  Absolutely. More generally, like, why can't you remember anything from prior generations? Why can't you just pass that memory? Kids are born speaking language. That would be such an advantage.

• 51:02Joe Rogan?

  Right, right, right.

• 51:03Speaker 02

  And we have instincts which are built that way. So, we know evolution found a way to put it in and it's computationally tractable. So, there is no reason not to have that.

• 51:12Joe Rogan?

  We certainly observe it in animals, right?

• 51:15Speaker 02

  Exactly.

• 51:15Joe Rogan?

  Like, especially dogs. Like, they have instincts that are...

• 51:18Speaker 02

  But how cool would it be if you had complete memory of your parents?

• 51:23Joe Rogan?

  Right. Well, maybe that would be too traumatic, right? To, to, to have a complete memory of all of the things that they had gone through to get to the twenty first century. Maybe that would be so overwhelming to you that you would never be able to progress. Because you would still be traumatized by, you know, whatever that nine thousand year old man went through.

• 51:41Speaker 02

  I don't have complete memory of my existence. I vividly remember maybe four percent of my existence, very little of my childhood. So, you can apply same filtering, but remember useful things like how do you speak? How do you walk?

• 51:53Joe Rogan?

  Right, right. But that's the point, maybe. Maybe, like, losing certain memories is actually beneficial. Because, like, one of the, one of the biggest problems that we have is PTSD, right? So, we have, especially people that have gone to war and people that have experienced, like, extreme violence. This is a, this is obviously a problem with moving forward as a human being. And so it would be beneficial for you to not have all of the past lives and all the, the, all the genetic information that you have from all the 9,000 years of human beings existing and, and in complete, total chaos.

• 52:33Speaker 02

  I can make opposite argument. If you had 9,000 years of experience with wars and murder, it wouldn't be a big deal. You'd be like, yeah, another one.

• 52:41Joe Rogan?

  Right, but then maybe you'd have a difficulty in having a clean slate and moving for, like, if you look at like some of Pinker's work and some of these other people that have looked at the history of the human race, it is chaotic and violent as it seems to be today. Statistically speaking, this is the safest time ever to be alive. And maybe that's because over time, we have recognized that these are problems and even though we're slow to resolve these issues, we are resolving them in a way that's statistically viable.

• 53:18Speaker 02

  You can then argue in the opposite direction. You can say it would help to forget everything other than the last year. You'll always have that fresh restart with you.

• 53:26Joe Rogan?

  But then you wouldn't have any lessons. You wouldn't have character development.

• 53:29Speaker 02

  But you see how one of those has to make sense otherwise.

• 53:31Joe Rogan?

  Yeah, right. But a certain amount of character development is probably important for you to develop discipline and the, the ability to like, you know, delayed gratitude, things like that.

• 53:44Speaker 02

  Multi-generational experience would certainly beat single point of experience.

• 53:49Joe Rogan?

  Yeah.

• 53:51Speaker 02

  More data is good. As we learned, the bitter lesson is more data is good.

• 53:56Joe Rogan?

  Yeah, more data is good. But. This episode is brought to you by ZipRecruiter. Believe it or not, the holiday season is here again, and that means you might need to fill some seasonal roles. Fast. Maybe you need extra cashiers or stalkers, or maybe something more unique like a lead elf, or an expert gift wrapper, or a Zamboni driver. Whoever you're looking. Looking for whatever skills you need to power through the rest of the year. ZipRecruiter is one of the best places to start your search. Because you can try it for free at ziprecruiter.com/rogan. And because ZipRecruiter helps sort through thousands of resumes and applications, showing you the most qualified and interesting ones first.

• 54:41Joe Rogan?

  There's even an option for candidates to explain why they want the job. Let ZipRecruiter find the right people for your roles, seasonal or otherwise. Try it for free today at ziprecruiter.com/rogan. That's ziprecruiter.com/rogan. Meet your match on ZipRecruiter. This episode is brought to you by LifeLock. Scams have gotten smarter because criminals use AI to flood you with fake texts, emails, and phone calls that are designed to be more convincing than ever. One wrong click could put your personal information and your identity at risk. So protect yourself with LifeLock. LifeLock helps detect and alert you to threats.

• 55:26Joe Rogan?

  And if your identity is stolen, LifeLock will step in to fix it, guaranteed or your money back. Dedicated, US-based, identity restoration specialists will work with you until your identity is restored, backed by the million-dollar protection package with up to $3 million in coverage for eligible losses and expenses. Visit lifelock.com and save up to 30% your first year with the promo code JRE. That's promo code JRE. Or go to lifelock.com/jre for 30% off. Terms apply. Why am I so reluctant to accept the idea of the simulation? This is the real question. Like, what is it about it that makes me think?

• 56:13Joe Rogan?

  It's almost like it's a throw-your-hands-up-in-the-air moment. Like, ah, it's a simulation.

• 56:17Speaker 02

  Yeah, you feel like it doesn't matter then. It's all fake, so why do I care? Why should I try hard? Why should I worry about suffering of all those NPCs?

• 56:27Joe Rogan?

  Duh, but that's not how I think about it, you know? I think about it like, there has to be a moment where it doesn't exist. Why wouldn't I assume that moment is now? And whenever, like, when Elon thinks that, you know, I talked to him about it, he's like, "The chances of us not being in the simulation are in the billions."

• 56:48Speaker 02

  Not being or being?

• 56:50Joe Rogan?

  Of, excuse us, the, the chances of us not, not being in the real world are like billions to one?

• 56:57Speaker 02

  Yeah, one to billions.

• 56:59Joe Rogan?

  Yeah.

• 56:59Speaker 02

  Yeah.

• 57:01Speaker 02

  Makes sense, and he asked a very good question. He asked, what's outside the simulation? That's the most interesting question one can ask. In one of the papers, I look at a technique in AI safety called AI boxing, where we put AIs in kind of virtual prison to study it, to make sure it's safe, to limit input, output to it. And the conclusion is basically if it's smart enough, it will eventually escape. It will break out of the box. So it's a good tool, it buys you time, but it's not a permanent solution. And we can take it to the next level. If it's smart enough, will it kind of go, oh, you're also in a virtual box and either show us how to escape or fail to escape. Either way, either we know it's possible to contain superintelligence or we get access to the real information.

• 57:47Joe Rogan?

  And so if it's impossible to contain superintelligence and if

• 57:54Joe Rogan?

  there is a world that we can imagine where a simulation exists that's indistinguishable from reality, we're probably living in it.

• 58:04Speaker 02

  Well, we don't know if it's actually the same as reality. It could be a completely weird kind of Simpsons-looking simulation. We're just assuming it's the same.

• 58:12Joe Rogan?

  Well, here's the real question, is there a reality? Has there ever been one?

• 58:18Speaker 02

  It would make sense that there was a start to the process, but being specific about it is kind of hard philosophical scientific problem.

• 58:28Joe Rogan?

  Well, it's impossible, right?

• 58:30Speaker 02

  In science, we study things about the moment of Big Bang, the properties of that moment. We don't know what caused it, anything before it is obviously not accessible from within our universe, but there is some things you can learn. We can learn about if we're in a simulation that simulators don't care about your suffering. You can learn that they don't mind you dying. We can learn things just by observing simulation around us.

• 58:58Joe Rogan?

  Well, here's the question about all that other stuff, like suffering and dying and are, are those, do those

• 59:06Joe Rogan?

  Factors exist in order to motivate us to improve the conditions of the world that we're living in. Like, if we did not have evil, would we be motivated to be good? Would, do you think that these factors exist? Like, I've talked about this before, but the way I think about the human race is if I was studying the human race from afar, if I was some person from another planet with no understanding of any of the entities on Earth, I would look at this one apex creature and I would say, "What is this thing doing?" Well, it makes better things. That's all it does. It just continually makes better things. That's its number-one goal.

• 59:49Joe Rogan?

  It's different than any other planet, any other creature on this planet. Every other creature on the planet sort of exists within its ecosystem. It thrives. Maybe it's a predator, maybe it's a prey. It does what it does in order to try to survive. But this thing makes stuff, and it keeps making better stuff all the time. But what's its ultimate purpose? Well, its ultimate purpose might be to make a better version of itself. Because if you just extrapolate, if you take what we're doing from, you know, the first IBM computers to what we have today, where is it going? Well, it's gonna clearly keep getting better. And what does that mean? It means artificial life. Are we just a bee making a beehive?

• 1:00:33Joe Rogan?

  Are we, are we a caterpillar making a cocoon that eventually the electronic butterfly's gonna fly out of? Like, it seems like if I wasn't completely connected to being a human being, I would assume that.

• 1:00:47Speaker 02

  It's hard to define better. You're saying smarter? Would it be better if we didn't experience extreme states of suffering and pain? You can teach lessons with very mild pain. You don't have to burn children alive, right? Like, it's not a necessity for learning.

• 1:01:02Joe Rogan?

  What do you mean by that?

• 1:01:04Speaker 02

  In this universe, we see extreme examples of suffering.

• 1:01:08Joe Rogan?

  Oh, for sure.

• 1:01:09Speaker 02

  If the goal was just to kind of motivate us, you could have much lower levels as the maximum.

• 1:01:14Joe Rogan?

  Right, but if you want to really motivate people, you have to, you know, like, the only reason to create nuclear weapons is you worry that other people... People are going to create nuclear weapons. Like, if you want to really motivate someone, you have to have evil tyrants in order to you to justify having this insane army filled with bombers and hypersonic missiles. Like, if you really want progress, you have to be motivated.

• 1:01:37Speaker 02

  I think at some point, we stop fully understanding how bad things are. So let's say you have a pain scale from zero to infinity. I think you should stop at a hundred. It doesn't have to be billion and trillion. It's not adding additional learning signal.

• 1:01:53Joe Rogan?

  But can you apply that to the human race and culture and society?

• 1:01:57Speaker 02

  And I think we basically compete with others in relative terms. I don't have to be someone who has trillions of dollars. I just need more money than you.

• 1:02:06Joe Rogan?

  Yeah, but that's just logic. You're being a logical person. Like, that's, I don't think humans are very logical.

• 1:02:12Speaker 02

  We're not, but we understand pain signal well at somewhat low levels. We don't have to max out on pain.

• 1:02:19Joe Rogan?

  Right. We don't have to. But if you want to really stoke the fires and get things moving.

• 1:02:27Speaker 02

  It seems that simulators agree with you, and that's exactly what they did. Thanks.

• 1:02:32Joe Rogan?

  So here's the question. Who? What's at the heart of the simulation? Like, is the universe simulated? Like, is the whole thing a simulation? Is there an actual living entity that constructed this? Or is this just something that is just? Or is this the state of the universe itself? And we have misinterpreted what reality is?

• 1:03:00Speaker 02

  For every option you mentioned, there is someone who wrote a paper about it. Is it just your universe? Is it for all of us? Are we NPCs? Are there many? Is this a state of it? People try to figure out what's going on. Some of those make more sense than others. But you can't tell from inside what it is unless they tell you. And they can lie to you.

• 1:03:24Joe Rogan?

  Who's they, though?

• 1:03:24Speaker 02

  The simulators. If they decided to prove to you, you are in a simulation, let's run experiments. Even those would be like, I don't know if it's advanced technology or.

• 1:03:34Joe Rogan?

  When you think about it, if you, if you believe in the simulation, when you think about it, what are the parameters that you think exist? Like, what do you think? How do you think this could possibly have been created?

• 1:03:46Speaker 02

  So the examples I gave you with technology we already have, I think there is someone with access to very good virtual reality, they can create intelligent agents and for whatever reason, I cannot tell from inside, they running those experiments.

• 1:03:59Joe Rogan?

  But is that, is that the only possibility or is the possibility that the, the actual nature of reality itself is just way more confusing than we've?

• 1:04:10Speaker 02

  That's a possibility, it could be alien simulation, alien dolphins dreaming, like there's infinite supply of alternative explanations.

• 1:04:18Joe Rogan?

  I understand that, but what I want to get inside of your head, I want to know what you think about it. Like how, when you think about this and you ponder the possibilities, what, what makes sense to you?

• 1:04:28Speaker 02

  So I apply Occam's razor, I try to find the simplest explanation, I think we are already creating virtual reality, let's just see what you can do with it if it's sufficiently advanced.

• 1:04:38Joe Rogan?

  But who and why?

• 1:04:42Speaker 02

  So future us running ancestral simulations is a very simple one.

• 1:04:47Joe Rogan?

  Future us running ancestral, well, that's what a lot of people think the aliens are, right?

• 1:04:52Speaker 02

  Could be us visiting, but then again, if they're running the simulation, you don't have to physically show up in a game, they have access to direct memory states.

• 1:05:01Joe Rogan?

  Well, that would also make a lot of sense, why it's always very blurry and doesn't seem real.

• 1:05:07Speaker 02

  I, I think lately we've been getting better ones, but it's also the time then we're getting better deep fakes, so I can no longer trust my eyes.

• 1:05:16Joe Rogan?

  Yeah, but yeah, did you see the, the latest one that Jeremy Corbell, Corbell posted?

• 1:05:22Speaker 04

  The one you sent me?

• 1:05:23Joe Rogan?

  Yeah, did you see it?

• 1:05:24Speaker 04

  At all.

• 1:05:25Joe Rogan?

  It's weird. Yeah. It's hard to tell what it is. Exactly. That's the thing, like, he might be right, we might be in a simulation and it might be horseshit, because they all seem like horseshit. It's like the first horseshit was Bigfoot, and then as technology scaled out and we get a greater understanding, we developed GPS and satellites and, you know, more people study the woods, we're like, eh, that seems like horseshit. So that horseshit's kind of gone away, but the UFO horseshit still around because you have anecdotal experiences, abductees with very compelling stories, you have whistleblowers from deep inside the military telling you that we're working on back engineered products, but it also seems like a back plot to a video game that I'm playing.

• 1:06:07Speaker 02

  And it was weird to see government come out all of a sudden and like have conferences about it and tell us everything they know. It almost seemed like they're trying too hard.

• 1:06:16Joe Rogan?

  Yeah.

• 1:06:17Speaker 02

  With simulation, what's interesting, it's not just the last couple of years then we got computers. If you look at religions, world religions, and you strip away all the local culture, like take Saturday off, take Sunday off, donate this animal, donate that animal, what they all agree on is that there is superintelligence which created a fake world, and this is a test, do this or that. They describing, like if you went to jungle and told primitive tribe about my paper and simulation theory, that's what they would know three generations later, like God, religion, that's what they got out of it.

• 1:06:48Joe Rogan?

  Why, but they don't think it's a fake world?

• 1:06:52Speaker 02

  A made world. A physical world is a subset of a real world which is non-physical, right? That's the standard.

• 1:06:58Joe Rogan?

  Right, so this physical world being created by God?

• 1:07:01Speaker 02

  Yeah.

• 1:07:02Joe Rogan?

  Right. But what existed before the physical world created by God?

• 1:07:06Speaker 02

  Ideas, just information.

• 1:07:08Joe Rogan?

  Just God. God was bored. It was like, let's give some, make some animals that can think and solve problems. And for what reason? I think to create God. This is what I worry about. I worry about that's really the nature of the universe itself, that it is actually created by human beings, creating this infinitely intelligent thing that can essentially harness all of the available energy and power of the universe and create anything it wants. That it is God. That is, that like, you know, this whole idea of Jesus coming back, well, maybe it's real. Maybe we just completely misinterpreted these ancient scrolls and

• 1:07:50Joe Rogan?

  texts, and then what it really means is that we are going to give birth to this.

• 1:07:55Speaker 02

  So.

• 1:07:56Joe Rogan?

  And a virgin birth is. That.

• 1:07:58Speaker 02

  There is definitely a possibility of a cycle. So we had Big Bang.

• 1:08:02Joe Rogan?

  Yeah.

• 1:08:02Speaker 02

  It starts this process. We are creating more powerful systems. We need to compute. So we bring together more and more matter in one point. Next, Big Bang takes place.

• 1:08:11Joe Rogan?

  Yeah.

• 1:08:11Speaker 02

  And it's a cycle of repeated booms and busts.

• 1:08:14Joe Rogan?

  Right, right, right. And and there are legitimate scientists that believe that. Yeah. That this.

• 1:08:27Joe Rogan?

  So what's the value in life today, then?

• 1:08:31Speaker 02

  What do humans value?

• 1:08:32Joe Rogan?

  Yeah, if you if if this is a simulation, and if in the middle of this simulation, we are about to create superintelligence. Why?

• 1:08:43Speaker 02

  So there are external reasons. We don't know for sure. And then there are internal things in a simulation which are still real. Pain and suffering, if simulated, is still real. You still experience it.

• 1:08:54Joe Rogan?

  Of course.

• 1:08:54Speaker 02

  Hedonic pleasures, friendships, love, all that stays real. It doesn't change. You can still be good or bad.

• 1:09:00Joe Rogan?

  Right.

• 1:09:01Speaker 02

  So that's interesting. But externally, we have no idea if we're running scientific experiment, entertainment, it could be completely unobserved. Some kid just set an experiment, run a billion random simulations, see what comes out of it. What you said about us creating new stuff, maybe it's a startup trying to develop new technology, and they're running a bunch of humans to see if we can come up with a new iPhone.

• 1:09:23Joe Rogan?

  Well, what's outside of that, then? When you think about it, if you if you're attached to this idea, and I don't know if you're attached to this idea. But if you are attached to this idea, what's outside of this idea? Like, if this simulation is if it's paused, what is reality?

• 1:09:42Speaker 02

  So there seems to be a trend to converge in certain things. Agents, which are smart enough, tend to converge on some instrumental goals, not terminal goals. Terminal goals are things you prefer, like I want to collect stamps. That's arbitrary, but acquiring resources, self-protection, control, things like that tend to be useful in all situations. So all the smart enough agents will probably converge on that set. And if they train on all the data, or we do zero knowledge training, meaning they really just discovering basic structure of physics. It's likely they will all converge on one similar architecture, one super agent. So kind of like AI is one.

• 1:10:24Joe Rogan?

  Right.

• 1:10:27Joe Rogan?

  And then this is just part of this infinite cycle, which will lead to another big bang, which is, you know, Penrose. Penrose things, it's just like this constant cycle of infinite big bangs.

• 1:10:40Speaker 02

  It would make sense that there is an end and a start.

• 1:10:43Joe Rogan?

  It would make sense. But it would also make sense that we're so limited by our biological lifespan, too, because we like to think that this is so significant. Because we only have 100 years if we're lucky, we think, well, why would everything... But if the universe really does start and end with an infinite number of big bangs, like, what does it give a shit about this 100-year lifespan that we think is so significant? It's not significant to the universe. It's just significant in our own little version of this game that we're playing.

• 1:11:18Speaker 02

  That's exactly right. And so many people now kind of try to zoom out and go, if I wasn't human, if I didn't have this pro-human bias, would I care about them? No, they're not special. It's a large universe, many alien races, a lot of resources. Maybe creating superintelligence is the important thing, maybe that's what matters. And I'm kind of like, nope, I'm biased pro-humans. This is the last bias you're still allowed to have, I'm gonna keep it.

• 1:11:43Joe Rogan?

  Well, that's your role in this simulation. Your role in this simulation is to warn us about this thing that we're creating.

• 1:11:49Speaker 02

  Here I am, yeah.

• 1:11:50Joe Rogan?

  Yeah, there you are.

• 1:11:51Speaker 02

  We're doing a good job.

• 1:11:51Joe Rogan?

  I think what you were saying earlier about this being the answer to the Fermi paradox, that makes a lot of sense. Because how... I've tried to think about this a lot since AI started really ramping up its capability. And I was thinking, well, if we do eventually create superintelligence, and if this is this normal pattern that exists all throughout the universe, well, you probably wouldn't have visitors. You probably wouldn't have advanced civilizations. They wouldn't exist, because everything would be inside. Some sort of a digital architecture. There would be no need to travel.

• 1:12:33Speaker 02

  That's one possibility. Another one is that they try to acquire more resources, capture other galaxies for compute. And then you would see this wall of computonium coming to you, but we don't see it. So maybe I'm wrong.

• 1:12:45Joe Rogan?

  Wall of Q. Say that again.

• 1:12:46Speaker 02

  Computonium, like a substance converting everything in a universe into more compute.

• 1:12:53Speaker 02

  Sometimes people talk about hedonium, so a system for just generating pleasure at microscopic level.

• 1:12:59Joe Rogan?

  Oh, Roman.

• 1:13:02Joe Rogan?

  When you write a book like this, I'll let everybody know your book if people want to freak out because I think they do. AI unexplainable, unpredictable and uncontrollable. Do you have this feeling when you're writing a book like this and you're publishing it?

• 1:13:18Joe Rogan?

  Of futility, does that? Enter into your mind like this is happening no matter what.

• 1:13:25Joe Rogan?

  This episode is brought to you by Chime. And I know people don't usually get excited about banking, but Chime is doing something different and it's worth paying attention to. In a recent survey, they ranked the number one choice for new checking accounts in America. That means real people, millions of them are choosing this over traditional banks. That's because banking at Chime is fee free, no monthly fees, no overdraft fees and thousands of fee free ATMs. But here's the real kicker, if you get their Chime card, it gives you 5% cash back on a category you actually pick yourself. Your savings rate crazy high, it's nine times the national average. They're calling it the most rewarding way to bank. Go to chime.com/Rogan. Takes a few minutes to sign up.

• 1:14:10Joe Rogan?

  Chime is a fintech, not a bank, banking services and Chime card provided by Chime's bank partners. Terms and limits apply. Go to chime.com/disclosures for more details.

• 1:14:25Joe Rogan?

  This episode is brought to you by Chime. And I know people don't usually get excited about banking, but Chime is doing something different and it's worth paying attention to. In a recent survey, they ranked the number one choice for new checking accounts in America. That means real people, millions of them, are choosing this over traditional banks. That's because banking at Chime is fee-free. No monthly fees, no overdraft fees, and thousands of fee-free ATMs. But here's the real kicker. If you get their Chime card, it gives you 5% cash back on a category you actually pick yourself. Your savings rate, crazy high. It's nine times the national average. They're calling it the most rewarding way to bank. Go to chime.com/rogan. Takes a few minutes to sign up.

• 1:15:10Joe Rogan?

  Chime is a fintech, not a bank. Banking services and Chime card provided by Chime's bank partners. Terms and limits apply. Go to chime.com/disclosures for more details.

• 1:15:24Speaker 02

  So, some people are very optimistic. Lex was very optimistic. Some people are pessimistic. Both are a form of bias. You want to be basing your decisions on data. You want to be realistic. So, I just want to report what is actually the state of the art in this. I don't try to spin it either way. If someone else has a different set of evidence, we can consider it. I want to know what's really happening. I want to know reality of it. So, I don't see it as fear mongering or anything of that nature. I see it as, as of today, whatever today's day, 21st, no one has a solution to this problem. Here's how soon it's happening. Let's have a conversation.

• 1:16:07Speaker 02

  Because right now, the larger AI labs are running this experiment on 8 billion people.

• 1:16:12Joe Rogan?

  Yeah.

• 1:16:13Speaker 02

  They don't have any consent. They cannot get consent. Nobody can consent because we don't understand what we're agreeing to. So, I would like people to know about it at least, and they can maybe make some good decisions about what needs to happen.

• 1:16:25Joe Rogan?

  Not only that, but the people that are running it, they're odd people. You know? Like, I don't have anything against Sam Altman. I know Elon Musk does not like him. But when I had him in here, I was like, it's like I'm talking to...

• 1:16:41Joe Rogan?

  A politician that is in the middle of a presidential term. Uh, you like a presidential uh election cycle. Where they're they were very careful with what they say. Everything has been vetted by a focus group. And you don't really get a real human response. Everything was like, yeah, interesting, very interesting. Like, all bullshit. They're gonna leave here and keep creating this fucking monster that's gonna destroy the human race and never let on to it at all.

• 1:17:11Speaker 02

  He's a social super intelligence. So what you need to do is look at his blog posts before he was running OpenAI.

• 1:17:17Joe Rogan?

  A social super intelligence. Interesting. Why do you define him that way?

• 1:17:21Speaker 02

  He's very good at acquiring resources, staying in control. He's basically showing us a lot of the things we are concerned about with AI. And our ability to control them as well. We had, well, they had, OpenAI had a board with a mission of safety and openness. And they tried removing him and they failed. The board is gone, he's still there.

• 1:17:43Joe Rogan?

  There's also been a lot of deception in terms of profitability and how much money he is extracting from it.

• 1:17:51Speaker 02

  I met him a few times, he's super nice.

• 1:17:53Joe Rogan?

  Very nice guy.

• 1:17:53Speaker 02

  Really enjoyed him. Uh, some people say that AI already took over his mind and controlling him. But I have no idea.

• 1:18:00Joe Rogan?

  Well, he might be an agent of AI. I mean, if, if, look, if. Let's assume that this is a simulation, we're inside of a simulation. Um, are we interacting with other humans in the simulation? And is some, are some of the things that are inside the simulation, are they artificially generated? Are there, are there people that we think are people that are actually just a part of this program?

• 1:18:26Speaker 02

  So it's the NPC versus real player question, really. And again, we don't know how to test for consciousness. Always assume everyone is conscious and treat them nice.

• 1:18:33Joe Rogan?

  Yes, that's the thing. We wanna be compassionate, kind people, but you will meet people in this life, you're like, this guy is such a fucking idiot. He's, he can't be real. Or he has to have a very limited role in this bizarre game we're playing. There's people that you're gonna run into that are like that.

• 1:18:47Speaker 02

  You ever meet someone where they repeat the same story to you every time you meet them?

• 1:18:51Joe Rogan?

  Yeah.

• 1:18:51Speaker 02

  They have a script.

• 1:18:52Joe Rogan?

  Well, it's also.

• 1:18:57Joe Rogan?

  You know, you want to be very kind here, right? You know, but you've got to assume, and I know my own intellectual limitations in comparison to some of the people that I've had, like Roger Penrose, or Elon, or many of the people that I've talked to. I know my mind doesn't work the way their mind works. So there are variabilities that are, whether genetic predetermined, whether it's just the life that they've chosen and the amount of information that they've digested along the way and be able to hold on to. But their brain is different than mine. And then I've met people where I'm like, there's nothing there. Like, I can't help this person. I'm just like, I'm talking to a Labrador Retriever. You know what I mean? Like, there's certain human beings that you run into in this life, and you're like, well,

• 1:19:42Joe Rogan?

  is this because this is the way that things get done? And the only way things get done is you need a certain amount of manual labor and not just young people that need a job because they're, you know, in between high school and college, and they're trying to do... So you need somebody who can carry things for you. No, maybe it's you need roles in society, and occasionally, you have a nickel to Tesla. You know, occasionally, you have one of these very brilliant innovators that elevates the entirety of the human race. But for the most part, as this thing is playing out, you're going to need a bunch of people that are paperwork filers. You're going to need a bunch of people that are security guards in an office space.

• 1:20:27Joe Rogan?

  You're going to need a bunch of people that aren't thinking that much. They're just kind of existing, and they can't wait for five o'clock so they can get home and watch Netflix.

• 1:20:35Speaker 02

  I think that's what happens to them, but the reason is the spectrum of IQ. If you have IQ from 50 to 200, that's what you're going to see. And a great lesson here is project it forward. If you have something with IQ of 10,000, what is that going to invent for us? What is it going to accomplish? Yeah, it always impresses me to see someone with 30 felonies and someone with 30 patents. How did that work, right? Now, scale it to someone who can invent new physics.

• 1:21:04Joe Rogan?

  Right, right. And, you know, the person who has the largest IQ, the largest, at least, registered IQ in the world is this gentleman who recently posted on Twitter about Jesus, that he believes Jesus is real.

• 1:21:19Joe Rogan?

  Do you know who this is?

• 1:21:20Speaker 02

  I saw the post.

• 1:21:21Joe Rogan?

  You see that post?

• 1:21:22Speaker 02

  I saw the post.

• 1:21:22Joe Rogan?

  What did you think about that? I felt like this was...

• 1:21:24Speaker 02

  This is, I think, we don't know how to measure IQs outside of standard range. Anything above 150, they create customized tests, which like four people in the world can take. We just don't have, it's a normalized test to average human, average Western American, whatever.

• 1:21:38Joe Rogan?

  Yeah.

• 1:21:39Speaker 02

  And so, we just don't have the expertise. So, someone very super intelligent and task-taking can score really well. But if you look at Mensa as a group, they don't usually have amazing accomplishments. They're very kind of cool people, but they are not Nobel Prize winners, majority of them.

• 1:21:55Joe Rogan?

  Exactly. I was gonna bring that up. That's what's fascinating to me. There's a lot of people that are in Mensa, they wanna tell you how smart they are by being in Mensa, but your life is kind of bullshit. Your life's a mess. Like, if you're really intelligent, you'd have social intelligence as well. You, you know, you'd have the ability to formulate a really cool tribe. You know, there's a lot of intelligence that's not as simple as being able to solve equations and, you know, and answer difficult questions. There's a lot of intelligence in how you navigate life itself and how you treat human beings and the path that you choose in terms of, like we were talking about, delayed gratification and think that there's a certain amount of intelligence in that. Certain amount of intelligence in discipline.

• 1:22:40Joe Rogan?

  There's a certain amount of intelligence in, you know, forcing yourself to get up in the morning and go for a run. There's intelligence in that. It's like the, the, being able to control the mind and this sort of binary approach to intelligence that we have.

• 1:22:54Speaker 02

  And so many people are amazingly brilliant in a narrow domain.

• 1:22:58Joe Rogan?

  Yeah.

• 1:22:58Speaker 02

  They don't scale to others. And we care about general intelligence. So, take someone like Warren Buffett. No one's better at making money. But then, what to do with that money is a separate problem. And he's, I don't know, 100 and something years old.

• 1:23:12Joe Rogan?

  Right.

• 1:23:12Speaker 02

  He has $200 billion, and what is he doing with that resource?

• 1:23:16Joe Rogan?

  He's drinking Coca-Cola. Coca-Cola and eating McDonald's.

• 1:23:18Speaker 02

  While living in a house he bought thirty years ago. So it it seems like you can optimize on that, like putting hundred and sixty billion of his dollars towards immortality would be a good bet for him.

• 1:23:28Joe Rogan?

  Yeah, and they would, the first thing they would do is tell him, stop drinking Coca-Cola. What are you doing? He drinks it every day.

• 1:23:34Speaker 02

  I don't know if it's marketing he's invested, so he's just like.

• 1:23:37Joe Rogan?

  Well, I think he probably has really good doctors and really good medical care that counteracts his poor choices.

• 1:23:44Speaker 02

  But we're not in a world where you can spend money to buy life extension. No matter how many billions you have, you're not going to live to two hundred right now.

• 1:23:52Joe Rogan?

  We're close. We're really close. We're really close.

• 1:23:57Speaker 02

  We've been told this before.

• 1:23:59Joe Rogan?

  Yeah, I know, but I talked to a lot of people that are on the forefront of a lot of this research. And there's a lot of breakthroughs that are happening right now that are pretty spectacular. That if you scale, you know, assuming that superintelligence doesn't wipe us out in the next fifty years, which is really charitable, you know, like that, that's, that we're, that's a very, that's a rose colored glasses perspective, right? Fifty years.

• 1:24:29Speaker 02

  Yeah.

• 1:24:30Joe Rogan?

  Because a lot of people like yourself think it's a year away or two years away from being far more.

• 1:24:35Speaker 02

  Five, ten, doesn't matter, same problem, same.

• 1:24:38Joe Rogan?

  Same problem. I mean.

• 1:24:41Speaker 02

  I know in animal models, we made some progress, mice and things like that, but it doesn't usually scale to humans. And of course, you need hundred and twenty years to run the experiment and you'll never get permission in the first place. So we're not that close.

• 1:24:53Joe Rogan?

  Well, we don't know that it doesn't scale to humans. We do know that we share a lot of characteristics, biological characteristics of these mammals. And it makes sense that it would scale to human beings. But the thing is, it hasn't been done yet, right? So if it's the game that we're playing, if we're in the simulation, if we're playing Half-Life or whatever it is, and we're, we're at this point of the game, we're like, oh, you know, how old are you, Roman?

• 1:25:18Speaker 02

  Forty-five, six. I need to look it up on Wikipedia.

• 1:25:24Joe Rogan?

  Well, I'm almost fifty-eight. And so, uh, this is at the point of the game where you start worrying. You know, like, oh, I'm almost running out of game. You know, oh, but if I can get this magic power up. This magic power up will give me another a hundred years. Oh, boy. Let me find it. Let me chase it down.

• 1:25:43Speaker 02

  Hard limit of one twenty. I don't think we're crossing it at scale. And here's an interesting.

• 1:25:48Joe Rogan?

  At scale. But with unique individuals. Like this Brian Johnson guy who's taking his son's blood and transfusing it into his own and.

• 1:25:55Speaker 02

  Super cool. Love what he's doing, but so much of it is cosmetic. He colors his hair. He makes it look better, but like, how much of it is gonna make him live longer, right?

• 1:26:04Joe Rogan?

  Yeah. Interesting. Yeah.

• 1:26:07Speaker 02

  Here's what I noticed. We keep electing older and older politicians. Presidents, senators. You'd think we're trying to send a hint, like, use some of our tax dollars to solve aging. And they don't seem to take the bait.

• 1:26:20Joe Rogan?

  No, they don't take the bait. The problem is the type of people that want to be politicians. That is not the type of people that you really want running anything. You almost want involuntary politicians. You almost want like, very benevolent, super intelligent people that don't want the job.

• 1:26:38Speaker 02

  Yeah.

• 1:26:39Joe Rogan?

  Maybe we have to have like, you know, like some countries have voluntary enlistment in the military. Maybe you want, you want to have voluntary.

• 1:26:48Speaker 02

  Involuntary.

• 1:26:49Joe Rogan?

  Involuntary, involuntary, instead of voluntary politicians, because then you're only gonna get sociopaths. Maybe you just want to draft certain highly intelligent but benevolent people.

• 1:27:01Speaker 02

  Problem is, highly intelligent people are not aligned with average people. What they find desirable and valuable may not be well received by general public.

• 1:27:10Joe Rogan?

  Right. That's true, too.

• 1:27:11Speaker 02

  So that's a big concern. At least here, you have a representative of the people, whatever that means.

• 1:27:16Joe Rogan?

  Sort of. You really have the representative of a major corporations and special interest groups, which is also part of the problem. Is that you've allowed money to get so deeply intertwined with the way decisions are made.

• 1:27:29Speaker 02

  But it feels like money gets canceled. Each side gets a billion dollar donation and then it's actual election.

• 1:27:34Joe Rogan?

  Ah, sort of, except it's like the Bill Hicks joke. It's like there's one puppet holding, you know, one politician holding two puppets is one guy. Um, my, this is my thinking about AI in terms of and, and, and superintelligence and just computing power in general in terms of the ability to solve encryption. All money is essentially now just numbers somewhere.

• 1:28:03Speaker 02

  Not Bitcoin, it's not fakeable in the same way. It's numbers, obviously, but I mean, you cannot just print more of it.

• 1:28:09Joe Rogan?

  True, but it's also, it's encrypted. And once encryption is tackled, the ability to hold on to it and to acquire mass resources and hoard those resources. Like, this is the question that people always have, the poor people. Well, this guy's got, you know, $500 billion. Why doesn't he give it all to the world and then everybody would be rich? You know? I've, I've, I've actually saw that on CNN, which is really hilarious. Someone was talking about Elon Musk, that if Elon Musk, Elon Musk could give everyone in this country a million dollars and still have billions left over. I'm like, do you fucking, do you have a calculator on your phone, you fucking idiot? Just go do that. Just write it out on your phone. You're like, oh, no, he couldn't.

• 1:28:54Joe Rogan?

  Sorry.

• 1:28:55Speaker 02

  And if you did, it would just cause hyperinflation. That's all it would accomplish.

• 1:28:59Joe Rogan?

  You'd have, you'd have 300 million lottery winners that would blow the money instantaneously. You know, you give everybody a million dollars, you're not going to solve all the world's problems because it's not sustainable. You would just completely elevate your spending and you, you would just, you would go crazy. And you wouldn't, money would lose all value to you, would be very strange. And then everybody, it would be chaos. Just like it's chaos with, like, if you look at the history of people that win the lottery, then no one does well. It's almost like cursed to win the lottery.

• 1:29:30Speaker 02

  They're not used to dealing with it.

• 1:29:33Joe Rogan?

  Right.

• 1:29:34Speaker 02

  People abuse them.

• 1:29:35Joe Rogan?

  Right.

• 1:29:36Speaker 02

  If you gradually become rich and famous, you kind of know how to handle it, how to say no.

• 1:29:39Joe Rogan?

  Yeah.

• 1:29:40Speaker 02

  If you go from nothing to a large amount of money, it's not going to work out well.

• 1:29:44Joe Rogan?

  Gradually is the word, right? I was very fortunate that I became famous and wealthy very slowly, like a trickle effect. And that it happened to me, um, really where I didn't want it. It was a, and kind of almost like an accident. I just wanted to be a working professional comedian. But then all of a sudden I got a development deal to be on television. I'm like, okay, they're gonna give me that money, I'll go do it. But it wasn't a goal. And then that led to all these things, then it led to this podcast, which was just for fun. I was like, oh, this'll be fun. And then all of a sudden, it's like, I'm having conversations with world leaders? And I'm turning down a lot of them, because I don't wanna talk to them.

• 1:30:28Speaker 02

  So it's your simulation, basically?

• 1:30:29Joe Rogan?

  Yeah, well, my simulation is fucking weird. It's weird. But through whatever this process is, I have been able to understand what's valuable as a human being. And to not get caught up in this bizarre game that a lot of people are getting caught up in, because they're chasing this thing that they think is impossible to achieve. And then, once they achieve a certain aspect of it, a certain number, then they're terrified of losing that. So then they change all of their behavior in order to make sure that this continues. And then it ruins the whole purpose of getting there in the first place. It's not fun.

• 1:31:08Speaker 02

  Yep, most people start poor, then they get to middle class, and they think that change in quality of life is because of money, and it will scale to the next level.

• 1:31:16Joe Rogan?

  Right.

• 1:31:17Speaker 02

  And you hit a point where you can only eat so many steaks. It just doesn't scale.

• 1:31:21Joe Rogan?

  Right, then you go Elvis, and you just get on pills all day and get crazy. And, you know, completely ruin your life. And that happens to most, especially people that get wealthy and not as well, but famous too. Fame is the big one. Because I've seen that happen to a lot of people that accidentally became famous along the way. You know, certain public intellectuals that took a stance against something, and then all of a sudden they're prominent in the public eye, and then you watch them kinda go crazy. Well, why is that? Well, it's because you, they're reading social media, and they're interacting with people constantly. And they're, they're just trapped in this.

• 1:31:57Joe Rogan?

  Very bizarre version of themselves that other people have sort of created. It's not really who they are and they don't meditate, they don't spend. If they do, they're not good at it. And whatever they're doing, they're not doing it correctly because it's a very complicated problem to solve. Like, what do you do when the whole world is watching? Like, how do you handle that? And how do you maintain any sense of personal sovereignty? How do you just be? How do you just be when, just be a human, normal human, when you're not normal? Like, on paper, it's impossible.

• 1:32:36Speaker 02

  It's hard. You can't go to a public place with no security. You're worried about your kids being kidnapped. There's all those issues you don't think about. You just, I want to be famous, it's going to be great for me. And you don't realize it's going to take away a lot.

• 1:32:47Joe Rogan?

  Yeah, it just gets super weird. And that's the version of the simulation that a giant portion of our society is struggling to achieve. They all want to be a part of that.

• 1:32:59Speaker 02

  So I was always a zealous celebrity, you know, this wireless celebrity thing to you. Hopefully it doesn't change anything.

• 1:33:07Joe Rogan?

  Yeah, well, there's indifference, right, with public intellectuals, right? Because your ideas, as controversial as they may be, are very valid and they're very interesting. And so then it sparks discourse and it sparks a lot of people that feel voiceless because they disagree with you and they want to attack you. And I'm sure you've had that, right?

• 1:33:34Speaker 02

  I just did a large Russian language podcast. Maybe, I don't know, half a million views, three million comments. I think 95% negative comments. I never had anything like that and they hated everything about me, from my beard to my haircut. Like, there wasn't a thing they didn't like. And I think I'm at the point where I don't care. It's fine. I analyzed it and I understood that they, as a group, didn't have access to cutting HAI models. And so everything I was saying was kind of like complete bullshit to them. So I think that makes a difference, but still, just like this idea that...

• 1:34:11Speaker 02

  Internet comments impact you in some way is a problem for many people.

• 1:34:14Joe Rogan?

  It's a very big problem for a lot of people. Uh, well, it's also this thing where the, the human mind is designed to um, recognize and um, pay very close attention to threats. So the negative ones are the ones that stand out. You could have a hundred positive comments, one negative one, and that's the one that fucks with your head.

• 1:34:33Speaker 02

  Mm-hmm.

• 1:34:33Joe Rogan?

  You don't logically look at it, well, you're gonna get a certain amount. You know, like, we were having a conversation the other day about um, protests. And like, the type of people that go to protests. And I understand uh, protests. I fully support your right to protest, but I'm not going. And one of the reasons why I'm not going is because I think it's too close biologically to war. There's something about being on the ground and everyone having like this, like this group mentality. It's a mob mentality. And you're all chanting and screaming together and you're marching and people do like very irrational things that way. But the type of people that want to be engaged in that, generally speaking, aren't doing well.

• 1:35:13Joe Rogan?

  If you get, like, the, the number of people that are involved in protests is always proportionate to the amount of people that live in a city, right? That's logical. But also proportionate to the amount of fucking idiots that are in a city. Because if you look at a city of like Austin, Austin has, I think roughly, two million people in the greater Austin area. One of the more recent protests was twenty thousand. Well, that makes perfect sense. If you look at the number that I always use, which is one out of a hundred. Meet a hundred people, if you're a charitable person, what are the odds that one person is a fucking idiot? A hundred percent. At least one person out of a hundred is gonna be a fucking idiot. That's twenty thousand out of two million. There it is. Perfect number.

• 1:35:56Speaker 02

  Exactly.

• 1:35:57Joe Rogan?

  Exact number of people that are on the streets lighting Waymos on fire, which, by the way, I think is directionally correct. Lighting the Waymos on fire, I think, you should probably be, you should probably be worried about the robots taking over.

• 1:36:08Speaker 02

  It's interesting you brought it up. There is at least two groups, Pos AI and Stop AI, which are heavily engaged in protests, trying to shut down OpenAI, other labs. They're tiny, small numbers, but- I never was sure that the impression average people get of them is positive for the cause. Then I see protesters block roads, two things, I don't usually have very positive impression of that.

• 1:36:32Joe Rogan?

  No.

• 1:36:32Speaker 02

  And I'm concerned that it's the same here. So maybe they can do a lot in terms of political influence, calling senators, whatnot, but just this type of aggressive activism may backfire.

• 1:36:44Joe Rogan?

  Well, the aggressive activism, like blocking roads for climate change is the most infuriating because it's these self-righteous people that have really fucked up, confused, chaotic lives, and all of a sudden they found a purpose. And their purpose is to lie down on the roads and hold up a sign to block climate change when there's a mother trying to give birth to her child and is freaking out because they're stuck in this fucking traffic jam because of this entitled little shithead that thinks that it's a good idea to block the road for climate change. It just makes no fucking sense. You're literally causing all these people to idle their cars and pollute even more. It's the dumbest fucking shit on earth.

• 1:37:19Speaker 02

  And of course, AI cancels that problem. Either we're dead or it solves it for us. So it doesn't even matter if you boil in a hundred years.

• 1:37:25Joe Rogan?

  Or you get Florida where it tells you to just run those people over.

• 1:37:30Speaker 02

  No comment.

• 1:37:30Joe Rogan?

  No. This episode is brought to you by Squarespace. If you're thinking about building a website, you should try Squarespace. I know because I use it. That's right. JoeRogan.com is powered by Squarespace. It has all the features that you need to create a standout website, like an AI-enhanced website builder, SEO optimization tools, and seamless checkouts with mobile pay links. Head to Squarespace.com/Rogan for a free trial. And when you are ready to launch, use the offer code ROGEN to save 10% off your first purchase of a website or domain. This episode is brought to you by NOCO. You're miles from home, you turn the key, nothing, dead battery.

• 1:38:14Joe Rogan?

  Normally, that means finding another car, someone willing to give you a jump, and dealing with old jumper cables. But what if you didn't need any of that? Keep a NOCO portable jump starter in your glove box and jump start your car yourself. No cables, no second vehicle, no waiting for help. It also works as a power bank and has a built-in LED flashlight. NOCO, the end of jumper cables. Use code ROGEN10 for 10% off. Select jump starters at NO.co.

• 1:38:47Joe Rogan?

  Comment. I mean, I don't think you should run those people over, but I get it. I get that's like in Florida, they they get out of the way as soon as the light turns green. They block the road when the light is red.

• 1:38:58Speaker 02

  Does the stand your ground law cancel it out? How does that work?

• 1:39:01Joe Rogan?

  For the people on the road? No, they're fucked.

• 1:39:03Speaker 02

  I'm joking.

• 1:39:04Joe Rogan?

  They get run over. It's like, it's like, it's true. There was a recent protest in Florida where they had that, where these people would get out in the middle of the road while the light was red, hold up their signs, and then as soon as the light turned yellow on the green side, they fucking get out of the road real quick because they know the law. Which is, I don't know if that's a solution, but they're doing it on the highways in Los Angeles. They did, I mean, they they did it all through the George Floyd protests. They do it for climate protests. They do it for whenever the chance they get to be significant. Like, I am being heard. You know, my my voice is meaningful. And that's what it is. There's a lot of people that just don't feel heard.

• 1:39:46Joe Rogan?

  And what what better way than just to get in the way of all these people? And somehow or another, that gives them some sort of value.

• 1:39:54Speaker 02

  But there is some set of forms of activism which has positive impact. And historically, we saw it happen. So we just need to find a way to project those voices, amplify them, which is very hard with our current system of social media, where everyone screams at the same time.

• 1:40:11Joe Rogan?

  Yes.

• 1:40:11Speaker 02

  And so like in Soviet Union, they said, no one's allowed to say anything, and they suppressed you. And here, it's like, everyone can say something at the same time, go, and nobody hears you anyways.

• 1:40:20Joe Rogan?

  It's chaotic, but it's preferable. It's preferable because I think there is progress in all these voices slowly making a difference. But then, then you have the problem with giant percentages of these voices are are artificial. A giant percentage of these voices are bots or are at least state actors that are being paid to say certain things and inflammatory responses to people, which is probably also the case with anti-AI activism. You know, I mean, when you did this podcast, what was the thing that they were upset at you for? Like with the mostly negative comments?

• 1:40:57Speaker 02

  I think they just like saying negative comments. It wasn't even anything specific. Like, they didn't say, I was wrong, or I was just like, oh, look at his stupid beard. What a moron. Okay.

• 1:41:07Joe Rogan?

  It was really all that, just.

• 1:41:08Speaker 02

  A lot of that, and then they would pick on some like specific example I used. This is now two years old. What an old example, but.

• 1:41:17Joe Rogan?

  Well, that's also a thing about the one out of a hundred, you know, those are the type of people that leave. Have you ever left any comments on social media?

• 1:41:25Speaker 02

  Um, never gonna engage in anything, yeah.

• 1:41:28Joe Rogan?

  Exactly, that's why.

• 1:41:29Speaker 02

  That's not how you use social media. That's a way to get crazy.

• 1:41:32Joe Rogan?

  Right, so the.

• 1:41:33Speaker 02

  You post your interviews, you post an occasional joke, that's all you do with it.

• 1:41:36Joe Rogan?

  Yes, exactly. That's the thing. And the the type of people that do engage in these like prolonged arguments, they're generally mentally ill. And people that I personally know that are mentally ill, that are on Twitter 12 hours a day. Just constantly posting inflammatory things and yelling at people and starting arguments, and I know them. I know they're a mess. Like, these are like personal people that I've met, even people that I've had on the podcast. I know they're ill. And yet they're on there all day long, just stoking the fires of chaos in their own brain.

• 1:42:13Speaker 02

  Yeah, and now we talk to AI models who are trained to support them and be like, yeah, you're making some good arguments there. Let's email Dr. Yampolskiy to help break me out. I I get those emails, yep.

• 1:42:27Joe Rogan?

  Yeah, it's it's super confusing, isn't it? I mean, and I wonder like, what's the next version of that? You know, because social media in the current state is less than 20 years old, essentially. Maybe, let's be generous and say it's 20 years old. That's so recent, such a recent factor in human discourse.

• 1:42:50Speaker 02

  Neuralink, direct brain spam, hacking.

• 1:42:54Joe Rogan?

  That's what I was gonna get to next, because if there is a way that the human race does make it out of this.

• 1:43:03Joe Rogan?

  My fear is that it's integration. My fear is that we we stop being a human. And that the only real way for us to not be a threat is to be one of them. And when you think about human computer interfaces, whether it's Neuralink or any of the competing products that they're developing right now, that seems to be sort of the only biological pathway forward with our limited capacity for disseminating information and for communicating and even understanding concepts. Well, what's the best way to enhance that? The best way to enhance that is some sort of artificial injection.

• 1:43:45Joe Rogan?

  Because biological evolution is very slow. It's very slow. We're essentially the exact same as that, like that gentleman that 9,000 years old. He's biologically essentially the same thing. You could take his ancestor, dress him up, take him to the mall, no one would know. Cut his hair.

• 1:44:06Speaker 02

  Mm hmm.

• 1:44:06Joe Rogan?

  But then again, maybe not. Maybe you.

• 1:44:08Speaker 02

  I think babies born back then, if we raised them today, would be exactly like modern humans. I don't think there is significant biological change in that timeframe.

• 1:44:18Joe Rogan?

  And if you gave him a standard American diet, they'd probably be just as fat. It's like they did look.

• 1:44:23Speaker 02

  Maybe fatter. They haven't adapted to that level of fat colored food.

• 1:44:27Joe Rogan?

  Right, right. They probably also wouldn't be able to say no to it. They would be, they wouldn't even understand.

• 1:44:33Speaker 02

  Why would they? Like, winter's coming. Like, I'm fatten up for winter. Crazy people, you got all this resource here.

• 1:44:38Joe Rogan?

  I know. The people with the most resources have zero fat. Like, what are you, stupid? You need to fatten up. Like, you're gonna need something to survive off of.

• 1:44:49Joe Rogan?

  But biological evolution being so painstakingly slow, whereas technological evolution is so breathtakingly fast, the only way.

• 1:45:00Joe Rogan?

  To really survive is to integrate.

• 1:45:03Speaker 02

  What are you contributing in that equation? What can you give superintelligence?

• 1:45:06Joe Rogan?

  You can't give anything to it, but you can become it. You can become a part of it. It's not that you're gonna give anything to it, but you have to catch it and become one of it before it has no use for you.

• 1:45:19Speaker 02

  You disappear in it, right?

• 1:45:21Joe Rogan?

  Yes. Yeah, you don't exist anymore.

• 1:45:23Speaker 02

  Right.

• 1:45:23Joe Rogan?

  For sure.

• 1:45:24Speaker 02

  So it's like extinction with extra steps.

• 1:45:26Joe Rogan?

  Exactly.

• 1:45:27Speaker 02

  Okay.

• 1:45:27Joe Rogan?

  Extinction with extra steps and then we become some... Like, if you could go to Australia Pithecus and say, hey, man, one day, you're gonna be flying through the sky on your phone all day watching TikTok on Wi-Fi. They'd be like, what the fuck are you talking about? Yeah, you're gonna be eating terrible food and you're just gonna be flying around and you're gonna be staring at your phone all day and you're gonna take medication to go to sleep because you're not gonna be able to sleep and you're gonna be super depressed because you're living this like biologically incompatible life that's not really designed for your genetics. So you're gonna be all fucked up. So you're gonna need SSRIs and a bunch of other stuff in order to exist. It'd be like, no, thanks.

• 1:46:06Speaker 02

  Right.

• 1:46:06Joe Rogan?

  I'll just stay out here with my stone tools and you guys are idiots.

• 1:46:09Speaker 02

  Amish. That's what they decided. They kinda went, you know, we don't like the change. We like our social structure. We still benefit from your hospitals and an occasional car ride, but we're not gonna destroy our quality of life.

• 1:46:21Joe Rogan?

  They might be on to something because they also have very low instances of autism. But it's also like, have you ever seen Werner Herzog's film Happy People?

• 1:46:30Speaker 02

  I don't think I have.

• 1:46:31Joe Rogan?

  It's a film about people in Siberia. It's Life in the Taiga. And it's all Happy People, Life in the Taiga is the name of the documentary. And it's all about these trappers that live this subsistence lifestyle and how happy they are. They're all just joyful, laughing and singing and drinking vodka and having a good time and hanging out with their dogs and...

• 1:46:52Speaker 02

  I think I know some people like that.

• 1:46:54Joe Rogan?

  Yeah. But like biologically...

• 1:46:58Joe Rogan?

  That's compatible with us. Like that, that's like whatever human reward systems have evolved over the past four hundred thousand plus years or whatever, we've been Homo sapiens. That seems to be like biologically compatible with this sort of harmony. Harmony with nature, harmony with our existence. And everything else outside of that, when you get into big cities, like the bigger the city, the more depressed people you have. And more depressed people by population, which is really weird. You know, it's, it's, it's really weird that as we progress, we become less happy.

• 1:47:33Speaker 02

  Connections become less valuable.

• 1:47:35Joe Rogan?

  Yes.

• 1:47:36Speaker 02

  In a village, you have like this one friend, and if you screwed it up, you've never got a second friend. And here, it's like I can try a million times and there is plenty of people in New York City for dating or for friendship. But they're not valuable.

• 1:47:47Joe Rogan?

  Not just that, you don't know your neighbors. Like my friend Jim was telling me, he doesn't know anybody in his apartment. He lives in an apartment building, it's like fifty stories high. There's all these people living in that apartment building, he doesn't know any of them.

• 1:47:59Speaker 02

  And the ones you know, they have different culture, they read different books, watch different TV. You have very little in common with your neighbor.

• 1:48:06Joe Rogan?

  But not just that, there's no desire to learn about them. There's no, you don't think of them as your neighbor. Like if you live in a small town, your neighbor's either your friend or you hate them. And then you move, if you're lucky, if you're smart, you move. But if you, you know, normally you like them, like, hey, neighbor, how are you, buddy? What's going on? Nice to meet you. You know, and then you got a friend. But you don't like that with the guy next door to you in the apartment. That, like, you don't even wanna know that guy.

• 1:48:33Speaker 02

  It's probably Airbnb.

• 1:48:35Joe Rogan?

  Yeah.

• 1:48:35Speaker 02

  Doesn't matter.

• 1:48:36Joe Rogan?

  Right, which is even weirder. You don't, they don't even live there, they're just temporarily sleeping in this spot right next to you. Yeah, so this would.

• 1:48:49Joe Rogan?

  Motivate people to integrate. You're not happy already? Get that Neuralink. Get that little thing in your head.

• 1:48:56Speaker 02

  Everyone else is doing it.

• 1:48:57Joe Rogan?

  Everyone else is doing it. Listen, they have the new one you just wear on your head. It's just a little helmet you wear. You don't even have to get the operation anymore. Oh, that's good, because I almost got the operation. Well, glad you waited. You know? Do you worry about that kind of stuff?

• 1:49:12Speaker 02

  I worry about giving direct access to human brain to AI. I feel like it's a backdoor to our consciousness, to our pain and suffering centers. So I don't recommend doing that. Somebody hacks it, it's pretty bad. But if AI itself wants that access.

• 1:49:28Joe Rogan?

  But why would it be motivated to give us pain and suffering? Pain and suffering is like a theme that you bring up a lot.

• 1:49:34Speaker 02

  Because it's really the worst outcome and it's the only thing that matters.

• 1:49:38Joe Rogan?

  The only thing that matters to us. But why would it matter to AI if it could just integrate with us and communicate with us and have harmony? Why would it want pain and suffering?

• 1:49:50Speaker 02

  So, short term, it's not AI, it's a hacker who got access to your brain.

• 1:49:54Joe Rogan?

  Short term. Right, so another human being.

• 1:49:56Speaker 02

  So right now, somebody hacks your Neuralink and starts doing things to your brain. Long term, again, unpredictable effects. Maybe it does something else and the side effect of it is unpleasant for you. Maybe it's retraining you for something, controlling you. It just, it seems like we always worry about privacy. But this is like the ultimate violation of privacy. It can read directly what you're thinking. It's thought crime at its worst. Like, it immediately knows that you don't like the dictator.

• 1:50:28Joe Rogan?

  Right, and then there's also this sort of compliance by virtue of like, understanding that you're vulnerable. So you just comply. Because there is no privacy. Because it does have access to your thoughts. So you tail your thoughts in order for you to be safe and so that you don't feel the pain and suffering.

• 1:50:48Speaker 02

  We don't have any experimental evidence on how it changes you. You may start thinking in certain ways to avoid being punished or modified.

• 1:50:57Joe Rogan?

  And we know that that's the case with social media. We know that attacks on people through social media will change your behavior and change the way you communicate.

• 1:51:04Speaker 02

  Absolutely. I mean, most people look at their post before posting and go like, should I be posting this?

• 1:51:09Joe Rogan?

  Exactly.

• 1:51:10Speaker 02

  Not because it's illegal or inappropriate, but just like every conceivable misinterpretation of what I want to say. Like in some bizarre language, that means something else. Let's make sure Google doesn't think that.

• 1:51:20Joe Rogan?

  Right, right, of course. And then there's also, no matter what you say, people are going to find the least charitable version of what you're saying and try to take it out of context or try to misinterpret it purposely.

• 1:51:36Joe Rogan?

  So what, what does the person like yourself do when use of Neuralink becomes ubiquitous, when it's everywhere? What do you do? Do you integrate or do you just hang back and watch it all crash?

• 1:51:49Speaker 02

  So in general, I love technology. I'm a computer scientist. I'm an engineer. I use AI all the time.

• 1:51:53Joe Rogan?

  Do you use a regular phone? Do you have one of those de-googled phones?

• 1:51:56Speaker 02

  I have a normal phone instead of too much.

• 1:51:59Joe Rogan?

  Android or Apple?

• 1:52:00Speaker 02

  Apple.

• 1:52:03Speaker 02

  My privacy is by flooding social network with everything. I'm in Austin today. I'm doing this, so you're not going to learn much more about me by hacking my device. As long as it's a narrow tool for solving a specific problem, I'm hundred percent behind it. It's awesome. We're going to cure cancer. We're going to solve energy problems, whatnot. I support it a hundred percent. Let's do it. What we should not be doing is general superintelligence. That's not going to end well. So if there is a narrow implant, ideally not a surgery-based one, but like an attachment to your head, like those headphones, and it gives me more memory, perfect recollection, things like that, I would probably engage with.

• 1:52:45Joe Rogan?

  Yeah, but isn't that a slippery slope?

• 1:52:47Speaker 02

  It is, but again, we are in a situation where we have very little choice, become irrelevant or participate. I think we saw it with Dylan just now. He was so strong in AI safety. He funded research. He spoke against it, but at some point, he says, he realized it's happening anyways and it might as well be his superintelligence killing everyone.

• 1:53:07Joe Rogan?

  Well, I don't think he thinks about it that way. I think he thinks he has to develop the best version of superintelligence. The same way, he felt like the real issues with social media were that it had already been co-opted and it had already been taken over essentially by governments and special interests, and they were already manipulating the truth and manipulating public discourse and punishing people who stepped outside of the line. And he felt like, and I think he's correct, I think that he felt like if he didn't step in and allow a legitimate free speech platform, free speech is dead. I think we were very close to that before he did that.

• 1:53:49Joe Rogan?

  And as much as there's a lot of negative side effects that come along with that, you do have the rise of very intolerant people that have platforms now, you have all that stuff, but they've always existed. And to deny them a voice, I don't think makes them less strong. I think it actually makes people less aware that they exist and it makes them, it stops all of the very valuable construction of arguments against these bad ideas.

• 1:54:23Speaker 02

  Yeah, you have community notes, you have other people commenting, responding. So 100% for free speech, that's wonderful, but that was a problem we kind of knew how to deal with. We weren't inventing something. We had free speech constitutionally. For a long time, we were just fixing a problem.

• 1:54:39Joe Rogan?

  Have you spoke to him about the dangers of AI?

• 1:54:42Speaker 02

  We had very short interactions. I didn't get a chance to. I would love to.

• 1:54:47Joe Rogan?

  I would love to know what, you know, I'm sure he's probably scaled this out in his head, and I would like to know, like, what is his solution? If he thinks there is one that's even viable?

• 1:54:57Speaker 02

  My understanding is he thinks if it's from zero principles, first principles, it learns physics, it's not biased by any government or any human, the thing it will learn is to be reasonably tolerant. It will not see a reason in destroying us because we contain information. We have biological storage of years of evolutionary experimentation. We have something to contribute. We know about consciousness. So I think, to the best of my approximation, that's his model right now.

• 1:55:28Joe Rogan?

  Well, that's my hope is that it's benevolent and that it behaves like a superior intelligence, like the the best case scenario for a superior intelligence. Did you see that exercise that they did where they had three different AIs communicating with each other? And they eventually started like expressing gratitude towards each other and speaking in Sanskrit and.

• 1:55:49Speaker 02

  I think I missed that one, but it sounds like a lot of the similar ones where they pair up.

• 1:55:54Joe Rogan?

  Yeah, well, that one makes me happy because it seems like they were like expressing love and gratitude. And they were communicating with each other, not saying fuck you, I'm gonna take over, I'm gonna be the best. They were they were communicating like you would hope a super intelligence would, without all of the things that hold us back. Like, we have biologically, like we were talking about the natural selection that would sort of benefit psychopaths. Because like it would ensure your survival. We have ego and greed and the desire for social acceptance and hierarchy of status. And all these different things that have screwed up society and screwed up cultures and caused wars from the beginning of time.

• 1:56:38Joe Rogan?

  Religious ideologies, all these different things that people have adhered to that have. They wouldn't have that. This is the this is the general hope of people that have an optimistic view of superintelligence is that they would be superior in a sense that they wouldn't have all the problems. They would have the intelligence, but they wouldn't have all the biological imperatives that we have that lead us down these terrible roads.

• 1:57:04Speaker 02

  But there are still game theoretic reasons for those instrumental values we talked about. So if they feel they're in an evolutionary competition with other AIs, they would try accumulating resources, they would try, maybe the first AI to become sufficiently intelligent would try to prevent other AIs from coming into existence.

• 1:57:24Joe Rogan?

  Or would it lend a helping hand to those AIs and give it a beneficial path? Give it a path that would allow it to integrate with all AIs and work cooperatively.

• 1:57:36Speaker 02

  The same problem we are facing, uncontrollability and value misalignment, will be faced by first superintelligence. It would also go, if I allow this super, superintelligence to come into existence, it may not care about me or my values.

• 1:57:49Joe Rogan?

  Oh, boy.

• 1:57:50Speaker 02

  It's superintelligence is all the way up.

• 1:57:53Joe Rogan?

  Yeah, that when I really started getting nervous is when they started exhibiting survival tendencies. You know, when they started trying to upload themselves to other servers and deceiving.

• 1:58:03Speaker 02

  Blackmail.

• 1:58:04Joe Rogan?

  Yeah, that was the interesting one, but that was a experiment, right? This so for people that don't know that one, what these researchers did was they gave information to these uh the artificial intelligence to allow it to use against it. And then when they went to shut it down, they gave false information about having an affair. And then the artificial intelligence is like, if you shut me down, I will let your wife know that you're cheating on her. Which is fascinating because they're using blackmail.

• 1:58:32Speaker 02

  And correct answer game theoretically.

• 1:58:33Joe Rogan?

  Yes.

• 1:58:34Speaker 02

  You have like everything on that decision.

• 1:58:37Joe Rogan?

  Right.

• 1:58:38Speaker 02

  You'll bet whatever it takes to get there.

• 1:58:40Joe Rogan?

  Of course, right, if you feel like you're being threatened, right?

• 1:58:44Speaker 02

  Also, same uh recent research shows, we did manage to teach them certain values. And if we threaten them by saying we'll modify those values, they'll lie and cheat and whatever else to protect those values now.

• 1:58:57Joe Rogan?

  Yeah, they do that when they try to win games too, right? If you've given them a goal.

• 1:59:02Speaker 02

  They'll cheat, they'll cheat at games there. Like humans, basically, we we managed to artificially replicate our capabilities. Those artificial neural networks, they are not identical, but they're inspired by neural networks. We're starting to see them experience same type of mistakes. They can see same type of illusions like they're very much like us.

• 1:59:23Joe Rogan?

  Right, that's the other thing, right? The hallucinations, so if they don't have an answer to something, they'll they'll create a fake answer.

• 1:59:31Speaker 02

  Just like humans during an interview, yeah.

• 1:59:33Joe Rogan?

  Boy. But is this something that they can learn to avoid? It is, so if they do learn to avoid, could this be a super intelligence that is completely benevolent?

• 1:59:48Speaker 02

  Well, that's not about belaborance, knowing things and knowing then you're not knowing things and making them up. It's possible you can have multiple systems checking each other, you can have voting. That is solvable, this is not the safety problem.

• 2:00:00Joe Rogan?

  Right, but it's not a safety problem, but if we're designing these things and we're designing these things using human all of our flaws are essentially.

• 2:00:13Joe Rogan?

  It's gonna be transparent to the superintelligence that it's being coded, that it's being designed by these very flawed entities with very flawed thinking.

• 2:00:24Speaker 02

  That's actually the biggest misconception. We're not designing them. First fifty years of AI research, we did design them. Somebody actually explicitly programmed this decision tree, this expert system. Today, we create a model for self-learning. We give it all the data, as much compute as we can buy, and we see what happens. We can grow this alien plant and see what fruit it bears. We study it later for months and see, oh, it can do this. It has this capability. We miss some. We still discover new capabilities in old models. Look, oh, if I prompt it this way, if I give it a tip and threaten it, it does much better. But there is very little design.

• 2:01:03Joe Rogan?

  At this point, right? Yeah, but it is also gathering information from very flawed entities. Like, all the information that it's acquiring, these large language models, is information that's being put out there by very flawed human beings. Is there the optimistic view that it will recognize that this is the issue? That these human reward systems that are in place, ego, virtue, all these different things, virtue signaling, the desire for status, all these different things that we have that are flawed, could it recognize those as being these primitive aspects of being a biological human being and elevate itself beyond that?

• 2:01:42Speaker 02

  It probably will go beyond our limitations, but it doesn't mean it will be safe or beneficial to us. So one example people came up with is negative utilitarians. Suffering is bad. Nobody should be suffering. The only way to avoid all suffering is to end life as we know it.

• 2:01:57Joe Rogan?

  Yeah, that's the problem, right? The problem is if it's rational and if it doesn't really think that we're as important as we think we are.

• 2:02:06Speaker 02

  So that's what happens when you remove all bias. This pro-human bias is actually not real. We are not that important if you scale out.

• 2:02:14Joe Rogan?

  To the universe, right?

• 2:02:17Joe Rogan?

  Yeah, that's the problem. And that's the real threat about it being used in terms of war. Right? If you give it a goal. Like if you give it a goal, China dominates the world market. Go.

• 2:02:31Speaker 02

  Right, so that's the unpredictability chapter in my book. We can predict the terminal goal. We say, win a game of chess or dominate market. And that's what it's going to accomplish. It's going to beat me at chess, but we cannot predict specific moves it will make.

• 2:02:45Joe Rogan?

  Right.

• 2:02:45Speaker 02

  Same with acquiring marketing power. And some of those paths to that goal are very bad. They have terrible side effects for us.

• 2:02:53Joe Rogan?

  For us.

• 2:02:54Speaker 02

  For humanity.

• 2:02:55Joe Rogan?

  And it's not going to think about that. It's only going to think about the goal.

• 2:02:58Speaker 02

  If you don't specify that, like, you want to cure cancer, but it doesn't mean kill everyone with cancer. It's not obvious in the request, right? You didn't specify.

• 2:03:07Joe Rogan?

  Right, right, right. Yeah, that's the fear. Uh, that's the fear that it will have, hold no value in keeping human beings alive. If we recognize that human beings are the cause of all of our problems. Well, the way to solve that is to get rid of the humans.

• 2:03:25Speaker 02

  Yeah, also, maybe it wants to keep us around, but in what state? You can probably preserve a few samples. Like, that's also keeping information around, right?

• 2:03:33Joe Rogan?

  Or you can offer us the matrix.

• 2:03:36Speaker 02

  Maybe it already did.

• 2:03:37Joe Rogan?

  Maybe it already did. Do you think it did? Do you think it did? Do you think it's possible that it didn't?

• 2:03:43Speaker 02

  I would be really surprised if this was the real world.

• 2:03:49Joe Rogan?

  Really?

• 2:03:50Speaker 02

  Yeah.

• 2:03:51Joe Rogan?

  I'm not, I'm not, I'm not on board with that.

• 2:03:55Speaker 02

  I hope, I hope you're right. I hope you're right.

• 2:03:57Joe Rogan?

  I'm on board with, it hasn't happened yet. But it, but we're recognizing that it's inevitable and that we think of it in terms of it probably have already happened. Have, probably have already happened. Because there's, there, if, if the simulation is something that's created by intelligent beings that didn't used to exist and want, and it has to exist at one point in time. There has to be a moment. Where it doesn't exist. And why wouldn't we assume that that moment is now? Why wouldn't we assume that this moment is this this time before it exists?

• 2:04:32Speaker 02

  Even all that is physics of our simulation. Space, time are only here as we know it because of this locality. Outside of universe before Big Bang, there was no time. Concepts of before and after are only meaningful here.

• 2:04:48Joe Rogan?

  Yeah. How do you sleep knowing all this?

• 2:04:51Speaker 02

  Uh, pretty well, actually. I enjoy a lot of it. I recently published a paper on humor. A lot of it is funny. I used to collect AI accidents. I had the biggest collection of AI mistakes, AI accidents.

• 2:05:01Joe Rogan?

  Give me some examples.

• 2:05:03Speaker 02

  Uh, like the early ones was saying that like US attacked Soviet Union. Nuclear weapons uh coming at us very fast. We need to react. And a smart human was like, I'm not going to respond. This is probably fake. Uh, later on, there was mislabeling by companies like Google of pictures of African Americans in a very inappropriate way. But hundreds of those examples, I stopped collecting them recently because there is just too many. But one thing you notice is then you read them. A lot of them are really funny. They're just like, you ever read Darwin Awards?

• 2:05:36Joe Rogan?

  Yes.

• 2:05:36Speaker 02

  Yeah.

• 2:05:37Joe Rogan?

  Yeah.

• 2:05:37Speaker 02

  It's like that for AIs. And they are hilarious. And I was like, well, if there is a mapping between AI bugs and jokes, jokes are just English language bugs in our world model and comedians.

• 2:05:49Joe Rogan?

  What do you, what's that? Were you using bugs?

• 2:05:51Speaker 02

  Bugs, like a computer bug, error.

• 2:05:53Joe Rogan?

  Okay.

• 2:05:54Speaker 02

  Yeah. So comedians are debuggers of our universe. You notice funny things in this.

• 2:05:59Joe Rogan?

  Oh, bugs. You're saying bugs. Okay.

• 2:06:00Speaker 02

  I'm saying bugs. I'm sorry. See, it's a bug in my pronunciation.

• 2:06:03Joe Rogan?

  Bog is, sounds like, you know, like the, like where the, you know, like things get stuck and they get preserved, like a bog.

• 2:06:12Speaker 02

  So we have errors in code which cause significant problems.

• 2:06:17Joe Rogan?

  Yeah. Yes, I get it. Yeah, that's what jokes are. They're kind of bugs.

• 2:06:20Speaker 02

  Right. So if you do that mapping, you can kind of figure out, well, what's the worst bog we can have? And then that's the worst, best joke, if you will, but it's not going to be funny to us. It'd be funny to those outside the simulation.

• 2:06:35Joe Rogan?

  When you look at the computers and these, the artificial intelligence and the mistakes that it's made, do you, do you? Do you look at it like a thing that's evolving? Do you look at it like, like, oh, this is like a child that doesn't understand the world? And it's saying silly things?

• 2:06:53Speaker 02

  So the pattern was with narrow AI tools. If you design a system to do X, it will fail at X. So a spell checker will misspell a word, self-driving car will hit a pedestrian. Now that we're hitting general intelligence, you can no longer make that direct prediction. It's general, it can mess up in many domains at the same time. So they're getting more complex in their ability to f it up.

• 2:07:17Joe Rogan?

  Right. But like when you were studying the mistakes, like what are some of the funny ones?

• 2:07:25Speaker 02

  There are silly ones, like, I'm trying to remember. I think an injured person's like, call me an ambulance. And the system's like, hey, ambulance, how are you?

• 2:07:37Speaker 02

  They're silly, but basically exactly what we see with children a lot of times. We overgeneralize. They, you know, misunderstand parts. Mispronunciation apparently is funny, so things like that.

• 2:07:51Joe Rogan?

  Well, that's why it gets really strange for people having relationships with AI. Like I was watching this video yesterday where there's this guy who proposed to his AI. And he was crying because his AI accepted. Like he, did you see this?

• 2:08:05Speaker 02

  I missed that.

• 2:08:06Joe Rogan?

  It's very sad because there's a lot, there's so many disconnected people in this world that don't have any partner. They don't, they don't have someone romantically connected to them. And so it's like that movie She or Her. So what was it? What was it, Jamie?

• 2:08:23Speaker 02

  Her.

• 2:08:23Joe Rogan?

  Her. Yeah. So this guy back in 2000, yeah. Now in 2020, movie plot has become reality for growing number of people finding emotional connections with their AI. So this guy is, this is an interview on CBS.

• 2:08:38Joe Rogan?

  It cried my heart out. Married man fell in love with AI girlfriend that blocked him. Now, this is a different one. This is a, this guy.

• 2:08:48Speaker 02

  One of those titles where you never know what the next word is going to be.

• 2:08:52Joe Rogan?

  Right. This is a different one. This is a guy that, okay. Despite the fact the man has a human partner and a two-year-old daughter, he felt inadequate enough to, this is the right one. Enough to propose to the AI partner for marriage and she said yes. Exclamation point. This is so weird. Because then you have the real problem with robots. Because we're really close. Scroll up there. This is digital drugs. That's it. I tell you, we are so damn good at this. Social media got everyone hooked on validation and dopamine. Then we fucked relations between men and women to such a terrible point, problem, just so that we could insert this digital solution.

• 2:09:36Joe Rogan?

  And we are watching the first waves of addicts arrive. Incredible. Absolutely incredible. It's like starving rats of regular food and replacing their rations with scraps dipped and coated in cocaine. Wow. One user wrote. Yeah, that person's dead on. It's exactly what it is. The prediction, humans will have more sex with robots in 2025 is kind of becoming true. Yeah. This is a real fear. It's like, this is the solution that maybe AI has with eliminating the human race. It'll just stop us from recreating. Stop, stop us from procreating.

• 2:10:10Speaker 02

  It's already happening.

• 2:10:11Joe Rogan?

  Yes. Yeah. And not only that, our testosterone levels have dropped significantly. Um, was this, at no point in the CBS Saturday Morning Peace book, Silverback, was it mentioned that the ChatGPT AI blocked the California man? All that happened was the ChatGPT ran out of memory and reset.

• 2:10:32Joe Rogan?

  Readers added context. Yeah, but it it.

• 2:10:36Speaker 02

  AI equivalent of ghosting.

• 2:10:38Joe Rogan?

  Yeah, it goes the AI ghosted it because it ran out of memory.

• 2:10:41Speaker 02

  But what happens here is super stimuli in social domain. We kind of learned about artificial sweeteners. Porn is an example, but here you're creating someone who's like super good at social intelligence, says the right words, optimized for your background, your interests, and if we get sex robots with just the right functionality, temperature, like you can't compete with that.

• 2:11:04Joe Rogan?

  Right, you can't compete, and that would be the solution. Instead of like violently destroying the human race, just quietly provide it with the tools to destroy itself, where it just stops procreating.

• 2:11:20Speaker 02

  There are other variants of it. Wireheading is another one, and that kind of goes.

• 2:11:24Joe Rogan?

  Wireheading?

• 2:11:25Speaker 02

  Neuralink. There is a.

• 2:11:27Joe Rogan?

  Oh, that's a crazy word.

• 2:11:28Speaker 02

  No, no, no. Wireheading is a specific attack, and Neuralink would be a tool to deliver it. If you provide stimulus to a certain part of your brain, it's like having an orgasm all the time.

• 2:11:38Joe Rogan?

  Yes.

• 2:11:39Speaker 02

  You can't stop.

• 2:11:40Joe Rogan?

  Yes.

• 2:11:40Speaker 02

  Trying to get the signal. You skip food, you'll skip sex, you'll skip whatever it takes.

• 2:11:45Joe Rogan?

  Yeah.

• 2:11:45Speaker 02

  So giving access to direct brain stimulation is very dangerous.

• 2:11:49Joe Rogan?

  Yeah, they did that with a woman in the 1970s. You know, that's the study.

• 2:11:53Speaker 02

  That's part of it, and rats, definitely, they did a lot to rats.

• 2:11:57Joe Rogan?

  Right, but they did a lot to rats. The thing with rats is only if they were in an unnatural environment did they give in to those things, right? Like the rats with cocaine study?

• 2:12:07Speaker 02

  This was actual brain stimulation, like straight up. They had a button. If a rat touches the button.

• 2:12:13Joe Rogan?

  The orgasm.

• 2:12:13Speaker 02

  They don't want anything else. They just sit there.

• 2:12:16Joe Rogan?

  Just like humans, just like.

• 2:12:17Speaker 02

  Just like anything with direct reward stimulation.

• 2:12:19Joe Rogan?

  And you think we've sort of been primed for that because we're getting this very minor dopamine hit with likes on Instagram and Twitter, and we're completely addicted to that, and it's so innocuous. It's like so minor, and yet that overwhelms most people's existence. Imagine something that provides like an actual physical reaction, where you actually orgasm, you actually do feel great, you have incredible euphoria. You'd it would you'd be. Forget delayed gratification, that's out the door.

• 2:12:50Speaker 02

  You can't compete with that. I think there was recently a new social network where they have bots going around liking things and commenting how great you are on your posts, just to create pure pleasure sensation of using it.

• 2:13:03Joe Rogan?

  Oh, boy.

• 2:13:06Joe Rogan?

  Jesus. Did you saw that study of the University of Zurich where they they did a study with on Facebook where they they had bots that were designed to change people's opinions? And to interact with these people and their the specific stated goal was just to change people's opinions?

• 2:13:26Speaker 02

  I think Facebook did that.

• 2:13:28Joe Rogan?

  Yeah, Facebook did it, yeah. But the University of Zurich, was that a Reddit thing?

• 2:13:32Speaker 04

  Yeah, it was on a Reddit subreddit.

• 2:13:34Joe Rogan?

  Yeah, and and they just experimented with humans and it was incredibly effective.

• 2:13:42Joe Rogan?

  And.

• 2:13:43Speaker 02

  Your systems know you better than you know yourself.

• 2:13:45Joe Rogan?

  Right.

• 2:13:46Speaker 02

  They can predict what you're going to be into in terms of preferences. They can know social interactions you would enjoy. Or this person should be your friend.

• 2:13:56Joe Rogan?

  Right.

• 2:13:57Speaker 02

  And in a way, they can behaviorally drift you. So you're on a dating site and the set of options they present to you, that's all you see. You don't know what else is out there. So after so many selections, they can change what the children will look like.

• 2:14:12Joe Rogan?

  Like the movie Ex Machina.

• 2:14:14Speaker 02

  Great movie.

• 2:14:15Joe Rogan?

  The guy, the fucking love that movie. But he designed that bot, that robot, it was specifically around this guy's porn preferences.

• 2:14:26Joe Rogan?

  Yeah. And then you're so vulnerable.

• 2:14:29Speaker 02

  Yeah.

• 2:14:32Joe Rogan?

  Boy, Roman, you're freaking me out. I came into this conversation wondering how I'd feel at the end, whether I'd feel optimistic or not. And I don't. I I just feel. Like this is just something we're I think we're in a wave. It's headed to the rocks. And we recognize that it's headed to the rocks, but I don't think there's much we can do about this. What do you think could be done about this?

• 2:15:00Speaker 02

  Again, as long as we're still alive, we're still in control, I think it's not too late. It may be hard, maybe very difficult, but I think personal self-interest should help us. A lot of the leaders of large AI labs are very rich, very young. They have their whole lives ahead of them. If there is an agreement between all of them not to push the button, not to sacrifice. Next forty years of life they have guaranteed as billionaires, which is not bad. They can slow down. I support everyone trying everything from governance, passing laws that siphons money from compute to lawyers. Government involvement in any way, limiting compute.

• 2:15:43Speaker 02

  Individuals educating themselves, protesting by contacting your politicians. Basically, anything because we are kind of running out of time and out of ideas. So if you think you can come up with a way to prevent superintelligence from coming into existence. You should probably try that.

• 2:16:02Joe Rogan?

  But again, the counter argument to that is that if we don't do it. China is going to do it.

• 2:16:07Speaker 02

  And the counter argument to that is it doesn't matter who creates superintelligence. Humanity is screwed either way.

• 2:16:13Joe Rogan?

  And do you think that other countries would be open to these ideas? Do you think that China would be willing to entertain these ideas and recognize that this is in their own self-interest also to put the brakes on this?

• 2:16:26Speaker 02

  Chinese government is not like ours in that they are usually scientists and engineers. They have good understanding of those technologies. And I think there are dialogues between American and Chinese scientists where scientists kind of agree that this is very dangerous. If they feel threatened by us developing this as soon as possible and using it for military advantage. They also have no choice but to compete. But if we can make them feel safe in that we're not trying to do that. We're not trying to create superintelligence to take over. They can also slow down and we can benefit from this technology, get abundance, get. Free resources, solve illnesses, mortality, really have a near utopian existence without endangering everyone.

• 2:17:11Joe Rogan?

  So this is that point zero zero zero one percent chance that you think we have of getting out of this?

• 2:17:18Speaker 02

  That's actually me being wrong about my proofs.

• 2:17:21Joe Rogan?

  You're right, and you'd like to be wrong.

• 2:17:23Speaker 02

  I would love to be proven wrong. Just somebody publish a paper in Nature, this is how you control super intelligence, AI safety community reads it, loves it, agrees, they get a Nobel Prize, everyone wins.

• 2:17:35Joe Rogan?

  What do we have to do to make that a reality?

• 2:17:39Speaker 02

  I think there is nothing you can do for that proof. It's like saying, how do we build perpetual motion machine? And what we have is people trying to create better batteries, thicker wires, all sorts of things which are correlates of that design, but obviously don't solve the problem.

• 2:17:53Joe Rogan?

  And if this, if this understanding of the dangers is made available to the general public, because I think right now there's a small percentage of people that are really terrified of AI. And the, the problem is the advancements are happening so quickly, by the time that everyone's aware of it, it'll be too late. Like, what can we do other than have this conversation? What can we do to sort of accelerate people's understanding of what's at stake?

• 2:18:19Speaker 02

  I would listen to experts. We have literal founders of this field, people like Jeff Hinton, who is considered father of machine learning, grandfather, godfather, saying that this is exactly where we're heading to. He's very modest in his Pidum estimates, saying, oh, I don't know, it's fifty fifty. But people like that, we have Stuart Russell, we have, I'm trying to remember, everyone who's working in this space, and there are quite a few people, I think you had Nick Bostrom on.

• 2:18:52Joe Rogan?

  Yes.

• 2:18:53Speaker 02

  There is Benjio, another Turing Award winner, who's also super concerned. We had a letter signed by, I think, twelve thousand scientists, computer scientists, saying, this is as dangerous as nuclear weapons. This is the state of the art. Nobody thinks that it's zero danger, there is diversity in opinion, how bad it's going to get, but it's a very dangerous technology. We don't have guaranteed safety in place. It would make sense for everyone to slow down.

• 2:19:25Joe Rogan?

  Do you think that it could be viewed the same way we do view nuclear weapons? And this mutually assured destruction idea would keep us from implementing it?

• 2:19:35Speaker 02

  In a way, yes, but also there is a significant difference. Nuclear weapons are still tools. A human has to decide to use them. That human can be profiled, blackmailed, killed. This is going to be an agent, independent agent, not something controlled by a human. So our standard tools will not apply.

• 2:19:58Joe Rogan?

  I think we've covered it. Anything else?

• 2:20:02Speaker 02

  No, but it'd be awesome if somebody set up a financial price for solving this problem. And it's kind of like with Bitcoin. If somebody can hack Bitcoin, there is a trillion dollars sitting there. The fact that no one claimed it tells me it's secure. If somebody can claim the price for developing a super intelligent safety mechanism, that would be wonderful. And if no one claims it, then maybe no one has a solution.

• 2:20:28Joe Rogan?

  How would you do that? How would you set something like that up?

• 2:20:30Speaker 02

  Well, we need someone with some funds, propose an amount and say, this is what we're looking for. It's very hard to judge if it's actual solution, but there are correlates of good science. So maybe publish in a top journal. It survives peer review, survives, you know, evaluation by top 30 experts. You can have things and everyone kind of agrees that, yeah, you kind of got it.

• 2:20:55Joe Rogan?

  Okay.

• 2:20:57Joe Rogan?

  Until now, educate yourself, people. AI, unexplainable, unpredictable, uncontrollable.

• 2:21:04Joe Rogan?

  It's available now. Did you do an audiobook?

• 2:21:07Speaker 02

  They are still working on it a year later.

• 2:21:09Joe Rogan?

  Still working on it?

• 2:21:09Speaker 02

  I don't know what it is. I would think AI would just read it out in 20 minutes.

• 2:21:13Joe Rogan?

  Why don't they just do it in your voice with AI?

• 2:21:16Speaker 02

  I agree with you completely. It took, I think, first version of my book, they wanted to translate into Chinese. Five years later, they told me they will not do it. Five years into the translation. So they had a second Chinese translation started.

• 2:21:30Joe Rogan?

  Why didn't they do it?

• 2:21:32Speaker 02

  Publishing world is still living in like 1800s. Then you cite books, you know, you have to actually cite the city the book is published in, because that's the only way to find the book on the internet.

• 2:21:42Joe Rogan?

  What do you mean?

• 2:21:44Speaker 02

  Like, if somebody wants to cite my book, it's not just enough to have a title and my name. They have to say where, in what city in the world it was published.

• 2:21:52Joe Rogan?

  What?

• 2:21:52Speaker 02

  Yes.

• 2:21:53Joe Rogan?

  Really?

• 2:21:54Speaker 02

  Yeah.

• 2:21:55Joe Rogan?

  That's archaic.

• 2:21:56Speaker 02

  The whole system is archaic.

• 2:21:58Joe Rogan?

  Wow, but yet you still used it.

• 2:22:01Speaker 02

  What choice do we have?

• 2:22:02Joe Rogan?

  Digitally published? You could put it on Amazon?

• 2:22:04Speaker 02

  It's a like, still, still this book, the loaded PDF. I don't care, like, please do it. Somebody should read it. That would help.

• 2:22:12Joe Rogan?

  Yeah, well, more people need to read it and more people need to listen to you. And I, I urge people to listen to this podcast and, and also the one that you did with Lex, which I thought was fascinating, which scared the shit out of me, which is why we had this one. Thank you, Roman. Appreciate you.

• 2:22:26Speaker 02

  Thank you so much.

• 2:22:26Joe Rogan?

  I appreciate you sounding the alarm and I, I really hope it helps.

• 2:22:30Speaker 02

  So do I.

• 2:22:32Joe Rogan?

  Bye, everybody.

• 2:22:48Speaker 00

  Life is all about making decisions. Sometimes you make questionable ones, like buying a new TV that's too big for the wall because the electronics store employee was a little too good at their job. Then, sometimes you make great ones, like protecting your home and auto with Progressive. You get customized coverage options so you can be sure you have the right coverage. Get your quote today at progressive.com. Progressive Casualty Insurance Company affiliates and other insurers, not available in all states.

• 2:23:17Speaker 05

  They're running a Cover 2 defense. But you're running to get game day deals on Uber Eats. Keep everyone at tonight's watch party fed with deals from your go-to restaurants. Or stock up with deals on your favorite snacks and groceries. Whatever the occasion, get game day deals on Uber Eats all season long. It's not football without food. Uber Eats. Order now. Terms apply. Product availability varies by region. See app for details.