Life Will Get Weird The Next 3 Years | Nick Bostrom (Fan Fave)

Welcome to Impact Theory, I’m Tom Bilyeu and in today’s episode, Nick Bostrom and I dive into the moral and societal implications of AI as it becomes increasingly advanced. Nick Bostrom is a leading philosopher, author, and expert on AI here to discuss the future of AI, its challenges, and its profound impact on society, meaning, and our pursuit of happiness. We touch on treating AI with moral consideration, the potential centralization of power, automation of critical sectors like police and military, and the creation of hyper-stimuli that could impact society profoundly. We also discuss Nick’s book, Deep Utopia, and what the ideal human life will look like in a future dominated by advanced technology, AI, and biotechnology. Our conversation navigates through pressing questions about AI aligning with human values, the catastrophic consequences of powerful AI systems, and the need for deeper philosophical and ethical considerations as AI continues to evolve. Don’t miss your chance to explore these groundbreaking ideas, challenge your concept of human worth and values, and consider what the future holds for humanity and AI. Follow Nick Bostrom: Website: https://nickbostrom.com/ Buy “Deep Utopia: Life and Meaning in a Solved World”: https://a.co/d/6CucXTX Follow Me, Tom Bilyeu: Website: https://impacttheoryuniversity.com/ X: https://twitter.com/TomBilyeu Instagram: https://www.instagram.com/tombilyeu/ Learn more about your ad choices. Visit megaphone.fm/adchoices https://megaphone.fm/adchoices See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Tom Bilyeu?

  Let's talk about the moment your side hustle becomes a real business. Now, I see way too many founders stay stuck running their business like it's a hobby, and then they wonder why nothing ever feels real. It doesn't feel real because it's not. I've helped thousands of entrepreneurs build real businesses through Impact Theory University, and the first step in the path to building a legit business is registering it. And Taylor Brands will help you do just that in a few clicks. An LLC, a limited liability company, is an official business structure. It's inexpensive to form and very simple to maintain. It's how you open a business bank account. It's how customers know they're dealing with a real company. And Taylor Brands doesn't stop at the filing.

• 0:45Tom Bilyeu?

  Their dashboard tracks what comes next based on what your business actually needs. So EIN number, registered agent, licenses and permits, bookkeeping, business banking. I tell every founder the same thing. Just make it official. Click the link in the show notes to check out Taylor Brands and get started on your business today. This is a paid advertisement.

• 1:09Speaker 01

  Hey, Greg May here. As a pro quarterback, I know I can't do it alone. I have to trust my team, and that goes for my money, too, which is why I use Betterment, the trusted investing and savings platform. Their automated investing tools always have my back, just like my O-line, always blocking and protecting me so I can focus on getting us to the end zone. With Betterment, I don't need to worry about picking stocks or managing everything myself. Their expert-built portfolios handle all that for me, automatically. They even help me avoid surprise tax bills, something I don't ever want to worry about. Plus, getting started is easy, like having a clear game plan from day one. Over a million people already trust Betterment to build their wealth, so I know I'm in good company. On the field or off it, you've got to trust your team. Mine includes Betterment, and yours can too. Get started at betterment.com or download the app.

• 1:54Speaker 02

  Investing involves risk. Performance not guaranteed. Betterment does not provide tax advice. TLH may not be suitable for all investors. Learn more at betterment.com/TLH-TERMS. Paid client ad. Views may not be representative. See App Store and Google Play reviews. Learn more at betterment.com/ambassadors.

• 2:07Speaker 03

  If at one extreme you had an AI that was exactly functionally identical to a human that had, that lived for 80 years, that had a human-like body, that had human-like memories, that had this brain, like an artificial brain structured very much like a biological brain, I think in that case the... It would be a very strong moral case that we should treat it as a moral subject as well, that it would be wrong to mistreat it and be cruel to it, etc.

• 2:39Tom Bilyeu?

  Nick Bostrom, welcome to the show.

• 2:41Speaker 03

  Happy to be here.

• 2:42Tom Bilyeu?

  All right, written language gave rise to nation-states because they could track things like laws and taxes. The printing press gave rise to religious persecution and wars. The internet gave rise to decentralized media and the age of conspiracy. What will AI give rise to?

• 3:00Speaker 03

  I think there are several possibilities there. So one is that the future is just shaped by and dominated by AI minds that have kind of disconnected themselves ultimately from their human origination.

• 3:16Speaker 03

  In roughly the same way that we've kind of disconnected ourselves from, I don't know, the great apes that we use or the Neanderthals, this kind of. But if we imagine a kind of human society with these AI tools, I think there are like maybe, there are certainly dynamics that could increase centralization and make centralization more extreme. Right now, if you have a totalitarian system, like a dictator, like the dictator can't rule on his own. You still, even if you are dictated, need the buy-in of some fraction of the population. Like at minimum, the security forces, the military, like some key families, maybe.

• 4:00Speaker 03

  So maybe you need 10% support or something like that to rule. But with automation of police forces and military forces, you could imagine an even tighter concentration of power and better abilities to surveil what is going on out in the land to keep track of what everybody's opinion is about the ruler and what they are doing. Their sort of political sentiments. So that could enable kind of increasing levels of centralization of power. That's that's one possible dynamic. And another is that like just this sort of AI amplification of current dynamics in our

• 4:40Speaker 03

  rometics just become more powerful that we develop sort of hyper stimuli that hijack our minds, as it were, like super memes or virtual reality worlds that are so compelling that people kind of check out of real reality to spend all their time. Yes, we kind of already are to a significant extent, like with television, people spending hours and now in front of like their social media feeds. And this could maybe be kicked to the next level if you had like just a higher level of technology doing that. So those would be some of the kind of negative dynamics that one could like worry about.

• 5:18Tom Bilyeu?

  So you wrote a book called Deep Utopia. It's a very interesting exploration of what if AI goes right? When I encounter the ideas, though, I do start to ask whether I would want to live in that kind of utopia and whether utopia would be a positive thing at all. Can you define utopia before we get to deep utopia? Can you define utopia so we can contrast that to this idea of a deep utopia?

• 5:52Speaker 03

  Yeah, generally in sort of utopia literature, it's usually people coming up with like a blueprint for the ideal society. They have some vision of what like, what would a perfectly fair society be like, where everybody has enough and everything is nice. And so this kind of utopia literature has kind of fallen a little bit into disrepute, partly for good reasons in that oftentimes people with these social visions, if they actually gain power to implement them, have created a trail of havoc and misery.

• 6:25Speaker 03

  And so people became a little bit skeptical in in like the second half of the last century in particular, after sort of the Soviet experiment and the Nazi experiment and some other regimes that ran with crazy ideologies. Uh, like resulted in massive human tragedies. People became, well, now maybe this grand vision for society thing is uh. Is actually really dangerous. Well, so that that's kind of what utopia traditionally mean. Now, deep utopia, I really just. Use the word because I I am interested in the philosophical question of what would. What would the ideal? What would a great human life be like if you abstract away from a lot of the? Constraints that currently limit what we can do. So imagine you had.

• 7:10Speaker 03

  Super advanced technology. You have AIs and robots who can do all the work. You have like super advanced biotechnology that give us unprecedented control over our bodies and minds and psychological states. In in in this kind of condition and and let's suppose also that somehow. Um, governments work really well as as well. So we don't have like wars and oppression, but just like. Wave the magic wand and imagine like a really great society. Right. So then, under those conditions, what would like a really great human life? Look like? And so that actually brings us into. And and I'm glad you you you you sort of started thinking about this question. Would I actually want to live in this kind of world? Because once you think about a lot of what we.

• 7:55Speaker 03

  Base our sense of dignity and worth and and fill our lives with, or because we our our efforts are needed currently. So you might pride yourself of being a breadwinner. Or of making a positive contribution to the world at large, or or maybe just within your family, like you're a valued. Person who contributes something and. To the extent that we define ourselves by our ability to make some instrumentally useful contribution. Right? Then, in this world where AIs can do everything better than we can do, that is a kind of a threat to our sense of self-worth. We would certainly need to rethink a lot of. Uh, the fundamentals of our values if if we are moving closer to this world of of. Human redundancy.

• 8:37Tom Bilyeu?

  Do you think those values are malleable? Or are they an echo of what I'll call an evolutionary algorithm running in our brain?

• 8:46Speaker 03

  Our values are what they are. But I think you can maybe distinguish superficial values and the deeper values underneath that justify or underpin them. And so my, my hope is that although a lot of the superficial values we have, we'll need to maybe give up because they no longer make sense in this kind of solved world. And that there are deeper values that could be more fully realized than is possible today. If we remove some of these constraints.

• 9:22Speaker 03

  So you can kind of go through a bunch of different candidate values that people might have and see whether they would be instantiateable in this kind of solved world. So like if you take the simplest value first, like purely hedonistic, subjective well-being pleasure, let's say, like having fun in this sense of being in a certain subjective state. So that would be trivially easy to realize in a solved world in that you would have very advanced neurotechnologies that if all you really wanted was pleasure, you would have like a super drug without side effects that could give you as much pleasure as you want. Or maybe more direct ways of interfacing with the human brain. So you could check that box. Like if that's like actually enjoying life

• 10:07Speaker 03

  and feeling good about it, like that's a check mark right off the bat.

• 10:12Speaker 03

  You can then go through a bunch of others where it starts to get more

• 10:18Speaker 03

  problematic is when we get to values like

• 10:23Speaker 03

  meaning, purposefulness, significance.

• 10:29Speaker 03

  If if all problems can be better solved by machine, then like what would give us purpose in in our lives? If there's nothing we need to do.

• 10:39Speaker 03

  So then, to the extent that you think your life goes better if it has meaning in it or purpose, then maybe to that extent, it would actually be a worse life in this old world. Because it wouldn't be useful. Now, note that you have to distinguish it between the subjective and the objective sense of, say, purpose. Like, so the subjective sense of feeling imbued with a sense of motivation and drive, and there is like something you're striving towards that you really want and that energizes your duck. So that, again, would be trivial, right? If you have these very advanced neurotechnologies.

• 11:16Speaker 03

  But some people think there is like an additional element, like what you might call objective purpose, that not just is there something you feel you want to do, but there is something that actually needs doing. And and that is a lot less clear whether you could have that in a solid world. A, most problems would all be solved, right? If it's really utopia. B, the problems that remain would be better solved by machines than they would by by you

• 11:45Speaker 03

  in in a technologically mature society.

• 11:48Tom Bilyeu?

  All of my anxiety around AI hinges on one idea that I believe there's no way for humans to get around unless we rewire our biology. And that is,

• 12:01Tom Bilyeu?

  it isn't about the pursuit of happiness. Happiness derives from pursuit. So I think, from an evolutionary standpoint, that we have been designed over god knows how many hundreds of thousands of years, generations, to have to do very hard things in order to survive. And so evolution only has pleasure and pain to get us to do the things. And so I think When you work hard in pursuit of something that's valuable to not only you, but to other people, and you feel like you're about to be successful, even before you're actually successful, that moment is like the greatest thing that life has to offer you. And I think that when people are in pursuit of something and it gives the meaning that you were talking about, man, that's when it feels good.

• 12:46Tom Bilyeu?

  And the second, you're either not working hard, you're just being given things, or you are working hard, but it doesn't matter because everybody already has everything that they need. And there's literally nothing that you could contribute to the group that would make the group better off. Then you ask a fundamentally corrosive existential question, which is, why do I matter? Why exist at all? And I think if we end up with a social structure that leaves people asking that question, we are really in trouble. Do you see a flaw in that fundamental base assumption?

• 13:26Speaker 03

  I think there is some truth to that as a psychological observation about our current minds,

• 13:34Speaker 03

  that some of the malaise in modern society might be from the absence of certain kind of survival pressures or opportunities or that were always there in our evolutionary past. I mean, just as kind of obesity is probably a function of refrigerators and plentiful food and stuff and fast food. It wasn't really a problem when you were a hunter gatherer. And so there is a kind of mismatch between our like physiology and our current circumstances. And I think that's also true mentally to some extent. And all of this is amazing just how adaptive humans have been, that we can still thrive as much as we can in these very different environments than we kind of people.

• 14:18Speaker 03

  But I think a key question here is whether we value this purposeful striving you described because it creates mental health and good feelings.

• 14:32Speaker 03

  Or whether we value it for its own sake. So right now, it's not important to differentiate these because they... The only way you can get like maybe the the mental health and and well being is by actually doing these hard things that you describe and then feeling the satisfaction. But um but in this hypothetical that I explore in Deep Utopia, these two elements could come apart. You would have these kind of the perfect drug that could induce exactly the same sense of satisfaction and fulfillment and, you know, energized, relaxedness, or whatever it is that like hard effort produces now. But without actually having to to make any effort.

• 15:12Tom Bilyeu?

  Yeah.

• 15:14Speaker 03

  And another way to get that it maybe is um to what extent do you think our artificial purpose would be a good enough substitute for the natural thing? So so a real purpose might be like you're being chased by a tiger and you really have to run as fast as you can. Otherwise, you get eaten and there are very real stakes there, right? It's not something you just randomly make up that you happen to like to run away from the tiger. Once the tiger is there chasing you, like you know what you have to do and it's a given and it's a very real purpose. The contrast adds to somebody who is playing a game, uh like maybe they really want to win. Uh but in some sense, the game itself is like an artificial purpose.

• 15:55Speaker 03

  There's no really if you're playing golf, there's no reason why the ball has to go into these sequence of holes, other than that we just decided, let's try to do this. We make up this random goal and then once you accept the goal, then you have the purpose of like trying hard to achieve it. And people can work, you know, decades to try to perfect their golf game and and find a lot of satisfaction, right? But in some sense, the over the whole thing is kind of made up. It's artificial, right?

• 16:21Tom Bilyeu?

  It it is, however, run the thought experiment of imagine if you could play golf, but no one would ever know about it. No one would ever see, no one would ever know that you were better than they are.

• 16:35Tom Bilyeu?

  It, I think, is a proxy for social status. So you are trying to rise within a hierarchy. And so the question becomes, uh, this is really, there's, there's two things here that we have to put on the table. Cause there's a huge hurdle before what I'm about to get to. But let's say that everything's taken care of. Uh, utopia is here as you defined it earlier. We don't want for anything. Everything's equal. Um, and now will people be interested enough in status games that that will be fun? Or will they be like, but this is all just a status game. So there's a deep emptiness. I think we have clues right now that answer that question. So right now you have video games that are unbelievable.

• 17:17Tom Bilyeu?

  As somebody that discovered Minecraft in my 40s, I will just tell you that game is unbelievable. I cannot believe that kids get to grow up in a world where that game just exists. But nonetheless, if I'm playing it and it doesn't feel like it's going anywhere other than I'm playing it. It does have an emptiness, which I think is part, part, it is a small part. This is a huge problem, but a small part of the sort of male sense of meaninglessness that certainly is sweeping across the West. Okay, that, that's the question you're putting forth. I think we have enough of an inkling to say it probably doesn't pan out as well as we would want it to. But I think there's probably a more important question that has to be asked before we even get to that,

• 18:00Tom Bilyeu?

  which is humans with their current value set now, their current brain wiring now. How are they going to, um, are they going to accept or radically push back against AI? When they see that it will lead us to a world where they are irrelevant by today's standards? There's a reason Quince sells cashmere for $60 and it isn't the cashmere. It's real 100% Mongolian cashmere. It's the same stuff luxury labels charge a fortune for. Quince just works directly with ethical factories and cuts out the middleman. So there's no need for a markup and no logo tax. The $60 goes to the actual sweater, not the fancy name on the tag. That's why everything they make.

• 18:45Tom Bilyeu?

  Runs fifty to eighty percent less. And it's not just the cashmere. I ordered a few things myself. Their fleece joggers, a couple of their tees, which I wear obsessively. First thing I noticed was the quality. Soft, well-made, built to hold up. They make down jackets and wool outerwear now, too. So upgrade your stuff to things you'll actually wear. Find your next fall favorites at Quince. Download the Quince app for app-exclusive offers or go to quince.com. Get free shipping on your order and 365-day returns, now available in Canada and the UK, too. And when Quince asks where you heard about them, let them know it was Impact Theory. It's the best way to support the show.

• 19:28Tom Bilyeu?

  Let's talk about something that genuinely keeps me awake at night. My team at Impact Theory gets hit with phishing scams from bad actors pretending to be me all the time. And they keep getting more sophisticated attacks with details specific enough to look legit. AI has made a lot of things possible, including scams like this. But AI still needs raw material. It gets it from data brokers who sell your name, address, phone number to anyone willing to pay. Incogni goes after that supply. They handle removal requests across 420-plus harmful broker sites, and they keep checking back as brokers constantly try to relist you. On the Unlimited plan, the Exposure Scanner hunts down your information,

• 20:13Tom Bilyeu?

  send a link, and their privacy experts handle the takedown. Track your progress in the app and get a monthly risk assessment showing exactly where you stand. Go to incogni.com/impact and use code IMPACT for 60% off an annual plan. Incogni is I-N-C-O-G-N-I dot com slash impact. Promo code IMPACT. It's completely risk-free with a 30-day money-back guarantee.

• 20:40Speaker 03

  If I had to guess, I think more likely it would be seduced by it. And, uh, yeah.

• 20:49Speaker 03

  And the displacement, I mean, in part, this is economic. People losing their jobs, maybe, right? Or downwards pressure on wages that will arise as automation advances. Interestingly, in this case, it might initially hit more certain kind of white-collar work that traditionally automation mostly affected lower-skilled workers. But this is kind of current language model technology. It seems to hit right at the sort of mid-level white-collar work, like people who summarize documents for a living and stuff like that.

• 21:25Speaker 03

  So interestingly, exactly if the AI succeeds at automating a wide range of jobs, there will also be massive economic growth, which to some extent might offset the kind of economic impacts of unemployment. Like if you have a booming economy, there are more tax revenues. It's easier to... There's more demand in other sectors that haven't yet been automated. There's more people can spend more money on, you know, hiring gardeners or nurses for their grandparents or whatnot.

• 22:01Speaker 03

  But it still leaves this question about meaning and purpose and social status.

• 22:08Speaker 03

  I'm wondering about social companions in this context, like AI, social companion bots. This might become another kind of...

• 22:19Tom Bilyeu?

  Is that a very nice way of saying sex bot?

• 22:22Speaker 03

  Well, it would encompass that, but it could also just be friends and fans and all the different elements of social interaction. Like maybe even sort of fake status.

• 22:39Speaker 03

  Like you were saying, that if people want to feel that they are high status in the real world, maybe they aren't and it's just a frustrating experience. And rather than work for years and decades to get like one notch up on the status hierarchy by, I don't know, like... Stressing yourself out in the gym to get a slightly better body or like educating like all these achievements. They are hard and take a long time, right? Imagine if you could instead tap into this virtual world where you have perfectly realistic uh virtual characters and where you're playing, you're the king or something like that. And you have these admiring um digital characters that maybe that if that becomes good at us would like be extremely compelling to to people.

• 23:22Speaker 03

  Um for the for the same reason, I mean, like drugs are really compelling and and often in case the worst your real life is, the more i i uh attractive like a kind of the alternative of some opiate or something is, right? That can sort of um so um I I think that, yeah, this whole AI social companion technology will uh advance very rapidly over the next couple of years.

• 23:47Tom Bilyeu?

  Do you see that being like online dating where at first people are weird about it and then it just becomes the norm?

• 23:52Speaker 03

  Yeah, I wonder so I'm the wonder there is like something uh slightly dystopian seeming about like if you imagine a world where more and more of our time is spent not with real people, but interacting with these like bots. Um on the other hand, it might be one of those things where there's like a generational thing where like uh uh I'm I'm the old fuzzy daddy like grandpa, you don't get it. And then people who grew up with this is like, yeah, of course, it's just much more interesting. This AI bot is much witchier and like really pays attention and like these humans are kind of a drag and of course we're all just using these AI bots now and like is that?

• 24:36Speaker 03

  Is that because if if that happens, is that because this whole generation will have made like a big error? Or is it just that uh um they they they would have more familiarity with this and like on its merits chosen to spend their life in that way rather than? By hanging out as much with other fellow humans. It's hard. So it's easy to have opinions about these things, but it's hard for those opinions to actually be grounded in some kind of objective truth as opposed to just merely reflecting your own personality or upbringing.

• 25:10Tom Bilyeu?

  Agreed. I think there's certainly value in both, but one of the more interesting things about you and the way that you've approached these problems is with the anthropic principle and finding ways to at least ground things in probabilities.

• 25:26Tom Bilyeu?

  I'd like to talk about your probabilistic look on what does AI do in the next three to five years and then what does AI do in the long run? Obviously, we're talking probables here, but as you've used that to great effect, I'd love to see how you think through that using anthropic principles.

• 25:47Speaker 03

  Well, yeah, I don't know about using anthropic principles. I do feel AI timelines appear relatively short from this point on. I mean, we are really far along the path towards AGI already. The things that are now possible, if you had asked people 20 years ago, I think many people would have assumed, well, if you can do these things, if you actually can have like an AI that can have a conversation with you in ordinary language and like you can't even tell whether it's an AI or a human, like unless you're really an expert, you know exactly how to pro that that that seems like AGI, computers

• 26:28Speaker 03

  that can write code like at the level of like maybe an entry programmer.

• 26:36Speaker 03

  So we have this tendency, I think, with each advance in artificial intelligence to move the goalpost.

• 26:46Speaker 03

  And to immediately discount and take for granted what's like the same thing happened like when when Deep Blue beat Garry Kasparov in chess, like before that, people saw chess as this great game of the human mind, like the most complex thing the human mind could do is to learn to play chess as the high level, right, with a deep logic. And then after computers could do it, we said, ah, it's just a game of chess, like there are simple rules. And then the same happened with Go and then like when you could have AIs look at pictures and actually visually understand what what's in the picture. Um, and now with natural language. Um, I feel there are not that many of these steps left because before before you have AI that can do AI, all kinds of AI research better than than humans can do.

• 27:30Speaker 03

  At at which case you have, I think, an intelligence explosion. Because then then you have the AI research being done by digital minds at digital time scales.

• 27:42Speaker 03

  And and then you get a very rapid feedback loop, right, with each subsequent improvement, the the the force that is doing the improving gets stronger and you might then have a some kind of singularity.

• 27:55Speaker 03

  Now, exactly how many years that is away is hard to tell, but I think we are no longer in a position where we can be confident that it couldn't happen even within some very short period of time, like a year or two. Uh, I'm not saying it will, but we are not in a position where we can be like really sure that it won't. It's like it might just be somebody makes some other breakthrough of the level of that transformer architecture. And applying that to the already really large models we have, you know, maybe that will be enough to sort of unlock a lot of latent potential there, or maybe there will be like need two or three more of these advances. Um, or or more scaling up of the size of the data centers.

• 28:38Speaker 03

  We just don't know exactly, but we are sort of, I think, close enough that we can't be confident that it couldn't happen at any time.

• 28:48Tom Bilyeu?

  What would you advise to somebody that is a junior in high school now? These are American terms, but junior in high school now, they've got to get really serious about where they're going to go to college or whether they're going to go to college, what they're going to study. How can, if we are, and I heard you, this is not a guarantee, but if we are potentially within a year of AGI, how can somebody even plan for the future? It just seems like such a big question mark.

• 29:14Speaker 03

  Yeah, I mean, but to be clear, it could also be 10 years or 15 years or like, it's just, yeah, I think, I mean, I'm always wary of giving a general advice to everybody. I feel that's like giving advice on what's the best shoe size. Like what's good for one is like, you know, so some people maybe are too, too hard on themselves and good advice to them might be to, you know, ease up a little bit, like go easy on yourself. And then for other people, that might be exactly the wrong advice. They might actually need a stern message. You really need to pull yourself together here, like you're just wasting your time, discipline. So the same message might be completely right for one person and wrong for the other, depending on how they are currently going wrong. And similarly with career advice, you know, it depends a lot on what your talents are

• 29:59Speaker 03

  and what your passions are in life.

• 30:02Tom Bilyeu?

  I think more than I meant looking for something specific, I'm looking for a guiding philosophical principle. So I know that you used to run the Institute for the Future of Humanity. So you, I'm sure have thought a lot about where we go, how we deal with it well. And so, yes, we're not going to say you should be a dentist, but there, I'm guessing you have a framework that people would benefit from in terms of facing such a rapidly changing environment.

• 30:31Speaker 03

  Yeah, I mean, so it depends. Like, so there's like a small fraction of people might actually, you know, be looking to directly contribute by being researchers or AI scientists and stuff like that. That's like one avenue.

• 30:45Speaker 03

  I think in general, probably useful to familiarize oneself with the current tools and the next generation so that you kind of know roughly where things are and what they can and cannot do to be adaptable.

• 30:57Speaker 03

  But then for other people who are not really. Technically minded, I mean, it might be that going in the opposite direction, you know, being really developing your skill with people. I think there's like enormous needs for various care professionals. I think, like, say with elder care, like, if we just had more resources. In in theory, every old person should have like their own full time personal. It would be great, right? Some some like younger person that could live with them full time and just help them. If they fall, help them up like. We we we can't afford that, but like in principle, the need is kind of unlimited there. Um, I would also say that don't forget to actually enjoy life.

• 31:38Speaker 03

  Um, right now, like, I wouldn't sort of plan on a forty year career and make big sacrifices now for ten or twenty years in the hope of then it paying off. Like when you're in your fifties and sixties, because, you know, maybe the future doesn't exist. Um, at that point, um, but it it it would. It would risk being a kind of, um. Yeah, I would maybe focus a little bit more on short term strategies.

• 32:06Tom Bilyeu?

  When you say the future may not exist, what do you mean?

• 32:09Speaker 03

  Well, I mean, several different things, actually, at the same time. But in one, one thing I meant was that if this AI revolution happens within the next five or ten years or something, then these long term investments in human capital that we might make now with a payback time of twenty, thirty years might not pay off. Because by that time, maybe human capital will have depreciated as a result of AIs surplanting us across the board. So that's one sense in which the future would not exist. There are other senses in which it might not exist as well, um, related to the simulation hypothesis, which we don't need to get into. But yeah, so enjoying things now. Also, like with college education, I think if you're would like really enjoy your time at college,

• 32:54Speaker 03

  that's one thing, then maybe do it. But if it's just something you have to drag yourself through for the sake of getting a diploma, I would like maybe seriously consider if there are not ways to sort of cut out those three or four years to get straight to what you want to do. Um.

• 33:10Speaker 03

  And similarly with like PhD programs that can take like in the US five or six years. That's a long time. If I think in many cases, it may be too long for it to be worth it these days.

• 33:24Tom Bilyeu?

  Just because the rate of change is so accelerated?

• 33:27Speaker 03

  Yeah, because the timelines might be shorter and so.

• 33:33Speaker 03

  I mean, if you imagine, if you had like. Suppose you had the view that there was like a 10% chance every year that the world will blow up and be destroyed. So then like you wouldn't make 20 year investments really, right? Like you, you'd kind of focus on things that have a shorter payback time. So like having a de facto higher interest rate or a hurdle rate for your, your own long-term investments maybe would make sense in this picture. Now, I would like hedge a little bit because this could all be wrong. And if, if the AI thing doesn't happen, or if it's like, you know, banned or it stalls out, you, you don't want to come. End up completely dry either, right? Where you have nothing, you're 30 years old, you lived for the day.

• 34:17Speaker 03

  You're planning that the AI revolution would happen, somehow it fizzled out, that was like a global ban. And then you're now a 30 year old with nothing, no skills, no job, no nothing. So you might want to, depending on like what your sort of social safety net is, you might, might want to hedge your bets a little bit there.

• 34:35Tom Bilyeu?

  Now, I know that a lot of people have what they call a P doom number. So how likely you think we are to basically blow up the world, whether with AI or something else? As I'm listening to you, it does beg the question, what is your P doom number?

• 34:53Speaker 03

  Yeah, I don't actually have a specific number, but maybe one way to think about it is if you could divide it into. So it's like ways in which things could go really badly, right? Where you kind of, you know, blow up the world or something dystopian. Then there's sort of the more utopian scenarios, everything is clearly, we cured a lot of diseases, like wonderful prosperity. So each of those would have some probability, but I think there's like a third bucket in the middle, which is actually perhaps. Maybe the most probable, which is that the world is such that even if we could actually see what would happen, even if you had like a little binoculars, you could look at the future and study, you wouldn't really know whether to count that as a success or a failure. It would like maybe be very different from the current condition.

• 35:38Speaker 03

  Better in some ways, worse in some ways, like strange. There's like some kind of minds doing stuff there, like they are not exactly human minds, but you know, they're sort of a little bit doing the same things. Do you count that as, as they're being humans around? Or is like, are we all dead and just replaced? Or did we sort of grow into this new life form?

• 36:01Speaker 03

  So I think it's not obvious that the future would be such that if we could see it, we would necessarily know even what to think of it.

• 36:10Speaker 03

  You can think of it in an individual life. So right now we have children, like say a four or five year old, who eventually becomes a 25 year old. And the 25 year old is quite different from the five year old in many ways, like mentally they have different interests. They're no longer interested in the toy train, right? They are interested in like their romantic partner or their job prospects or US politics or whatever it is, like the Roman Empire.

• 36:39Speaker 03

  So in many ways, what was there at age five is all gone. And yet we don't think it's bad for the child to grow up. I mean, in fact, most of us would probably think it would kind of be something sad and unfortunate if a five year old never grew up to become a 25 year old, if they remained at the level of a five. So I wonder if there is like a similar thing where we now are basically children in this group. None of us ever get the chance to truly grow. Because we just like biologically developed for 20 years and then stagnate and then we sort of rot away and die after a few more decades. Just biologically, we are not, we can't live for 500 years continuously growing and expanding and learning new things, like it's, we are kind of cut short.

• 37:24Speaker 03

  And maybe like 80 years is just not enough to really fully realize our inherent potential, like we are kind of zapped by our rotting biology and.

• 37:37Speaker 03

  So there might be different kinds of lives that would become possible if you could live for a million years and if you could gradually upgrade your capabilities. That might be really wonderful, but that would maybe change us as much as like the five-year-old is changed when he or she grows into a 25-year-old or more.

• 37:55Tom Bilyeu?

  Hmm.

• 37:56Speaker 03

  What that perhaps suggests is that, especially when we're zooming out and thinking about these more radical scenarios, we should not really focus so much on comparing two states, like the current state and some later state, but maybe thinking more in terms of trajectories. Leading out from the current state and then evaluating how desirable those are. Like, maybe it's fine if ultimately we end up in a very different weird post-human condition, like in 10,000 years from now, like, but if we went there slowly and we sort of had a chance to grow into it properly. That kind of trajectory might, I think, be more attractive than one where we just remain

• 38:40Speaker 03

  humans and keep doing the human-like things for 500,000 more years, I don't know, 5 million more years, like, at what point is enough? At some point, you'd wanna maybe sort of unlock the next level, right? It's like playing the same level of a computer game. At some point, you want, you need to move on. And maybe similarly, the kinds of values and lives that can be lived with our current human physiology is like a limited set of all the possible values. Maybe we haven't yet exhausted it. We might wanna spend some more time and go slowly through the level, rather than just skip to the sort of the final level, right? That might be another mistake, but still, thinking in terms of a trajectory that eventually leads to greater forms of development, including ones that ultimately take us out of the human realm.

• 39:22Tom Bilyeu?

  You're probably paying two salespeople to do one salesperson's job. That's where today's sponsor, Pipe Drive, comes in. An intelligent AI-powered sales CRM loved by growing sales teams. Pipe Drive just launched meeting intelligence built right into the CRM. Before every call, it pulls deal history and past conversations into one brief.

• 39:47Tom Bilyeu?

  During the call, it records and takes notes. After it, it drafts your CRM updates to review and approve. So there's less admin and more selling. Switch to a CRM built by salespeople for salespeople and join the over 100,000 companies already using Pipe Drive. My link gets you an exclusive 30 days free instead of the usual 14 day trial. There's no credit card payment needed. Just head to pipedrive.com/impact to get started. Again, that's pipedrive.com/impact and you can be up and running in minutes.

• 40:24Speaker 04

  This message comes from Betterment. Dan Egan, VP of Behavioral Finance and Investing, explains the benefits of automated dividend reinvestment.

• 40:34Speaker 05

  If you've ever invested, you probably have noticed that occasionally you get dividends. Your stock pays it out. You get that as cash in your account and it usually sits there until you remember that you're supposed to buy something else with it to reinvest it back. Automated dividend reinvestment makes that effortless and seamless. When dividends come into your account, we automatically reinvest available dividends, not necessarily into where they came from, but into whatever would serve your portfolio best. So automated dividend reinvestment keeps you invested and keeps your portfolio in balance.

• 41:04Speaker 04

  Learn more about Betterment's dividend reinvestment methodology and other helpful investment tools at betterment.com. Investing involves risk. Performance not guaranteed.

• 41:15Tom Bilyeu?

  Okay, you're playing with a lot of ideas here and I want to start pinning some of them down. So one is the idea of trajectories and I think people right now today are going to care a lot about that. So through regulation, through what people end up pursuing as entrepreneurs, we're going to have a tremendous amount of influence over what gets developed, what doesn't get developed. And so I think that's the big question of today is what trajectory do we want to see this go on? And so I'm very curious to hear your take on how much can we control the trajectory? And do you see an ideal trajectory?

• 41:55Speaker 03

  Most of the uncertainty about how AI pans out is uncertainty about how hard the challenge is that we will confront, rather than uncertainty about the degree to which we will be getting our act together and make a good effort. Like, we don't know how hard this is. We've never had a machine intelligence transition before, right? We haven't studied a million other planets where some human-like species developed AI. And we can like, study the statistics. We have, you know, if we're coming to this approach, we have no idea whether it's like relatively easy or like fiendishly hard. So I think that's most of the uncertainties coming from.

• 42:40Speaker 03

  And then a little bit of certainty, like obviously we can at least nudge the odds in a better direction if we really make a good effort. We work on this collaboratively, you know, we are really smart about it. We studied hard, like be careful then like we can improve the odds a bit. But, but most of it is just, I think, baked in. So in that sense, I'm kind of fatalistic, like you could say I'm a moderate fatalist in, in the sense, the moderate coming from, well, we can still affect the odds at least a little bit on the margin by getting our act together. But fatalist in the sense of, for the most part, it's probably just baked into our situation and, and like the technology itself.

• 43:19Tom Bilyeu?

  When you say it's baked in, what do you mean? That it's going to happen?

• 43:22Speaker 03

  The outcome for, for humanity. Like, for example, whether we end up destroying our, like AI kills us all, or we achieve alignment and manage to align it to human values.

• 43:37Speaker 03

  I think some of those things might be baked in, uh, in, in the current situation.

• 43:43Tom Bilyeu?

  Elon Musk has said that he thinks of AI as a demon summoning circle and that we should be very careful about what we wish for. Um, I'm hearing tones of that in what you're saying now. And he said his life got a lot better when he became more fatalistic about AI. What do you think about his take, his level of anxiety about AI? Warranted, not warranted?

• 44:08Speaker 03

  Yeah, it seems warranted. And he is also the founder of XAI, which is an AI startup, and as well as Tesla, which has major AI operations. And one of the original investors and founders of OpenAI. So I guess his attitude is complex. Like, I think he recognizes that there will be big dangers, but it doesn't necessarily follow from that that the conclusion is that each person should unilaterally remove themselves from the race.

• 44:42Tom Bilyeu?

  Okay, so when you look at this, you have a similar, this is gonna happen, this stuff is baked in. I see a world where we end up bifurcating as a species. So I consider myself wildly technologically optimistic. I have a natural bent towards somehow things will just work out. But I also look at what I can feel brewing in culture right now, which is a massive resurgence of religious fervor, people reconnecting to that, refinding faith, accounts that are focused on faith on podcasts and YouTube's, YouTube are starting to dramatically increase in popularity. And I think in many ways,

• 45:26Tom Bilyeu?

  this is a response to a hyper technological world where even just us humans are using technology a lot, whether it's Ozempic and losing weight, whether it's anti-depression medication, whether it's AI, that they see this influx of what I think many will read as anti-human things. And there's this feeling, a desire to connect with something traditional and certainly divine. And I see that creating a bifurcation in society. And what I predict, timeline gets a little bit fuzzy because it's all gonna be predicated on the rapidity with which AI disrupts our normal life.

• 46:11Tom Bilyeu?

  So on whatever time scale that is, I think what you will see is a group of people that spring That I'll call Puritans that will not want to use AI. They won't engage with art that's created by AI. They won't support companies that use AI to create their product or their marketing. And then other people that will sign up for Neuralink when it becomes available. And they will literally augment themselves. They will use AI whenever and wherever humanly possible. They will fantasize about free energy and the utopia that AI is going to bring. And I think over time, those guys will end up pulling apart. Especially if AI helps some people augment themselves. And you could be augmenting yourself directly.

• 46:56Tom Bilyeu?

  You could be augmenting your children just through gene selection, let alone gene editing. Do you think that's plausible, likely, delusional?

• 47:07Speaker 03

  Yeah, I think the debate is likely to become polarized. If we're talking about the sort of public debate about what should be done about this. We're already seeing a little bit, you know, on the one hand, the sort of the doomers, right? And then the EAX, the like kind of go forward at all maximal speed on everything. Crew that are sort of dividing themselves up into two different tribes that can now start to hate on one another.

• 47:36Speaker 03

  And I think maybe broader segments of society will be recruited into this debate as the impacts start to be more widely felt.

• 47:47Speaker 03

  I could see.

• 47:50Speaker 03

  Yeah, like this, it's interesting to think about how the speed of development might impact the degree to which this happens. So I think maybe there are actually three different regimes. So like extremely sudden, fast. A like super intelligence is invented like next week, just comes out of the blue, right? Then, okay, that that won't be much more polarization than there currently is because people didn't see it coming enough. And so now I think also maybe if it's extremely slow and happens over many decades, then it might be kind of the boiling of the frog phenomenon where people like. Are using this technology and of course every little increment makes it better. Like if you're gonna have like a

• 48:33Speaker 03

  a medical diagnosis bot, surely you want it to make slightly fewer errors rather than, you know, more errors. And so every little step along the way will just be better. If you have self-driving car, you want it to be slightly smarter, so it crashes less often. Like for every application, it's clear that more capable means better. And so if you just follow that long enough, you eventually end up with super intelligence. But at no point is there like a clear jumping off, like an alarm signal. So that now in the intermediate scenario, where you have kind of turbulence, where people feel uh dislocated, because like every other month, there is like a new thing. And now a big sector of workers were laid off. And now there is this other thing that has created these propaganda bots that are running around.

• 49:18Speaker 03

  And then there's like deep uh fakes or like then, and then some big disaster happening. Because the AIs were running the power grid and it all sort of malfunctioned. And like in that kind of world or drone swarms coming in and killing a bunch of people in war. You can imagine maybe more that that turbulence creating a kind of increased resistance.

• 49:42Speaker 03

  Um, now I think you were also asking not just about like the conversation around this, but also whether different communities will form that sort of like the Amish decide to only use certain technologies. And that whether many people will opt out of this, this AI technology.

• 50:01Tom Bilyeu?

  Very much so.

• 50:02Speaker 03

  Yeah, I don't know.

• 50:06Speaker 03

  It it's kind of so, I mean, unless you go full

• 50:11Speaker 03

  full, like unless you're like really hardcore about it, like some of these communities are, where you don't even want cars and stuff. Otherwise, it's pretty sort of integrated into the modern economy. Like if you are using Google, like you're using AI, right? In the future, every car will have AI. The electricity grid will be optimized with AI algorithms.

• 50:34Speaker 03

  You know, all these different systems that you interact with, like the doctor, they will have like probably use some AI bot and you have some weird mole. You know, take a picture of it and scan it. And then some like skin cancer diagnosis system will look at it and flag it. Like they will just be everywhere. So, so it might, it might not be easy to opt out unless you're really willing to sort of completely rip, tear yourself off. That's kind of the fabric of modern society.

• 51:06Tom Bilyeu?

  Do you see that happening? That seems self-evident to me that that's going to happen.

• 51:12Speaker 03

  Well, the question is on what scale, right? So, I mean, there are people who live off the grid or who are Amish and stuff, but they are still a small fraction of the world population. We, you know, with a higher growth rate because fertility rates are larger. So if you imagine rolling the tape forward hundreds of years, then eventually those groups would expand and others would kind of dwindle into non-existence unless they change their ways. But I'm just thinking the time scales for that kind of population dynamic level stuff to play out is multi-generational, whereas the technology is moving forward year by year. And so, so I'm thinking like, yeah, like it will not have,

• 51:55Speaker 03

  there will not be enough time for these slower processes to really, would be my guess, to really have a big impact.

• 52:03Tom Bilyeu?

  So here's how I see it, and maybe you can pull me back off the brink, which I would love, but. It ultimately, when humans feel either emotionally distressed or financially distressed, which usually the two are intertwined, they will go all the way to killing their fellow humans with just absolutely no problem whatsoever. If you take the French Revolution, right? Things got bad enough economically, they just pulled people into the streets and started beheading them. I don't think we are fundamentally different than that version of humanity, and I think if AI begins to disrupt enough jobs and creates enough turmoil, that it's not like the Industrial Revolution where, yeah, you had a generation that had it kind of rough

• 52:47Tom Bilyeu?

  because they weren't able to rapidly change, but there was just such an economic boom that everybody, the people that were winning from it far outweighed the people that were losing from it, and so it ended up being fine. But I think what you're gonna see is a disruption that happens so quickly and touches on the one thing, that if you break, you're gonna have a real problem, which is meaning and purpose. And the only hope we have, and this is ultra dystopian, is that we have enough entertaining things that people are numbed to the fact that they're no longer climbing, that life isn't gonna be better for them than it was for their parents, that they've lost their job or whatever.

• 53:26Tom Bilyeu?

  And so, they drink, do drugs, online porn, play video games, and that just becomes a sort of get by existence and they just sort of give up on it. That's the hopeful outcome. But I think the more likely outcome is that this becomes a political divide, where the battle ends up being drawn along the lines I was saying before, where people that utterly reject it and just wanna absolutely shut down AI, put it back in a bottle, and then people that wanted to develop it, and just another terrifying twist, if AI comes out slowly enough that we see, let's just say China makes a major advance, but it's not

• 54:08Tom Bilyeu?

  a big enough advance where we would automatically lose in a war, I could see a preemptive escalation of violence to shut it down, to make sure that either we're able to hit parity with them, or by elevating ourselves, or by tearing them down.

• 54:31Speaker 03

  It's very hard to predict these kind of social-political dynamics and cultural dynamics. We don't have the kind of scientific theory that can tell us how social sentiment will change over the course of five or 10 years when you start to... I mean, I think like in the past, a lot of revolutions, I guess, is for like

• 54:51Speaker 03

  for lack of food to eat. I think that hopefully would be relatively easy to supply with some degree of political mobilization, especially in these rapid growth scenarios. So you could have bread and circus.

• 55:09Speaker 03

  The meat, the purpose issue might be harder to remedy. But then, maybe the line is, well, like, let's be honest here. Most people's lives today, like, just how grandiosely purposeful are there, really? Like, you go and you make a paycheck and then you spend the rest of your hours, you know, relaxing or having fun or playing with the kids. Like, most people are not really trying to change the world or imagining that they are like some historical figure bestriding humanity to shape its destiny. Like, it's like, just not reality. And so if you didn't have to go in and work for eight hours every day

• 55:51Speaker 03

  using, doing some pretty boring stuff, maybe, that you don't really want to do and you'd rather sleep in and have fun and, like, you know, would that really be such a tragedy? You got the same paycheck, let's just say.

• 56:05Speaker 03

  But without, you know, doing these chores, that seemed like a win, potentially. Hopefully, a lot of the energy that people put into work could then be put into, instead, building up leisure activities, like to have clubs and hobby organizations that create sort of activities for people to now have more free time to do things. And so that would have to be this cultural reset. That seems like a maybe better outlet for the surplus time and energy than trying to tear everything down.

• 56:41Tom Bilyeu?

  It's interesting. So have you read Brave New World?

• 56:45Speaker 03

  Mm hmm.

• 56:47Tom Bilyeu?

  What did you think about that? Because it feels like you have sort of dueling dystopias. You've got, on the one hand, 1984, massive suppression. You could think of this as an AI tool that's watching you all the time. Like, if you reread 1984 with the thinking of AI doing the surveillance, this suddenly becomes super real. So you have that version of dystopia where even wrong thing gets you punished. And then you have over here, the other version, which is just keep taking your drugs, feeling good, being blissed out all the time. Both read as dystopias. Did you take a Brave New World to be dystopic? Is there something that I'm missing in that interpretation?

• 57:31Speaker 03

  Yeah, I think it's it's missing some elements that if they were added would make a world lot better. So there is like, no, it was a long time since I read it. But I think like, no, real romantic love, for example, in Brave New World.

• 57:48Speaker 03

  No appreciation for true art and beauty at the higher level, as opposed to sort of easy distraction and shallow kind of flim flam. And so if you imagine a Brave New World-like scenario, but where people actually had a lot of free time that they spent being with people they loved and cultivating hobbies and like appreciating great literature and learn like cultivating the art of conversation.

• 58:22Speaker 03

  You know, maybe taking arts classes to deepen their appreciation of greater, like all kinds of things, like also less cerebral things, like people, some people might be doing more sporty things or being into nature, whatever it is. But that a society where people kind of were.

• 58:41Speaker 03

  Yeah, focusing on sort of developing a high culture of living well, I think could be pretty utopic. The other thing with Brave New World that I think casts a kind of dystopian pall over it is the really stratification of their society, where people are sort of destined from birth to be a particular class. Most people in Brave New World have various degrees of engineered mental retardation. I think they add like alcohol to the fetus to sort of deliberately brain damage certain people so that they would be suitable then to work as elevator operators

• 59:21Speaker 03

  or menial jobs without having some kind of... So that obviously makes it pretty horrific. And if you imagine a society where everybody were like more allowed to encourage to sort of grow to their full potential and to be full participants in like a kind of democratic politic, then I think that would also brighten up that kind of future. The main thing that might be then missing is kind of certain forms of heroics

• 59:54Speaker 03

  that there would be no need for, sort of heroic self-sacrifice, like, you know, some great warrior who sacrifices himself for the sake of the comrades by rushing the enemy with a spear, like that kind of thing. Okay, so that might be a certain value in that, that would no longer make any sense in Brave New World, but we can probably have a pretty good life while just kind of reducing or redefining a few of those particular values.

• 1:00:22Tom Bilyeu?

  Really fast, so I want to move on now to how this could actually be amazing. I think there are some interesting...

• 1:00:32Tom Bilyeu?

  What some people will read as religious implications, but there's certainly value system implications. But before we do that, or as a ladder into that, walk me through what will AI actually do boots on the ground that could lead to a utopia where we're able to pursue more leisure things, our passions, whatever. What is AI actually going to do?

• 1:00:58Speaker 03

  Well, so it could start with a lot of work that could be automated. So, you know, instead of having some guys who have to drive the garbage truck around the city every morning to collect the garbage, right? You could have a self-driving garbage truck with like an Optimus robot that hops off and picks up your garbage can and

• 1:01:20Speaker 03

  does all of that automatically, right? But then you can sort of go through job by job. And if you really have artificial general intelligence, like AI with the same learning ability as a human mind, then

• 1:01:34Speaker 03

  basically every intellectual human job would like every, every while, every job that could be done over like

• 1:01:42Speaker 03

  a video conference link could be automated, right? And then if you have robotics to go along with that, then also all the manual work could be automated with very few exceptions.

• 1:01:53Speaker 03

  Like, for example, there might be job for athletes if consumers just happen to prefer to watch humans runners compete than to watch robot runners compete, right? Like, maybe that's just a root preference that people just prefer to watch the humans. Then there might still be jobs for humans in those areas. Or people just want the human priest to officiate their wedding, even if the, even if the robot priest could like intone the same words just as well as the human, we might just care about like a certain task be done by human, then those would be car rides. But for the rest, you could automate. So this would create a potential enormously

• 1:02:34Speaker 03

  high rate of economic growth, because it's like you can just build more and more robots and run more and more instances of these AI minds. So everybody could have like um a bunch of these that that would be on the lookout for their interests and and helping not just to clean up the home and to cook their food and but AI bots who were like scanning for really great movies that you would watch that knows all about your preferences that could you know um check in on your health and make sure you take your medicines or like spend hours just researching your particular health conditions to optimize everything. Um so everybody could in that sense as step number one live like extremely rich people in terms of their

• 1:03:21Speaker 03

  um their access to to human labor and and the cost of products would go down if if like you take human labor out of the equation and it's all automated. Um but then beyond that and more exciting I think is that like you could actually move the technology uh envelope outwards by doing like accelerating the pace of new research. Like for example in medicine, there are a lot of uh conditions now that no matter how much money you have, you can't cure them because we don't have you know cures for all cancers and for hard so so there you could imagine accelerating and have like a thousand years of medical research progress in just a couple of years when you have these digital minds working on this. Um like maybe unlocking cures for

• 1:04:06Speaker 03

  to to to reverse the aging process, etc. And then forestalling a huge amount of uh human misery and death that is currently uh pretty unavoidable. Um and in other areas like much better and entertainment uh where you could have like AIs making these you know movies and artworks and virtual reality game like computer games um

• 1:04:29Speaker 03

  designing experiences and and just generally organizing things in a more delightful manner. Um and uh and then then beyond that, I think also like these ways of then improving uh the the human organism itself, our own brain is kind of ultimately limiting how good our lives can be. So then you could imagine these different forms of upgrading opportunities. You know, maybe step one, extending your healthy lifespan. I think that's like perhaps an obvious one. It's just no fun to kind of have terminal diseases and just have your body decaying and falling to all the pain like you're just like making sure you remain

• 1:05:11Speaker 03

  healthy like and then on top of that you could then start to maybe add boosts to your wellbeing, to your ability to understand, your musicality or a sense of humor, like your ability to form deep emotional connections to other people.

• 1:05:29Speaker 03

  And then like the kind of having a trajectory where people can continue to grow and develop and achieve ever greater levels of flourishing. And I think like, yeah, and then freeing up space for more spiritual practices and aesthetic experiences, as opposed to kind of low quality mundane work-related experiences that currently occupy much of our waking hours.

• 1:05:53Tom Bilyeu?

  In a solved world, which I think you define as all things that we know to be technologically possible have actually been done. So in that world, do you think that we'll be able to perfectly manipulate our nervous system so we could see and feel and hear and taste and basically completely manipulate our senses to orchestrate experiences?

• 1:06:18Speaker 03

  Yeah, I think so. I think if we have our organic brains still, there might be some limits to that. I think it could get pretty close by combining like perfect virtual realities. You could have like whatever sensory input that you choose, right? Sound and smell and vision and stuff. Combined with, imagine some kind of super drugs that allow you to fine tune each emotion precisely the way you want it without side effects and addiction potential.

• 1:06:53Speaker 03

  That already, I think, gets you some way there than if you imagine other kinds of neurotechnology like kind of Neuralink interfaces or other more kind of invasive forms, gene editing, various brain circuits and stuff. I think you could get even further along that path to sort of having fine-grained, real-time control over the content of your experiences. If you go to more radical scenarios where maybe you upload into a computer and sort of digitize digital minds, then you might have even more fine-grained control because those data structures would be completely accessible.

• 1:07:28Speaker 03

  Right, you could sort of edit every little neuron in real-time potentially. But I think even with biology, you could get pretty close to that with mature technology.

• 1:07:37Tom Bilyeu?

  Okay, so that gets into what I think, if that comes true, that is where I think we inevitably end up when I put my utopian hat on. That, are you familiar at all with the Japanese genre of storytelling known as isekai?

• 1:07:55Speaker 03

  Not really, no.

• 1:07:57Tom Bilyeu?

  It's kind of like Ready Player One. You wake up inside of a video game, but you're actually in the video game. And so you can have relationships with the characters. If you get killed, you actually die. There's a whole thing about that.

• 1:08:11Tom Bilyeu?

  That feels to me, minus the "you actually die" part, that feels like if we could completely manipulate our nervous system or upload ourselves, that the sort of ultimate expression of life, the maximally cool way to live would be to have, like, you go to Netflix and you're like, "Ah, today I want to be a master chef from the 1800s, France. Go." And you then go live as that person for however much time you want. You could speed time up, you could slow your perception of time down, whatever. So you could play for an hour, but it felt like you played for 50 years. You could do something, "I want to do like I'm traveling the cosmos." And now you don't actually have to violate the laws of physics to travel somewhere billions of light-years away.

• 1:08:56Tom Bilyeu?

  It would just be an imagined simulation, but you're actually, you feel like you're there, you smell everything. And I don't know, with our current... Way of responding to things. I don't know that people could avoid that, that you would end up with an universe that is tailored to you, that you may change frequently, or you may live in one for an extended period of time. But that feels like, again, with with the way we are now, because obviously, we could change our own biology so fundamentally through AI that you can throw this out the window. But that feels like the end game.

• 1:09:35Speaker 03

  Yeah, I wonder though whether it might not be possible to do even slightly better than that. I mean, you might say if it's either that or the current world. Uh, I mean, that does seem pretty good because the current world has a lot of, I mean, it's not just like, you know, your baby smiling at you or like a sunset, right? Most of the real world is pretty much a horror show for many people, for many animals. And so even just getting rid of the negative might be just well worth. But if you have all of that, I think one of the sort of values that seem possibly missing from the picture you painted there, um, is this value of, again, coming back to purpose and or meaning or significance.

• 1:10:19Speaker 03

  There is like some sense, I think, when people consider that, yeah, these would be like, you know, a lot of fantastic experiences that would be a lot of fun, but it seems a little sort of shallow or like a little arbitrary or random or atomistic. And so I think one might want to think about whether that would be the ability to have a lot of that, what you just said, but with some constraints that create more of a structure around it.

• 1:10:46Speaker 03

  That within which we also can have some forms of purpose. I think there are these constraints particularly arising from our commitments uh, social culturally to to other people and to traditions.

• 1:11:01Speaker 03

  So think, think of a very simple

• 1:11:06Speaker 03

  form of purpose in a technologically mature world. Suppose that person A.

• 1:11:14Speaker 03

  Happens to really want that person B gets what they want. So person A cares about B, they really want person B to get what they want. They just happen to have this desire. And then person B now is in a position to give A purpose. If B wants that A should do something on their own steam, not just out sources to some robot, but that A should put in their own effort to do a certain thing. Now, A has purpose in the sense that the only way they can achieve their goal, that B gets what they want, is by A themselves actually putting in the effort. Because nothing else would actually satisfy B's preference. And so now, A would actually have a real purpose.

• 1:11:59Speaker 03

  The only way they can achieve their goal is by putting in effort themselves. No matter how advanced the technology is that they have access to, there would be no other way of actually achieving B's preferences. So I think in this very reductionistic way, it seems a little hokey with like person A wanting this in person. But I think more complex and subtle ways of that, it could actually be a plausible framework of constraint for these future deep utopians, where they kind of care about various traditions, various social norms and activities in some ways that give them reason for doing things on their own steam. Even if that technologically, they would be able to outsource a bunch of stuff. Like, for example, if you value upholding a tradition,

• 1:12:44Speaker 03

  there might be no other way of upholding it than actually by continuing for humans to do various things on their own. Like, setting up a population of robots that kind of enacted these past terminus or something might not count as continuing the tradition. And so, maybe there would be a kind of more ceremonial and social aspect to these future utopian lives that would still give a lot of room for this kind of unbridled fun, but maybe there would still be a sort of more, I don't know, serious contours around it that gives it a little bit more shape and structure. That could also allow the utopians to realize various forms of purpose, including natural purpose and not just this artificial purpose that we see in game playing,

• 1:13:28Speaker 03

  where you make up some random goal just for the sake of having a goal. But where they care about each other's opinion about things. And maybe like what you were saying, wanting higher social status, if the thing that gets you social status is doing things on your own steam. Like then, you know, people have to do things on their own steam if they actually want to achieve the social status. Um, so something like that, that kind of on the upside gives maybe some scope for human effort. Uh, but then on the downside has this like amazing safety net. Where uh, like the AIs make sure that anybody who falls seriously sick is kind of cured and that everybody has, you know, all the food they need and like all the material conditions for like a great comfortable existence that

• 1:14:12Speaker 03

  that everybody's brain is kind of have the opportunity to like experience great levels of joy. Like some people are just born depressed and it's kind of their whole life sucks just because they had too little, too few neurotransmitter receptors in some, some area of their brain, like their whole life is just basically uh ruined. You could fix that, like so that um, so like uh, like lift up the floor and then like at the very top, you could still have these kind of little games that people are playing perhaps to sort of make small differentials like through your own effort, you could change your life, you could make it instead of being fantastically good, you could make it super fantastically good. Something like that, that could be sort of the span, the stakes that, that uh, that we fight for.

• 1:14:56Tom Bilyeu?

  If we could create AI, whether in a robot or whether in a simulation that was indistinguishable from a human, do you think people would care whether they're interacting with a human? Or they're interacting with a simulated human?

• 1:15:13Speaker 03

  Um, that probably uh, start caring less about it as they get more experience with these kinds of interactions. Would be my guess. I think one important question for me would be whether this robot is conscious, whether it's not just externally hard to distinguish from a human, but if it has the same inner psychological life as a human has. In which case I think it would be a moral patient, like it wouldn't just be a thing that you can throw in the trash if you no longer want it. It would be a thing who has uh, welfare interests of its own.

• 1:15:54Speaker 03

  It matters how life goes for it, not just like whether it makes humans happy, but it, it would be like a member of this population that. We would want to have a good future. And I think in fact, this maybe is a little bit of a tangent now, but like the general ethics of digital minds is gonna, I think, become increasingly important. It is like even the AIs we currently have. We are very soon, if not already, at the point where it's not really. We can't be very confident that they don't have some rudimentary forms of of of moral status or or awareness or some subjective capacity for feeling a pleasure or pain and stuff. So it will increasingly also become important how how well the future goes for these AI minds themselves.

• 1:16:37Tom Bilyeu?

  If you're saying it's already hard for us to tell for sure one way or the other, what metric will we use to know when this is something that we can just turn on or off, make it do what we want? How we know when we cross a line into something that has moral rights?

• 1:16:53Speaker 03

  Well, it's it's a difficult question. There needs to be more philosophical and scientific work on that. I'm involved with some research groups trying to do this. But I at least we can say something like if at one extreme you had an AI that was like exactly functionally identical to a human that had that lived for eighty years, that had like a human like body, that have human like memories, that had this brain in brain, like an artificial brain structured very much like a biological brain. I think in that case, it would be a very strong moral case that we should treat it as as a moral subject as well, that it would be wrong to mistreat it and be cruel to it, etc. But I think something far short of that.

• 1:17:36Speaker 03

  I think just as most of us would agree that at least some animals have various degrees of moral status.

• 1:17:46Speaker 03

  Like like it's it's wrong to to be cruel to a dog or to like mistreat, you know, a chimpanzee. Like if if you're a medical researcher, even just on a mouse, if you want to perform as an experiment, you have to anesthetize it before you do surgery on on a mouse, right? Because we think it is capable of experiencing suffering. Um, so if even a mouse has like possible claim to sentience and at least some simple form of moral status, then AI systems that are roughly equivalent to a mouse in in their sort of behavioral repertoire, I think, would also be prima facie candidates for moral status. But

• 1:18:27Speaker 03

  It does get more complicated because like

• 1:18:32Speaker 03

  in some cases, AIs can achieve similar behavioral output using very different internal mechanisms. And so then you need to think more carefully about what exactly is it that we think matters morally. These things can kind of come apart more. With humans and animals, you have a cluster of things that all come together. Like animals, they can sort of, yes, they have a brain and then they can squeak and they have eyes and they can, they have like a body that they're like a whole bunch of things that you don't need to have all of those attributes together with AI. So you need to think more carefully about which ones of them are actually the weight carrying elements.

• 1:19:12Tom Bilyeu?

  Do you think it would be morally acceptable to create a simulation? Where, let's say the AI is conscious. So is it morally acceptable to create a simulation where a young girl dies of leukemia?

• 1:19:29Speaker 03

  I think we should avoid doing that. But if I don't really feel in a position to sort of offer some

• 1:19:38Speaker 03

  overall verdict on like human history, all of the good things and the bad things and how to weigh that up. It feels more like a judgment that, you know, like it's

• 1:19:53Speaker 03

  we are too sort of limited to really even understand what, what, what is on the scales there.

• 1:20:01Tom Bilyeu?

  It feels like, I'm not entirely sure I understood that answer in the context of the question. So what does it have to do with human history?

• 1:20:13Speaker 03

  Well, I was imagining that where you would go with that would be to say, well, if we look at all of human history, it has not just one girl dying from leukemia, but a whole bunch of other horrible things as well.

• 1:20:28Tom Bilyeu?

  Yeah, there's two paths before us that I'm, I'm interested in. So path number one is where you're going, which is, does that make you think any differently about whether this is a simulation, which is something that we haven't talked a lot about, but you're obviously very famous for putting forward the simulation hypothesis, which is that what you're living in right now could be a simulation. And in fact, mathematically, probably is. But if it is. It seems pretty immoral by our own standards if all of the... I mean, I guess it comes down to the question of can we say that the suffering is intentional? And is that where the moral break is? Or do we just say a set of rules? Let's call them physics are put in place and then what comes comes? And maybe it couldn't be anticipated.

• 1:21:13Tom Bilyeu?

  And yes, unfortunately, suffering is going to be one of the things that may or may not have been anticipated.

• 1:21:19Speaker 03

  We don't know, first of all, supposing we are in this simulation, what exactly the motives are for having created this simulation? Or what the alternatives would be if these hypothetical simulators? Like, we know so little about their world or the choices that they face or about them, that it's hard to really come in strong with a clear, like, we know exactly how you should do things. Like, we have no, we've never even met them. We have never heard a thing like, so I feel a little... It would be kind of hubris to sort of come in there loudly and bang our chests and sort of tell everybody what's what and how they have, like, we are these like idiots running around here,

• 1:22:04Speaker 03

  having no clue about what's going on in the universe. So that's the first thing. Also, I guess, at least theoretically, there seems to be some possibilities in a simulation of avoiding or ameliorating or remedying various kinds of ills that might occur in a simulation. So there might be partial simulations. There might be characters in a simulation that get continued after the simulation. And you could imagine models in which people opt into being in a simulation. There's like a whole big space of possibilities,

• 1:22:44Speaker 03

  some of which I'm sure would be morally very bad, but also many others that it's harder to evaluate the morality of.

• 1:22:53Tom Bilyeu?

  Let's take a morality question that's closer to home. How would you feel if an AI could write a Nick Bostrom book as well as you can?

• 1:23:00Speaker 03

  Well, it would, I guess, save me a lot of time and effort then.

• 1:23:04Tom Bilyeu?

  But imagine that somebody puts it under a different name, Tim Bostrom. And wow, it's shockingly like your last book.

• 1:23:15Speaker 03

  If they had that level of AI, I'm not sure why they would like constrain themselves to writing my kind of... Flawed human outputs, they presumably would be able to do something better and more. Like, it would be a...

• 1:23:33Speaker 03

  Like, it seems harder to write a book that's exactly the kind of book somebody else would write than to write something better.

• 1:23:43Speaker 03

  Um, um, be- because like, I, I would have to... Yeah, it's... So it seems like an AI that could, for each person, write a, a book in their, that person's style. That would be as good as what that person could write. I think an AI that could do that could probably also write a better book than any of these people could write.

• 1:24:05Tom Bilyeu?

  If you could request an AI not be trained on your works, would you ask it to not be trained on your works?

• 1:24:11Speaker 03

  Yeah, um, I'm, I'm, I, uh, it's a hard, hard, hard to, to, to really, uh, uh, to know these. I mean, I think if it's there, they're out there on the internet, so, uh, I don't know. Um, I mean, it would be nice maybe to...

• 1:24:33Speaker 03

  I mean, one, one is always aware of, like, giving up rights in perpetuity forever for any purpose, including purposes we have not yet imagined, like, uh, it's like, it just seems like a big license to grant. Uh, so like, on, on just being conservative with not kind of giving up big chunks of possibility space without knowing what's in there. I think one might not, uh, wanna do that.

• 1:25:01Speaker 03

  Like, if it were one specific AI for one specific case, it would be easier to evaluate it. Like, limited downside, it's gonna be used for this thing, okay, that... But like, if you give it up for any use for whatever purpose in perpetuity through... What they have on these contracts, like, in, in, throughout the universe, using known and unknown new media of communication, I don't know if you have signed one of these release forms, they, they sometimes, uh, uh, your, your, your mind boggles at what kind of, uh, thing you're actually, uh, putting your signature chip when you're signing one of these.

• 1:25:34Tom Bilyeu?

  Yeah, they, they are, needless to say, very expensive.

• 1:25:37Speaker 03

  Like, you scroll through all of these updated terms of services, like, you click yes. I'm sure in one of these updated, there's like something, and you hereby sell your soul to the devil, or you're like, if somebody threw that in there, like... I this is like, yeah, I feel a little bit like it's weird that um we currently are responsible, each one of us have this kind of dictatorial power over an entire human life. Uh so like each of us is like our own life, right? We have complete like, which is kind of weird if you think about it being having complete dictatorial power over an entire human being for their entire life. That's like like a big responsibility. Are we really capable of shouldering that responsibility?

• 1:26:21Speaker 03

  I feel uh sometimes maybe not. It's just that there is no alternative, like there is no kind of other set of people you could trust to do a better job than each person themselves. But you do feel if somebody screws up their life, you know, they they are like, you know, 20 years old, they get into bad company, they make some bad decision and then, you know, either they're in prison for the rest of their life or they're like in a car accident and or like maimed for the rest of their life or they're like they're some little dumb decision they make early on have these like decades long consequences. I feel sometimes that there is a disproportion. Like maybe our our choices should have consequences, but a little bad decision that like you suffer

• 1:27:04Speaker 03

  for decades for like it feels so I worry if if all of us are slightly kind of it's a little bit like we were, you know, maybe 14 year olds uh who whose parents died and we were now had to fend for ourselves in the world, like like people had to do before social welfare services existed. So yeah, maybe they can kind of do it, but it seems a little like they're not really fully ready to take full responsibility. And I feel maybe we were all a little bit like that um currently.

• 1:27:36Tom Bilyeu?

  Given that, yeah, you made me think of Ilya Sutskever. What do you think he saw that I read it as scared him enough to leave OpenAI and start a new company called uh Safe Superintelligence? What do you think he's worried about that makes safety the number one thing in his mind?

• 1:27:56Speaker 03

  Fortunately, they haven't released any details and it's probably better if AI labs have some form of infosec, information security, so that not all advances are immediately distributed all over the world, because if at some point there is like some actually a dangerous capability advance, it might be better to have the option at that time, you know, to decide whether it should be disseminated, rather than sort of forfeit that opportunity to steer.

• 1:28:28Speaker 03

  I don't know, like, probably just like some possible path, technological path forward that seemed to, you know, maybe be able to scale more than the other path and that seemed harder, maybe from a alignment point of view to get to work or something like that. I don't think it was like any currently existing system, but more maybe a research path or something like that.

• 1:28:49Tom Bilyeu?

  And what do you think about alignment? I've heard you say that we need to give AI our values. My pitch would be that we need to give AI a completely different set of values where it does not value progress, for instance, because if it's constantly trying to progress and ever sees us as problematic in that, we've got trouble. And because humans kill so many humans, I definitely don't want them to have our values.

• 1:29:15Speaker 03

  It depends a little bit on whether you are willing to sort of differentiate between more superficial values and deeper values. So we have many things we value because we think they are associated with various kinds of consequences.

• 1:29:33Speaker 03

  So, you know, maybe you value exercise because you think it will make you healthy and strong and, you know, successful. But if, if you learned that you were actually wrong about these things, like in fact, for you, the way your particular body works, exercise actually will harm you and like make you die early because some valve will break when you put too much pressure on it, like some, like if you learned that, then suddenly you would no longer value exercise, like in fact, you would value not doing exercise in that scenario, right? Because it would kill you. And so, so there you discover exercise is not really your basic value. It's like what you actually value is perhaps more like, you know, health, happiness, strength or something like that.

• 1:30:16Speaker 03

  So then, but then maybe you could ask the same question for each of those. Uh, and then it's only when you like tick down to your sort of ultimate values that you would have at least a candidate if if you think we should align AI to human values, like maybe that's what you would align it to rather than um, some of these kind of instrumental values. Um, so that that's one observation. Um. Um, another is with human conflict, which is the source of a lot of misery. It's there. There's a kind of obviously, if you align AI with one set of humans and and they are at war with another set of humans, then it might not be good for the set of humans that uh, they are at war with if they just get more powerful tools

• 1:30:59Speaker 03

  uh, to to defeat their enemy. So if you care about all of humanity, presumably you would want the AI to be aligned either with all of humanity or with some entity that actually cared altruistically about all of humanity as as opposed to just a random little bit of humanity. Um, but then it it it is also possible to try not to align it in that way and to have AIs with more limited goals that deliberately uh, diverge from human goals because maybe you just feel more confident that you could actually instill those goals. Um.

• 1:31:36Speaker 03

  And with something like not desiring growth, I think was your example. Uh, there are problems that crop up there that even if you don't sort of explicitly instill a value va- of of of growth, like it might just emerge as one of these instrumental sub-goals. So it wants something else. This is kind of the um, one of the points of this paperclip maximizing AI example, right? So you have an AI that doesn't want growth. It wants to make paperclips. As many paperclips as possible. This is like the goal you give it. But then it turns out that by, say, growing, like by getting more resources, it can make more paperclips.

• 1:32:19Speaker 03

  So then you have an AI that actually for instrumental reasons want to grow, wants to avoid being shut off, wants to increase its intelligence, accumulate more power, not because it cares about or values those things in their own right, but just because it kind of calculates that I could actually make more paperclips if I have more power and more resources. So some of these goals that you might want an AI not to have would sort of, unless you're really careful, just be a natural side effect of almost any other goal that you put into the AI, that it is this kind of convergent instrumental reasons. And that's one of the reasons why you might worry about sort of scaling up these AI systems, developing very powerful agents. It doesn't, the sort of the catastrophe scenario doesn't depend on somebody deliberately

• 1:33:03Speaker 03

  putting in like a really evil goal in there, like it could just have some random arbitrary goal and then like bad things are done in the name of that goal that emerges subgoals.

• 1:33:15Tom Bilyeu?

  Nick Bostrom, this is an incredibly pivotal moment in human history and I have thoroughly enjoyed spending this time with you. Where can people follow you and hear more about your philosophies?

• 1:33:26Speaker 03

  Um, easiest way is just to go to nickbostrom.com. It's my homepage. There's like videos linked and a bunch of writings. I'm not really active on social media, so yeah, just go to my homepage.

• 1:33:40Tom Bilyeu?

  We'll have to get a bot out there publishing in your voice. We'd all be better for it. Thank you, man, so much for joining me today and everybody at home. If you haven't already, be sure to subscribe and until next time, my friends, be legendary. Take care, peace. Let's talk about a pattern that is guaranteed to be killing your progress. You know what you need to do. You need consistent nutrition. We all do. You need vitamins, probiotics, greens. We all know that we should be doing more of it. When your morning gets chaotic, you skip it. When you travel, you skip it. When your routine breaks, everything tends to break and that inconsistency compounds against you every single day. AG1 is designed to solve the execution problem. One scoop, eight ounces of water and you're done.

• 1:34:23Tom Bilyeu?

  You're getting 75 plus ingredients, vitamins and minerals, pre and probiotics. Nutrient-dense superfoods, everything that used to require six, seven different supplements, and perfect planning now happens in one drink that takes about 30 seconds to make. Right now, AG1 is giving you $87 worth of free gifts with your first subscription. You get a welcome kit, travel packs, vitamin D3 plus K2, and flavor samples. Click the link in the show notes or visit drinkag1.com/impact to claim this offer.

• 1:34:57Speaker 04

  This message comes from Betterment. Dan Egan, VP of Behavioral Finance and Investing, explains how Betterment takes the time-consuming work out of smart investing.

• 1:35:06Speaker 05

  I grew up learning about finance and investing myself and realizing that I needed to reinvest dividends and rebalance my portfolio, and if there was an opportunity to tax loss over time. And then I realized that I was doing all of these things that were pretty straightforward to implement, I just needed to spend my time doing them. Betterment automates the same good practices so that I know I'm doing portfolio management and goal-based planning in a way that makes sense and is responsible without me having to spend hours of my life doing it.

• 1:35:38Speaker 04

  Learn more at betterment.com. Investing involves risk. Performance not guaranteed. Betterment does not offer tax advice. TLH may not be suitable for all customers. Learn more at betterment.com/tlh/terms.