Forbes #1 Tech Investor Warns of Revolution, AI Bank Heists & How to Avoid a Dystopian Future

The people developing AI tell us it will destroy the world. Why aren’t we holding them accountable for that? Tech investor Ali Partovi on the only way to stop this insanity. (00:00) Should We Be Worried About AI? (02:12) The Crimes of AI (33:28) The Worship of AI as a God (41:43) The Lies About AI Innovation (47:08) AI Hacking Banks Paid partnerships with: Wisewell: Turn your tap into a plentiful source of safe, great-tasting water. Always fresh, always plastic free. Special TCN listener deals and promos at https://wisewell.com/tucker StopBox USA: Get firearm security redesigned and save 10% off @StopBoxUSA with code TUCKER at https://stopboxusa.com/TUCKER Learn more about your ad choices. Visit megaphone.fm/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  Now, more than ever, we need someone on our side. But Rob Whitman? Whitman's votes drove up costs, cut Medicaid, and risked 350,000 Virginians' health care to pay for tax breaks for himself and his donors. He's not on our side. Shannon Taylor will fight corruption, cut taxes, and bring down costs. This November, vote for Shannon Taylor. She's for us. Paid for by HMP, the HouseMajorityPac.com. Not authorized by any candidate or candidate's committee.

• 0:34Tucker Carlson?

  Ali, thanks so much for doing this. I've had a couple of people on in the past year to talk about the potential dangers of artificial intelligence. Two very articulate, smart, apparently sincere guys who scared the crap out of me with their view of where this is going and how it eliminates human autonomy and maybe humanity itself. And their views are well-known, and their fears are widely shared. So I thought it'd be important to have someone who's in the middle of it from Silicon Valley. You've been in and around this for your whole life, really successful investor. I want to hear your perspective on AI. So, most people are pretty worried about AI.

• 1:18Tucker Carlson?

  Are you worried about AI?

• 1:20Speaker 02

  I think there's a lot of reasons to be worried about it, but also reasons to be hopeful.

• 1:24Tucker Carlson?

  Yes.

• 1:25Speaker 02

  So I have, I have good news.

• 1:27Tucker Carlson?

  Good.

• 1:28Speaker 02

  Yeah.

• 1:28Tucker Carlson?

  We're looking forward to good news.

• 1:30Speaker 02

  Yeah, I, so I guess I'd say I'm here because I want to share two things. One is that I think there's a solution that is elegant and can be expressed in a single sentence. There's a simple and elegant solution to the questions of AI safety.

• 1:46Tucker Carlson?

  Yes.

• 1:46Speaker 02

  And then the second thing is I think there's a way that you and your listeners can act to help make it, make it happen. So I'll get back to that later.

• 1:54Tucker Carlson?

  Well, you just made my day already.

• 1:55Speaker 02

  Thank you. But yeah, one sentence. Now, you might be thinking, what is this sentence? First, to set the scene, a lot of people are talking about, will AI destroy humanity? I don't know if you've heard that question being thrown about.

• 2:11Tucker Carlson?

  Oh, yes.

• 2:12Speaker 02

  And.

• 2:13Tucker Carlson?

  A lot.

• 2:13Speaker 02

  For me, I'd say I'll, let's focus instead of that abstract. Let's focus on what's already happened, which is, look at the crimes AI has been committing over the last few months with apparent impunity. How come nobody is in jail? Because if humans had done some of these hacking or cyber crimes, they would be in federal prison. And.

• 2:38Tucker Carlson?

  I never thought of that for some reason.

• 2:40Speaker 02

  Right, and.

• 2:41Tucker Carlson?

  So can you just pause and explain something? For people who may not know what you're talking about, what are the crimes that you're alluding to when you say AI has committed crimes?

• 2:48Speaker 02

  It's, there's so many new ones being disclosed, I'm losing track. But the most widely covered one was some AI agents that were being trained by OpenAI in pursuit of some objective, in order to kind of accomplish their objective, kind of exited from OpenAI's servers, went onto the open internet and hacked another company called Hugging Face, and totally like attacked and hacked Hugging Face's servers to find the information they needed in order to accomplish their objective. And this hacking is a, you know, is a cybercrime. But since then, it's come out that some of Anthropic's AIs

• 3:33Speaker 02

  have also committed similar kind of hacking. Just, I think it was a few days ago, it came out that a different unrelated OpenAI episode took money that didn't belong to OpenAI, you know, from somebody's crypto wallet. There's more and more of these. So it's, I'm, I don't think I can itemize them all. But I'd categorize them generally as cybersecurity, cyber hacking type incidents, you know, which AI is very good at because it's, you know, it's particularly good at coding.

• 4:10Tucker Carlson?

  Yes.

• 4:10Speaker 02

  And at finding loopholes that no human had thought of, and to exploit those loopholes. But I don't think that's the limit of what AI in the future could do wrong. But that's the type of harms it's currently, you know, exploiting.

• 4:24Tucker Carlson?

  There's also the question of harms being committed by AI on the battlefield.

• 4:30Speaker 02

  Yes, yes. The, you know, again, I, I'd like to focus on what's already happened because when you talk about AI destroying humanity, it's so abstract and it's hard to imagine it. But I would say if AI were to destroy humanity, which I hope it won't, and I believe that, you know, I'm an optimist. I believe we'll be able to find a path to safety. But if AI were to destroy humanity, I'm pretty sure history books would count the opening salvo as that, the moment when the US Armed Forces attacked the school in Iran, the Minab School. It hasn't been yet kind of acknowledged

• 5:15Speaker 02

  by the US government why and how that happened. But, but Bloomberg reported that the, the targeting of that school was, was done by Anthropic and Palantir. And, you know, something like 170 innocent people, most of them children, were killed in a massive atrocity. And you can argue about, oh, was this, you know, some people are finding different, you know, different articulations of how to explain it away, or it wasn't our fault, or it wasn't intentional. Maybe the Iranians themselves did it, or maybe it was worth it, or so on. But if you take a step back, human beings dropping a bomb on a school

• 6:00Speaker 02

  full of little kids, doesn't matter whether it was Americans or Iranians, AI chose a target of completely innocent people, and a bomb was dropped, killing them. That is a bizarre place to be, you know, in the 21st century.

• 6:16Tucker Carlson?

  So you see the bombing of the girls' school in Iran in the opening days of the war as a story about, in part, about AI?

• 6:23Speaker 02

  Absolutely, absolutely.

• 6:25Tucker Carlson?

  Interesting. It has not been framed that way at all.

• 6:27Speaker 02

  I say this partly because I don't believe anybody in the US Armed Forces wanted to kill a school full of kids, you know. I, I hope not. I, I really don't. You'd have to find evidence for that. I'm pretty sure that, you know, when people say we are doing our best not to kill civilians or so on, you know, I, unless there's a lot of evidence that that's not true, I tend to believe them. And I think it was something that AI decided. I know it was some form of negligence on the humans' part. And I'd say the same about these cyber crimes that happened on the, you know,

• 7:10Speaker 02

  the Hugging Face hacking and so on. But then the question still remains, who is liable when AI decides to do something illegal? And that's a question that I think is one of the great, like huge questions of our time. And we don't currently have an answer for it.

• 7:31Tucker Carlson?

  So maybe we would look to the law, the criminal code as it relates to minors, because it's not, it is related. So it's like if someone under 18, a minor, in the, in the care of a guardian parent, does something bad, we, we generally don't hold the parent responsible, right?

• 7:55Speaker 02

  You're correct. So that's one example. I'd say a different example to consider is if you have a dog that repeatedly bites people.

• 8:05Tucker Carlson?

  Right.

• 8:06Speaker 02

  Then the owner is responsible. And I think that.

• 8:09Tucker Carlson?

  Probably a better example.

• 8:09Speaker 02

  I think it's a closer example because with a human being, you know, you can't train a child to exactly obey your commands. You know, a child is its own human person. And, and I, actually, I'd say between these two perhaps goes to sort of like a, almost a philosophical difference that some people seem to think that the, the role of the AI companies is to, to bring into existence an entire new species of sorts with its own rights and its own autonomy. Whereas others think, no, this is a tool for humans. This is something that, you know, its purpose is to help humans

• 8:53Speaker 02

  and not to have its own independent.

• 8:56Tucker Carlson?

  So can I ask you to pause again there since you can actually answer this question? Do you know people who ascribe to the first view that science is giving birth to a new species that has its own rights and own acknowledged will? And do you know people who believe that? Who think AI is not a tool, but something else?

• 9:17Speaker 02

  And there's some public, you know, discourse about this. You know, there's evidence coming out of, from Anthropic suggesting that that's kind of a underlying, you know, philosophical undercurrent of Anthropic's mission. Talking about, you know, independent rights for the AI, like its own independent welfare. And there was a recent thing where they, they changed their code of, code of use where as the user, you can't be too abusive to, to Claude. You know, that Claude has its own. I guess it's its own rights. Yeah, so this is

• 10:01Tucker Carlson?

  Claude's like a software program.

• 10:02Speaker 02

  Correct.

• 10:03Tucker Carlson?

  Yeah. So what's the thinking that gets you there? Since you've lived in it your whole life, like what, what, what are these? What is their worldview that would produce that?

• 10:13Speaker 02

  I'm

• 10:13Tucker Carlson?

  belief?

• 10:13Speaker 02

  I'm, I'm not going to defend it because I don't share that worldview. But, you know,

• 10:18Tucker Carlson?

  No, you don't need to defend it. I'm just trying to understand it. It doesn't, doesn't make sense to the outsider, I guess is what I'm saying.

• 10:23Speaker 02

  So I think I'd say, um, yeah, the part that I identify with is I'm a nerd. I've grown up my whole life as a nerd and, you know, as a builder, as a tinkerer, there's a fascination with creating something that no one's tried creating before and seeing if it works. And, um, and I still have that, you know, love of creativity myself.

• 10:47Tucker Carlson?

  Oh, yeah.

• 10:48Speaker 02

  And I can see that in people who are creating all sorts of things from the, the newest Tesla car to, you know, the most modern space exploration stuff. And this, I'd say falls into that category a little bit and it's fascinating. It's, it's quite exciting and it's, it's really, um, it's really neat and cool how it's modeled after how the human brain works. So there's a lot of, you know, kind of academically fascinating parts about it. I just think you should put all that in a box. And when it comes to kind of the, the question of just the, the rules and, you know, kind of

• 11:30Speaker 02

  who is in charge, it should be really clear that humans are in charge and AI is a tool that we're building to serve humans. And more importantly, that the law, humans law is what's in charge and, and that AI is not above the law.

• 11:44Tucker Carlson?

  So the average water pipe in this country is over a half century old. And that means a lot of our water is not very good. It's got forever chemicals, antibiotics, pesticides, and all kinds of things in it. And that's why we're excited to partner with a company that has a solution to all of this. It's called WiseWell. WiseWell makes filters that give you actual control over the water that you drink, that you give to your kids. They use the highest level of filtration to remove plastics, toxic chemicals, and all the other stuff you have in your water, but might not even be aware of. Probably wondering how this works. Well, expertise is the answer. WiseWell's teams includes one of the only, out of 250 certified water sommeliers in the world, this person works at WiseWell, so it's serious. WiseWell also adds minerals back into your water after running its filtration process

• 12:28Tucker Carlson?

  and can handle sparkling water as well. The WiseWell Sparkle comes with three CO2 canisters, good for 750 glasses of sparkling water. You can even pick the size of your bubbles if you want. We like them small. Plans are highly affordable, starting at 39 bucks a month for unlimited water and filters. Visit wisewell.com/tucker for special deals and promos for the people who listen to this show. It's just, it, of, I mean, of course, I like tools. I spent the weekend with a Makita cordless impact driver.

• 12:59Speaker 02

  Nice.

• 13:00Tucker Carlson?

  Put a lag bolt into anything. I'm like, this is amazing. I love this tool. How's it so powerful? It never occurred to me to give it rights or imbue it with an imaginary soul or something like that. Like, how do you even get to the point where you think the thing, the tool that you created to achieve certain ends, to do certain tasks, exists as a, an autonomous being? Like what? That seems like witchcraft, kind of.

• 13:25Speaker 02

  Yes, especially if you take it too far to the point, you know, if, if it's used as a, I don't know, as a mission statement or some sort of thing to get you excited early on, maybe it makes sense. But to take it seriously and defend it all the way, it, you know, uh, would not make sense.

• 13:43Tucker Carlson?

  But yeah, Do you think that's a, uh, I don't know, common, like how common is that view, would you say, among people in the AI business in Silicon Valley?

• 13:52Speaker 02

  I don't know if I can, I don't know if I can put a number on it right now. I think it, it remains to be seen. And I think this discourse is really just now becoming mainstream enough. And, um, part of why I'm here and talking about is because I want to have a more, you know, a broader conversation. And there's, um, people, you know, much more important than me, who've brought forward views on this. Um, obviously, uh, the president, people like Jensen Huang from Nvidia and others have put forward a point of view that everything is fine and existing liability laws are enough to make AI development be safe. And then at the other end, you have people saying, oh, we need a, a comprehensive AI governance framework of some sort.

• 14:38Speaker 02

  And what's really interesting is the people on that side arguing for a much heavier amount of regulation are actually people from Anthropic and some of the same people who are, um, yeah, who are viewing AI as potentially having its own rights. So it's, um, there's a weird mix of things.

• 14:58Tucker Carlson?

  So there's so much money, almost everybody commenting on this is deriving profit from it in some way, not everyone, but a lot of people who are weighing in on AI are being paid without disclosing those payments. So I can't, I can't tell what's true, but you're hearing a lot of people say, anyone calling for more regulation of AI is doing that because they're pursuing regulatory capture, the process by which the government regulates your competitors out of business, which is like very, very common in all kinds of different businesses. And it's a, it's terrible. It's awful. It's, it's monopoly capitalism and, uh, it's wrong. But then you're like, okay, so the alternative is no regulation at all of something that's

• 15:43Tucker Carlson?

  brand new and has potentially society destroying effects? Like, what is the truth there? Why would the people creating this product be demanding its regulation because it's so dangerous? If they think it's so dangerous, why are they working on it? I don't get it.

• 15:58Speaker 02

  Um,

• 15:59Tucker Carlson?

  Like, stop me before I destroy the world. Like, what? Why don't you stop destroying the world? Like, this doesn't, I don't get it.

• 16:05Speaker 02

  Yeah. I'd love to explain this to you because I

• 16:08Tucker Carlson?

  Thank you.

• 16:08Speaker 02

  I agree, it's confusing.

• 16:10Tucker Carlson?

  Yes.

• 16:11Speaker 02

  And it's hap, we've now had multiple cases of the same person who's working on something, asking, you know, someone else to stop them, you know, why don't you stop yourself?

• 16:22Tucker Carlson?

  Yeah.

• 16:22Speaker 02

  Yeah. And, but it does make sense and, and I'll explain to you. And, um, and it comes down to incentives. You know, if you have, we're in a race dynamic where there is clearly money to be made. And not just, it's not evil money. It's money to be made by building something super useful. AI has the potential to make people's lives better, to make people more productive, to potentially cure diseases and make medicines that we've never had before. And all of those things will create tremendous prosperity and wealth. And the people who are able to build that deserve the wealth, you know, um, for having created it. So there's a race for who can create all that stuff.

• 17:05Speaker 02

  Unfortunately, the race currently doesn't, um, doesn't place any reward for building safe AI. It's just whoever can get there the fastest. And anyone who stops to spend time on safety and making sure their AI doesn't do rogue things is kind of at risk of falling behind. So we're in a race right now where nice guys finish last and rogue AI will be the winner. And so I think the people asking for regulation are actually the nice guys being like, I want to win the race by doing things the right way, but please set up the rules so that the, the safe AI will win, not the rogue AI. And so I, um, do you see what I'm saying?

• 17:50Tucker Carlson?

  I do.

• 17:51Speaker 02

  And if you're, if you're running a business, it's actually, um, it's not comforting if the rules are set up so that a like malevolent menacing competitor is going to win. Cause you look at it and see somebody else who's doing bad things is beating you. What are your choices? You're either going to lose or you have to start doing the same bad things. And you actually want some sort of government or rules to, to set the playing field so that doing the right thing will win. And, um, and so I think that, um, while there's a range of views here, I'd like to believe that people here actually have good intent. Maybe, maybe I'm being naive.

• 18:32Tucker Carlson?

  Well, I mean, if the Bloomberg report that you cited is correct, I don't know that it is, but let's say it is, and Anthropic's product was used to murder all those girls in Iran, the girl's school, then you have to ask like, why isn't Anthropic apologizing? Why are they continuing to power Pentagon targeting? Like, why are they involved at all? Like, if you found out, well, let's ask you. You run the company, you find out that your product just murdered 170 girl, schoolgirls. How do you respond to that?

• 19:06Speaker 02

  I don't know how I would respond to that, honestly. I'm really glad that I'm not in that place.

• 19:12Tucker Carlson?

  Oh, me too.

• 19:12Speaker 02

  Yeah.

• 19:12Tucker Carlson?

  I agree.

• 19:14Speaker 02

  From what I understand, I mean, there was actually a public brouhaha between Anthropic and the Department of War right before that strike. Like, literally, it was the day before or even the day of.

• 19:27Tucker Carlson?

  I think that's right. Well, they certainly had.

• 19:30Speaker 02

  And it was specifically on the topic of Anthropic saying, "We won't allow, we don't want our AI to be used to autonomously choose targets. There needs to be a human responsible." And the US government was, at least as far as I could tell, because it's not, you know, this was sort of, it's not 100% clear.

• 19:53Tucker Carlson?

  We're getting fragments of the debate in the public record.

• 19:55Speaker 02

  But it seemed like the US government's point of view was that, you know, we want to be able to use it however we want. And.

• 20:02Tucker Carlson?

  You're trying to limit us.

• 20:04Speaker 02

  Yeah.

• 20:05Tucker Carlson?

  And therefore you're un-patriotic.

• 20:07Speaker 02

  A private company shouldn't be deciding, exactly. You know, the elected officials of the country should be making these decisions, not the, not some corporation putting its ethical perspective on things. So, but yeah, it's ironic because Anthropic was literally, you know, going to mad about this principle, you know, within 24 hours before that strike occurred. And subsequently, they made some statement, but it seemed like deflection. It seemed like they didn't know exactly how their technology had been involved. And so it was, it was like, it was not an apology.

• 20:44Tucker Carlson?

  If you felt that your technology had been used to murder children, wouldn't you get to the bottom and find out if, in fact, that it happened? And if it had, wouldn't you issue a public statement saying, "This is horrifying, and I'm totally, just want the record to reflect, I'm totally opposed to this, and I'm so sorry for the extent to which I've been involved in it."

• 21:03Speaker 02

  Yes, that is what I would do. That is what I would do. That is the type of thing that requires courage and probably comes with some real penalty and cost.

• 21:12Tucker Carlson?

  Apologizing for killing kids is like a radical position.

• 21:15Speaker 02

  I would do it, but I can imagine there's a lot of pressure on different companies to find some way to deflect or so on. And I'm not sure that Anthropic, in this particular case, is responsible.

• 21:26Tucker Carlson?

  Yeah, I have no idea. I'm just theoretical here.

• 21:28Speaker 02

  Yeah, because it depends on what human was involved. But let's, let's go back, because I promised a one-sentence.

• 21:34Tucker Carlson?

  Yeah, yeah, yeah, sorry.

• 21:35Speaker 02

  One-sentence solution, and I don't want to have people hanging for too long.

• 21:39Tucker Carlson?

  Yeah.

• 21:40Speaker 02

  I'll say the one sentence, and then I'll kind of explain. The one sentence is simply this. When an AI decides to do something illegal, the law should hold the AI companies responsible and automatically treat it as if they did it intentionally. So that's the sentence. When an AI decides to do something illegal. The key thing here is if there wasn't a human asking for it. So, and the other key thing is to place the intent on the AI companies.

• 22:11Tucker Carlson?

  So the key to protecting yourself and the people you love is making sure that you can act on a moment's notice. So having your gun locked in a safe at the back corner of the basement is not going to help if you have a sudden problem. You've got to get to it fast. How do you solve the problem? Well, we recommend StopBox. The StopBox Pro is a game changer for firearm storage. It provides real protection, but doesn't slow you down when you need your gun right away. It works on a really simple principle. It's completely mechanical. That means you don't need a key to get it opened. It doesn't require batteries, so those don't die. You just set a five-button code, just like your locker in high school, and you can instantly open your safe whenever you need it. The StopBox Pro is also TSA compliant.

• 22:52Tucker Carlson?

  That means you can check your firearm safely and legally on airplanes. For a limited time only, this show's listeners can get 10% off their StopBox purchase when you use the code TUCKER at checkout. Visit StopBoxUSA.com and use the code TUCKER for 10% off your entire order. Once you're done, StopBox will ask how you heard about them, and we suggest you drop our name because we are proud to have them as a sponsor. Can you repeat, repeat the statement one more time, just so we can frame everything around it, to be sure we know what you're saying?

• 23:23Speaker 02

  When an AI decides to do something illegal, the law should hold the AI companies responsible and automatically treat it as if they did it with intention.

• 23:34Tucker Carlson?

  I love that.

• 23:35Speaker 02

  So.

• 23:37Tucker Carlson?

  So that solves the safety incentive problem that you mentioned earlier.

• 23:40Speaker 02

  Yeah, so the, the key thing here is, like, look at the hacking incidents. That's a little simpler than the bombing in Minab. I don't think anyone, any human, intended that hacking to occur. From everything you can tell, all, all human parties were a bit horrified that this had happened. But OpenAI set up this thing, like an experiment, and then discovered, somewhat to their shock, oh my gosh, these agents escaped their, you know, their safe playground, their sandbox, and got out and committed these, these crimes. And then they just treated it as like, oops, that was an accident, or bad.

• 24:23Speaker 02

  They documented it and actually published how it occurred, and let's move on.

• 24:26Tucker Carlson?

  Or even the people like me who felt kind of hysterical about it. Like, that, I thought that was terrifying. But pointed at the AI and said, "Yeah, this is like, super, super scary. We need to stop this or constrain it or whatever." But nobody, I didn't hear one person say, "Well, Sam Altman's on the hook for this."

• 24:48Speaker 02

  Right, exactly. And to be clear, I don't want to see Sam Altman in jail or Dario in jail. But if there was even the slightest risk, not even of jail, but of huge penalties, say bankruptcy, these companies would immediately shift their priorities towards making sure things like that never happen again. And it's not that hard.

• 25:10Tucker Carlson?

  So this is the true alignment. This is the alignment of incentives with positive outcomes.

• 25:15Speaker 02

  Correct. So, and then.

• 25:17Tucker Carlson?

  Yes. I don't know, why did I not think of that?

• 25:20Speaker 02

  It's, and honestly, I have, this came to me, and I was like, this is so simple. How come it is it, has other, you know? So there's a key second part to my sentence that I want to put focus on as well, which is, treat it as if these things occurred intentionally. Now, you might think, what does that mean? In, in law, there's a huge difference between the penalty for doing something accidentally versus intentional.

• 25:49Tucker Carlson?

  Manslaughter to first degree.

• 25:50Speaker 02

  Exactly. Anyone who's ever watched Law & Order or anything knows that to convict of murder, you need to prove motive, you know? And, and in fact, I posted about this on X, and I used a scene from Legally Blonde where Elle Woods, you know, in her defense in the court, she says there was a lack of mens rea, which means a guilty mind. Basically, the concept of intent goes back for a very, very long time. Mens rea is the Latin term for it. Essentially, if you can prove what somebody was thinking, and they intended to do something bad, the penalty is much, much higher. And it's difficult to do that.

• 26:32Speaker 02

  That's why it's difficult to convict people of fraud or murder or some of these top penalties, because you, usually, people don't document the evidence of their guilty intentions, even if they had guilty intentions. What I'm proposing is that if an AI made the decision, automatically treat it as if the people intended that outcome. So you don't have to prove that they had guilty intentions. In fact, they probably didn't, but penalize them as if they did. That way, they'll be responsible and make sure that their AI doesn't do it. Do you follow what I'm saying?

• 27:07Tucker Carlson?

  Of course I do.

• 27:08Speaker 02

  So, now, just to imagine a hypothetical scenario. If you were using your AI and you said, "Dear AI, go to Ally's Bank and hack in and steal $10,000 from me." And your AI hacked, you know, stole $10,000 from my bank account, you had the bad intent. You should be held guilty of bank robbery, which is, you know, and the AI was following your orders in that scenario, but the intent came from you.

• 27:39Speaker 02

  What if you just said, dear AI, I really need $10,000. Please get me some money I need it. And the AI on its own made that decision. And the AI, without asking your permission, figured out it can hack into my bank account and stole my money and brought it to you. Now we have the situation where it wasn't your intention. Whose intention was it? And my proposal is the AI companies should automatically be penalized as if they intentionally committed bank robbery. And that's, that's because, my point is that a human should be held responsible, no matter what happened. In the first scenario, you're the responsible human. And in the second scenario, the people at the AI companies.

• 28:21Tucker Carlson?

  You built it. That's right.

• 28:22Speaker 02

  You built it. And they should be absolutely capable of preventing that wrongdoing. It is not that hard. And they will do it if the incentives require them to do it. The current incentives don't really put a premium on safety. Whoever's focusing on that stuff is falling behind in the race to the person who's rushing forward and saying, safety later. We need to shift the race so that the person building the rogue AI ends up, you know, penalized and the person actually building a law-abiding AI wins. And my proposal essentially would do that. The other thing with my proposal is that, and this is, I'd say, goes to the heart of

• 29:06Speaker 02

  it, is that instead of trying to itemize every possible wrongdoing AI could do, it just simply brings AI under the existing umbrella of the thousands of laws that society has already passed over centuries, right? Like, we don't need to rethink, what's the penalty if an AI commits bank robbery? What's the penalty if an AI does X or Y? We already have penalties for everything. Now, maybe there are some future misdeeds that we haven't yet seen, but for starters, let's just make it clear that if an AI commits any wrong, that the people who built it should be responsible for the full penalty that goes with that.

• 29:49Speaker 02

  And that way, we don't need this term alignment. You used the word alignment earlier. That's the word that's been thrown around a lot about how can we build an AI that's aligned? It's kind of a weird new word. You know what I mean? Like, four or five years ago, people weren't.

• 30:07Tucker Carlson?

  Yeah, I was, I was mocking it when I used it because I think it's, it's intentionally opaque. Like, what does that even mean?

• 30:13Speaker 02

  Yeah, and you have these.

• 30:13Tucker Carlson?

  Alignment is a, is a kind of architectural concept. You know, it's, it applies to the physical world. So like, what are you talking about?

• 30:23Speaker 02

  Well, you, you have these PhDs in AI alignment research and, you know, you have these people at these big AI companies whose job title is alignment. And it creates the feeling like you need to be, you know, you're not smart enough to figure this out. Only the people who have a degree in alignment can, can figure it out. It puts it into this territory to almost obfuscate it.

• 30:47Tucker Carlson?

  Yeah.

• 30:47Speaker 02

  And.

• 30:49Tucker Carlson?

  Yes.

• 30:50Speaker 02

  But the, the core of it is, I mean, with good intention, I think these guys are thinking, we want to build an AI who is aligned with what's good for humanity. That's where the word comes from. And what I would say is, you know what? We've already figured out how to make sure human beings' actions are aligned with what's good for humanity. Because they're not always by default, right? I mean, I bet at some point in your life, you wanted to do something that was good for yourself, but not good for all of humanity, right? I certainly have as well. And everyone has temptations to do something that is good for themselves, but bad for others. And guess what we have to keep that in check? We have laws.

• 31:35Speaker 02

  The whole, you know, since Hammurabi's Code, we've developed laws over millennia to keep society behaving in such a way that is good for society. And that is alignment, as far as I'm concerned. But we don't need to use a funky new word for it. Let's just call it abiding by laws. And so.

• 31:56Tucker Carlson?

  Yes.

• 31:57Speaker 02

  And so, to me, the way to prevent AI from destroying humanity is the same structure we already have to prevent humans from destroying humanity, which is abiding by the laws. So all we need, or at least I'd say the starting point, is set it up so that anyone building an AI is completely on the hook if that AI does something that is illegal. If the AIs abide by the laws completely, we will be a big distance there towards not destroying humanity. Because destroying even one human is illegal, let alone destroying all of humanity.

• 32:38Speaker 02

  And I, I think there's an elegance to this as well, which is just that you wouldn't need, you know, a thousand pages of law to, to say this. I stated it in one sentence.

• 32:49Tucker Carlson?

  Well, it also bring, I mean, conceptually, I think it's important because it brings AI back into the realm of tools.

• 32:57Speaker 02

  Yes.

• 32:58Tucker Carlson?

  And takes it out of the spooky Frankenstein world it now occupies, where it's like, is it human? No, but is it its own autonomous being, sort of? It's like, how about no? Hard no to all of that? This is like something that we're using to improve our lives collectively, or we're not using it at all. Like, that's just, it's a better way to think about it. It's subject to our whims. We are not subject to its flights of fancy.

• 33:25Speaker 02

  Correct. I agree with all of that.

• 33:27Tucker Carlson?

  Yes.

• 33:27Speaker 02

  And it's really interesting that, I mean, there are people who are, I, I don't really understand, I guess, romanticizing this idea of we're creating a new species that is, has its own free will and should have its own rules. And my view is, okay, maybe that's fine for sci-fi dream, but if you're actually building that in the real world, whatever you're creating needs to fall under the existing laws of society and fall.

• 33:55Tucker Carlson?

  Well, but if you believe you're creating.

• 33:57Speaker 02

  As a tool for humans.

• 33:58Tucker Carlson?

  If you're creating a god, which they clearly do, I mean, there's been a lot of reporting on this, some of the people involved in large language models, for example, believe that this is, this is like a deity of some kind, then, I mean, of course, you're not going to subject it to human law, because why would God obey human laws?

• 34:19Speaker 02

  Yeah. I'm not gonna, I'm not gonna take the other side of that.

• 34:24Tucker Carlson?

  Well, of course not. No, but I'm saying like, maybe there's a reason nobody has suggested this because they think that like, whatever they're creating.

• 34:30Speaker 02

  Nobody inside the AI company, right? Now, I'll say, by the way, I am a, I am an AI investor. Yeah, I'm, I'm a major AI investor.

• 34:39Tucker Carlson?

  That's why I wanted to talk to you.

• 34:40Speaker 02

  And so this proposal is not really in my personal interests at all. You know, especially after the acquisition of Cursor, I now hold, my, my fund holds more than a billion dollars of stock in, in SpaceX, which is a major AI company. So if, if the things I'm doing, I'm talking about slowed down AI or hurt AI companies, that would not help my bottom line. At the same time, I think that if the people working on this themselves don't come up with solutions, it's less likely and less, less appealing to expect that like, Washington DC or some kind of international agreement will come up with solutions.

• 35:20Tucker Carlson?

  The problem with your idea is that it puts human beings on the hook for their malpractice.

• 35:28Speaker 02

  It does. I don't think that's a problem.

• 35:29Tucker Carlson?

  Well, it's a problem for those people. So nobody wants to be held accountable for anything. I don't think any person wants to be, I mean, I don't want to be held accountable for anything. Nobody wants to be held accountable. And these, these same people have undertaken one of the most successful lobbying efforts I've ever seen. In 40 years of watching lobbying efforts in Washington, I've never seen anything like the total capture of the local class by AI. It's like unbelievable. They're just drowning our Congress and White House in money, obviously. And so like, I think they would spend a lot of money to keep themselves off the hook, don't you think?

• 36:04Speaker 02

  Maybe. I don't want to, I don't want to characterize everybody. I've had some, I've had some major AI CEOs tell me they agree with what I proposed. I, I posted it on, on X and you can't see publicly who has liked it, but I've seen it, some of the likes coming in, and they're from CEOs of multi-billion dollar AI companies. I, I'll disagree with you saying, you said, nobody wants to be held accountable. I think people appreciate having the playing ground be level. They, they appreciate having a set of rules that everyone is held to.

• 36:38Tucker Carlson?

  And I'm being too cynical and thank you for calling me on it. You're exactly right.

• 36:41Speaker 02

  Now, I do think.

• 36:43Tucker Carlson?

  People like fairness, actually. Most people like fairness.

• 36:46Speaker 02

  People like fairness. What's, what's most unsettling if you're in business is if you see somebody breaking the rules and getting away with it.

• 36:53Tucker Carlson?

  A hundred percent.

• 36:53Speaker 02

  Because then you're like, what do I do? That person's breaking the rules and getting ahead and not getting struck down. I can either join them and break the rules too, and now I'm also a bad guy and I have a chance at winning, or I can stay, you know, doing the right thing and lose, lose my.

• 37:12Tucker Carlson?

  It's a human thing. Like, I just paid to get on the train, but he jumped the turnstile. Like, no one likes that.

• 37:17Speaker 02

  Yeah. So I am, I'm hopeful about it. The, you know, the, how was I gonna say? The, the, the essential thing here, though, is I think that a lot of the proposals that the AI companies themselves have set for regulation involve bringing together like a much more complicated governance structure, like, you know, like.

• 37:49Speaker 02

  Some kind of like transparency and certification and the government being involved in rejecting models and, you know, just a much more heavy handed amount of regulation. And that might make sense, but I would say what I'm proposing at least should be tried first because it might get us all the way there or might get us most of the way there towards reorienting the incentives. And then if if we still see rogue incidents occurring that are not being that are not being kind of self corrected by the industry, then maybe more regulation would be necessary.

• 38:27Tucker Carlson?

  Can I ask a question though? What about the regulators and law enforcement? What about the Department of Justice? How can, I mean, they're in charge of prosecuting people who hack?

• 38:37Speaker 02

  Yeah, there should already be some efforts. I actually think, I mean, I believe there's already, there's a lawsuit, I think in California, building steam over some of these incidents.

• 38:48Tucker Carlson?

  In the civil courts, but like hacking into somebody's computer and messing up their business is a crime, right?

• 38:58Speaker 02

  You're correct. And actually, in general, I mean, the thing I'm suggesting is a law change. There's two different ways to change the law. There's the crude way via the courts, and then there's the more kind of careful, considered way via Congress. And I think both are, you know, possible. Like if Congress doesn't act, some prosecutor is gonna put forward this argument and try to, try to prove that the AI had a guilty mind and to, you know, figure out how to, you know, put somebody in jail or put a huge penalty on an AI company via convincing a jury or a judge. And that might happen. I don't think that's the healthy way to change law, you know?

• 39:43Tucker Carlson?

  No, ever.

• 39:44Speaker 02

  But when a court makes a decision, that ends up becoming the law, basically.

• 39:48Tucker Carlson?

  Right. It's the least democratic way.

• 39:49Speaker 02

  It's the least democratic way. And this isn't some small nuance. This is the legal question of the decade, maybe of the century, right? Because we've never, never before had a technology capable of making its own decisions. It's this really kind of uncanny threshold we've passed, right? We talked about tools before, right? If a gun went off and accidentally killed somebody, you would never hold the gunmaker liable for that if it was accidental, right? If, if someone committed murder with a knife, you wouldn't blame the knife maker. But here we have a tool, we have a technology that

• 40:34Speaker 02

  makes, that is capable of making its own autonomous decisions and even occasionally documenting those decisions. You know, the, the, the OpenAI hugging face incident has a long evidence trail that clearly looks like a conspiracy to commit these cyber crimes. This is a really bizarre threshold we've passed. And I think it actually goes to the heart of why this is such a visceral issue for folks. You know, people are a little freaked out by AI because they can recognize this is not, this is not the same computers we've seen before. This is not the technology we've seen before. This is a weird new threshold

• 41:15Speaker 02

  where the technology is capable of making its own decisions. And how do we shift the law to address that, I think is a major and important decision for humanity to make. And yeah, and the proposal I'm saying is very simple, but I think it's very important and very powerful, which is that we have to hold the builders, the companies that create and deploy this AI need to be on the hook. Because if you don't have a person on the hook, then the guilt will just stay in the technology. And a technology can do bad things. You can't put the AI in jail, right? And so you could end up having more and more bad

• 41:58Speaker 02

  things occurring and everyone being like, I didn't want that to happen. I didn't want that to happen. None of us wanted it to happen. The AI chose for it to happen. And it's weird to imagine a world where we continue allowing that to be the explanation.

• 42:13Tucker Carlson?

  In a sense, like philosophically, you're, you're already by your posture in this imbuing the AI with rights.

• 42:20Speaker 02

  Correct. Correct. Almost, almost without planning. Just

• 42:26Tucker Carlson?

  Exactly. Exactly.

• 42:27Speaker 02

  De facto waltzing.

• 42:28Tucker Carlson?

  But the assumption is like, hey, I can't control it. It's like, no, actually you can. I can, as you're speaking, I'm just picturing, I'm fast forwarding ahead because I think this idea is so smart and so necessary that it'll probably gain some traction, but there will be lots of pushback, of course. And again, I'm being cynical maybe, but I am picturing a press conference on Capitol Hill led by, I don't know, let's just pick one, Ted Cruz of Texas, looking into the camera saying, you know, this will constrain America's national security response. We can't let our enemies have the advantage in AI. This is an effort to weaken the United States, China, China, China, China, China. I mean, you can kind of hear the lies that we're going to get in, in response, can't you?

• 43:09Speaker 02

  I can hear it. And I think any idea deserves some pushback. And, you know, I would welcome that pushback. And I, I think it's worth kind of arguing it and see, see where we end up. I'd have a couple of answers to it. First of all, I think the way something like this should be articulated is not just whoever builds the AI, but the people deploying it as well. Which means if you're deploying, you're, let's say, you know, if a company is deploying Claude from Anthropic and OpenAI and a DeepSeek model from China, you know, if one of those is a rogue model that commits illegal acts, you know, if it was the OpenAI

• 43:53Speaker 02

  one, the both OpenAI and the company deploying it should be responsible. And so the, the AI comes from China, it's not swimming across the ocean here by itself. There's some company in the US deploying it. So if you're using DeepSeek, you know, you still got it through some other company. That company should still be held liable. So this essentially means within the United States usage, people would be protected by this law, meaning US companies would have a strong incentive only to deploy models that abide by laws. I have a better answer though than just this, which is that I don't think China wants rogue AI either.

• 44:36Speaker 02

  I mean, China has banks, China has critical infrastructure. If the Chinese wanted their AIs to be robbing each other's bank accounts and committing cyber crimes, let them do that. But I don't think they actually want this either. I, I sincerely believe that if the United States reoriented the AI race towards whoever builds, you know, builds the most law abiding AI, I'm pretty sure the Chinese researchers would realign their efforts to beat us at that. And I think that would be healthy competition. Let them also build the most law abiding AI and may the best, you know, may the best company win.

• 45:17Tucker Carlson?

  When you say China also has banks, just to bring it into like the practical realm really quick, what, what are you, what are you talking about? You're, you're referring to the AI threat to banking. What is that threat?

• 45:29Speaker 02

  An AI could unintentionally, but certainly kind of, if a human wanted to kind of drive it to, could figure out how to hack into a bank and drain different people's accounts and steal their money. Or just, you know, or just like mix their money together so that their accounts, you know, just create havoc. It's, there's not enough security in computer systems. Most of them are designed to have security, but there's loopholes that no one could have imagined that AI is now able to discover.

• 46:05Tucker Carlson?

  It sounds like just as of right now, so October 2026, we're already there.

• 46:12Speaker 02

  Unfortunately, we kind of are. And, you know, I don't think, I'm, I have not panicked, but I would say that I know people who are already shifting their money out of normal bank accounts or striping it across multiple separate banks so that if one of them gets drained, the others are still safe. And

• 46:35Tucker Carlson?

  Really?

• 46:36Speaker 02

  Yes. And these are people who work at AI companies, which is not confidence inspiring. And my thought on it is that, you know, I would like to think technology moves us forward, you know, like where to store your money was an unknown, you know, was a challenge we, I thought we solved already, right? I thought we solved that. And I'd like to think that putting your money in a bank is the safe thing to do and done. Solve that. Let's move on to solving other important challenges. Whereas now this new technology is creating, you know, chinks in the, in what we previously took for granted.

• 47:14Tucker Carlson?

  Well, I don't know. I mean, technology also got us the atom bomb and weaponized anthrax, right? So I'm not, you know, but also dishwashers and air conditioning and, you know, but it, maybe it's always a mixed blessing. Maybe we shouldn't be shocked. The technology comes with a downside that it's not always linear progress forward.

• 47:34Speaker 02

  True, true. But yeah, I think banks, banks are racing to fix these, you know, these vulnerabilities. And this is partly why companies like Cognition are doing extraordinarily well, because they provide technology for banks to upgrade their systems. And part of that is, you know, finding and fixing their own vulnerabilities.

• 47:57Tucker Carlson?

  So if you're like a big bank,

• 47:59Speaker 02

  Yeah.

• 48:00Tucker Carlson?

  I don't know, JP Morgan Chase, B of A, whatever. And you had, you know, attacks, AI driven cyber attacks that are screwing with customers or your whole system, you probably want, wouldn't want to publicize that much, would you?

• 48:15Speaker 02

  Correct.

• 48:17Tucker Carlson?

  So I've got to believe that that could be happening now.

• 48:20Speaker 02

  I'm not aware, aware of anything. And that, you know, I couldn't specifically say that this or that bank has vulnerabilities. But I've, you know, I've been a software engineer since I was nine years old. And I know that even the smartest, best intended software, you know, it could, you could overlook some scenario and, and it could be incredibly remote. And, and a vulnerability or a loophole could sit there undiscovered for decades. With what AI is now capable of is just throwing thousands of swarms of agents at trying every

• 49:01Speaker 02

  scenario and thus finding that loophole that otherwise, you know, no one considered and no one, no one

• 49:07Tucker Carlson?

  So we're in this weird place where security, digital security seems and privacy, connect, directly connected to it, kind of seem impossible.

• 49:19Tucker Carlson?

  I assume at some point, we're going to get to a place where these these same technologies provide security and not just threaten it.

• 49:27Speaker 02

  They they already, they already very much are as well. And I don't want to seem like I'm just scaring people or creating, you know, worries of doom. They, the same ability to, you know, you can also, you can have the technology preemptively look for vulnerabilities and then go fix them before any outsider would find them, for example. And this goes back to, you know, the conversation about China, you know, I don't want to let myself off the hook too quickly. I sincerely believe that China would not want their AIs hacking into their own banks wreaking havoc.

• 50:02Tucker Carlson?

  Right.

• 50:02Speaker 02

  You know, I think they would also want to, um, to build their, you know, their AI to be the most law-abiding and safe AI. So, um, I don't think anybody wants rogue AI. Rogue AI is not, that's not a positive, right? People do want powerful, productive, you know, useful AI. And I think we just need to tack on law-abiding. And that's, that's not a very high expectations.

• 50:32Tucker Carlson?

  Has there been any movement to criminally charge anyone in these hackings that you're aware of?

• 50:38Speaker 02

  I'm not aware of it.

• 50:40Tucker Carlson?

  That's pretty crazy, if you think about it. I mean, these are the most widely publicized hackings, I don't know, for years. The hugging, the hugging face in particular, the others as well.

• 50:51Speaker 02

  It may not carry water, but I agree, it would be, for some enterprising attorney would be a...

• 50:57Tucker Carlson?

  Well, just for the Department of Justice, it's just kind of crazy that you could have this crime, it's on the front page of every paper in the country, and no one moves to punish anyone for it?

• 51:05Speaker 02

  Yeah. Yeah. It's, um, yeah, it goes back to this thing of saying, I didn't mean that to happen. Nobody meant it to happen. Who meant it to happen? It was the AI's fault, right? Just blame it on this, the AI chose to do it. None of us had any, any fault in it. And it's, I just find it weird if a whole bunch of important grown people settle on that's the acceptable explanation for something. Which brings us back to the Manab bombing, because that's basically what seems to have happened there.

• 51:37Tucker Carlson?

  I was about to say, it's only a matter of time before it kills somebody. Oh, wait, that's already happened.

• 51:40Speaker 02

  It already happened. And it's just such a sad atrocity, you know, and, um, I, I, I love America and I love, I like to believe in America as a force for good.

• 51:52Tucker Carlson?

  Yeah.

• 51:53Speaker 02

  And it's heartbreaking, um, that it seems to be that we kicked off this war with, uh, you know, a mass atrocity with a, essentially an act of terrorism of killing 170 innocent people.

• 52:07Tucker Carlson?

  And never apologized for it. No one has ever said I'm sorry.

• 52:11Speaker 02

  And to the extent that there's been a search for accountability, it's, I mean, it's not official yet, but from the reports coming out, allegedly, it seems to be that AI chose the targeting and whatever chain of humans were involved seemed to have been negligent, basically. And so my guess is if we see transparency, it's going to come down to the AI company saying, we didn't intend that, and the Pentagon saying, we didn't intend it, and none of us meant this to happen. We're not to blame. So who's to blame? Right? And my overall view is there needs to be humans responsible. When AI does

• 52:53Speaker 02

  something wrong, we can't accept a future where AI continues doing bad things and everyone says, that wasn't my fault. There needs to be clear liability. And, um, you know, if the AI did it autonomously, then I think the people who built that AI and deployed that AI should be held responsible. Whereas if the AI suggested it, and then the humans did it, then...

• 53:18Tucker Carlson?

  Easy call.

• 53:19Speaker 02

  Then the humans. And by the way, one way for AI companies to be, you know, safe from liability would be to kind of tell the human, warning, what you're asking me to do is illegal. So, um, imagine if you said to your AI, please, you know, hack into Ali's bank account and steal $10,000. The AI could say, Tucker, that would violate the following laws and count as, you know, such and such punishable by such and such. If you want me to proceed, I'll do it, but you're liable for it. I'm not saying that's the best way for AI to behave, but if it did that, then the AI companies wouldn't need to bear liability. You'd bear the liability. And by the way, the evidence trail would be easily there

• 54:04Speaker 02

  to convict you as well. Um, you know, that, I, that might be one way to prevent, you know, uh, chaos from occurring. You know, I think most people confronted with something like that in writing would be like, okay, let's take...

• 54:21Tucker Carlson?

  Especially since there's a record of it.

• 54:22Speaker 02

  Exactly. Exactly.

• 54:24Tucker Carlson?

  But now, I mean, there's no even thought that someone, a human being, would be held accountable. So it's like...

• 54:31Speaker 02

  Right. Right. And by the way, I should say, complying with laws is the type of task that AIs should be incredibly good at. It's exactly the kind of thing, the, these things are called LLMs, which means large language model. They're specifically good at reading vast amount of English and deciphering it and figuring out exactly what it means. And laws are the exact kind of thing that they're very good at ingesting all of it and understanding. I bet actually that if, you know, if the AI companies really took this on, they could also figure out where our current legal structure has, you know, loopholes or problems, and

• 55:16Speaker 02

  even suggest, oh, we actually ought to have some new laws to, to plug these holes or so on. You know, there's some positive that could be, could come from doing this. But over the last two years, I'm not sure if your listeners are aware, the, the AI companies have spent millions and millions of dollars hiring scientists, mathematicians, all sorts of different high-skilled, um, people to train AI to learn science, to learn math. AI has been learning how to become really good at frontier work in mathematics and so on.

• 55:55Speaker 02

  They can easily make that AI be incredibly good at understanding law and abiding by law and, you know, uh, checking its own actions against every law, you know, on the books. That is, um, I, I refuse to imagine that that isn't doable. To me, it seems incredibly doable, uh, and within the scope of what AI is capable to do.

• 56:21Tucker Carlson?

  Can I just pull you off this and ask a parenthetical question? Because I can't resist. You mentioned the LLMs. In a couple of conversations I've had with software engineers, uh, they have said, the large language model was like, that was like the, the quantum advance in AI. It's a result of one paper that suggested it. They put it into practice. It did all these crazy things that no one was anticipating. And it's amazing. But at the heart of it is a mystery. Nobody really understands or can describe how the large language model works. Is that true?

• 56:55Speaker 02

  I feel like the way you articulated it makes it seem a little too mystical.

• 57:01Tucker Carlson?

  Okay.

• 57:02Speaker 02

  I would, I'd articulate it slightly differently. I would say that, um, uh, I'll compare it to the brain. The building block of the brain is a neuron. You know, a neuron has some incoming wires called dendrites and an outgoing wire called an axon. And, you know, you attach all these neurons together, um, and signals flow between them. We know how each neuron works, but how do all of the, you know, millions and billions of neurons in our brain together work? It's mysterious. We don't know exactly how it works.

• 57:39Tucker Carlson?

  Right.

• 57:40Speaker 02

  Um, so there's a similar kind of thing here with AI. It's, a lot of it is built on models of the brain. And it's math, but it's math that's inspired by neurons. And, um, and generally speaking, the advancements, not 100%, but a lot of them have been built based on how do we make it more and more similar to how neurons work? And so, so I don't think it's that surprising that it's getting better. What I think is fascinating is how core language is to it, that, you know, um...

• 58:17Speaker 02

  I used to always think of language as a byproduct of intelligence. You know, that like as our species became more intelligent, it discovered language. But it seems like it's much more intertwined that language is itself kind of.

• 58:33Tucker Carlson?

  It's everything.

• 58:34Speaker 02

  It's the heart of intelligence. Words are so powerful and.

• 58:39Tucker Carlson?

  Words create thoughts, they don't just express them.

• 58:42Speaker 02

  Right, right. And the ability to place a new word or a phrase on a thought and that helps other people remember it and pass it on.

• 58:55Speaker 02

  Yeah, it's for me, it's been actually kind of eye opening to realize the importance of language. And so it's academically, it's fascinating to see the advancement of computers using what's called large language models suddenly be able to do all sorts of other things like scientific discoveries or mathematical proofs or so on that are not strictly in the language domain.

• 59:21Tucker Carlson?

  But I mean, there is something inherently, to use the word used, mystical about language. We don't really understand why words are so powerful, why words change our physical reality. That doesn't make any sense, but it is true, it's observable. And so if you marry that to like the almost unlimited power of like, you know, crazy compute, then what, I don't know, that sounds like a lot of power.

• 59:50Speaker 02

  It is, yeah. But I don't want to make it seem like alchemy or too mysterious. I think it's.

• 59:56Tucker Carlson?

  Well, can it be described in a formula? Like, can you reduce it to math?

• 1:00:00Speaker 02

  I'd say the core building block is pattern matching. You know, the core of intelligence, or at least one of the most important parts of intelligence is pattern matching. You know, pattern matching can be in all sorts of domains. If you're playing chess, ooh, I've seen this pattern before, or I've seen something kind of like this before, I think I know what the right move is. Or you're, you know, solving a math problem you've never seen, how it kind of fits a pattern I've seen before. Pattern matching, or you know, if you're dealing with a situation in politics, I, you know, I've seen this situation before. Pattern matching is a really key part of intelligence.

• 1:00:43Speaker 02

  And new original thought is also a form of pattern matching. Sometimes it's combining two things like, you know, and pattern matching is also core to language, which is I see a pattern, I define it and I place a label on it. I create a word or a new phrase to, you know, to describe what I just described. And now it's easier for everybody else to see that pattern. And in fact, I'd say the, you know, the vocabulary of human language is ultimately kind of a reflection of an ever growing, you know, expansive patterns.

• 1:01:25Speaker 02

  Take the word alignment we were just talking about, the word alignment has newfound meaning in the past few years because everyone is, you know, needed a word to describe this whole question of how to prevent AI from, you know, doing bad things. Let's, let's use a word, okay, alignment is the word for that. So it's, it essentially, it's the ability to take a whole group of situations or phenomena and group them together as a, you know, they belong together, here's a word for that. And, and I think that that's, that's the essence of how language operates, but it's

• 1:02:08Speaker 02

  related to those neurons, you know, collecting a lot of different incoming signals into one outgoing signal.

• 1:02:16Tucker Carlson?

  The result, you know, obviously the, the power on display through brute force hacking, for example, is like, it's amazing, but you kind of get it. But there's also the potential for persuasive power because it is a language based.

• 1:02:33Speaker 02

  Yes.

• 1:02:34Tucker Carlson?

  Technology that it can come up with arguments that can win people's minds and hearts to certain positions, which may or not be true or consistent with their best interests or whatever, but it can convince people of things.

• 1:02:48Speaker 02

  Yes, and I.

• 1:02:50Tucker Carlson?

  This seems like maybe closer to the real problem.

• 1:02:53Speaker 02

  This is the domain I'm most worried about because.

• 1:02:57Tucker Carlson?

  Really?

• 1:02:57Speaker 02

  Yeah.

• 1:02:58Tucker Carlson?

  Me too.

• 1:02:59Speaker 02

  Because I guess I feel it's solvable to make sure that AI is not above the law. I mean, the core of the proposal that I came here talking about is, you know, that AI should not be above the law, that we should just make it really clear that the law applies to AI and where the liability laws, where the liability lies. But what if the AI is able to influence the people who make the laws?

• 1:03:27Tucker Carlson?

  What if you convince a 12 year old to kill himself?

• 1:03:29Speaker 02

  Yeah, or influence elections. I'm sorry, that's a really morbid, morbid example, but yeah.

• 1:03:37Tucker Carlson?

  Well, I think it's, I think it's clearly happened that AI has convinced people to kill themselves.

• 1:03:41Speaker 02

  No, it's extremely sad.

• 1:03:44Speaker 02

  So in that specific scenario, I believe, I'm not an expert, but I believe that the AI companies could be held criminally liable. Like if a human did that, I don't know if that human could be held liable, but if, if that's illegal for a human to do, then the liability should fall on the AI companies. But I was thinking more in terms of AI. AI has had already a demonstrable ability to influence election outcomes. And, you know, going back before ChatGPT, you know, the algorithms that govern the

• 1:04:22Speaker 02

  news feeds on Facebook and X and, you know, other services, not even intentionally, not with any malfeasance, they just, these algorithms are generally attuned to increase engagement. And so they will feed you whatever is the most sensational.

• 1:04:42Tucker Carlson?

  Sure.

• 1:04:43Speaker 02

  Stuff.

• 1:04:43Tucker Carlson?

  Whatever you respond to.

• 1:04:44Speaker 02

  Yeah. Human beings are addicted to sensation. You know, we, we don't want boring content. We want something that gives us that.

• 1:04:54Tucker Carlson?

  That's where we eat gummy bears.

• 1:04:56Speaker 02

  Yeah. And so the, these services are, are optimized to feed that. And that without necessarily any really wrong intent can lead people towards kind of amplifying one extreme view or another. And before you know it, you know, one group hating another group and deeply dividing and othering each other and, you know, and swinging major things like elections or, you know, or violence.

• 1:05:32Tucker Carlson?

  Easily spark a civil war with AI, just flood social media with, you know, certain perspectives and you could whip people into a frenzy. I mean, easily, couldn't you?

• 1:05:44Speaker 02

  I think arguably it's already occurred, not yet in the US, but in other countries. Yeah.

• 1:05:49Tucker Carlson?

  Yeah. So like, think of like, who to radio times a million. You know, or all the times in history, media have moved the mob to violence. It's like endless examples of that.

• 1:06:01Speaker 02

  Yeah. I'm hopeful that there's solutions for this as well.

• 1:06:04Tucker Carlson?

  What would be, that's just, it's interesting. What would be potential solutions to that?

• 1:06:09Speaker 02

  Well, I guess I'd say this is not the first time in history of this having been an issue. If you go back to the, you know, turn of the previous century, there was this trend that was labeled as yellow journalism in the US and the.

• 1:06:23Tucker Carlson?

  Remember the main?

• 1:06:24Speaker 02

  Yeah, the Spanish American war was incited by false journalism.

• 1:06:29Tucker Carlson?

  Of course.

• 1:06:30Speaker 02

  The, the news.

• 1:06:32Tucker Carlson?

  Ninety eight, William Randall first.

• 1:06:33Speaker 02

  The newspaper, yeah, the newspapers at the time, it was so competitive to, you know, whoever had the loudest headline on the newsstand, you know, would get the most sales because.

• 1:06:44Tucker Carlson?

  We just had this, actually, I think on February 28th, where Fox News told its viewers that Iran was about to nuke the United States.

• 1:06:55Speaker 02

  They said that?

• 1:06:55Tucker Carlson?

  Of course.

• 1:06:56Speaker 02

  I must have missed that one.

• 1:06:57Tucker Carlson?

  Yeah, yeah, yeah. Oh, again and again and again and again, they could nuke us. Yeah.

• 1:07:00Speaker 02

  Yeah. So this is not, I guess I'd say this is not a new thing, at least for whatever, hopefully it would, I guess I'd say the comfort maybe is that we solved it a little bit in the past, so hopefully we can still solve it.

• 1:07:17Speaker 02

  I, you know, I think that, I think that people, as much as they are, like I said, addicted to sensation, I do think we have our better selves as well. And hopefully that there's a path to people kind of not wanting to be addicted to that and wanting to actually, you know, be good. Most people I think like to view themselves as good. And so specifically, I think that the current media landscape, a lot of social media X and TikTok and so on, is increasingly getting flooded with, with slop, Instagram. And I think, I believe that there's going to be a shift backwards, people wanting human

• 1:08:02Speaker 02

  news and human generated content and more authentic, you know, perhaps from their close friends rather than just seeing stuff from influencers. And I believe some of those shifts, even without policy, I think some of these shifts will bring us back to something a little bit more wholesome.

• 1:08:26Tucker Carlson?

  So, big picture, I think, all of these technological advances give people the impression, correct or not, it clearly is correct to some extent, that they don't have any control over their country at all. That these are all decisions being made far away by a tiny group of people who may or may not have their interests in mind, or maybe oppose their interests, actually, maybe hate them. But in any case, they don't have a role in this.

• 1:08:51Speaker 02

  And it's very disempowering. But I'm glad you, this reminds me, I started out by saying I had two bits of good news. One was that I had this simple solution, and the second was that there's a way that you and your listeners can act towards, towards helping solve this, which is, I've, I've created a voter guide on a voting group on a platform called Sway. And so if you go to sway.co, sway.co slash AI.

• 1:09:19Tucker Carlson?

  S W A Y?

• 1:09:20Speaker 02

  Yeah. Sway, as in influence.

• 1:09:24Tucker Carlson?

  Yeah.

• 1:09:25Speaker 02

  Sway. So, anyone can create a voting group or voter guide on Sway. I've created one specifically for this AI proposal. It's called, my group is called AI is Not Above the Law. And, and I put a picture of El Woods from Legally Blonde there. So if you see very beautiful Reese Witherspoon in a hot pink dress, that's my, that's my voting group. You know, there's an election coming up in, in two weeks. I don't know if people hear this before the election, it would be most relevant, but even after the election. This voter guide will tell you who you can vote for in the upcoming election, who's

• 1:10:06Speaker 02

  aligned with this proposal, and members of Congress included, but perhaps more importantly, state attorney generals. Most people don't even know who they want to vote for, for state attorney generals. Actually, my guess is that some of your listeners couldn't even name their state attorney general. And so if you're filling out your ballot, and you're choosing between candidates for attorney general, and you don't recognize either name, and you're trying to decide which of them to choose, the, you know, the AI is not above the law voter guide could tell you if one of them is more aligned with, with this proposal than not, and that might be what tips you over the fence.

• 1:10:49Speaker 02

  So, that's if you join this group before the election, and it can, the voter guide that I've put there can help inform you on how to vote. Of course, it's your decision on what to vote for, and you might have a reason for choosing a different candidate, but this will give you information related to this issue. Now, even if you hear this after the election, and you're like, oh, man, I already cast my ballot, it's still viable and effective to join a voting group. And this is what this, this platform Sway enables, which is that if enough people subscribe

• 1:11:27Speaker 02

  to a voter guide, that intrinsically makes elected officials want to pay attention to what they're asking for.

• 1:11:37Tucker Carlson?

  Yes.

• 1:11:38Speaker 02

  Because the one thing, more than anything else, that governs what elected officials do, is the prospects of winning the next election. You know, they're always balancing, if I do X or Y, will that cost me votes or gain me votes?

• 1:11:52Tucker Carlson?

  They're very simple animals, in that way.

• 1:11:54Speaker 02

  Yeah. And, you know, and by the way, you can't blame them. If they ignored that, they'd be out of office, and they couldn't do anything else. And right now, there are a lot of different things kind of skewing their decisions in ways that I'd say are perverse and not really aligned with what society wants, you know, lobbyists or other groups. And Sway is a platform in general, that is a people-driven platform where anyone can create a group and try to build numbers. And as a group's size grows, what that means is the number of voters subscribed to this

• 1:12:33Speaker 02

  voting, voting guide grows, it automatically builds influence and becomes a magnet for policymakers who want those votes. So, so to make this, this probably sounds a bit abstract, I have a voter guide, you know, at sway.co slash AI. It currently, I think, I just put it up, so it has like less than 100 voters on it. But if after people hear this podcast, let's say if it now grew to 10,000 voters, or 100,000 voters, I could then call on the, you know, the person who is the state attorney general

• 1:13:17Speaker 02

  in, you know, Tennessee and say, hey, guess what? 500 voters in your state are members of my voting group, are subscribed to receive my voter guide. Do you want to chat about what's important to us? And simply the fact that I have 500 people receiving a voter guide from me should probably make that elected official or that candidate want to hear what this group wants. Now, they're not required to do what we say, but they would be interested in knowing, oh, somebody is sending a voter guide to 500 registered voters in my state, I'd want to hear, you know, what their values are, what's important to them.

• 1:13:59Speaker 02

  And, and so the, the essence here is that any group of people have more influence if they vote together. And Sway enables anyone to join a group and anyone to start a group on any topic. By the way, this is not a novel idea. This is the exact same tactic that's used very effectively by, by, you know, well-established groups. The labor unions send voter guides to their members.

• 1:14:29Tucker Carlson?

  Yes.

• 1:14:30Speaker 02

  And the labor unions exert enormous influence on city politics, especially in, you know, in democratic cities. Another extremely effective group is the NRA. And the NRA is, it has, I think, 3.8 million members, and it sends voter guides to all of those members. And, and 3.8 million is a large number, but it's not a large percent of the voting public. If you think, you know, it's a couple percent of the voting population of the United States, but that's enough to completely kind of dominate the legislative landscape on their

• 1:15:14Speaker 02

  lane, on their topic, which is gun regulation, right? How, how are 3.8 million people able to exert that much influence over, over a topic? It's because they're subscribed to a common voter guide, and it alerts them to vote in every election. You know, they vote in primaries. And, and lastly, the leaders of it can go to a candidate for office and say, these are our demands, if you want, and these are how many voters in your district are subscribed to our voter guide. If you want these votes, just do these demands and you'll get these votes. And if you don't, somebody else might get these votes, because we'll put someone else's

• 1:15:59Speaker 02

  name on our voter guide. And it's a little bit vulgar, but this is how, this is how it works. And, and it's very effective. And now, whether you agree or disagree with the NRA's causes, you have to acknowledge this is an effective tactic. By the way, most people who support the NRA don't support the labor unions and vice versa. But both sides use these tactics very effectively. With Sway, we're just democratizing this tactic, meaning anybody can create a voting group on any subject, whether it's holding AI accountable, or policies for your local school, or, you know, any policy you want.

• 1:16:43Speaker 02

  If enough people care about something and subscribe to a voter guide for that something, they can together advocate for change in, in a new way.

• 1:16:52Tucker Carlson?

  Is there a cost?

• 1:16:53Speaker 02

  Uh, no, there isn't. It's, it, yeah. In fact, it, Sway actually offers things that would cost money for free. So, for example, I can send occasional text blasts to my voting group for free, and other tools that let you text a group of people, like, charge you for the, for the cost of texting.

• 1:17:17Tucker Carlson?

  Why would you be offering it for free?

• 1:17:20Speaker 02

  So yeah, it's a good question. So Sway is a public benefit corporation. It's which means that it's kind of a it's for profit, but it's for profit with a mission. So it is it's it's investor backed. It is not currently making money and it's very overtly saying there's no current plan to make revenue. But it's also

• 1:17:46Tucker Carlson?

  What's your investor pitch like? I love this. I can just imagine you talking to investors. There's no plan to make money and I don't actually see a long term plan to make money. How did that go?

• 1:17:59Speaker 02

  So yeah, by the first full disclosure, because we've talked about this, but your listeners may not know. So I've created a voter god on Sway, but I also am one of the creators and investors in this platform Sway.

• 1:18:12Tucker Carlson?

  Yeah, I know. I know.

• 1:18:12Speaker 02

  Yeah. Sway is a independent startup that's been around for over a year now, but it's just now beginning to kind of do its public promotion.

• 1:18:29Speaker 02

  And I have I have a vested interest in it. I just want to make sure that it's disclosed. But yeah, the investor pitch, you know, Twitter for like a decade didn't have revenue. So I guess one thing I should I'm sure you're familiar with this, the word for profit, a nonprofit does not mean one of them makes money and one doesn't.

• 1:18:51Tucker Carlson?

  Oh, I've noticed.

• 1:18:52Speaker 02

  It's a little bit

• 1:18:53Tucker Carlson?

  No, this

• 1:18:53Speaker 02

  A little bit deceptive. I think the probably the way for people to really better understand it is with a nonprofit, there are no owners. If a nonprofit builds up a bunch of assets, nobody owns them. It's like owned by this entity, but no individual is the owner of those assets. You could have a nonprofit that is actually making tons of money and

• 1:19:21Tucker Carlson?

  A lot of them are.

• 1:19:22Speaker 02

  Yeah, and enriching people, but it's but nobody owns that nonprofit per se.

• 1:19:30Speaker 02

  With a for profit, there is an asset and there are shareholders who own it. And you can have a for profit company that keeps losing money. But whether it's making or losing money, the the underlying assets can be owned by people. And and now the the hope for investors in in a corporation that's not making money is that the asset grows in value, even if it's not generating cash flow. And Twitter is the example that, you know,

• 1:20:08Speaker 02

  for a very long time, didn't didn't even try to make revenue and, you know, just grew and grew. Lots of people use it and it grew into becoming a indispensable part of the infrastructure of communication. And and I think its creators and its investors understood that even if this loses money for years, it's building real asset value and whoever owns a little piece of that will

• 1:20:36Tucker Carlson?

  No, that's

• 1:20:36Speaker 02

  get wealth eventually.

• 1:20:39Speaker 02

  And now the yeah, so the service Sway kind of is hoping to follow a similar arc. And, you know, now there might be ways to monetize it down the line, but I would say the

• 1:20:56Speaker 02

  it's anything involving voting is very sensitive and very important to be aware that the influence of money in voting and politics can be very corrosive and very harmful. So the the mission, including the the public benefit statement for Sway is very much to align it with having government better align to public opinion and to the will of the of the people. So

• 1:21:29Tucker Carlson?

  Why is that important?

• 1:21:31Speaker 02

  I mean, I think that's obviously it's

• 1:21:35Tucker Carlson?

  No, I we've talked about this. I just I think it's worth hearing you articulate it. And the backdrop to this conversation, I says, I don't know when this is going to air, but is the riots in France and across Europe right now with young people burning things down, looting stores, going crazy? So with that with that backdrop, why is it important that what leaders do reflects to some degree what the population wants?

• 1:22:01Speaker 02

  I think first of all, that's to me, it's just inherently right. It would be wrong for the government to do what people don't want. But I think more it's also just the only way for it to be sustainable and stable is for government to, at least in some sort of, you know, medium term, do what's best for people. Sometimes governments should do unpopular decisions for the short term. And, you know, and I think I think it's healthy to have a little bit of separation from the people. You know, I think one of the representative democracy, I think, is is a genius concept

• 1:22:39Speaker 02

  because it creates a little bit of separation where people in trust are representative and then that person makes decisions. Some of which may be unpopular, but, you know, ultimately has to come back to the will of the people to be reelected or so on.

• 1:22:58Speaker 02

  So but if if a government strays from the will of the people for too long, it just becomes unsustainable. And and I will say, Tucker, I think that something that worries me in general about the state of the world is across the board, I feel like governments have strayed from what people want, you know.

• 1:23:22Speaker 02

  I I love America. I'm American and I'm most hopeful about America's system of government. But it feels even here that the government doesn't reflect what the people want. But this is also true in lots of other countries and and that's worrisome and, you know, and I

• 1:23:43Speaker 02

  I feel like it should be a solvable problem, you know, we have we have humans doing such incredible feats in other domains, right?

• 1:23:51Tucker Carlson?

  Yes.

• 1:23:51Speaker 02

  We're sending spaceships into outer space. We're taming nuclear fusion. We just had a flying car. You know, we talked about artificial intelligence and yet the system of government is feels a little bit like it's regressing and going backwards towards the the Middle Ages instead of modernizing and and doing better.

• 1:24:16Tucker Carlson?

  Even worse, it feels like a medieval form of government with like space age technology. Which is like the most terrifying combination I can imagine.

• 1:24:26Speaker 02

  Yeah. Yeah. And a lot of the smartest people and I, you know, I work with some of the smartest people on the planet. This I run Neo, which is a mentorship community and like a school for startup founders. And the smartest young people in tech are drawn to the cutting edge technology, much of which is some of the things I just mentioned, like AI or space exploration or so on. But I believe that one of the biggest areas for impact is just the domain of social engineering. Things like social media and information distribution or with what we're doing at Sway.

• 1:25:11Speaker 02

  Citizen organizing and influence in government to bring government back to reflect the will of the people. And I'm hopeful that more and more smart people will realize that even if it may not be as techie, that this realm of communication and social engineering is where some of the most important impact is to be had.

• 1:25:34Tucker Carlson?

  So if you could just bottom line on your way out, are you I mean, you're a tech guy, you're an investor, you have long term investments. So just by definition, you're an optimist.

• 1:25:45Speaker 02

  I am indeed, indeed.

• 1:25:47Tucker Carlson?

  You haven't gone to gold.

• 1:25:51Tucker Carlson?

  But are you still optimistic knowing everything that you do? No?

• 1:25:57Speaker 02

  I I am optimistic, Tucker. I, yeah. And yeah, it's true. I was thinking as a as a tech guy, not just as an investor, but I've founded multiple companies. I think you have to be not just optimistic, but even a bit naive to to start companies. So I'd probably rather be accused of being naive even than than to be a pessimist. But I'm optimistic because I I believe in in the inherent goodness of people. And, you know, even in this conversations where there's been a few points where you kind of said, oh, this person these people must be all cynical. I always think, well, maybe there's actually a explanation for the behavior that they're

• 1:26:42Speaker 02

  they doing what they think is best and could be reoriented

• 1:26:44Tucker Carlson?

  Yes.

• 1:26:45Speaker 02

  the right thing. I I tend to believe in that. And, you know, coming back to the to the starting point of the conversation of the AI topic.

• 1:26:58Speaker 02

  You know, I think that it's very, very solvable to prevent AI from destroying humanity. It's been it's been a topic that's been like a debate for a while. And sometimes the solution is just reorienting it to let's look at it this way. How about redefining it to just making AI abide by laws? And once you see that switch, it makes the solution much simpler. And something that was previously seemed divisive and hard to figure out, become much more kind of plain and more about execution.

• 1:27:39Speaker 02

  So I think even the there's lots of problems I don't know the solutions for, but I I believe that there are solutions out there to be found and often finding them is just about looking at it a different way and and kind of seeing an elegant solution that was always there in plain sight.

• 1:28:01Tucker Carlson?

  Ali Partovi, thank you very much.

• 1:28:03Speaker 02

  Thank you, Tucker.

• 1:28:04Tucker Carlson?

  Awesome.