The peril (and promise) of AI with Tristan Harris: Part 1

When Tristan Harris co-founded the Center for Humane Technology in 2018, he was trying to educate tech leaders and policymakers about the harms of social media. But today, he’s sounding the alarm about a different technology — one that he says could pose an existential threat to the entire world … Artificial intelligence. This week on How I Built This Lab: the first of a two-episode series in which Tristan and Guy examine the serious risks posed by the rapid development and deployment of AI — and what we can do to make sure this powerful technology is used for good. You can learn more about “The Social Dilemma,” the 2020 Emmy-winning docudrama featuring Tristan, here: https://www.thesocialdilemma.com/. This episode was researched and produced by Alex Cheng with music by Ramtin Arablouei. It was edited by John Isabella. Our audio engineer was Neal Rauch. You can follow HIBT on X https://twitter.com/HowIBuiltThis & Instagram https://www.instagram.com/howibuiltthis, and email us at [email protected] mailto:[email protected]. See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Guy Raz?

  Our presenting sponsor today is Anthropic, the team behind Claude. Every founder on this show started with a hard question. Not the marketing plan, the 2 a.m. kind. Is this idea any good? Am I the one to build it? Should I quit my job? Anthropic got built the same way. A public benefit corporation founded on one hard question. How do we make sure AI goes well for people? So they asked over 100,000 people their hopes and their fears and are publishing what they find, even the uncomfortable parts. Me? I've got my own hard question about AI. Here it is. If everyone has access to something that can help them write the business plan,

• 0:46Guy Raz?

  build the prototype, analyze the market, maybe even come up with the idea, what separates the people who actually build something from everyone else? I don't have a clean answer yet, so I've been sitting with it with Claude. There's hope in hard questions. Ask yours at claude.ai/hibt. We get support from U.S. Bank. A question I love asking founders. What's the one decision you almost didn't make? The one that changed everything? Because it's never the obvious stuff. It's never, I decided to start a company. It's the small, boring, Tuesday afternoon decision you barely remember making until you realize it's the reason everything after it either worked or didn't.

• 1:32Guy Raz?

  Say you're 18 months in. Business is growing. You've got expenses coming from six directions. Gas for the van, office supplies, your phone bill, team lunches that are actually client meetings, and you're putting it all on whatever card you grabbed in year one. You're not thinking about it. Why would you? You've got bigger problems. But here's the thing. Path A, you keep going like that. End of the year, you're sorting through statements, trying to figure out what went where. You've left hundreds, maybe thousands, on the table in rewards you never earned, money that could have gone back into the business. Path B, you pause and get the US Bank Triple Cash Rewards Visa Business Card. Now, you're earning 3% cash back

• 2:16Guy Raz?

  on gas and EV charging, office supply stores, cellphone service, and restaurants. You pick up an extra $750 cash back as a bonus. And you've got a low APR on purchases and balance transfers for 12 months while you're scaling. Same business, same expenses, two completely different outcomes based on one small decision. Visit usbank.com/business to learn more. The creditor and issuer of this card is US Bank National Association, pursuant to a license from Visa USA, Inc. Some restrictions apply. If you travel often, you'll want to hear about this unprecedented offer. For the first time ever,

• 3:00Guy Raz?

  new Delta SkyMiles Reserve American Express Card members can earn two Delta Comfort Round Trip flights for travel within the 48 contiguous US states, Puerto Rico, or the US Virgin Islands. Plus, you can earn 50,000 bonus miles towards your next getaway. And who doesn't appreciate an elevated airport experience? Delta SkyMiles Reserve Card members get access to the Delta Sky Club, your pre-flight oasis to recharge, with 15 visits and four one-time guest passes each medallion year when flying Delta together. That's up to $950 in annual value. Value estimate based on $50 per visit rate to purchase additional visits

• 3:45Guy Raz?

  or bring a guest to the Delta Sky Club. Make every trip feel more rewarding with the car that upgrades your travel. Apply today at delta.com/cardsocial. Offer ends November 4, 2026. Minimum spending requirements and terms apply. Flights are fulfilled as flight certificates valid for Delta Comfort or Delta Maine to select domestic destinations. Book 21-plus days in advance. Up to $80 per person and taxes and fees apply. Other restrictions apply. When I pull up to a gas pump to fill my car, I'm not thinking about chemistry or engineering. I'm thinking about getting in, filling up, and getting on with my day. And it reminds me a little bit of the founders I talked to on this show, because the best

• 4:27Guy Raz?

  ones obsess over things their customers will never see. Tiny details, invisible improvements, relentless iteration. And not because anyone's watching, but because it makes the product better. That's what the mobile brand does. It engineers fuel the same way great founders engineer their products. Mobile Supreme Plus Premium Gas helps keep engines three times cleaner, which can mean better performance and improved gas mileage. It's for people who care about what's under the hood, even if they never see it. Three times cleaner compared to mobile regular gas in port fuel-injected engines. Actual results may vary.

• 5:07Guy Raz?

  Visit mobilefuels.com for details. Hello and welcome to How I Built This Lab. I'm Guy Raz. Okay, artificial intelligence is going to change everything, not just about business or entrepreneurship, but everything, or at least we think so. I do, and a lot of it excites me. Breakthroughs and curing diseases, or maybe even solving climate change. But a lot of it really freaks me out, too. Like, how it might become impossible to know what's true and what's not, what's real and what's fake. And because trust is the invisible force that allows our societies to work, AI could completely undermine all of it.

• 5:51Guy Raz?

  Now, we've had a lot of conversations about AI on the show in the past year, and we're going to have many, many more. And this week and next, we have a really important guest, and I really hope you all spend some time really listening to these episodes. Many years before anyone noticed, Tristan Harris warned about the perils of social media. And by and large, he was proved right. He even helped make a film about it. You might have seen it. It was called The Social Dilemma. Tristan is one of the founders of the Center for Humane Technology, and his roots in the tech world run deep. And today, he's sounding the alarm about AI. Now, to be clear, he's not anti-AI, but Tristan is

• 6:32Guy Raz?

  really worried about the pace of its growth, because in a very short period of time, he argues, we're going to lose control over it. Today, we're going to run part one of my conversation with Tristan, and next week, we'll have part two. Anyway, Tristan grew up in the Bay Area, and he was a technology kid through and through. He even wrote fan mail to Steve Wozniak, one of the co-founders of Apple. And actually, one of Tristan's co-founders at the Center for Humane Technology is deeply connected to that early obsession with Apple.

• 7:05Speaker 01

  And I'm honored today to say that my co-founder, Azar Raskin, his father was Jeff Raskin, who started the Macintosh project at Apple, along with Steve Jobs, who later took over the project. And I think there's an ethos that both he and I come from of the original days of Silicon Valley that is aspirational, in which computers can be a bicycle for the mind, a bicycle for human creativity, extending human expression. I think sometimes we can get classed as doomers. But the risk side of AI, we only do that because we care about the vision where technology actually is in service of humanity. And to do that, we just think we have to fix the incentives.

• 7:40Guy Raz?

  Yeah. You eventually started your own company. This is in the 2000s, the mid 2000s, called Apcher. And this was a, it was a hyperlink. You would click over, hover over a hyperlink, and you would get like... Other information, right? More or less. Can you describe what that company did?

• 8:01Speaker 01

  Yeah. I started Napture in 2007 and it was going back to the original ethos of what the internet and hyperlinking was supposed to be about. You know, you could say when people click on this button or click on this image or click on this text, I want the computer to speak this out loud or to issue a dialogue prompt or to play this song or to play the piano. And it was the first really creative idea of this interlinked, what if everything was connected to everything else in the most visually expressive multimedia, educational, inspiring, beautiful way. So then I learned a lesson though, because while I was interested in kind of re-instituting this original inspiring ethos of multimedia and teaching and education

• 8:43Speaker 01

  into the internet, the way that Napture, which is a for-profit company, we raised venture capital, we had investors and our progress, our success was measured not in the number of children who are inspired by cool media that they got to learn and watch and click on, but our progress was measured in the form of engagement. You know, we did deals with the Washington Post, the New York Times, The Economist, and they would ask us one question, which was, how much did you increase the amount of time people spent on my website? Okay, how many ad views, impressions did you increase? And that's when, you know, I really saw, I think, the fallacy that leads and guides both the social media work that we're, we became known for with the social dilemma and our work with AI, which is there's all these positive stories we want to tell ourselves

• 9:28Speaker 01

  about what we're building. But the question that determines which future we'll end up in is the incentives. And Charlie Munger, Warren Buffett's business partner, just passed away. He had a very famous quote we reference in our work that he said, if you show me the incentive, I'll show you the outcome.

• 9:43Guy Raz?

  Yeah.

• 9:44Speaker 01

  When people ask themselves the question, like, which way is AI going to go? Is it going to be the promise or is it going to be the peril? How are we going to know? Well, the point is that the way that we'll know which future we get is by where the incentives, where the profit motive, where the, you know, status and reputation is all conferred to. And that's what we have to change.

• 10:01Guy Raz?

  We're going to talk a lot about AI in this conversation, but I want to go back to around 2011 when Aperture, Aperture was acquired by Google and you started work at Google.

• 10:09Speaker 01

  Yep.

• 10:10Guy Raz?

  And it was around, I think around this time, that you really started to focus on this idea of attention and to become more troubled by it. Something that is now just, you know, it's an article of faith. We now know that the attention economy is a term and we now know that tech companies make money from capturing our attention. You know, media does, YouTube does, this show does, right? But you were thinking about this a long time before others were as a potential problem. How did those ideas begin to kind of percolate in your mind?

• 10:43Speaker 01

  Well, again, starting with my experience at Aperture, I realized that for, you know, for our company to be so successful, we had to increase the total amount of time people spent on The Washington Post and New York Times and that there obviously isn't an infinite amount of human attention out there. It's almost like planetary boundaries, right? Can you run infinite economic growth on a finite planet forever? Well, so long as economic growth has environmental externalities or depletes finite resources, you can't do it forever unless you keep making scientific breakthroughs on every dimension. So, you know, I think similar to that, you can't run infinite growth of every company demanding more attention per quarter, per year forever with a finite supply of human attention. And at the time, in 2007, it was actually the year the iPhone came out.

• 11:27Speaker 01

  We started our company before the iPhone came out. But obviously what mobile phones did is they opened up the attention economy. It used to be people only spent a few hours a day on computers and then they would get offline and go outside, go to a movie, do something else. And increasingly, every moment of our lives became part of this attention economy, sold for a commodity like the time you sit in the toilet and when you go to the bathroom and that's a boom. Now there's 10 extra minutes in the attention economy because the smartphone opened up that new piece of real estate. So I was just seeing the fact that this is where this is all going. There's, there's only so much and it's going to get more competitive. People are going to find more creative ways of creating stickier, more persuasive, more socially validating, more outrage driven, more addicted, more distracted,

• 12:10Speaker 01

  more polarizing, narcissistic, you know, these kinds of things.

• 12:14Guy Raz?

  Yeah.

• 12:15Speaker 01

  And it was pretty daunting to see that in 2013 when I was at Google and made this presentation. Because you're starting to see like, if this keeps going, I can tell what kind of society this is going to create. And that's not a society that, that I think we can afford to be in. We need to, we need to turn the tide.

• 12:30Guy Raz?

  This presentation that you're referencing, it was called, it was a call to minimize distraction and respect users' attention. You were an employee at Google and you decided to put together a 144-page Google slide presentation about what was going on. And I just want to read a line in there. The line is, "Never before in history have the decisions of a handful of designers working at three companies, Google, Apple, and Facebook, had so much impact on how millions of people around the world spend their attention. We should feel an enormous responsibility to get this right." That was written in 2013. You wrote it internally in Google and it kind of went internally viral. How did the leadership of Google respond? I mean, did they pay you lip service and say, "Yeah, this is all,

• 13:12Guy Raz?

  you're saying all the right things?" Or were people annoyed? Or what'd they say?

• 13:16Speaker 01

  I remember when I sent the presentation to just 10 friends at Google, just to say, "Hey, can I get your feedback on this?" And I came to work the next day and there were something like 40 simultaneous viewers. And I knew that was impossible because I'd only sent it to 10 people.

• 13:28Guy Raz?

  They were sending it around.

• 13:29Speaker 01

  And then later I looked that day and there was 150 simultaneous viewers and then thousands by the end of the day. And so I really realized, I got to clean this up and finish it basically in less than a couple hours. And it was this real moment in time. I remember hearing that, I think in the first 24 hours, that Larry Page, the CEO of Google, had had several meetings that day in which people brought up this presentation to him. And I got emails from around the company, mostly from other employees who just said, "I completely agree. This is happening to my children. This is affecting my relationships. This is this thing that you're naming a thing that I felt, but I didn't know how to put into words." And there was even an executive at Google who decided

• 14:12Speaker 01

  to host me, basically offer me the chance to work on this topic. And he sent me a quote by Neil Postman, that we were all worried about this dystopian future of 1984, the George Orwell vision of dystopia, where technology limits our access to information, that there's surveillance, there's control, we ban books. But he said alongside that vision, there's this other dystopian vision with technology, which is the Aldous Huxley vision of a brave new world, in which control is not established by banning books, but by creating a world of so much amusing ourselves to death that no one wants to read a book. No one even knows.

• 14:47Guy Raz?

  There's just this... Tsunami of information.

• 14:51Speaker 01

  That's right.

• 14:51Guy Raz?

  It's impossible to discern what is real from what is not.

• 14:55Speaker 01

  That's right, because it doesn't have a single source. It's not Big Brother. It's the big incentives of the attention economy that have made this problem worse. And then combine that with technology and AI. And we're heading into, you know, a bigger version of that. So I'm not trying to paint a dark picture here. It's just important that we get a clear eyed view of what world we're pulling towards so that we can say if that's not the future that we want, how do we have to change the incentives to arrive in that future that we all want for our children?

• 15:22Guy Raz?

  We're going to take a quick break. But when we come back, more from Tristan on how social media and now AI development are happening too fast for humans to fully process. Stay with us. I'm Guy Raz and you're listening to How I Built This Lab.

• 15:41Guy Raz?

  Does your team want a website that looks and feels handcrafted but is still fast to ship? Well, Framer is built exactly for that. With Framer, you design on a visual canvas with responsive layouts, hosting and a CMS built in. So the work is production ready from day one, and you can get it done with help from Framer's AI agents. Framer is the AI website builder that helps creators, teams and businesses ship production ready sites faster than ever while getting every detail right. Prompt, inspect, edit and publish in one place at a whole new pace. AI agents and humans work together. The agents bring speed and

• 16:25Guy Raz?

  scale and people bring taste, judgment and control. Learn how you can get more out of your site from a Framer specialist or get started building for free today at framer.com/built for 30% off a Framer Pro annual plan. That's framer.com/built. Rules and restrictions may apply. AI isn't just opening new business opportunities, it's changing the way businesses get work done. The questions they ask, the decisions they make, the routine tasks they can hand off. That's the idea behind NetSuite Next, the next generation of NetSuite with AI woven into the tools your business already relies on. NetSuite Next surfaces insights

• 17:10Guy Raz?

  exactly when you need them, puts agents to work on routine tasks and problems, and lets you ask complex questions in plain language, like talking to a knowledgeable colleague. But technology is only part of the story. AI is also reshaping how people and teams work together, and that shift is already underway. That's why NetSuite wants to put a new expert-created business guide in your hands today. It's called Aligning for the Agentic Era: How AI is Changing Everyday Work. And right now, it's yours, absolutely free. Inside, you'll discover how AI could reshape work across your entire organization, and how to position your business to prosper from it.

• 17:53Guy Raz?

  If your revenues are at least in the seven figures, get NetSuite's free business guide, Aligning for the Agentic Era: How AI is Changing Everyday Work, at netsuite.com/built. The guide is free to you at netsuite.com/built. netsuite.com/built.

• 18:13Speaker 02

  Confidence. It's listening to your gut. It's moving forward even when the path ahead is unclear. For nearly 160 years, Pacific Life has helped people keep their promises, building confidence for generations. Whether you're confident in your financial future or just beginning to envision it, we're here to help. Ask a financial professional how. Pacific Life: The Power of a Promise. Pacific Life Insurance Company, Omaha, Nebraska. And in New York, Pacific Life and Annuity, Phoenix, Arizona.

• 18:50Guy Raz?

  Welcome back to How I Built This Lab. I'm Guy Raz, and my guest is Tristan Harris, co-founder of the Center for Humane Technology. Now, back in 2013, social media was really starting to explode. And Tristan was at Google, and he was sounding the alarm about the dangers of the attention economy. And he wasn't the only one concerned about the power of this new technology. And I remember reading at the time, and I don't know if this was apocryphal or not, but reading that Steve Jobs, who had died two years earlier, wouldn't allow iPads in his own home. He did not allow his children to have these products that he himself helped to create. And it really struck me as, not so much hypocritical, but that there was something that people

• 19:34Guy Raz?

  understood, fundamentally understood about the dangers of what they were unleashing.

• 19:40Speaker 01

  Yeah.

• 19:41Guy Raz?

  And did you feel, at least at Google, did you feel like, okay, they're taking this seriously. They made a position for you there called Design Ethicist. Did you feel like, you know, maybe I can really make a dent here at Google. Maybe I can have an impact.

• 19:53Speaker 01

  Well, I certainly told myself that story when I first got started. And I really want to make sure that I'm honoring that. I thought it was generous for Google to support the fact that I was doing that work.

• 20:03Guy Raz?

  Right.

• 20:04Speaker 01

  And I want people to hear that, so you don't hear me as some kind of reactionary, you know, that the evils of big tech and all the people at the top are evil. At a human level, when you talk to the human beings who worked on these products, I had a lot of people who were very sympathetic with these concerns. But when it came down to trying to change Android, like I met with the Android team and say, what if we could change how the operating system works and better protect people's attention? I met with the Chrome design team. What if we could change Chrome to make it better at protecting people's attention? At the end of the day, Android and Chrome and Google benefit the more overall screen time there is versus not. And so I knew that my success within the company was going to be limited. And I had to eventually take the concerns outside of the public world to try to say, how do we create public pressure that will start to change those incentives?

• 20:48Speaker 01

  And I had no idea in 2015 or so, when I left Google, how I was going to do that. But, you know, here we are today, and there's some amazing things that have shifted in the public consciousness around this, and a lot more needs to happen.

• 21:01Guy Raz?

  The first nonprofit that you founded was called Time Well Spent, and that was around 2014. At that time, and I mean, up until recently, understandably, your focus, I think increasingly, was on social media as it began to capture more and more of our time and attention.

• 21:19Speaker 01

  Yeah.

• 21:20Guy Raz?

  And you started to see this happen at lightning speed.

• 21:23Speaker 01

  Yeah.

• 21:23Guy Raz?

  Around this time.

• 21:25Speaker 01

  Yeah, I mean, so Time Well Spent came from this term or phrase, time spent. Most tech products and advertising is maximizing time spent. And we said, but is it maximizing time well spent? Meaning, at an existentialist level, as a human being, what are the choices that you endorse as time well spent? And imagine a world where technology is competing not to maximize how much time it takes from you, but to maximize its contributions, its net positive contributions to a life that you would endorse on your deathbed, meaning enabling you and helping you make the choices that are the lasting, meaningful, fulfilling choices, not the full but empty choices. But certainly, inside of the time well spent world and the attention economy, the biggest forces that we were dealing with at that time were the

• 22:09Speaker 01

  growing revenues of social media companies and the growing portion of social media in that problem.

• 22:15Guy Raz?

  You know, it's, and I know you've made this analogy or versions of it, but you think about something like the Gutenberg press, right? And, you know, that happens in the 15th century in Europe, and all of a sudden, ordinary people can get access to the Bible, and they can start to learn how to read it, and it doesn't have to be filtered through the priests. And so that creates, it launches the Reformation, you know, of course, a huge innovation, it changed the world, but it was very disruptive. At the same time, this happened over a long period of time, right?

• 22:48Speaker 01

  Yeah.

• 22:48Guy Raz?

  And so you can basically trace that moment all the way to the end of World War II, which was kind of the end of the European era of wars, but I'm about 500 years. What happened with social media was like five years and it was like the Gutenberg press on steroids and amphetamines and you know, everything in between. It's almost inconceivable how our brains were going to adapt to this massive rapid proliferation of information.

• 23:17Speaker 01

  Yeah. In our work, we often reference the E. O. Wilson quote, who's the father of the field of sociobiology, that the fundamental problem that humanity faces is that we have paleolithic brains, medieval institutions and godlike technology. Which is to say, both in the power and the speed, our brains and our emotions are not built to see exponential curves, right? There's nothing on the savanna when you see a giraffe or a tiger and you gotta run from, you know, something that your brain needed to understand an exponential curve. It took, you know, Isaac Newton and calculus and sort of teaching ourselves education about math to start to understand what exponential curves are. We get more practice with that with finance, savings accounts, things like that.

• 23:58Speaker 01

  But our brains are not built for that. So suddenly you have something like, you know, social media come along where you totally have an exponential curve of how many users, how much content, et cetera, is flowing in the system. Then you get AI and you get a double exponential. You get an exponential that accelerates its own exponential, meaning AI accelerates AI development. And so we now have something that is moving so fast that, you know, it's like our brains are completely not comprehending the moment that we're in. As you said, social media took, you know, five, six years to get to market penetration and the absorption of elections and journalism kind of gets sucked into the black hole of that super organism. In the case of AI, you know, the stat that we use is it took Instagram, I think, two years to get to 100 million users and it took ChatGPT two months.

• 24:42Speaker 01

  So we're living with a technology that's changing and undermining the assumptions about how our world worked. We can, humanity can absorb new technologies, but it takes time. And the challenge is when the time pressure that you have to absorb that new change is faster than than ever before. This is the fastest that we've ever had to face it.

• 25:04Guy Raz?

  Hmm.

• 25:04Speaker 01

  Just to provide one quick thought experiment, a friend of mine, who's an AI policy researcher at one of the major labs, he said, imagine that we just named that humanity has a finite capacity to absorb new technologies that undermine our assumptions about how everything works. And imagine instead of just releasing all the new technology as fast as possible and just blowing past those finite absorption boundaries, that we instead, what if you had to apply for a license to release a new technology into the commons? And so we're basically consciously choosing as a society, which new technologies we want to absorb, we want to prioritize, and which ones we want to like, give ourselves a little bit more time. It's not yes or no to technology. It's how do we absorb technologies at the pace that we can get it right?

• 25:49Speaker 01

  And I think it's an interesting thought experiment for people to think about.

• 25:52Guy Raz?

  We're gonna take a quick break, but when we come back, the story of how Tristan was alerted to the dangers of another nascent technology, one that he says could pose an existential threat to the entire world. Stay with us. I'm Guy Raz, and you're listening to How I Built This Lab.

• 26:15Speaker 03

  Football is back, and PrizePix is bringing out their best offer yet. New users who sign up will get $150 in lineups if you win your first $5 lineup. That's right, if you win your first $5 lineup, you'll get $150 in lineups. On PrizePix, you simply pick two to six players, pick more or less on their stat projections, and submit your lineup. Then sweat it out as you watch your picks play out live. It's the best way to get more locked in on game day. Make all the picks you want this football season, all in the same app. And now, PrizePix is available nationwide. So what are you waiting for? Lock in for kickoff, because everyone and everything is on PrizePix. What you on?

• 27:00Speaker 04

  Download the PrizePix app today and use code WONDERY, that's code WONDERY, to get $150 instantly in lineups if you win your first $5 lineup. PrizePix, run your game. Must be present in certain states. Visit prizepix.com for restrictions and details.

• 27:21Guy Raz?

  Welcome back to How I Built This Lab. I'm Guy Raz and my guest is Tristan Harris, co-founder of the Center for Humane Technology. In 2018, Tristan cofounded that nonprofit, and at the time, it was focused on the dangers of social media. But then, in late 2022, early 2023, Tristan started getting messages from people working on a different technology. You and Azar Raskin, one of your co-founders, were contacted by people working in AI, and they were sounding the alarm. And the analogy that you've made about this encounter really alarmed me. You compared it to the Manhattan Project. Can you describe or explain that a little bit?

• 28:02Speaker 01

  Yeah, well, a lot of people analogize that the invention of AI is as significant as the invention of the atomic bomb. Now, that might sound like alarmist or panic-creating or something like that, and it's not, actually. And it's because of how the atomic bomb restructured the world order. It was a new kind of power that whoever had it was clearly sort of the dog on top of the food chain. And with AI, what people don't understand is if you genuinely build something that can do full artificial intelligence across all kinds of cognitive labor, meaning scientific labor, research labor, market analyst labor,

• 28:44Speaker 01

  financial labor, if you can out-compete all stock traders on the stock market, if you can out-compete all military strategy games, if you can out-compete anyone in writing text to influence people on the internet, if you have that AI system that can do that, that is a new kind of power in which your position in the world will be greatest relative to everybody else. And so, there is a new atomic bomb project in the form of those who are racing to build towards this fullest expression of AI, which some people call artificial general intelligence. Remember that the stated mission statement of OpenAI, Anthropic, and DeepMind, from the very beginning, those three companies have been to create

• 29:27Speaker 01

  artificial general intelligence. So, when we got calls from some people in those labs, it felt like getting a call from a scientist working on the Manhattan Project before you knew what the Manhattan Project was.

• 29:39Guy Raz?

  Okay, so in 2022, you are contacted by AI researchers who are kind of ringing the alarm, right, that there's this AI arms race underway. And so presumably, they wanted you to help spread the word about what was happening, right?

• 29:58Speaker 01

  Yeah, this is late 2022, early 2023. And frankly, as you said, when we started the Center for Human Technology, we had all the other issues of how social media is undermining democracies. We had our plate full. And I actually, they were asking for our help. They basically said, okay, you all raise the alarm about social media and the social dilemma. You have a huge public platform. Listen, this race to build AI has gotten out of hand. And OpenAI and Anthropic and DeepMind are now in this race to release things as fast as possible. And this race is going to go to a dangerous place if we don't have some outside pressure that can help bend the curve, maybe slow it down a little bit, create some international norms, create some safety guardrails. Would you use your public platform to help raise the alarm?

• 30:41Guy Raz?

  And you did. And you and your co-founder, Aza Raskin, would go on to build a presentation called The AI Dilemma that you, I think you first delivered it in March of 2023 here in the Bay Area. You presented several times since then. I've seen it live. It's available online. Anybody can watch it. What was the message that you were trying to send with this presentation?

• 31:03Speaker 01

  You know, the main point we made in the presentation is that social media was really humanity's first contact experience with a mass deployed AI, because it's an AI pointed at your 13-year-old's brain, trying to calculate what's the perfect next TikTok video to show you, or what's the perfect next politically outrageous tweet that will keep you scrolling. And we saw how that experiment went. You know, there's a lot of really good things that social media has done. But the overall picture of what social media has done, if you really take into account the full scope of impacts and externalities, is it's also created the backdrop of a more addicted, outraged, polarized, narcissistic, breakdown of truth, you know, lower trust society.

• 31:45Speaker 01

  And that that is like undermining the quality of the soil underneath your feet while you have a few nice shiny toys above the soil. We knew that no matter what positive stories we were telling about social media, unless you pay attention to the incentives, which is to maximize attention and engagement, which produces that race to the bottom of the brainstem, that that was going to be the driving force of what would tell you which future we're going to land into. And if we care about which AI future we get, we're going to hear a lot of positive stories about AI developing antibiotics and solutions to climate change and new drugs for cancer. And of course, I have a beloved with cancer right now. I want as many of those solutions as we possibly can get as fast as possible.

• 32:27Speaker 01

  But we have to also look at the incentives, which is that it's a race to roll out AI capabilities as fast as possible, like handing out new magic wands for new kinds of things that people can do that they couldn't even do four months ago. The fact that, you know, there's a new magic wand that was released last year that with three seconds of your voice, Guy, I can talk to your bank representative or your grandmother and pretend to be you and get sensitive information out of them. And society wasn't prepared for that magic wand to be rolled out.

• 32:53Guy Raz?

  I want you to explain, there was a big breakthrough in 2017, where essentially Google announced this development, it's called the transformer model, and this helped kind of spark this breakthrough in what we now know as large language models, and that's kind of helped to trigger what's now called generative AI. But help me understand how it works, because I mean, I think a lot of people, you know, are thinking about or, you know, hearing about breakthroughs in scientific developments and cancer research and climate change technology, things that are going to benefit us, things that will make our lives easier. But at the same time, from what I understand, based on what you've talked about, a lot of the scientists and researchers working with large language models are kind of developing

• 33:38Guy Raz?

  a Prometheus, something that already they know. Is growing faster and becoming smarter faster than they ever anticipated?

• 33:48Speaker 01

  Yeah. So just to say that I was pretty skeptical of a lot of the bigger AI risks. When there was a community in San Francisco called the Effective Ultra Risk that had been worried about bigger AI risks for a long time.

• 34:01Guy Raz?

  Yep.

• 34:01Speaker 01

  I was incredibly skeptical of a lot of this stuff. In fact, I actually told them, I actually think you all are misguided. You're not seeing the AI that's been released right underneath your feet that has already wrecked the world and it's called social media. So just want to say that I'm not walking into this conversation wanting to hype AI capabilities. What changed, though, is in 2017, there was a paper at Google published called Attention Is All You Need, in which they invented this new kind of AI paradigm of transformers. I won't go in too much in the technical details, but we swapped the engine underneath the hood of AI in 2017. And everything that we used to be skeptical of about AI up until 2017, I would have agreed with everybody on. And, you know, there's AI when Siri mispronounces your mom's name and there's AI when Google Maps gets the directions wrong or mispronounces a street address.

• 34:45Speaker 01

  But that AI that falls over and makes mistakes is different than the AI of transformers, in which basically it's like a big brain neural network and you're throwing more data, more training, more compute at it. So for example, GPT-4, they spent $100 million to get a bunch of Nvidia chips to churn away for something like six months and then come out with this weird digital spaghetti brain. This is a massive neural network. And the thing about it is that as you scale these digital brains, they end up with more emergent capabilities that no one who built them anticipated. So suddenly, when they scaled, you know, GPT-4, they tested it and it could explain jokes.

• 35:30Speaker 01

  You could give it an image of the picture of an iPhone with with the bottom of the port. There's like an old VGA cable, like those old monitor cables from the 1990s.

• 35:38Guy Raz?

  Yeah.

• 35:38Speaker 01

  And you could say, what's funny about this image? And it explained, well, it's funny because an iPhone can't have a 1990s VGA cable at the bottom.

• 35:46Guy Raz?

  Wow.

• 35:46Speaker 01

  Of the iPhone.

• 35:47Guy Raz?

  Yeah.

• 35:47Speaker 01

  It's not that it had ever seen that image before. It's not that it was trained on that. And this is not to Sort of conjure this sort of mythical blank check of AI is going to have all sorts of magic capabilities. It's just that we know that it gains capabilities that people may not notice for a long time. It took two years, for example, for researchers to figure out that GPT 3.5, the predecessor to GPT 4, had research-grade chemistry knowledge, meaning you could ask it questions about, you know, how to synthesize dangerous chemicals, and it would tell you how to do that. And so

• 36:17Guy Raz?

  By the way, nobody knew that. Nobody knew that it had developed those capabilities on its own.

• 36:22Speaker 01

  That's right. And it's confusing, by the way, because I want to also, for those who are listening to this and skeptical, because it's like, well, that's true, but look at how many times it hallucinates and it gets things wrong. That's 100% correct. It's hallucinating and getting a bunch of things wrong. So it's similar. It's, we've never been around this, this new kind of brain that is simultaneously in certain ways better than humans at a bunch of things, but also makes really dumb mistakes, like surprising and kind of almost embarrassing mistakes. It's like a weird combo that we're not used to, but it's because it's an artificially intelligent mind. It's not a kind of mind that we're, have any previous sort of knowledge about.

• 36:57Guy Raz?

  That's part one of my conversation with Tristan Harris, co-founder of the Center for Humane Technology. You can catch the rest of my conversation with Tristan, where we discuss how AI could undermine the foundations of our society and what we can do to prevent that. That's coming up in part two next week. And thanks for listening to the show this week. Please make sure to click the follow button on your podcast app so you never miss an episode of the show. And as always, it's free. This episode was researched and produced by Alex Cheng with editing by John Isabella. Our music was composed by Ramtin Arablouei. Our audio engineer was Neil Rouch. Our production team at How I Built This also includes Carla Estevez, Chris Messini, Casey Herman, J.C. Howard, Catherine Seifer, Carrie Thompson,

• 37:38Guy Raz?

  Malia Agudelo, Niva Grant, and Sam Paulson. I'm Guy Raz, and you've been listening to How I Built This Lab.