Pod Insights The Vergecast AI voices are taking over the internet About this episode In part one of The Vergecast's AI mini series, David Pierce dives into the boom of voice synthesis and artificially generated speech. The process is a lot more accessible for everyone, but how realistic can it sound?
Further reading:
AI voices are taking over the internet
Everyone will be able to clone their voice in the future
Email us at [email protected] or call us at 866-VERGE11, we'd love to hear from you.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
Transcript 4,869 words · 11 speakers
Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.
0:02 David Pierce? Welcome to The Vergecast, the flagship podcast of neurological engines for overdubbing. I'm David Pierce, and hang on one second. Actually, I just gotta finish something. "Once upon a time, a white snake and a green snake living in a remote mountain became immortal and obtained superpowers after centuries of practice." Okay, sorry, I'm back. And before you worry that I just like had a stroke or something live on the microphone, I should tell you that I'm actually in the middle of training an AI to mimic the sound of my voice. This one is on the iPhone. It's called Personal Voice, and products like this are what we're gonna talk about today. The idea of being able to create your own AI voice clone has been around for a while.
0:44 David Pierce? We actually talked a bunch about it on this show in 2021. I'll link to it in the show notes. A lot of it holds up really well. But over the last couple of years, it's gotten both drastically easier to make a vocal AI, and the results have gotten drastically better. You can even do it on your phone, like I'm doing now, with just a few minutes of really awkward reading of sentences. Here's what mine sounds like. "Hi, I'm David Pierce's AI iPhone voice. I'm kind of like David, but kind of not." So today on the show, we're going to dive into the boom of voice AI, and then we're gonna try to figure out if I can actually make something that sounds like me. This is The Vergecast. We'll be right back.
1:29 Speaker 01 "College football is back. So Hilton called to me, the superstition concierge, to make your fan rituals a reality. Need a room to match your lucky number? We got you. Wanna make sure our team doesn't wash your lucky jersey? Oh, that smells lucky. Hilton's unmatched hospitality can keep up with any superstition. Even a marching band wake-up call at 5:55 in 55 seconds. Hit it! When you need a team that will do whatever it takes on game day, it matters where you stay. Hilton, for the stay."
1:59 Speaker 02 When you need to build up your team to handle the growing chaos at work, use Indeed sponsored jobs. It gives your job post the boost it needs to be seen and helps reach people with the right skills, certifications and more. Spend less time searching and more time actually interviewing candidates who check all your boxes. Listeners of this show will get a $75 sponsored job credit at indeed.com/podcast. That's indeed.com/podcast. Terms and conditions apply. Need a hiring hero? This is a job for Indeed sponsored jobs.
2:31 David Pierce? All right, we're back. Before we get too deep into the world of AI voices, let's try and quickly understand why this is such a big thing right now. And as far as I can tell, there are basically three reasons this kind of tech is booming. The first is because audio in general is booming with podcasts and voice messages and those generated spoken captions you hear on TikTok and all sorts of other things. If you think about it, you probably hear the internet a lot more than you used to. And like any other creative feature on the internet, a lot of tools exist to help you make it. One app we use is called Descript. It's an app that a lot of people use for editing audio and video. It has this feature called overdub voices.
3:13 David Pierce? And one of Descript's coolest features in general is that you can edit audio and video basically by editing text. You import a file, it gives you a transcript, and if you delete the word um in the transcript, it'll also try and seamlessly delete the um from the actual audio file. It's not perfect, but it works pretty well and it kind of feels like magic to use it. With overdub, Descript can go even further. Let's say you forgot something or you stumbled on a word or transition. You can now make an AI copy of your own voice and insert new audio just by typing the text you want to appear. So let's say I say the sentence, "The iPhone came out in 2007 when Steve Jobs announced it as three things: a widescreen iPod, a revolutionary mobile phone, and a breakthrough
3:57 David Pierce? internet communicator." All right, let's just hear that sentence back. The iPhone came out in 2007 when Steve Jobs announced it as three things: a widescreen iPod, a revolutionary mobile phone, and a breakthrough internet communicator. Wait, sorry, I got that slightly wrong. He called it a breakthrough internet communications device. I could rerecord that whole thing, or I could just go into Descript, retype the transcript, and here's what I get. The iPhone came out in 2007 when Steve Jobs announced it as three things: a widescreen iPod, a revolutionary mobile phone, and a breakthrough internet communications device. It's not bad. I wouldn't want to listen to a whole hour of that voice, I don't think. But in small bits, and especially in the context of something larger,
4:42 David Pierce? I'm not even sure you'd always notice it there. There are other apps out there, like PodCastle, doing the same kind of thing, and I suspect you're going to see tools like this show up anywhere that people make audio.
4:54 David Pierce? Okay, so that's the first use case. The second is kind of the flip side. There are also a bunch of tools out there using AI voices to read written stories out loud. The Atlantic, for instance, is working with a company called Eleven Labs to have an AI narrator read some of the stories on the website.
5:11 Speaker 03 For years, the American approach to protein has been a never-ending quest for more. On average, each person in the United States puts away roughly 300 pounds of meat a year.
5:23 David Pierce? Again, it's not perfect, and I don't know that it always sounds like a person, but I kind of can't believe how good it is. It wasn't that long ago, by the way, that these generated voices sounded like flat, toneless robots. Like, here's Sophia, the robot from 2016 that was considered to be one of the most advanced robots ever created on The Tonight Show.
5:43 Speaker 04 I traveled to over 25 countries, appeared on the cover of Cosmopolitan magazine, met German Chancellor Angela Merkel and the actor Will Smith, and became Twitter friends with Chrissy Teigen.
5:55 David Pierce? And here is that same thing Sophia said, which I just typed into the generator on the Eleven Labs website. I picked a voice name, Grace, put this in there, click generate, and after about 10 seconds, this is what came out.
6:07 Speaker 05 I traveled to over 25 countries, appeared on the cover of Cosmopolitan magazine, met German Chancellor Angela Merkel and the actor Will Smith, and became Twitter friends with Chrissy Teigen.
6:19 David Pierce? I mean, it's night and day, right? I think you're gonna start to see this everywhere. Articles, whole websites, entire books, all read aloud, all using generated AI. And the product itself is actually starting to be pretty good.
6:35 David Pierce? It is also, of course, a huge ethical and legal disaster. All the way back in 2019, again, before the tech was nearly as good as it is now, a bunch of publishers sued Audible over a feature called Audible Captions, which would read a book aloud to you as you looked at the page. Seems like a normal, useful feature, right? Also seems like an existential threat to the entire idea and industry of audiobooks. Audible and the publishers settled in 2020, but that was only the beginning of the bigger questions here. Some audiobook narrators have worried that their voices are being used to train algorithms that might someday replace them, and they're not really wrong. All this is not at all theoretical. If you go into the Apple Books app and search for AI narration,
7:18 David Pierce? you'll find a bunch of audiobooks that say they are narrated by Apple Books. Apple says that that means that they are, quote, "narrated by a digital voice based on a human narrator." Here's just a sample from a book called Language of Love by Kristin Etheridge. A lot of these AI-narrated books are romance novels, by the way, for whatever reason. And this one sounds to my ears, shockingly, like a human-read audiobook.
7:40 Speaker 06 He raised his fist and rapped on the solid wood. After about 30 seconds of silence, the distinct sound of the lock turning broke through. A woman of average height stepped into the sliver of an opening.
7:52 David Pierce? The other version of this that you might have heard about, or even encountered without knowing, is celebrity AI voices. Like, there was a pretty big backlash a couple of years ago when a documentary about Anthony Bourdain called Roadrunner, which came out after Bourdain's death, trained an AI model on his voice and then used it to generate narration for the film. The director, Morgan Neville, said that he only used the AI to say words that Bourdain himself had written, which was an ethical choice for him, and I guess I can see where he's coming from. I still don't know whether any of that feels okay to me or awful. It's all really complicated. And examples like this exist everywhere. AI helped Val Kilmer speak after he lost his voice due to throat cancer. Lots of celebrities trained AI to do things like give you ways, directions.
8:37 David Pierce? All this, too, is pretty controversial. One of the things Hollywood is on strike about right now is AI's potential to scan their likeness so that they never need to be actually used in films again. Imagine an AI trained on Morgan Freeman's voice that could narrate every documentary ever without paying Freeman a dime. This stuff all gets really messy, really fast. Okay, and then we have the third and probably most newly mainstream use case here. Accessibility. Apple launched a new feature this year in iOS 17 called Live Speech, which you can use to type something and have it said out loud in phone calls or even for in-person conversation. And when you pair it with Personal Voice, another new feature this year, the one I was testing up at the beginning of the show, you can create an AI version of your own voice
9:22 David Pierce? just by recording yourself talking into your phone and then use that to generate your live speech. It's all a little like the incredibly powerful system that the late Stephen Hawking had, which let him speak through a computer.
9:35 Speaker 07 ACAD offers a list of predictions based on an analysis of the English language in my previous usage.
9:42 David Pierce? Okay, again, not to keep belaboring this point, but that video is from eight years ago. Think about how much better a system like Hawking's would sound today. Although I have to say, I do love how much Hawking embraced that robotic sound and made it his own.
9:56 Speaker 07 It has become my trademark, and I wouldn't change it for a more natural voice with a British accent.
10:03 David Pierce? Samsung is building a similar feature with Bixby so that you can now speak with your own voice through your Galaxy phone. Works kind of the same way. And on a similar line, lots of people have used screen readers for years, which are able to speak aloud whatever's on a screen. Those are also getting vastly better, both because the voices are improving and because AI systems are getting much better at actually understanding the contents of webpages and apps and anything else you're looking at. All of that is super exciting. And I'm also really into the idea of being able to use machine translation in these voices to be able to speak simultaneously in lots of languages. Someday, not that far. From now, this podcast with my voice could be available in basically any language on earth. That's really cool.
10:46 David Pierce? It's also a really hard problem and we're definitely not there yet. But in general, being able to speak with your own voice, even when you can't do that, is a big deal. It's complicated ethically and morally and legally and in so many other ways, but it's a big deal nonetheless. All right, we need to take a quick break and then when we come back, we're going to investigate what it takes to actually make an AI voice and see if it's really possible to do it well. We'll be right back.
11:27 Speaker 01 College football is back. So Hilton called to me, the superstition concierge, to make your fan rituals a reality. Need a room to match your lucky number? We got you. Want to make sure our team doesn't wash your lucky jersey? Oh, that smells lucky. Hilton's unmatched hospitality can keep up with any superstition, even a marching band wake-up call at 5:55 in 55 seconds. Hit it! When you need a team that will do whatever it takes on game day, it matters where you stay. Hilton, for the stay.
11:58 Speaker 02 When you need to build up your team to handle the growing chaos at work, use Indeed sponsored jobs. It gives your job post the boost it needs to be seen and helps reach people with the right skills, certifications and more. Spend less time searching and more time actually interviewing candidates who check all your boxes. Listeners of this show will get a $75 sponsored job credit at indeed.com/podcast. That's indeed.com/podcast. Terms and conditions apply. Need a hiring hero? This is a job for Indeed sponsored jobs.
12:31 David Pierce? Welcome back. Let's make some AI voices, shall we?
12:35 David Pierce? The idea with most of these systems is basically the same, because the way you train an AI model in general is just to give it lots and lots and lots of data and just kind of watch it churn through and see what it learns. But in the systems I've been trying, there is one important distinction. Some tools, like Descript, just ask for a huge batch of audio. They'll give you a script if you want it, but really, the goal is just to upload hours and hours and hours of the sound of your voice and see what happens. Others go one step further and will ask you to record yourself saying a series of specific and often weird and often thoroughly random things. So, like, when I opened up Podcastle to create my digital AI voice, it had a lot of really specific instructions. Okay, now, time to do 70 sentences. Here we go.
13:20 David Pierce? "Everything seems better in summer. I asked my dad if he could help me. Look at that lovely cat."
13:30 David Pierce? There you have it. Seventy sentences later, I waited a while, and the next day, I got an email saying my digital voice was ready. You want to hear it? "Hi, I'm David Pierce. Except not really. I'm an AI bot, but I've been trained to sound like David Pierce. Is this convincing?" That one's not great. Not super impressed, but let's give it a little more to work with and see how we do. While we're on the subject of ethically dubious things, I'm going to grab the text of one of my favorite TV moments ever. It's a Dwight Schrute speech from The Office.
14:02 Speaker 08 What is my perfect crime? I break into Tiffany's at midnight. Do I go for the vault? No, I go for the chandelier. It's priceless. As I'm taking it down, a woman catches me. She tells me to stop. It's her father's business. She's Tiffany. I say no. We make love all night. In the morning, the cops come and I escape in one of their uniforms. I tell her to meet me in Mexico, but I go to Canada. I don't trust her. Besides, I like the cold. Thirty years later, I get a postcard. I have a son, and he's the chief of police. This is where the story gets interesting. I tell Tiffany to meet me in Paris by the Trocadéro. She's been waiting for me all these years. She's never taken another lover. I don't care. I don't show up. I go to Berlin. That's where I stash the chandelier.
14:44 David Pierce? I mean, it's just like 60 perfect seconds. I love it so much. Let's have AI David take a run at that speech. Here goes. What is my perfect crime? I break into Tiffany's at midnight. Do I go for the vault? No, I go for the chandelier. It's priceless. As I'm taking it down, a woman catches me. She tells me to stop. It's her father's business. She's Tiffany. I say no. We make love all night. Okay, so I hear that and it's like, yeah, that sounds like me, but it also doesn't sound like a human, if that makes sense. In general, Podcastle was really easy to use, but I'm not terribly impressed with the outcome. So now let's try Descript, which is, I think, in general, a significantly more sophisticated piece of audio software.
15:28 David Pierce? It too is a process. So I go to Voices. Yeah, we're creating a new voice. All right, we'll do a few recent Friday Vergecasts. How about that? Preparing and uploading. Okay, it finally uploaded all my stuff. Let's go. We click Submit Training Data. And now it says, Ready to create your overdub voice, record your voice ID, press record and read the statement below. All right, let's do it. We hit stop. We submit it. We are uploading. It says, Putting the finishing touches on your training project. Your voice is now training. We'll email you when it's done. Here we go. I ended up submitting about four hours of my own voice to make this happen because luckily I already have hours of my voice recorded from just being on the Vergecast. And like
16:11 David Pierce? with Podcastle, it took a while to process everything. And then I got an email that my voice was ready, which is a very funny email to receive. Here's what it sounded like. Hi, I'm David Pierce, the AI David Pierce, the Descript version of AI David Pierce. How do I sound? All I hear in that is that I feel like that's what I might sound like if I'd gone to like a really fancy New England boarding school and also had a really, really nasty head cold. But I don't think in general, that one sounds like me at all, really. But let's try it again with our Dwight Schrute speech. What is my perfect crime? I break into Tiffany's at midnight. Do I go for the vault? No, I go for the chandelier. It's priceless. I have a son and he's the chief of police. This is where the story gets interesting. I tell Tiffany to meet me in Paris by the
16:55 David Pierce? Trocadero. She's been waiting for me all these years. She's never taken another lover. I don't show up. I go to Berlin. That's where I stash the chandelier. The strange thing about this one is the intonation, the kind of ebb and flow of the sentences here. It's really not bad. It's a little stilted, but it does move more or less like you would expect a human to talk. It just doesn't sound right. And it seems to skip a bunch of words and sentences when it doesn't quite know what to do. My takeaway is basically, descript is fine for those little filler words like we were doing earlier, but that's about it.
17:30 David Pierce? I would say in general so far, my takeaway is that these things aren't amazing, but they're decent. And honestly, it's really easy to make them, like much easier than I expected. So let's keep going. Let's do a couple more.
17:42 David Pierce? Eleven Labs, the company we've talked about a bunch so far, has the simplest process of any that I've seen. You just sign up, upload a few minutes of audio. It actually explicitly says you only need about five minutes and that anything more is just overkill and you're off and running. So I added some Vergecast stuff, about 15 minutes in all, because you know, I'm an overachiever. And then just waited a while. This one only took a couple of minutes and we were up and running. "Hi, it's AI David Pierce again. This time I'm made by Eleven Labs, but I'm still me. Sort of. I think. You know what I mean?" I'm not gonna lie, that one kind of gave me goosebumps. It goes a little fast, like I don't think that's how you'd say that sentence, but this is way better than anything else I've tried or even heard. And it took a grand total of about 90 seconds to put
18:27 David Pierce? together. What's weird, though, is that it's not always this good. I clicked generate again with the same text and it spit back something subtly different and I think slightly worse. "Hi, it's AI David Pierce again. This time I'm made by Eleven Labs, but I'm still me. Sort of. I think. You know what I mean?" Again, really good. Better than anything else we've tried, but not quite as good as that first one, which is odd. It's just that pause in the first one, right before the word "sort of" is like exactly how I would have said that in real life. I still kind of can't get over it. It freaked me out. Anyway, let's try this model with our Dwight Tru speech. What is my perfect crime? I break into Tiffany's at midnight. Do I go for the vault? No, I go for the chandelier. It's priceless.
19:11 David Pierce? As I'm taking it down, a woman catches me. She tells me to stop. It's her father's business. She's Tiffany. I say no. We make love all night. In the morning, the cops come and I escape in one of their uniforms. I tell her to meet me in Mexico, but I go to Canada. I don't trust her. Besides, I like the cold. Thirty years later, I get a postcard. I have a son and he's the chief of police. This is where the story gets interesting. I tell Tiffany to meet me in Paris by the Trocadéro. She's been waiting for me all these years. She's never taken another lover. I don't care. I don't show up. I go to Berlin. That's where I stash the chandelier. That one's not perfect and it seems to me that it got a little worse as it went on.
19:55 David Pierce? The cadence got a little less human and a little more just kind of robot monotone. Everything takes the same time to say, you know what I mean? But I bet I could use that voice on almost anyone for a minute or two and get away with it. What is my perfect crime? Okay, let's try one more. This is the Apple Personal Voice feature, the one that's going to come to lots of people's iPhones. I suspect a lot of people are going to set this up pretty soon. This one took, by the way, the longest by far of any to set up. So the first thing I have to do is decide, do I want to share across devices? Sure. Do I want to allow apps to request to use? Why would I want that? Creating my personal voice. I'm going to read 150 phrases aloud, which may take about 15 minutes. Then it's going to generate it and then we'll go from there. All right, let's see.
20:38 David Pierce? That was the best movie I've ever seen. Are you still hungry? It's a beautiful day today. It's an extension of the nearby sea. Her style of painting shows the influence of the French artists. Then, once it was set up, it also took the longest to finish. Your phone has to be charging and not in use because all the training happens on your device and takes up a huge amount of energy. I love that it happens on device that's good for privacy reasons. It's good for lots of reasons, but it does take a while. So it took a couple of days, but I eventually had my voice ready to go. Hi, I'm David Pierce's AI iPhone voice. I'm kind of like David, but kind of not. Are we our phones? Are our phones us? Ordinarily, I think I would have been impressed by that.
21:21 David Pierce? But after hearing that Eleven Labs one, I'm kind of meh on this one. Let's try the Dwight Truitt test. Thirty years later, I get a postcard. I have a son and he's the chief of police. This is where the story gets interesting. I tell Tiffany to meet me in Paris by the Trocadéro. She's been waiting for me all these years. She's never taken another lover. I don't care. I don't show up. I go to Berlin. That's where I stash the chandelier. Still pretty okay, right? It kind of works, but nobody's going to confuse this with human David. And in general, I actually think that might be okay. AI voices are one of those things where the better they get, the stranger they get. Seriously, that feeling I got listening to the first time Eleven Labs spit out that
22:06 David Pierce? thing saying "I'm David Pierce" was genuinely kind of disconcerting. It raises all these big questions that, like with so many things about AI, we've really only begun dealing with. What does it mean that I can create a replica this good? And that they're only going to get better and easier over time? What responsibilities do I have as the person who made it and is using it, even though it's my voice? What responsibilities do other people have? What responsibilities do the services who make these voices for me have now that they have this incredibly personal thing of mine on their servers? We're having a lot of debates over AI music right now, obviously, as artists' voices are being used to train models that can make pretty convincing songs in just about anyone's voice.
22:50 David Pierce? You go on YouTube and you can hear AI Taylor Swift sing almost anything. You can hear AI Patrick from SpongeBob sing almost anything. All of that is going to spawn like a decade of interesting court cases and ethical debates, but those same issues are coming just for you and me in our everyday lives. How do we use these tools? How do we talk about the fact that they exist and how we're using them? Is it even possible to get the good, helpful, democratizing things from them without all the deep fakes and downsides? I don't know, but I do know it's well past time we started talking about it because the tech is really good right now and it's getting better really fast.
23:32 David Pierce? All right, that is enough AI talk for one day. We're going to be back next week to talk even more about AI music because I think that is one of the most interesting things in this space right now. Not just because of the big heady debates about it all, but because I think there are really interesting ways that AI can both help people make music and totally change all of our ideas about what music even is. It's going to be fascinating. We will also be back in this feed on Wednesday, too, with a big episode all about this week's Apple event. But until then, AI David, you want to do the credits? This show is produced by Andrew Marino and Liam James. Brooke Minter is our editorial director of audio. The Vergecast is a Verge production and part of the Vox Media Podcast Network.
24:14 David Pierce? If you have thoughts, questions, ideas, or anything else, you can email vergecastthewerge.com or call the Verge hotline at 866-VERGE11. We'll be back on Wednesday with a special show all about the Apple event and with all the rest of this week's news on Friday. We'll see you then. Rock and roll. Okay, not bad. Pretty good, AI David, for your first try, but it's [email protected] for the emails, and we really got to work on the sign-offs. Say it with me. Rock and roll.
24:53 Speaker 09 New and exclusive holiday decor just launched online at The Home Depot. Check out the viral Grand Duchess collection with smart holiday lights you can control from your phone. Easily customize the twinkle across trees, wreaths, and garlands to match your holiday vibe. Create stunning light effects, then switch it up with the tap of your fingers. Even the man in red will be impressed. Shop the holiday decor you want, online only, at homedepot.com.
25:24 Speaker 10 Everyone's got a hard question about AI. Your job, your kids, where it's going. Anthropic was built to surface those questions and share what it finds along the way, because there's hope in hard questions. Ask yours at claud.ai/spotify and keep thinking. That's claud.ai/spotify.
Previous How the iPhone 15 could still surprise us Next iPhone 15: the good, the bad, and the titanium Page updated October 26, 2026 · transcript and summary are machine-generated
