Everyone will be able to clone their voice in the future

For the next four Tuesdays, Verge senior reporter Ashley Carman will explore how artificial intelligence and machine learning are shaping the future of a variety of industries. In this episode, Ashley talks to AI companies that are working with voice synthesis to see why they are targeting the field of voice talent and podcasting and what cloning your voice can be used for in the future. Read more This podcast was made by producer Liam James, senior audio director Andru Marino, senior reporter James Vincent, and senior reporter Ashley Carman. Learn more about your ad choices. Visit podcastchoices.com/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  This episode is brought to you by On Investing, an original podcast from Charles Schwab. Each week, hosts Lizanne Saunders, Schwab's Chief Investment Strategist, and Colin Martin, Head of Fixed Income Research and Strategy for the Schwab Center for Financial Research, bring you fresh insights on what's happening in the markets and why, and what the implications might be for your portfolio. Join Colin and Lizanne as they explore questions like, how do you evaluate corporate bonds that look interesting? And what sectors are on the move right now? Download the latest episode and subscribe at schwab.com/oninvesting, or wherever you get your podcasts.

• 0:45Nilay Patel?

  Hey, Vergecast listeners, it's Neelai. For the next four Tuesdays in the Vergecast feed, we're going to be doing a little mini-series we made about the different uses of artificial intelligence and machine learning in a whole variety of contexts. It's all hosted by Verge senior reporter Ashley Carman, who is here. Hey, Ashley.

• 1:03Speaker 02

  Hello.

• 1:04Nilay Patel?

  We're going to get to the first episode in a second, but first, give us a broad overview. What is this series about?

• 1:09Speaker 02

  Yeah, so for a while now, we've, of course, heard lots of hype over AI, what it can do for us, for our work, and that basically a lot of tech companies are investing in it. So for this series, we really want to see how AI could actually be implemented in interesting ways and in industries you wouldn't immediately think of when you think about artificial intelligence. So we're going to be looking at areas like audio, video, text, and some other places about how they're currently using AI and how they might use it in the future.

• 1:38Nilay Patel?

  That sounds wide-ranging. Where are you starting this week in this episode?

• 1:42Speaker 02

  So this week, we are talking about voice clones. Maybe you've heard a little bit about it, like the Anthony Bourdain stuff.

• 1:49Nilay Patel?

  Yeah, and also I have to say that Vergecast producer Andrew Mariano has made a clone of his own voice, which is terrifying.

• 1:57Speaker 02

  Well, we have some surprises in this episode, too. There might be more terrifying things than Andrew's voice clone.

• 2:02Nilay Patel?

  Did you make a voice clone of yourself?

• 2:05Speaker 02

  I don't want to spoil anything.

• 2:07Nilay Patel?

  All right. Well, I'm very excited for this episode. Here it is, episode one of the Vergecast AI series. Roll the tape.

• 2:16Speaker 02

  The world today often feels like it's full of digital voices, with AI assistants like Siri, Amazon Alexa, and Google reading your messages, announcing the weather, and answering trivia.

• 2:27Speaker 03

  Here's what I found on the web.

• 2:29Speaker 02

  But if you think things are chatty now, just do wait. The voices of these AI assistants used to be based on real recordings. Voice actors spent hours talking in a studio, and these clips would be cut up and rearranged to create synthetic speech. But increasingly, these voices are being created using artificial intelligence. This means we can not only create more realistic computer voices, but clone the voices of real people much more quickly, creating endless artificial speech at the touch of a button. For example, it was surprisingly easy to make a synthetic version of my own voice.

• 3:06Speaker 02

  In case you missed that, that was not me talking. That was all made digitally by typing into a computer.

• 3:13Speaker 02

  So why would someone want to do this, besides the obvious novelty of it? You might have guessed a reason: to make some money.

• 3:20Speaker 04

  Hey, listeners, what's going on? Kevin Hart here, and I want to talk to you about why- Do we have to have mac and cheese every night? Think about it. That's why I recommend- Thousands of new shows and movies.

• 3:30Speaker 02

  This is a promo from Veritone One, a company that's working on an AI product to create synthetic voices and make them something the media industry wants to use.

• 3:39Speaker 05

  So we've created a platform AI, which, at the end of the day, turns unstructured data into structured data.

• 3:45Speaker 02

  That's Sean King, Executive Vice President at Veritone One.

• 3:48Speaker 05

  So if you're thinking about audio, thinking about video, things that are typically unstructured, and we make that searchable, discoverable through a host of different cognitive engines that are there, from transcription, speaker detection, speaker separation. And then we provide those tools to many different industries that are needing that.

• 4:06Speaker 02

  And where Veritone plans on really making cash with its Marvel AI product is what they can do with audio marketing.

• 4:12Speaker 05

  At the end of the day, we are an ad agency, and we specialize in audio and influencer media. And with that, we're able to take these tools and be able to help provide better attribution and better efficacy to the ad performance for these campaigns.

• 4:26Speaker 02

  In other words, they are making realistic voice clones for voice actors, podcasters, and other celebrities so they can spend less time in the studio recording while the companies that hire them can save more production time and money, especially if they need to rerecord a few sentences in a larger project.

• 4:43Speaker 05

  You know, the hardest part about someone's voice and being able to use it and being able to expand upon that is the individual's time. A person becomes the limiting factor in what we're doing.

• 4:55Speaker 02

  The time aspect could make sense for voice artists, especially those who aren't able to do voice acting full-time. For example, you know those station IDs you hear on your local radio station from famous musicians?

• 5:06Speaker 06

  Hi, this is Lionel Richie. This is Billy Joel. This is Pink. What's up? This is Justin Timberlake.

• 5:11Speaker 02

  Those promos are actually recorded all at once in a studio somewhere and aired on a bunch of radio stations across the country. Even though they're recording this in batches, it takes a lot of time, time that is not always available for these stars. So with a company like Veritone, an artist would be able to create a synthetic version of their voice and use it to create these promos, all without having to go into a recording studio.

• 5:34Speaker 05

  We're able to use technology to be able to make that personalization or that localization and really be able to still use the person's, their trusted voice that the consumer wants and is accustomed to hearing, but not having to have that person's time to be the limiting factor.

• 5:51Speaker 02

  This could also potentially be used for actors who can't use their voice anymore. Recently, a British company called Synatic created a model of actor Val Kilmer's voice, which he lost in 2014 after a tracheotomy due to throat cancer.

• 6:06Speaker 07

  But now I can express myself again. I can bring these dreams to you, show you this part of myself once more.

• 6:13Speaker 02

  That's definitely impressive. And for voice actors who already have an archive of recordings of their voice, it could end up being a career saver. But we wanted to hear directly from voiceover talent ourselves. Could voice synthesis create a more fruitful business for them? And do they want this?

• 6:29Speaker 08

  The folks who were consummate professionals do not buy that. And no one is talking about this in an excited way.

• 6:35Speaker 02

  We talked to Andia Winslow, a working voice artist and narrator in the VO talent industry.

• 6:40Speaker 08

  I do commercial promos, in-show narration, video games, animation, voice of God, live events, and audiobooks. So seven different genres.

• 6:49Speaker 02

  Andia says the potential for voice synthesis is talked about a lot in the industry. But she doesn't really see it as useful in her line of work.

• 6:57Speaker 08

  Folks who look at voice acting or voiceover narration as a money thing, perhaps they do, but people who look at it as an art, they do not.

• 7:03Speaker 02

  When it comes to artistic expression and natural performance, this technology might not be applicable to an industry that relies so deeply on the human element.

• 7:11Speaker 08

  For big stuff, things that need breadth and life, it's not going to go that way because partly, these brands like working with the celebrities they hire, for example. I can't see this being something like Cameo where people have their voice bank read to adoring fans who pay. I don't see that happening.

• 7:27Speaker 02

  Her take is that voice synthesis would really only work for mass quantity projects.

• 7:32Speaker 08

  E-learning, corporate intake, mass transit communication, that work will probably go ultimately, probably three to 10 years to AI because it's easier to create. You're not looking for human element. You're not looking for humanity in the voice. You're just looking for the dissemination of information. And I think those types of jobs, those will be automated and people will lose that market share.

• 7:52Speaker 02

  That seems spot on. It'll likely be cheaper to rent a voice, especially for industries like transportation or education that need to update what they're saying regularly. This is already being used in train systems in Sweden.

• 8:11Speaker 02

  But Veritone also makes the case that voice synthesis could fill in in situations that are too difficult and expensive to do with humans, like when trying to overcome language barriers.

• 8:21Speaker 05

  Right now, we're hearing this podcast and everyone's going to hear us in English because we're both sitting here and we're both speaking and we're talking about it. And so the person that's sitting in Italy is going to hear the same thing that we're talking about today. Well, there is a future here where we can have our voices and the person who downloads it in Italy can hear our voices, but actually hear us speaking Italian and being able to kind of personalize this podcast and localize it specifically to the user. And if we're able to do that, what does it mean to the success of the podcast globally? How many new people are we going to be able to engage with as a result of that?

• 8:55Speaker 02

  This could also work for TV and movies. Perhaps you could watch a James Bond movie in Thai with Daniel Craig speaking Thai in his own voice because of voice synthesis. Or you could listen to this podcast in Spanish. Este soy yo diciendo algo en español con mi propia voz.

• 9:12Speaker 05

  If you're living in an area where you have a high degree of people that are speaking English, that are speaking Spanish, that are speaking Mandarin, whatever the different ones are, you know, to be able to take an important statement and something that you want to share and important news and be able to have that versioning out there so that it's more inclusive to everyone that's in your community is another great opportunity. And, you know, I think at the end of the day, we're just beginning to scratch the surface.

• 9:40Speaker 02

  Andia remains unconvinced, though, and warns that we should remain skeptical of technology that intends to disrupt an industry.

• 9:46Speaker 08

  Is disruption always a good thing? So like automation in the workforce, this automation and voice acting, what does it do to the creative and the collaborative process? And like the production ecosystem, what about all my friends who are mixers and producers and artistic directors and copyright, what about them?

• 10:03Speaker 02

  There's no clear answers right now. Everyone is going to have a different opinion, but that doesn't change the fact that this technology is being developed and becoming more widely available. But how easy is it to create a synthetic voice right now? And how realistic do they actually sound? We wanted to try this out ourselves with Veritone and walk you through the whole process with us. I'm ready to be voice cloned.

• 10:27Speaker 02

  First, of course, we need to give verbal consent to Veritone to be able to use my voice to create a synthetic version.

• 10:32Speaker 08

  I, Ashley Carmen, am aware that recordings-

• 10:35Speaker 02

  Next, we need to give the AI data. In this case, that's a bunch of audio of myself speaking, ideally with a consistent audio setup. Luckily for me, I've been podcasting at The Verge for years, so we submitted a compilation of about 90 minutes' worth of audio from various episodes of my show, "Why'd You Push That Button?" If you ask me, "How are you doing today?" And I'm just like, "I'm good."

• 10:56Speaker 08

  Another friend texted me an old friend.

• 10:59Speaker 02

  Then we sent that over to Veritone.

• 11:01Speaker 05

  And that is effectively the training data, in which we are feeding into the cognitive engines and the neural networks that are then using the sounds, using their utterances to be able to train the model to be able to create those two different modalities of that person's voice.

• 11:15Speaker 02

  There are two different methods we can use to control this voice. One is a text-to-speech, which you might be familiar with. It's where someone can type a statement on my behalf and render it in my voice. "What I'm saying next here is totally based off text." "What I'm saying here is totally based off text." How do I sound? Would I be able to use this voice in my podcast from now on? I could use a vacation. Perhaps I can go to the Galapagos Islands to see the giant tortoises, or the finches or iguanas. I'm sure I would love that.

• 11:49Speaker 02

  Some of it sounds like what I would probably say, but then there's phrases like "Galapagos Islands" that just throw off the entire sentence. "Galapagos Islands," I do not think this could be used as a podcast narrator. I mean, it could. It just would not be a very good one. It would not make for a good show. Maybe my synthetic voice can do the podcast advertisements for me?

• 12:12Speaker 02

  Veritone also offers a speech-to-speech mode. In this method, someone can record themselves saying what they would want their talent to say, and the AI would mimic the ways that person speaks. The pauses, the intonation, the emphasis, sort of like a computerized voice changer.

• 12:29Speaker 02

  This theoretically would be a more realistic sounding render of voice synthesis, whereas the text to speech can sound more monotonous and stale or robotic. Hey, who are you calling stale? In order to train the AI for speech to speech mode, it would need not only the voice talent recordings, but also recordings of the user who would be speaking in their voice. We intended to test this technology for the podcast using my voice and our director Andrews. But instead, Veritone was only able to demo it with me speaking in the voice of EA Sports and professional hockey announcer Randy Hahn. The voices of these AI assistants used to be based on real recordings.

• 13:08Speaker 09

  Voice actors spent hours talking in a studio, and these clips would be cut up and rearranged to create synthetic speech. But increasingly, these voices are being created using artificial intelligence. This means we can not only create more realistic computer voices, but clone the voices of real people much more quickly, creating endless artificial speech at the touch of a button.

• 13:32Speaker 02

  This sounds definitely more believable than the text to speech, but it's still not totally right. So the tech right now probably isn't going to work really well for full advertisements or movie scripts. Instead, it might be more useful to replace only a few words.

• 13:51Speaker 02

  And that's how the company Descript has been implementing this technology, specifically in the podcast editing space.

• 13:57Speaker 10

  We had a pretty basic idea, which was make an audio editor that works like a word processor, where you can just edit the audio by editing text.

• 14:05Speaker 02

  That voice is Andrew Mason, the CEO of Descript, whose audio editing app is available for anyone on the internet to use right now.

• 14:13Speaker 10

  We're trying to create a new kind of audio video editor that not only can live across both of those mediums, but is also much easier to master.

• 14:23Speaker 02

  Descript's editor has a variety of features that helps with editing audio in a text-based program. Once you upload your audio to Descript, the program will automatically transcribe everything that's been said in the recording. From there, you can start editing. If you need to take out a bunch of filler words, like ums or uhs, or parts of a conversation you want to trim down, in Descript, you can just highlight the text corresponding to that audio section and delete it. The same goes for pasting certain sections of audio, the same way you would in Microsoft Word or Google Docs. And then there's the feature called overdub.

• 14:59Speaker 10

  Overdub completes the equation by also letting people type. And what I mean by that is you can not only delete words in Descript and have it delete the audio, you can type words and it will generate audio in your voice.

• 15:13Speaker 02

  That's where AI comes in, generating your voice to fill in any gaps. All you have to do is type. Like Veritone, Descript requires you, or the person who is in the audio recording, to record 30 to 90 minutes of spoken word content to train the AI to make a synthetic version of the voice to insert into your project. For this, I had to read a specific script from the show Planet Earth. A hundred years ago, there were one and a half billion people on Earth. Now- Once that audio is uploaded to Descript, optimized and active, in our experience, this only took a couple of hours, it's ready for you to use.

• 15:51Speaker 02

  Alright, so let's do a demo of Descript's overdub feature. We're gonna play a game with you, the audience, to see if you can tell what word we overdubbed in this sentence. "The world today often feels like it's full of digital voices, with AI assistants like Siri, Amazon Alexa, and Google delivering your messages, announcing the weather, and answering trivia." So which word do you think is synthesized? Or, better said, which word do you think we just typed into an app and it generated my voice for? It was the word "delivering." So we're gonna play this clip one more time and pay attention to that word. "The world today often feels like it's full of digital voices, with AI assistants like

• 16:33Speaker 02

  Siri, Amazon Alexa, and Google delivering your messages, announcing the weather, and answering trivia." Now that I pointed it out to you, you probably can hear how this sounds a little funky, but would you have noticed if I didn't point it out to you? I'm curious what someone who works and edits audio all day thinks about this. Like, what could they do to maybe make the sound even more believable? So we're going to bring in Andrew, our podcast director. Hey, Andrew.

• 16:59Speaker 11

  Hello.

• 16:59Speaker 02

  To hear what he thinks. What do you think?

• 17:01Speaker 11

  So what's impressive about it is the quality of audio that it generates is pretty high fidelity, and it kind of has to be so it can match with the high-quality audio recordings of a podcast. Otherwise, like, from other voice synthesis that we've seen, it's kind of low-fidelity audio. And if you were to splice that in, it would sound a little off, kind of like a lo-fi MP3 in a high-fidelity audio recording.

• 17:30Speaker 02

  This is Ashley speaking solely with Descript's overdub feature. Okay, so, I guess, then, would you use this?

• 17:37Speaker 11

  I would try to use it, but I am still skeptical of using it. In my scenario, we have a studio, we can go to a studio anytime we want and re-record something. But in a situation where someone is not able to go into a studio, or they have to pay extra for a studio time, and this is kind of like the only option they have, I think it would work pretty well.

• 17:59Speaker 02

  So we're just using Descript's app for this? Like, that's just, quote-unquote, like, raw audio? We haven't edited that clip. But I'm wondering if, in whatever audio editing app you use, if you would be able to actually make that sound a little bit better somehow?

• 18:14Speaker 11

  If I were using this in my podcast, I would be editing it in another program eventually. So, in my case, listening to it, I would try to massage it a little bit to make it sound a little more smooth and unnoticedable. But I think in Descript's scenario, they want Descript to be kind of all-in-the-box software, that you wouldn't be exporting this to another software and massaging it. So, it's not all the way there yet, but it's super impressive.

• 18:51Speaker 02

  Right now, we aren't seeing a ton of this technology in use today, the way we laid out here. But when we do, it tends to be pretty controversial. Recently, a documentary about the late TV personality and chef Anthony Bourdain attracted criticism after it was revealed that the film used a synthetic version of Bourdain's voice.

• 19:10Speaker 12

  You were successful, and I am successful. And I'm wondering, are you happy?

• 19:16Speaker 02

  The director later confirmed that this was made with AI from old recordings of Bourdain before he died. This brought up a continued discussion around the ethics of voice synthesis and when it's OK to use. That's why a lot of these companies working in voice synthesis have really tried to make sure that the person whose voice you're synthesizing knows it's being synthesized and has given the OK.

• 19:36Speaker 10

  We've created a pretty bright line on what you're allowed to do using Descript. You can only copy your own voice. Now, that's mostly just to keep us out of the debate. Because the fact of the matter is that anybody that wants to can go out on the internet and relatively easily find ways to clone people's voices using other technology out there.

• 20:01Speaker 02

  Veritone also stresses consent first before they render anyone's voice. They've even developed a way to watermark the audio so there's a lesser chance anyone gets fooled or misled. Or if they are, Veritone can definitively say whether the audio is legitimate or not.

• 20:16Speaker 05

  And we partnered with groups like the Open Voice Network, who is part of the Linux Foundation, to help bring better awareness and rules of engagement around synthetic content, specifically synthetic voice. At the end of the day, the consumer or the in- listener shouldn't feel or be tricked in any way, if that makes sense.

• 20:37Speaker 02

  But it gets trickier if someone is no longer around to object to how their voice is being used.

• 20:42Speaker 05

  We have been approached by many people working on projects like that. But for us, we need to understand and how we begin to work through those is, who's the executor of that individual's estate? Is it their widow or widower? Is it their estate manager, the executor of the estate, the legal team? It really, again, comes down to who has the authority of that person's consent and to give that consent.

• 21:05Speaker 02

  Veritone and Descript might have a consent-first approach, but not all companies have to operate like that, especially as this technology becomes more democratized and affordable. A similar conversation with consent started recently with TikTok's text-to-speech feature.

• 21:21Speaker 03

  How text messages go with my younger brother? Yo, sis. Yo, bro.

• 21:26Speaker 08

  There was a case of Bev Standing in TikTok, which is owned by ByteDance, as you know, in which an assign bought her bank of recorded audio that she had made years prior for the Chinese Institute of Acoustics. And then they repurposed her text-for-speech to the social media app TikTok without any notice, without compensation. So that was a big surprise. Everyone started sending me these videos going, this is you, this is you. And that's how I found out.

• 21:50Speaker 02

  This story was not about AI, but power dynamics and data rights, a problem that AI could exacerbate. Once it's easy to make a voice clone of someone, how might that be used in the future? Could smaller voice stars be forced to sign away their rights to their voice in perpetuity, for example? These individuals might not have the resources to fight big companies that misuse their voice, while celebrities would have the agents and lawyers to argue on their behalf.

• 22:16Speaker 08

  The union players are going to be protected from this use and misuse, but folks who are in the margins or not quite ready to or able or disinterested in joining the union, they're going to face challenges like Bev Standing did for her. So I think it matters also where you are in your career.

• 22:32Speaker 02

  We're left with a lot of questions, though, about how we're going to use this technology. Maybe someone can approve the use of their voice to be used after they pass, but who knows what their voice could be used for in the future? To spread misinformation? Endorse a product they went against morally? And what about the audience? How and when do we indicate what you're listening to is a synthetic voice and not the real thing? The field is still new, and we're all still figuring it out together.

• 23:00Speaker 02

  But at this point, I want to take what we've learned here to discuss it further with a colleague of mine, James Vincent, The Verge's London-based reporter who writes about artificial intelligence and machine learning, which includes, of course, voice synthesis. We're going to take a break, but when we come back, I'll talk to James, and we'll chat about the potential of the synthesized voice.

• 23:30Speaker 00

  This episode is brought to you by On Investing, an original podcast from Charles Schwab. Each week, hosts Lizanne Saunders, Schwab's chief investment strategist, and Colin Martin, head of fixed income research and strategy for the Schwab Center for Financial Research, bring you fresh insights on what's happening in the markets and why, and what the implications might be for your portfolio. Join Colin and Lizanne as they explore questions like, how do you evaluate corporate bonds that look interesting? And what sectors are on the move right now? Download the latest episode and subscribe at schwab.com/oninvesting or wherever you get your podcasts.

• 24:25Speaker 02

  And we're back. We're here with James Vincent, senior reporter at The Verge, whose specialty is AI and machine learning. Hello, James.

• 24:33Speaker 13

  Hello, Ashley. How are you doing today?

• 24:35Speaker 02

  I'm great. It's always a treat to see you.

• 24:38Speaker 13

  Thank you.

• 24:40Speaker 02

  So obviously, you have been reporting on AI and machine learning here at The Verge for years. I trust you. You're going to give us the real take. You're going to give us skepticism, that wry British wit. I'm ready for it. Obviously, in this episode, we're talking about voice synthesis. And I wanted to hear just from you, there's a lot of hype around this right now, specifically because of the Anthony Bourdain documentary. We're hearing a lot about it. People are writing about it. Do you think this industry is something that we need to be paying attention to? We've just done a whole podcast episode, so I hope the answer is yes. Or do you think this is kind of overhyped, maybe something that's not going to play as big of an importance in the world going forward?

• 25:18Speaker 13

  So yeah, I mean, I am not as skeptical as you might be expecting me to be. I genuinely think the technology is here. I think the technology is impressive. And unlike some applications we see in AI, in machine learning, it's much closer to just being out there. You know, you've been speaking to Veritone. You know, they have a product. It's being used. It's ready to go. And that's quite unusual sometimes in AI. What I think is overhyped is when we think about the potential impact this will have. I think the reason that, for example, the Anthony Bourdain documentary caused such a huge discussion, obviously, it's the novelty of it. And it's bringing with it a lot of ethical questions that we've not dealt with. But I think once those have gone past, the actual impact on the industry will be smaller than we're currently thinking now.

• 26:03Speaker 13

  But as I say, the technology that's here is very exciting. I'm super into it.

• 26:07Speaker 02

  Yeah. And I mean, obviously, whenever we talk a lot about new technology, again, here at The Verge, we tend to sort of look at the potential future misuse of it. So having kind of your ear to the ground on the reporting here, do you think there's enough discussion going on around ways this technology could be misused? And enough forethought going into how to prevent that?

• 26:29Speaker 13

  I don't know in terms of forethought. It's difficult to say. So one of the big uses for this is going to be fraud. We've already had reported accounts, only a couple, but they've been trickling out about fraud cases to do with banks, to do with financial transfers, where someone has created an AI fake of a CEO's voice and said, yes, I authorize you to send me, you know, 300,000 euros over the wire. And they just believed that and it just happened. And that's wild to me. But I don't think that necessarily creates a completely new threat model. If you found someone who could do a good impersonation of your CEO or you convinced them that you were speaking over a crackly phone line and that's why they sounded weird, that's just social engineering. That happens a lot anyway.

• 27:12Speaker 13

  So I don't think this makes a completely new threat out there in the world, but it will make the access to that sort of attack much easier. And I know, for example, it's something that's a huge problem in the US with spam calls. And if you start getting, you know, if your parents start getting spam calls which sound, I don't know, a little like their daughter or their son, that's going to be super freaky. And that's something that could really plausibly happen. So I think it's something that people need to be aware of.

• 27:38Speaker 02

  Yeah, that was my parents' first reaction when I played them my synthetic voices. They were freaked out because it's happened to my grandfather where he got like a scary phone call from someone crying, claiming to be my brother. And he was like, what the like, asking for money.

• 27:51Speaker 13

  That's crazy.

• 27:52Speaker 02

  Imagine if that was actually my brother's voice. I mean, it already pretty much duped my grandpa, like he called my mom. But like, still, if it had actually been my brother's voice or my voice, that's terrifying.

• 28:02Speaker 13

  Yeah. And it's going to be one of those things where we start to rethink what information about us is available online. So I think it's something over the past couple of years, we're now all quite aware of the fact that, hey, if you're on Facebook and you've got a lot of public photos of you about, then someone could use those for mischief. They could create a fake account that pretends to be you. And I think in the future, we're going to now start thinking, oh, is there quite a bit of audio of me online that someone could use to create a fake? And now, for most of the listeners, that's probably not going to be a huge problem. For you, Ashley Carmen, host of popular podcast On The Verge, that's actually a huge problem. I mean, are you, does it worry you?

• 28:41Speaker 02

  Yes, it does. I

• 28:43Speaker 13

  I'm sorry.

• 28:44Speaker 02

  I already am anxiety prone, so it's not exactly ideal. But no, I do think about that because obviously, we have tons of videos of us at The Verge.

• 28:53Speaker 13

  Yeah.

• 28:54Speaker 02

  Like, if you wanted to clone me in any way whatsoever, the data is ripe for the taking. So, enjoy.

• 29:00Speaker 13

  Right. And I think that creates this new level of threat for people who have perhaps, let's say, a semi-public profile. I don't know how you'd categorize yourself in that. But obviously, you know, I think as journalists, we do have that. We're not, we're not all famous, obviously, but we have information about us that's out there in a way that it isn't for everyone. And I think it does create a new threat for that sort of individual. And obviously, it's not just journalists. It's, say, you're a company CEO, you know, that's the fraud example I used. If you have an earnings call, then there's lots of audio of you out there. Every time you've done an earnings call, there's going to be recordings of that accessible online, transcripts, and someone can scrape that data very easily and turn that into a new type of attack. Whether it's something that's being talked

• 29:43Speaker 13

  about enough, I don't know. But I think it's like, it's one of those problems that as soon as we start seeing more cases of it that get public discussion, like the Anthony Bourdain thing, then we're going to start seeing reactions to this from these companies. That's why I think it's great to be talking about this stuff now, because the more people know about it, the less of a threat it is.

• 30:03Speaker 02

  I'm curious also about the economics of this. Like whether this will be something that will be democratized for everybody that like anyone and their mom, if they are willing to record 90 minutes of audio could theoretically make a voice clone of themselves, or if this is going to kind of stay at the higher end of cost where you have to kind of be willing to dedicate the time and money and also maybe just use it for economic gains, like for advertisement reading, like we've talked about.

• 30:30Speaker 13

  I think it'll really come down in terms of costs and training data needed. I know, you know, you've had to record 60 minutes, 90 minutes of audio to get your personal clones, but I think that'll come down and probably we'll see it with 10 minutes of audio or something like that. Or actually, you just have a phone call and it gets enough. I think that that'll definitely happen. I don't think it'll be economically useful to everyone, but I think it will be interesting and fun, you know, creating a voice clone that, for example, you know, say you're playing a video game and you design your character at the beginning of it and maybe you make them look like you and maybe you record five minutes of audio to make it sound like you. So when you're out in the video game world, your character speaks with your voice.

• 31:11Speaker 13

  And I feel applications like that could become quite common and quite accessible, you know, within five, 10 years or something like that. But, you know, it'll take that long to trickle in, but I think that's a very plausible timeframe. But another one would be a sort of story time app for children in which a parent would create a voice clone of themselves and then they could feed that into a little box, a little app that then reads all their child's favorite stories in their voice. So if they are traveling in another country, if they are unavailable in some way, then they will still be able to speak to their child. And you could actually have that with a sort of voice assistant where your child gets to speak to a voice assistant that sounds like mum and dad. And that won't be everyone's cup of tea, definitely not, but I can imagine some people who would like that.

• 31:55Speaker 13

  Yeah, so I think there are lots of these little use cases that will come out there. I think the big impact is going to be in the world of celebrity and in the world of media and entertainment, which you've obviously discussed already. But I think as ever with this tech, there are always unexpected ways that it shows up in the world. And I'm really, I'm really interested to see how this one does show up.

• 32:15Speaker 02

  It's interesting to me because in this episode, we talk about how some of these celebrities or voiceover talent are going to have to protect themselves just through contracts. Like, they have lawyers, agents, everybody who's willing to kind of make sure that their voice is protected. And I'm just wondering if, like, the practical person might have to start thinking about these things, like, when they die, if in their will, they're going to be like, "The rights to my voice, not that they're famous or anything, but just purely, like, you know, you can leave your Facebook page to your family. I'm going to leave my voice recordings to my family to not do what they wish with it."

• 32:47Speaker 13

  Absolutely. I mean, I feel there's already companies that, as you say, that look after your digital assets. And I think the voice will be added to that pile. And there may be some people who are quite happy with saying, "You know what? I'm not going to get to speak to my great-grandkids." But they might want to create, my children might want to create a voice clone of me so they can speak to their great-grandpa. But there might be some people who are uncomfortable with that. And yeah, they want to include that sort of provision in their will, that they are not to be reanimated using this AI technology. I can absolutely see that happening.

• 33:19Speaker 02

  So I've obviously made some voice clones of myself. Are you thinking about, do you want to make your own voice clone? Have you done it already?

• 33:27Speaker 13

  I very much want to make my own voice clone. I'm actually in the process of making one now, and then I can have conversations with myself every day of the week.

• 33:35Speaker 02

  Because actually, my concern here is, I'm like, no distaveritone? But I'm like, okay, after this episode's done, I gotta email them and tell them to delete my data ASAP. So that doesn't concern you as much?

• 33:47Speaker 13

  Okay, now you've said it. Yeah, it really concerns me. You know, yeah, look, I would like a clone, and I would keep it in a little box on my desktop, and no one would ever be able to use it but me. But you're totally right. Do I want it to be out there? Would I be comfortable if there was a website that said, "Anyone can talk like James Vincent"? Oh, God knows why they'd want to. But anyone can do it, and they can type in it and make me say whatever. That would make me hugely uncomfortable. No, I would, thank you, I'm gonna go delete all that data.

• 34:14Speaker 02

  Exactly. The internet-connected part of it, I think that's a little scarier. Like, again, if you just had this little effect in some Adobe program where you could just be like, "Today, I'm gonna turn on my voice." Okay, that's sort of fun. But the idea that it might have to live elsewhere is the scary part, I guess.

• 34:31Speaker 13

  Yeah. It's when it's outside your control, that's when it becomes a threat.

• 34:35Speaker 02

  Right. Well, what a lovely, positive note to end on.

• 34:40Speaker 02

  No, but this has been a great discussion. I really, really appreciate you coming on. And everyone who's listening to this episode is going to hear you in our future episodes. Hopefully they tune in to hear more of your thoughts. Thank you so much for helping out and being on and giving us, like I said, the real take.

• 34:54Speaker 13

  No problem, Ashley. Absolute pleasure to talk, and I look forward to speaking again in the future. Or me or my clone, who knows?

• 35:09Speaker 02

  Thanks for listening to the first episode of the Vergecast AI Series. This podcast was made by producer Liam James, senior audio director Andru Marino, senior reporter James Vincent, and me, senior reporter Ashley Carmen. See you next week.

• 35:33Speaker 14

  Your heart can tell you a lot about your health. Apple Watch Series 12 measures your heart rate every five seconds with the most accurate heart rate sensing in a wearable. So your vitals app, now with heart rate variability, can tell you when something is off. And your readiness score can let you know when to rest and when to push. Hear the story in every heartbeat with Apple Watch Series 12. The features described are for wellness purposes only and not for medical use. iPhone 11 or later required. Based on Apple conducted study of heart rate accuracy, August 2026. Visit apple.com slash apple watch series 12.