Pod Insights Decoder The AI election deepfakes have arrived About this episode Decoder is off this week for a short end-of-summer break. We’ll be back with both our interview and explainer episodes after the Labor Day holiday. In the meantime we thought we’d re-share an explainer that’s taken on a whole new relevance in the last couple weeks, about deepfakes and misinformation.
In February, I talked with Verge policy editor Adi Robertson how the generative AI boom might start fueling a wave of election-related misinformation, especially deepfakes and manipulated media. It’s not been quite an apocalyptic AI free-for-all out there. But the election itself took some really unexpected turns in these last couple of months. Now we’re heading into the big, noisy home stretch, and use of AI is starting to get really weird — and much more troublesome.
Links:
The AI-generated hell of the 2024 election | The Verge
AI deepfakes are cheap, easy, and coming for the 2024 election | Decoder
Elon Musk posts deepfake of Kamala Harris that violates X policy | The Verge
Donald Trump posts a fake AI-generated Taylor Swift endorsement | The Verge
X’s Grok now points to government site after misinformation warnings | The Verge
Political ads could require AI-generated content disclosures soon | The Verge
The Copyright Office calls for a new federal law regulating deepfakes | The Verge
How AI companies are reckoning with elections | The Verge
The lame AI meme election | Axios
Deepfakes' parody loophole | Axios
Credits:
Decoder is a production of The Verge and part of the Vox Media Podcast Network.
Our producers are Kate Cox and Nick Statt. Our editor is Callie Wright. Our supervising producer is Liam James.
The Decoder music is by Breakmaster Cylinder.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
Transcript 7,629 words · 12 speakers
0:00 Speaker 00 Companies shouldn't have to choose between speed and control. Amex Corporate connects cards with flexible spending controls and real-time visibility to help teams adapt faster. Built to simplify, designed to scale. This is Amex Corporate. Get started at go.amex/ammexcorporate. Terms apply.
0:24 Speaker 01 Are your ad campaigns lighting up the dashboard? But not the pipeline? That's bull spend. And marketers are calling it out in dashboard confessions.
0:33 Speaker 02 My boss asked for results, so I opened my dashboard for the only positive sounding metric I had: impressions.
0:41 Speaker 01 Cut the bull spend. See revenue, not just reach. LinkedIn delivers the highest return on ad spend of major ad networks. Advertise on LinkedIn. Spend $250 on your first campaign and get a $250 credit. Go to LinkedIn.com/campaign. Terms and conditions apply.
0:55 Speaker 03 Hello and welcome to Decoder. I'm Neil Apetel, editor in chief of The Verge, and Decoder is my show about big ideas and other problems. We're on a short summer break right now. We'll be back after Labor Day with new interview and explainer episodes and pretty excited about what's on the schedule. In the meantime, we thought we'd reshare an explainer that's taken on a whole new relevance these last couple of weeks. It's about deepfakes and misinformation. In February, I talked with The Verge Policy Editor Addie Robertson about how the generative AI boom might start fueling a wave of election-related misinformation, especially AI-generated deepfakes and manipulated media. At the time, the biggest news in AI fakes was a robocall with an AI version of Joe Biden's voice. It's been about six months, and while there hasn't been quite an apocalyptic AI free-for-all out there, the election itself
1:39 Speaker 03 took some pretty unexpected turns. Now, we're headed into the big, noisy home stretch before Election Day, and the use of AI is starting to get really weird and much more troublesome. Elon Musk's X has become the de facto platform for AI-generated misinformation, and Trump's campaign has also started to boost its own AI use. For the most part, these AI stunts have been mostly for cheap laughs, unless Taylor Swift decides to sue the Trump campaign. But as you'll hear Addie and I talk about in this episode, there are not a lot of easy avenues to regulate this kind of media without running headlong into the First Amendment, especially when dealing with political commentary around public figures. There's a lot going on here and a lot of very difficult problems to solve that haven't really changed since we last talked about it. Okay, AI deepfakes during the 2024 election. Here we go.
2:37 Speaker 03 Addie Robertson, how are you doing?
2:38 Speaker 04 Hi, good.
2:39 Speaker 03 You've been tracking this conversation for a very long time. It does seem like there's more nuance in the disinformation conversation than before. It's not just Russia made people elect Trump, which is, I think, where we were in 2016. Can you just give a background? What's the shape of how people are thinking of disinformation right now?
2:56 Speaker 04 We've had, I think, about three major in the US presidential election cycles where disinformation was a huge issue. 2016, where there was a lot of discussion in the aftermath about, all right, was there foreign meddling in the election? Were people being influenced by these coordinated campaigns? There was 2020 where deepfakes technically did exist, but generative AI tools were just not as sophisticated. They were not as easy to use. They were not nearly as prevalent. And so there was a huge conversation about what role do social platforms play in preventing general manipulated information? And there was, in a lot of ways, a huge crackdown.
3:38 Speaker 04 There was the entire issue of stop the steal. There are these large movements that are trying to just lie about who won the election. What do we do? There were questions about, all right, do we kick Trump off social networks? These were the locus of debate. And now it's 2024 and we have, in some ways, I think, a little bit of a hangover from 2020 where platforms are really tired of policing this. And so they're dealing with, all right, how do we renegotiate this for the 2024 election? And then you have this whole other layer of generative AI imagery, whether or not you want to technically call it deepfakes is like an open question.
4:20 Speaker 04 And then there are all the layers of how that gets disseminated and whether that turbocharges a bunch of issues that already existed.
4:30 Speaker 03 So the platforms are getting tired of this is worth talking about for one second longer. There was a huge rush of how do we make ultra sophisticated content moderation systems? And I think the pinnacle of that rush was Facebook setting up its Oversight Board, which is effectively a Supreme Court of content moderation decisions. And that was seen as, okay, Facebook is as big as a state. It has the revenue of a state. It's a government now. It's going to have some government like functions to regulate speech on its platforms. That didn't pan out, right? Like, the Oversight Board exists, it moves very slowly. It's, I think, hard for the average Facebook user or average Instagram
5:10 Speaker 03 user to think there's a moderating force on content moderation on this platform. It's the same as it ever was for the user perspective, as far as I can tell.
5:20 Speaker 04 Yeah, I think that the Oversight Board, what it tends to do is, that is maybe comparable to the Supreme Court, is do sophisticated outside thinking about what does a consistent moderation framework look like? But like, the Supreme Court in real life does not adjudicate every single complaint that you have. You have a whole bunch of other courts. Facebook doesn't have really those other courts. Facebook has a gigantic army of moderators who don't always necessarily even see its policies. So yeah, it's this very macro level, we're going to do the big thinking. But also, even at the time, there was the question of, is this really just Facebook, or now Meta, kind of outsourcing and kicking the can out of
6:02 Speaker 04 its court? And putting the hard questions on other people?
6:07 Speaker 03 I wanted to bring that up specifically because that was the pinnacle, I think, of the big thinks about content moderation. Since that time, the companies have all done lots of layoffs. We've seen trust and safety diminished across the board. I think most famously with Twitter, now X, Elon Musk basically decimated the trust and safety team on that platform. It appears Lyndon Yaccarino is trying to bring some of them back. But the idea that content moderation is the thing these platforms have to do has, is no longer in vogue, I think, the way it was when the Oversight Board was created.
6:41 Speaker 04 Yeah, and part of this is also political that there was a huge largely in the again in the US right wing backlash to this, that this was the kind of thing that would get a state attorney general mad at you and get a congressional committee to investigate you as it ended up doing with pre Musk Twitter. I think that yeah, there became a real political price for doing this as well. Since then, some platforms have let Donald Trump back on. They've said, all right, but we cannot possibly moderate every single lie on this. We're going to just wash our hands of whether you're saying the election was stolen or not.
7:19 Speaker 03 Yeah, let's go through the new players and how they might turbocharge the disinformation conversation now. And then let's talk about what might be done about it. I do just want to emphasize for the audience, it doesn't seem like the desire to regulate information on social networks is nearly as high as it has been in the past. And I think that is an important thing to start with because the technical challenges are so hard that wanting to solve them is actually an important component of the puzzle. But let's talk about the actual technical challenges and the players behind them. OpenAI, that's a new company. There are a lot of other new companies in various stages of controversy. So Midjourney
8:00 Speaker 03 exists, that is an image generator. Stability AI exists, another image generator. They're getting sued by Getty for using the Getty library allegedly to train images that look like Getty photos. In this context, very important. Midjourney is getting sued as well. OpenAI is getting sued for training on the New York Times database. Just a few days ago, OpenAI announced Sora, its text to video generator, which frankly makes terrifying videos. All those videos are terrifying. But you can see how An enterprising scammer could immediately use that to make something that looks like compelling video of something that didn't happen. All of these companies talk about AI alignment, making sure AI doesn't go off the rails. Where's the AI industry broadly on we shouldn't do
8:45 Speaker 03 political deep fakes? Do they have a unified point of view? Are they all in different spots? How's that working out?
8:50 Speaker 04 The companies are in slightly different spots, but they actually have come together. Very recently, they've signed an accord that says, look, we're going to take this seriously. They've announced policies that are varying levels of strictness, but tend toward if you're a major AI company, you're going to try to prevent people from creating information that maybe looks bad for public figures. Maybe you ban producing images of recognizable figures altogether, or you try to. And you have something in your terms of service that says if you're using this for political causes, or if you're creating deceptive content, then we can kick you off.
9:30 Speaker 03 One challenge here in America is the existence of the First Amendment. The Biden administration recently did an executive order saying, don't do bad stuff. And these companies all agreed, okay, we won't do bad stuff. But the United States government is pretty restricted in saying you can't make deep fakes of other people because the First Amendment exists and it can't control that speech directly. Are the companies rising to that challenge? It's like we will self-regulate because the government can't directly regulate us?
9:58 Speaker 04 We don't know necessarily how good the enforcement of it is going to be, but the companies seem so far pretty open to the idea of self-regulation, in part because I think this isn't just a civic-minded political thing. Dealing with unflattering stuff about real people is just a minefield they don't want. That said, there are also just their open source tools. Stability AI is pretty close to open source. It's pretty easy to go in and make a thing that builds on it that maybe strips away the safeguards you'd get in its public version. So it's just not quite equivalent to the way that, say, social platforms are able to completely control what's on their platforms.
10:42 Speaker 03 So you got a handful of companies with varying sets of restrictions, a broad, general industry consensus. We shouldn't do deep fakes. And then you have reality, which is that there are deep fakes of celebrities all the time. There are deep fakes of teenage girls in high schools that are getting circulated on private message boards. It is happening. What can be done to stop it?
11:04 Speaker 04 Does stopping mean that you're just trying to limit the spread to where this doesn't become a huge viral thing that a bunch of people see, but it's still maybe technically possible to create this? Or do you want to say, all right, we have a zero tolerance policy if anything is created with any tool anywhere, even if someone keeps it to themselves that is unconscionable?
11:23 Speaker 03 Let's start with the second one, which I think has the more obvious answer. Saying no deep fakes are allowed whatsoever seems like it comes with a host of unintended consequences about speech, and also seems like impossible to actually accomplish because of the existence of open source tools. Like, I think, how would you actually enforce a total ban on deep fakes? And the answer is that Intel and Apple and Qualcomm and Nvidia and AMD and every other chipmaker have to prevent it somehow at the hardware level, which seems impossible. The only example I can think of where we have allowed that to happen is that
12:05 Speaker 03 Adobe Photoshop won't allow you to scan and print a dollar bill, which makes sense. Like, it broadly makes sense that Adobe made that deal with the government. But it's also like, well, that's about as far as you should let that go, right? Like, there's a point where you want to make a parody image of a Biden or a Trump, and you don't want Photoshop saying, hey, are you manipulating a real person's face? Like you're saying, that seems way too far. So a total ban seems implausible. There are other things you could do at the creation step. OpenAI bans certain prompts that are violates their terms of service. Getty won't let you talk about celebrities at all. If you type a celebrity's name or basically any proper noun into the Getty image generator, it just tells you to go
12:46 Speaker 03 away. There's a lot of conversation about watermarking this stuff and making sure that real images have a watermark that say they're real images and AI images have a watermark that say they're AI images. Do any of those seem promising?
12:59 Speaker 04 The most promising argument I've heard for these is the idea that you can, and this is an argument that Adobe has made to me, train people to expect a watermark. And so if what you're saying is we want to make it impossible to make these images without a watermark, I think that raises the same problems that we just talked about, which if anyone can make a tweaked version of an open source tool, they can just say, "Don't put a watermark in." But I think that you could potentially get into a situation where you require a watermark. And if something doesn't have a watermark, there are ways that its design or its spread or people trusting it are severely hobbled. That's maybe the best argument for it I've heard.
13:43 Speaker 03 The part where you restrict the prompts, OpenAI restricts the prompts, Getty restricts the prompts, it's pretty easy to get around that, right? The Taylor Swift deepfakes that were floating around on Twitter, they were made in a Microsoft tool and Microsoft just had to get rid of the prompts. Is that just a forever cat and mouse game on the restrict the prompts idea?
14:02 Speaker 04 It does seem like the thing about a lot of generative AI tools is that there are just vast, vast numbers of ways to get them to do something. People are going to find those. Software bugs are a thing that has been a problem. Zero day exploits have been a problem on computers for a very long time. And this feels like it kind of falls into that category.
14:25 Speaker 03 That's the creation side. We need to take a quick break. When we come back, we'll get into the harder problem, distribution.
14:35 Speaker 01 Are your ad campaigns lighting up the dashboard, but not the pipeline? That's bullspend, and marketers are calling it out in dashboard confessions.
14:44 Speaker 02 My boss asked for results, so I opened my dashboard for the only positive sounding metric I had: impressions.
14:52 Speaker 01 Cut the bullspend. See revenue, not just reach. LinkedIn delivers the highest return on ad spend of major ad networks. Advertise on LinkedIn. Spend $250 on your first campaign and get a $250 credit. Go to LinkedIn.com/campaign. Terms and conditions apply.
15:05 Speaker 05 College football is back. So Hilton called to me, the superstition concierge, to make your fan rituals a reality. Need a room to match your lucky number? We got you. Want to make sure our team doesn't wash your lucky jersey? Oh, that smells lucky. Hilton's unmatched hospitality can keep up with any superstition. Even a marching band wake-up call at 5:55 in 55 seconds. Hit it! When you need a team that will do whatever it takes on game day, it matters where you stay. Hilton, for the stay.
15:35 Speaker 06 Chronic migraine, 15 or more headache days a month, each lasting four hours or more, can make me feel like a spectator in my own life.
15:41 Speaker 07 Botox, onabotulinum toxin A, prevents headaches in adults with chronic migraine. It's not for those with 14 or fewer headache days a month. It's the number one prescribed branded chronic migraine preventive treatment.
15:52 Speaker 08 Prescription Botox is injected by your doctor. Effects of Botox may spread hours to weeks after injection, causing serious symptoms. Alert your doctor right away as difficulty swallowing, speaking, breathing, eye problems, or muscle weakness can be signs of a life-threatening condition. Patients with these conditions before injection are at highest risk. Side effects may include allergic reactions, neck and injection site pain, fatigue, and headache. Allergic reactions can include rash, welts, asthma symptoms, and dizziness. Don't receive Botox if there's a skin infection. Tell your doctor your medical history, muscle or nerve conditions, including ALS, Lou Gehrig's Disease, Myasthenia gravis, or Lambert-Eaton Syndrome, and medications, including botulinum toxins, as these may increase the risk of serious side effects.
16:29 Speaker 06 Why wait? Ask your doctor. Visit botoxchronicmigraine.com or call 1-800-44-BOTOX to learn more.
16:38 Speaker 03 Welcome back. So we've talked about what the companies that make software and hardware can do about the creation of deepfakes. And it seems like the best answer we have right now is adding watermarks to AI-generated content. But the real problems are in distribution.
16:54 Speaker 03 Let's talk about the distribution side, which is, I think, where the real problem lies. If you make a bunch of deepfakes at your house with Donald Trump and you never share them with anyone, what harm have you caused? You start telling lies about both presidential candidates and you share them widely on social platforms, they go viral. Now you have caused a giant external problem. And so it feels like the pressure to regulate this stuff is going to come to the platforms. And again, I think the desire of the platforms to moderate waxes and wanes, and it feels low right now, maybe it'll ramp back up. Where are the platforms right now with the deep fake distribution problem?
17:30 Speaker 04 So far, it feels like the consensus is we're going to label this and that's going to be mainly our job, is that we're going to try to make sure we catch it. There are cases where, say, maybe you get it taken down if you haven't disclosed, if you're a company or you're buying a political ad. But broadly, the idea seems to be we want to give people information and tell them that this is manipulated and then they can make their own call.
17:57 Speaker 03 The one platform that stands out to me, and you and I have talked about this a lot, is YouTube, which has an enormous dependency on the music industry. The music industry is not happy about AI-generated covers using the voices of its artists. Notably, Fake Drake caused a huge kerfuffle. Universal Music Group went to Google, they announced some rules, they're going to prevent deepfakes or allow some licensing of the money to flow back to the artists. That is a very private sort of licensing scheme that sits outside of the law, it sits outside of the other platforms. Do you think YouTube is going to lead the way here because it has that pressure? Or is that just a one-off to the music industry?
18:38 Speaker 04 I feel like the incentives for something like the music industry and for things that are basically aesthetic deepfakes, I think the incentives there are very different than they are for political manipulated imagery. That a lot of the question with YouTube is, okay, you are basically parodying someone in a way that may or may not legally be considered parody. And we can make a deal where that person really, all they want is to get paid. And maybe they want something sufficiently controversial taken down. But if you give them some money, they'll be happy. That's just not really the issue at hand with political generated images. The problem there is around reputation.
19:19 Speaker 04 It's around people who do, at least in theory, care about, did this person say this thing? Is this true? So I just, I don't know that you could cut a deal with Joe Biden that says every time Joe Biden, you make something up about him, he gets a penny.
19:35 Speaker 03 I feel like politicians are always asking for donations. Maybe that's just the way to solve the problem. You just pay for the lies. As long as, as long as politicians are getting paid, from what I gather, I think particularly Donald Trump, as long as he's getting paid, uh, he might be, he might be cool with it. Outside of YouTube, which does have this big dependency on the labels and licensing. And so I think is leading the way on having any particular policy with specificity. Do any of the other platforms have ideas here that are more than we have an existing policy? And we'll see how it works with the problem.
20:06 Speaker 04 There are companies that are signing on to an initiative called C2PA, which is, we were talking about watermarks earlier. It's a content provenance system. It includes a watermark that has metadata. And the goal there is the idea that you will be able to at least tell where something has come from and whether it's manipulated. And that it's supposed to be this broad, industry-wide, everybody has the same watermark system. So it's very easy to look at an image and pop it in and check and see if it has the watermark. That's one of the leading ways the AI industry at this point is trying to deal with truth and provenance.
20:44 Speaker 03 Is that shipped yet? I feel like we've been talking about C2PA and the Content Authenticity Initiative. We've had Dana Rao, Adobe's General Counsel, on the show. He said the deep fake of the Pope wearing a puffer jacket was, quote, "a catalyzing event for content provenance", which is an amazing quote, and I'll credit to Dana for it. But there's people wanting to do it. There's the activity we see, and then there's shipping it. Has that shipped anywhere? Can you go look at it?
21:09 Speaker 04 Watermarks are rolling out places. OpenAI adopted them in mid-February. They're starting to appear on Dolly images. You can look at them in Photoshop. I think the problem is more that this thing rolled out, but really, most people are not going to care enough to check.
21:26 Speaker 03 Well, unless the labels are in their face, right? Unless you start scrolling on TikTok and you see something and TikTok puts a big label right over the top of it that says, "This is AI," which doesn't seem to be happening anywhere. You know, OpenAI did Sora, its video generator. The videos are compelling, although they have some extremely terrifying errors in them. But there's not like a big label on them that says, "This is AI-generated." Like, they're gonna travel without the context of OpenAI having produced them to promote their AI tool. And even that seems dangerous to me.
21:58 Speaker 04 Yeah, a lot of the issue with C2PA right now is that you have to actually go in and pop it into a tool to check the metadata, which is just an extra step that the vast majority of people are not going to take. And that, yes, it's not applying to things like Sora yet, at least as far as OpenAI has told us. So there is not a really prominent "in your face, this thing is AI" in most cases.
22:24 Speaker 03 Can you remove those watermarks?
22:26 Speaker 04 I mean, a screenshot tool, as far as I can tell, can remove the watermarks. And I think there are ways that you can end up just stripping these things out. It's very, very hard to create a perfect watermarking system. Just so much of this relies on a lot of Adobe's argument being, "Well, eventually, we want people to expect this, that it's gonna be like, you know, if you look in your browser and you get a certificate warning that says there's no certificate for this webpage, maybe you won't trust the webpage." I think the goal they're going for is the idea that everyone will be trained into expecting a certain level of authenticity, and I just don't think we're at that point. In some ways, these problems already existed. Photoshopped nudes have been a thing that
23:09 Speaker 04 has been used to harass people for a very long time. And photoshopped images of politicians and manipulated content about politicians is nothing new. A thing AI definitely does is scale up those problems a huge amount and make us confront them in a way that it was maybe easier to ignore before, especially by adding a technology that...
23:31 Speaker 04 The people who are creating the technology are trying to hype up in a way that sounds terrifying and world ending for other reasons. The problem with a lot of this is that you can't apply the kinds of paradigms that social media has because it really only takes one person with one capability to do a thing. Like, it takes one bad actor to make something that you can spread in huge variations that are hard to recognize across huge numbers of platforms. I think that raises slightly different problems than, say, there's this big account on social media that's spreading something. Well, all right, Facebook can ban them.
24:10 Speaker 03 So, we've talked a lot about what the platforms can do, what the AI companies can do, is private companies, these initiatives like content authenticity, that's a private framework. The government has some role to play here, right? The big challenges are the First Amendment exists in the United States, and that really directly restricts the government from making speech regulations. And then, you know, we are a patchwork of state and federal laws. What is the current state of deep fake law? Are you allowed to do it? Are you not allowed to do it? How's that work?
24:45 Speaker 04 It's mostly a small patchwork of past laws, a huge number of laws of varying likely constitutionality that people are debating, and not a whole lot at the federal level. There are a lot of different problems that AI-generated images pose, and there are cases where individual states have passed rules for individual problems. There are a few states that incorporate, say, non-consensual AI pornography laws into anti-general revenge, non-consensual porn rules. There are a few states with rules about how you have to disclose manipulated images for elections. And there are some attempts in Congress to create a larger framework, or in the, say,
25:29 Speaker 04 FEC and other government regulatory agencies, to create a larger framework. But we just are still in this large, chaotic period of people debating things.
25:38 Speaker 03 Let's start with non-consensual deep fake pornography, which I think everybody agrees is a bad thing, that we should find ways to regulate away. A solution to revenge porn broadly on the internet is copyright law. Right. You have made these files with your phone or your computer. Someone else distributes them. You say, no, those are, those are mine. Copyright law will let me take this down. When you have deep fakes, there is no original. It's not a copy of something that you've made or that you own. You have to come up with some other way to do it. Right. You have to come up with some other mechanism, whether that's just a law that says this is not right, or it's some other idea like the right to your likeness. Where have most of the existing laws landed there?
26:24 Speaker 04 The copyright issue is actually something that came up with non-synthetic, non-consensual pornography, because say if one of your partners took a nude picture of you, you don't own that picture. And that was already just a huge loophole that legislators have spent about a decade trying to make laws that meaningfully address non-consensual pornography that's not AI-generated. And the frameworks they've come up with are getting ported over to AI-generated imagery that a lot of it is about, all right, this is harassment. This is obscenity. This is some other kind of speech restriction that is allowable. A lot of non-consensual pornography is a kind of sexual harassment
27:05 Speaker 04 that we can find ways to wall outside protective speech and that we can target it in a way where it's not going to necessarily take down huge amounts of other speech, the way that say just banning all AI-generated images would.
27:20 Speaker 03 There are a bunch of state laws around non-consensual AI-generated pornography. What states are those? And is there any federal law on the horizon?
27:29 Speaker 04 There's California, New York is another, there's Texas. At the federal level, there have been attempts to work this into, it's not a criminal statute, but there is a federal civil right to sue if you have non-synthetic, non-consensual pornography. And there have been attempts to work AI into that and say, all right, well, it's not a crime, but it's a thing that you can sue for under, I believe it is the Reauthorization of the Violence Against Women Act. And then there have been attempts to, like you mentioned, just tie all of this into a big federal likeness law. So likeness laws are a mostly state-level thing that says,
28:10 Speaker 04 all right, you can't take Taylor Swift and make her look like she's advertised your instant pot.
28:19 Speaker 04 And so there have been some attempts to make a federal version of that, but likeness laws are really tricky because there's so much broader that they end up catching things like parody and satire and commentary. And they're just, I think, a much riskier than trying to create really targeted, specific use laws.
28:39 Speaker 03 The idea that someone should be in absolute control of a photograph of themselves has only gained prominence over time. Emily Radikowski wrote that great essay for The Cut several years ago, where she said, "A street photographer took a photo of me, and I put it on my Instagram, and I'm suing him to say that I can take his photo because it's a photo of me." And that is a very complicated argument in that case. But the idea that you should be in total control of any photo of you, I think a lot of people just instinctively believe that. And I think likeness law is what makes that have legal force. But you're saying, oh, there's some stuff here you wouldn't want to pull under that umbrella.
29:22 Speaker 04 If you're talking about non-synthetic stuff, then there are all kinds of documentaries and news reports and really things that people have a public interest in making where you don't want to give someone the right to say, "You cannot depict me in a thing." And in that case, it's doing something I actually did. But AI-generated images raise the whole other question, which is, okay, so where do you draw the line between an AI-generated image and a Photoshop of someone and a drawing of someone? Should you not be able to depict any person in a situation that they don't want to be depicted in, even if that situation is something that would just broadly be protected by the First Amendment? Like, where do we
30:03 Speaker 04 think that the societal benefit of preventing a particular usage that hurts someone should be able to override the interest we have in just being able to write about or create images of someone?
30:20 Speaker 03 We have to take another quick break. We'll be right back.
30:30 Speaker 01 Flowing ad budget on metrics that look great till the CFO sees them? That's bull spend. And marketers are calling it out in Dashboard Confessions.
30:40 Speaker 02 I remember telling my boss, "It'll be good for the brand," when leads were slow. Yeah, it wasn't.
30:48 Speaker 01 Cut the bull spend. LinkedIn lets you target by company, job title, and more. Advertise on LinkedIn. Spend $250 on your first campaign and get a $250 credit. Go to LinkedIn.com/campaign. Terms and conditions apply.
31:01 Speaker 05 College football is back. So Hilton called to me, the superstition concierge, to make your fan rituals a reality. Need a room to match your lucky number? We got you. Want to make sure our team doesn't wash your lucky jersey? Oh, that smells lucky. Hilton's unmatched hospitality can keep up with any superstition. Even a marching band wake-up call at 5:55 in 55 seconds. Hit it! When you need a team that will do whatever it takes on game day, it matters where you stay. Hilton, for the stay.
31:31 Speaker 06 Chronic migraine, 15 or more headache days a month, each lasting four hours or more, can make me feel like a spectator in my own life.
31:37 Speaker 07 Botox, onabotulinum toxin A, prevents headaches in adults with chronic migraine. It's not for those with 14 or fewer headache days a month. It's the number one prescribed branded chronic migraine preventive treatment.
31:48 Speaker 08 Prescription Botox is injected by your doctor. Effects of Botox may spread hours to weeks after injection, causing serious symptoms. Alert your doctor right away as difficulty swallowing, speaking, breathing, eye problems, or muscle weakness can be signs of a life-threatening condition. Patients with these conditions before injection are at highest risk. Side effects may include allergic reactions, neck and injection site pain, fatigue, and headache. Allergic reactions can include rash, welts, asthma symptoms, and dizziness. Don't receive Botox if there's a skin infection. Tell your doctor your medical history, muscle or nerve conditions, including ALS, Lou Gehrig's Disease, Myasthenia gravis or Lambert-Eaton Syndrome, and medications, including botulinum toxins, as these may increase the risk of serious side effects.
32:25 Speaker 06 Why wait? Ask your doctor. Visit botoxchronicmigraine.com or call 1-800-44-BOTOX to learn more.
32:34 Speaker 03 We're back talking with Verge Policy Editor Addie Robertson about why it's really hard to limit either the creation or sharing of deep fakes. So that's the philosophical policy debate. You want to restrict this because in many cases it can be used to do very bad things. There are some things that we absolutely want to forbid, but if we let that get too wide, we're going to start running into people's everyday speech. We're going to start running into absolutely constitutionally protected speech like documentaries, like news reporting. That's pretty blurry. And I think the audience here, you should sit with that because that is pretty blurry. On the flip side, there are two bills in Congress right now that purport to restrict on this stuff. There's
33:15 Speaker 03 something called the No Fakes Act, which is Chris Coons, Marsha Blackburn, Amy Klobuchar, Tom Tillis. And then after the Taylor Swift situation on X, there's something called the Defiance Act, which stands for the Disrupt Explicit Forged Images and Nonconsensual Edits Act, which is quite a lot of words. Do they go towards solving the problem? Do you see differences there? Do you see them as being an effective approach?
33:40 Speaker 04 The two bills are a little bit the thing I talked about where one of them, the Defiance Act, is really specifically about we want to look at non-consensual pornographic images. We define what that means. And we think that this particular thing we can carve out. There are lots of questions about in general, how far you want to go in banning synthetic images. But it's really targeting sexually explicit pictures of real people. And I think things like the No Fakes Act, I believe there's also something called the No AI Fraud Act. These are much broader. We just think that you shouldn't be able to fake images of people. And we're going to make some carve outs there. But the fundamental idea is that we want
34:23 Speaker 04 to create a giant federal likeness law. And I think that's much riskier because that is much more a, we start from a point of saying that you shouldn't be able to fake an image of someone without their permission. And then we're going to create some opt-ins, with some options where you're allowed to do it. And I think that raises so many more of these questions that do we really want to create a federal ban on being able to create a fictionalized image of somebody?
34:58 Speaker 03 That is the likeness law approach to it, which has big problems of its own. Another approach we've heard about on Decoder is rooted in defamation law. So Barack Obama was on Decoder. He said, "There are different rules for public figures than 13-year-old girls. We're going to treat them differently. We should have different rules for what you can do with a public figure than teenagers. We should have different rules for what is clearly political commentary and satire versus cyberbullying." And then Senator Brian Schatz was recently on, and he said something similar. Is defamation where this goes? Where it's, "Hey, you made a deep fake of me. Maybe it's my likeness, but you're actually defaming my character, and you did it on purpose." And that rises to the level of you knowingly telling a lie about me.
35:43 Speaker 03 And defamation law is what's going to punish you for this, instead of some law about my likeness.
35:49 Speaker 04 Defamation law has already come up with text-based generative AI, where if something like ChatGPT tells a lie about you, are you allowed to say, "They're making things up about me, I can sue?" And I think the benefit of defamation law is that there is a really huge framework for hammering out when exactly something is an acceptable lie and when it's not. That, all right, well, would a reasonable person believe that this thing is actually true? Or is this really obviously political commentary and hyperbole? I think that we're on at least more solid ground there than we are with just saying, "All right, fine, you know what, just ban deep fakes." I do think that still defamation law is complicated, and every time you open up defamation
36:34 Speaker 04 law, as Donald Trump has once suggested, you end up getting a situation where, in a lot of cases, it's very powerful people throwing the law against people who don't necessarily have the money to defend themselves. And in general, I'm cagey about trying to open up defamation law. But it is a place where at least you have a framework that people have spent a very long time talking about.
37:03 Speaker 03 One thing we constantly say here at The Verge is that copyright law is the only real law on the internet because it's the only speech regulation that everyone just kind of accepts. Defamation law is not a speech regulation that everyone just accepts that has boundaries. The cases go back and forth. The idea that there should be a federal right to likeness doesn't even exist yet. So that feels like it will be very controversial if it happens as speech regulation. But at the heart of that is the First Amendment, right? People have such a strong belief in the First Amendment that saying the government should make a speech regulation, even if something is really bad, is extraordinarily complicated and high barrier to cross. Do you see that changing in the context of AI?
37:44 Speaker 04 When a new technology comes along, there are a large number of people who don't necessarily think about it in terms of the First Amendment or of speech protections, where you're able to say, oh, well, this thing is just categorically different. We've never had technology like this before. The First Amendment shouldn't apply. And I always hope we don't go there with the technology because I think that the problems that come from just blanket outlawing it tend to be really huge. I don't know. I think that we're still waiting to see how disruptive AI tech actually is. We're still waiting to see whether it is meaningfully
38:24 Speaker 04 different from something like Photoshop, even though it seems intuitively like it absolutely should be. But we're still waiting to see that play out.
38:34 Speaker 03 We spend a lot of time talking about the visual side of it. We're going to make deep fake images. Those images have real world harms, especially to young people, especially young women. In an election cycle, making it seem like Trump or Biden fell down the stairs could be very damaging. There's also the voice side of it, right? Where having Joe Biden do AI-generated robocalls is a real problem. Or convincing people on TikTok that Trump said something he didn't say is a real problem. Do any of these laws address that aspect of it?
39:07 Speaker 04 If we're talking about non-internet systems like robocalls, then we actually have laws that aren't really even related to most of the things we've talked about. There is a rule called the TCPA that's an anti-robocall law, basically, that says you cannot just bombard people with synthetic phone calls. And it was recently decided that, all right, should artificial voices there include voice cloning? Yes, obviously. So at this point, things like robocall laws apply to AI. And so if you're going to try to get Joe Biden calling a bunch of people and telling them not to vote, that's something that just can be regulated under a very longstanding law.
39:47 Speaker 03 What about a fake Joe Biden, Joe Rogan podcast on TikTok?
39:51 Speaker 04 That raises really all the same questions that image based AI raises. In some ways, it's probably going to be harder to detect and regulate against at a nonlegal platform level because so much stuff is optimized for detecting images. And so in some ways, it's maybe even a thorny or problem. And also, on the other hand, voice impersonation was a thing before this, that there were really good impersonators of celebrity voices. And so I think that that might be a technically harder problem to fix, but I think that the legal questions it raises are very similar.
40:30 Speaker 03 All right, so we've arrived at what I would describe as existential crisis. Many, many problems. One set of things that should clearly be illegal, which deep fake, non consensual pornography seems like it should clearly be illegal. Everything else seems kind of up for grabs. How should people be thinking about these challenges as they go into this election year?
40:50 Speaker 04 There are a bunch of really hard technical issues. And a lot of those issues are going to be irrelevant to people because so many people do not check even very obviously fake information because of a variety of reasons that do not have anything to do with it being undetectable as a fake. I think that trying to actually make yourself care about whether something is true is in a lot of ways, a bigger, more important step than making sure that nothing false is capable of being produced. I think that's the place where huge numbers of people have fallen down and where huge numbers of people have fallen for things.
41:33 Speaker 04 And I think that while all of these other issues we've been talking about are incredibly important, this is just a big individual psychological thing that people can do on their own that does not come naturally to a lot of us.
41:51 Speaker 03 Thanks again to Verge Policy Editor Addie Robertson for joining us on Decoder. These issues are so challenging, and she always helps me understand them so much more clearly. If you have thoughts about this episode or what you'd like to hear more of, you can email us at [email protected] . We really do read every email, and we talk about them quite a bit. You can also hit me up directly on Threads on that reckless 1280. We also have a TikTok. It's a lot of fun. Check it out. It's at DecoderPod. If you like Decoder, please share it with your friends. Subscribe wherever you get your podcasts. If you really love the show, hit us with that five-star review. Decoder is a production of The Verge and part of the Vox Media Podcast Network. Today's episode was produced by Kate Cox and Nick Statt. It was edited by Kelly Wright. Decoder music is by Breakmaster Cylinder. We'll see you next time.
42:31 Speaker 09 Looking for a simple way to thank your clients or recognize employees for a job well done? A Starbucks card is more than a gift. It's a pick-me-up, a break in their day, and a reminder that you appreciate them. Whether you're shopping for digital or physical cards in bulk, Starbucks cards are the perfect gift to brighten anyone's day. Share the joy of coffee and connection when you give the gift of Starbucks. Shop Starbucks cards in bulk now at starbuckscardb2b.com.
42:58 Speaker 10 Mr. Monopoly here. Miss me? Monopoly is back at McDonald's with millions of prizes. A 2027 Jeep Cherokee, a Carnival Cruise vacation, gift cards from DoorDash, and Best Buy. Feel and play in the McDonald's app. Get your bag.
43:16 Speaker 11 No purchase necessary. 50 U.S. and D.C. age 18+. See play at mcd.com. For rules, play at mcd.com/amoe for info on playing without purchase by mail by November 2. Chance card game ends November 8. Game ends November 22, 2026. See rules for prize details. Monopoly is a registered trademark of Hasbro.
Previous Disney Is a Tech Company? Next How the Wayback Machine is fighting linkrot Page updated October 26, 2026 · transcript and summary are machine-generated