Pod Insights Planet Money Two ways AI is changing the business of crime (Two Indicators) About this episode Pre-order the Planet Money book here for your free gift. http://planetmoneybook.com Our sister show, The Indicator, is chronicling the evolving business of crime for its Vice Week https://www.npr.org/2025/10/05/nx-s1-5561958/vice-series-the-evolving-business-of-crime series. Today, we bring to you two cases of crime in the age of AI. First, cybercriminals are using our own voices against us. Audio deepfake scams are picking up against individuals but also against businesses. We hear from a bank on how they’re adapting defenses, and find out how the new defenses are a game of AI vs AI. Then, we move over to the stock market to witness AI market manipulation. A new breed of trading bots behave differently. They could collude with each other, even without human involvement or instruction, so researchers are asking how to think about blame, and regulation in a world of more sophisticated trading bots. That’s assuming regulators could even keep up with the tech in the first place. Indicator Vice Series
Head to The Indicator from Planet Money https://podcasts.apple.com/us/podcast/the-indicator-from-planet-money/id1320118593 podcast feed for the latest on the Indicator Vice Series including an episode on data breaches https://www.npr.org/2025/10/07/nx-s1-5563884/whats-supercharging-data-breaches . If you don’t already subscribe, check it out. Each episode explains one slice of the economy connected to the news recently, always in 10 minutes or less. Subscribe to Planet Money+ https://n.pr/3HlREPz Listen free: Apple Podcasts http://n.pr/PM-digital, Spotify https://n.pr/3gTkQlR, the NPR app https://n.pr/3Bkb17W or anywhere you get podcasts. Facebook https://n.pr/3h92GwS / Instagram https://n.pr/3FqLuws / TikTok https://n.pr/3sGZdrq / Our weekly Newsletter https://n.pr/3zrFvUB. This episode is hosted by Darian Woods, Adrian Ma, and Wailin Wong. These episodes of The Indicator were originally produced by Cooper Katz McKim and engineered by Robert Rodriguez. They were fact-checked by Sierra Juarez. Kate Concannon is The Indicator’s editor. Alex Goldmark is the Executive Producer. Music: NPR Source Audio - “Diamond High”
See pcm.adswizz.com https://pcm.adswizz.com for information about our collection and use of personal data for sponsorship and to manage your podcast sponsorship preferences.
NPR Privacy Policy https://www.npr.org/about-npr/179878450/privacy-policy
Transcript 3,752 words · 14 speakers
0:00 Speaker 00 This episode's sponsor is HubSpot, which offers the following message. What if, instead of updating your CRM, your CRM updated you? HubSpot's self-updating CRM keeps your customer context current, so you can win more deals. Learn more at hubspot.com.
0:17 Speaker 01 Big announcement. Planet Money is publishing a book. And as of today, it is finally available for preorder at planetmoneybook.com. The book is called Planet Money: A Guide to the Economic Forces That Shape Your Life. It has lots of stories, all that can help you use economics to make life a little richer. From work and career, to retirement and food, to dating and family. And of course, we'll be doing some episodes about the behind-the-scenes things we learned while reporting and publishing this book. Things like this. Preordering a book helps the author so much more than waiting to buy it. It sends a signal to the booksellers to stock up, to promote it, to put it on that front table
1:01 Speaker 01 when it does publish. So help us get some strong preorder sales. You'll get a free gift and a free month of Planet Money Plus if you aren't already a subscriber. Go to planetmoneybook.com. And thank you.
1:21 Speaker 02 This is Planet Money from NPR.
1:26 Speaker 03 So Waylon, the other day, I decided to give our colleague, Angel Carreras, a little test.
1:33 Speaker 03 Hello, Darian. Hey. Sorry, did you have headphones on? Angel, I need your help with something real quick. What's up? I need your help with something real quick. You sound like AI. Would you be able to go out and buy some gift cards for me? You sound like AI. I don't have time today.
1:49 Speaker 03 It's a surprise for our colleague. Darian, I'm so sorry. You're not fooling me. This is AI. If you could just go out and buy like $200 in gift cards, that'd be awesome.
1:58 Speaker 04 Okay, actually, you've convinced me. Where should I get these? Uh, Dair, Day, D A I, Darian? Come on, quick, on your feet, Darian, where?
2:07 Speaker 03 Angel, I have to admit something to you.
2:09 Speaker 04 Too sloppy, Darian.
2:10 Speaker 03 This is not my real voice.
2:11 Speaker 04 Too sloppy.
2:12 Speaker 03 I am a deep fake.
2:14 Speaker 04 Gosh.
2:15 Speaker 03 Angel, I got you.
2:17 Speaker 04 Dude, you got, you got nothing. You got nothing.
2:20 Speaker 05 Oh my gosh. Angel was so clever. If you had called me, I would have fallen for it immediately.
2:26 Speaker 03 Yeah.
2:27 Speaker 05 I would have been like, where do you want the gift cards from? Gap? Do you need a Gap gift card?
2:32 Speaker 03 Now I know. And so, yeah, depending on the person, depending on the situation, like maybe it had been urgent, like a cousin calling from a hospital, this could have really fooled somebody.
2:41 Speaker 05 Yeah, a lot of people are falling for these kinds of audio deep fakes. Like, millions of Americans have lost money to a scam call that uses an AI voice. And the losses from these scams can be in the thousands of dollars.
2:55 Speaker 03 Businesses are also getting targeted, so naturally, they're fighting back, using AI to fight AI. Hello and welcome to Planet Money. I'm Darian Woods.
3:05 Speaker 05 And I'm Wayland Wong. Normally, we are the co-hosts of Planet Money's short daily podcast, The Indicator. And we're over here today to bring you a couple of stories on AI and the evolving business of crime from The Indicator's Vice Week series airing this week.
3:20 Speaker 03 Today, defending against AI voice clones, how the fakes can be detected, what banks are doing to fortify themselves, and what we can all do to keep ourselves a little safer.
3:31 Speaker 05 Then, after the break, AI market manipulation. The new breed of trading bots behave differently and collude differently, too. And regulators can't keep up. Stay tuned.
3:45 Speaker 06 Stay tuned for the following announcements and messages from our sponsors.
3:49 Speaker 00 This message comes from Capella University. That spark you feel? That's your drive for more. Capella University's FlexPath learning format lets you earn your degree at your pace without putting life on pause. Learn more at capella.edu.
4:03 Speaker 06 This message comes from LinkedIn. As a small business owner, you wear many hats. You're the owner, the marketer, the seller, the hire. With LinkedIn, you have the tools to help you boost your visibility, find prospective customers and find the best team for your small business, all in one place. So while LinkedIn can't hang up all of your hats, it makes it easier to wear them all. Learn more at LinkedIn.com/PlanetMoneyShow.
4:31 Speaker 00 This episode's sponsor is HubSpot, which offers the following message. What if instead of updating your CRM, your CRM updated you? No catching up on manual edits, no more guesswork. HubSpot's self-updating CRM keeps your customer context current and helps you understand what to do next. So, marketing builds more demand, sales wins more deals, and customers keep coming back. Learn more at HubSpot.com.
4:57 Speaker 03 Banks are a big target of AI voice fraud.
5:00 Speaker 05 I mean, that's where the money is, literally.
5:02 Speaker 03 And so if you're a chief information officer at a bank, you're constantly checking your websites and phone line systems for any vulnerabilities. That's what Mark Kowalski is doing at PNC Bank.
5:14 Speaker 07 Fraudsters constantly bang on every door trying to find any crack in essentially our armor or our moat around the bank. As banking has gone more digital, obviously, the criminals have followed there.
5:29 Speaker 05 One scheme calls people up. It records you talking for several seconds and then it turns that into a cloned AI voice and uses that to bypass banks' voice verification on the phone.
5:41 Speaker 07 Because it's so easy now to reproduce your voice, you really can't rely on any one vector to say, okay, I'm just going to accept it's you because I hear you.
5:51 Speaker 03 One person has been on this problem for years. Ben Coleman used to work for Goldman Sachs and there he saw the early stages of these kinds of frauds. So in 2021, he co-founded a tech company that would try to protect big institutions like banks from voice fraud. He just didn't have the language for it yet.
6:12 Speaker 08 But we didn't have the buzzword of defix. We didn't have generative AI. We didn't have ChatGPT or anything. So we said, we can detect AI avatars and virtual humans, which are about to be this huge tsunami of fraud.
6:24 Speaker 08 How did you see this coming? I just assumed if I was a hacker, what would I be doing? How do I do more hacking?
6:30 Speaker 05 That's what I ask myself every day, Jerry.
6:33 Speaker 03 No should black hat hacker, Willen Long. Watch out.
6:38 Speaker 05 Ben thought that voice verification was this huge vulnerability for banks. If the bank verified your voice on the phone, you could do a wire transfer or reset the password and gain complete control. He named his company Reality Defender.
6:52 Speaker 08 We're doing what's called inference, which is looking for different features that probabilistically indicate that AI was used.
6:58 Speaker 03 An AI voice has a particular harmonic structure that the human ear doesn't hear, but Reality Defender's software can detect.
7:06 Speaker 08 There's indicators of AI, which means that the information is, yes, it's yours, but it's being used by somebody who's not you.
7:13 Speaker 03 So your company is almost like one of these AI detection websites where teachers might put a student's essay and say, is this AI?
7:23 Speaker 08 Yeah, turnitin.com, yeah.
7:25 Speaker 05 Ben says the majority of top 20 banks use Reality Defender's software, and many use other services like Ben's. But he says that banks should step up even further.
7:34 Speaker 08 Unfortunately, many institutions, not only banks, but also government organizations, insurance companies, media organizations are still using what are called voice biometrics, which is a sort of saying your voice is your password.
7:48 Speaker 03 Ben thinks banks should just remove seeing a voice as a kind of password entirely. We asked Mark Kwapazewski at PNC Bank why it was still using Voice ID. Are there risks to PNC using voice authentication technology?
8:03 Speaker 07 I think if you're only using the one dimension, there's risk in everything. There'd be risk in accepting a driver's license, for example, somebody walking into your branch, which is why you're starting to see a lot more. Technologies that are looking for multi-factor authentication, or even just those other signals. So I would sort of say you always want to have layers of security. And that's probably the key thing that we're always looking at is which, how well do we feel we have our various layers covered? And then you're able to learn where you might be overusing one of those signals and adjust.
8:41 Speaker 05 So it's not just your voice the banks are looking at, but also your location, the device you're calling from, details like your birthday, a text message verification code, all kinds of things. In fact, Mark says criminals flock to where the weakest defenses are. And thanks to software like Reality Defender, the greatest vulnerability isn't with bank phone lines. It's with the customers.
9:03 Speaker 07 So it's a little bit in reverse. How do you know that the company that just called you is actually PNC? We've spent a lot of time and money with the telecom carriers, different technology companies, so that if somebody's trying to spoof one of PNC's numbers, it gets blocked and it never gets delivered to you.
9:22 Speaker 03 The fraudster tries to build a sense of urgency that you need to move your money. Maybe they say the bank account's been compromised.
9:29 Speaker 07 We'll never ask you to move your money. If we think an account has been compromised, the bank will move your money for you, within the bank.
9:39 Speaker 05 But he says a lot of people believe they're talking to the bank. The supposed bank worker will tell them to buy gold or cryptocurrency or withdraw cash and hand it over to someone, thinking that will keep the money safe.
9:51 Speaker 07 It's a scam every time.
9:53 Speaker 05 Another voice scam is going straight to the customer, pretending to be a loved one in need.
9:58 Speaker 07 Being in this part of the business I have with my family is essentially a safe word. And we all know if there's ever a situation where somebody is either...
10:10 Speaker 07 Really in trouble and asking for money. It's consistent. We will ask for the safe word.
10:16 Speaker 05 Angel could have used that.
10:18 Speaker 03 Yeah, well, I mean, he didn't need one, but you know, I thought the voice clone was actually pretty good. And that's why Ben Coleman from Reality Defender doesn't think that protecting banks is enough. He wants all content online to be vetted for whether it was AI-generated, from text to voice to video.
10:36 Speaker 05 Yeah, like celebrity scams are a problem right now. We recently had revelations of scammers pretending to be pro golfers on Instagram and Facebook.
10:45 Speaker 08 I think we're going to look back and say, I can't believe there's a time when we didn't have automated deep fake detection. Our challenge is just this technology is moving quicker than regulations.
10:54 Speaker 05 And that's why Ben went to Congress to try to advance regulation that would mean when you logged into Instagram or got a Zoom call or a WhatsApp voice memo, you would be informed about whether it was AI.
11:05 Speaker 08 We just gave testimony in Congress and in the Senate about this. We deep faked Senator Blumenthal and Senator Hawley. We're going to ask the audience and those on the DS, which ones are real and which ones are fake?
11:16 Speaker 09 Hi, my name is Richard Blumenthal, United States Senator from Connecticut, and I'm a diehard Red Sox fan.
11:23 Speaker 03 That clip of Richard Blumenthal was AI, by the way.
11:25 Speaker 05 Geez, he needs a safe word. Should be Red Sox.
11:29 Speaker 03 And that's not even getting into video deep fakes. I've seen these clips coming out of Sora 2, OpenAI's new video generator. And what can I say, I'm not going to believe anything I see on the internet anymore. And even The Indicator itself as a podcast has been dragged into all this. We've heard that scammers have impersonated The Indicator and other podcasts. They invite business owners on as guests, then in a Zoom meeting, pretend to be podcast staff to interview prep. And These people have tried to hack them or get sensitive information out of the victims. So please, if you hear from us, always check for that mpr.org email address.
12:13 Speaker 05 Next up from the Indicators Vice series, the stock market and AI. Automated trading bots have been around for a long time, but the new bots, built with certain types of machine learning, can behave differently and can show an inclination toward manipulating the market. And of course, the tech is moving faster than the regulations.
12:32 Speaker 03 After the break, why it can be so complicated to determine blame when it comes to market manipulation from artificial intelligence. Ajay Kumar picks it up after this.
12:46 Speaker 00 Stay tuned for the following announcements and messages from our sponsors.
12:50 Speaker 06 This message comes from Capella University. You know that feeling when there's a spark building inside you? That you were meant for more? That's your own drive pushing you towards what's next. Capella University gets that. With their FlexPath learning format, you can set the pace and earn your degree without putting life on pause. You've built experience and know what you're capable of. Now, this is your time to turn that momentum into more. The only real question is, what can't you do? Learn more at capella.edu. This message comes from LinkedIn. Owning a small business comes with a lot of challenges and means juggling multiple things at once. It's even harder to do it efficiently. But with LinkedIn,
13:33 Speaker 06 you get all the tools you need to grow in one place. With LinkedIn, simplify your sales, marketing and hiring so that you can actually run your small business. Learn more at linkedin.com/planetmonieshow.
13:47 Speaker 00 This episode's sponsor is HubSpot, which offers the following message. What if instead of updating your CRM, your CRM updated you? No catching up on manual edits, no more guesswork. HubSpot's self-updating CRM keeps your customer context current and helps you understand what to do next. So, marketing builds more demand, sales wins more deals, and customers keep coming back. Learn more at hubspot.com.
14:13 Speaker 10 For almost as long as there have been financial markets, there have been people trying to manipulate those markets. People who made money off unsuspecting investors by artificially influencing the price of a stock or some other security. To help us wrap our heads around it, we're going to sort them into two basic buckets. The first is what you might think of as human-led manipulation.
14:36 Speaker 05 And to help us explain, we called up Nicole Turner Lee. She's director of the Center for Technology Innovation at the Brookings Institution.
14:43 Speaker 11 When we talk about artificial intelligence today, we're probably talking about it in ways that are attainable for everyday people. You know, what AI looks like in retail or how AI affects employment. But when you begin to get into the markets and trading area, AI is so much more opaque.
15:02 Speaker 10 A couple of years ago, Nicole was asked to research how the increasing adoption of artificial intelligence could shape financial markets.
15:09 Speaker 11 I have to admit, when I did this project, out of all the projects, this one was the most scary. Because any AI that goes awry has the potential to shut down the whole market in ways that I think would be unforeseen and consequential.
15:23 Speaker 05 In her research, Nicole outlined ways AI could be used to mess with markets. One big one is by spreading misinformation. And as we all know, information moves markets.
15:35 Speaker 11 We see this every day in the analog world. Announcements get made by the president on tariffs. The market goes awry. When you have something that's embedded in the technical system, what's even scarier about this area is you may not know where it emanates from.
15:49 Speaker 05 Ghost in the machine.
15:50 Speaker 11 Woo!
15:52 Speaker 05 Generative AI makes it super easy for bad actors to manufacture misinformation. With a few keystrokes, anyone can make a fake news article or a deepfake recording. And with the help of bots, they can easily spread that misinformation across the internet.
16:07 Speaker 10 So those are examples of how humans can use AI to manipulate markets. But what if AI could use AI to manipulate markets? What? What we're talking about here is AI-powered trading bots run amok. Now, trading bots are not an entirely new thing, of course. For years, hedge funds have been using them to carry out high-frequency trading. But as finance professor Yekaterina Svetlova says, those bots still require a lot of human input to tell them how to trade.
16:40 Speaker 12 In case of high-frequency trading, you give a machine a clearer rules what to do. And now we have algorithms which don't receive clear rules from humans.
16:51 Speaker 05 At the University of Taventa in the Netherlands, Yekaterina studies how technology shapes financial markets. And she says these new algorithms have given rise to a more intelligent kind of trading bot powered by AI machine learning. In particular, something called reinforcement learning. That's where an AI agent is given a goal, like maximize long-term profits, and without any further instructions from a human, the AI goes to work, figuring out through trial and error the best trading strategy to achieve that goal.
17:21 Speaker 12 And they are not programmed to do this directly.
17:25 Speaker 10 One way to think about it is that the old trading bots are like Roomba, while the new trading bots are more like R2-D2.
17:33 Speaker 05 So friendly and helpful.
17:34 Speaker 10 Maybe not as friendly as R2-D2.
17:37 Speaker 05 But with that amount of intelligence and autonomy.
17:40 Speaker 10 Exactly.
17:41 Speaker 05 Okay.
17:42 Speaker 10 And Yekaterina acknowledges that it is hard to say right now just how many firms are employing these new kinds of bots. But she thinks soon financial markets could be filled with them, and that could cause some problems.
17:56 Speaker 12 That fundamental models on which those algorithms are based are very similar, and they might react to market signals in a similar way.
18:05 Speaker 05 Trading bots could start to mimic each other's behavior, unintentionally buying and selling stocks in tandem, causing wild swings in the market. Or, as a recent study suggests, these AI super traders could even engage in collusion.
18:18 Speaker 10 Yeah. Researchers at the University of Pennsylvania ran a simulation to see what would happen if they unleashed a bunch of AI bot traders powered by reinforcement learning into a marketplace. And what they found was that instead of trading against each other, like you would expect in a competitive market, these bots started colluding with one another to manipulate the market. E. Ty Goldstein is a finance professor who worked on the study.
18:44 Speaker 13 Collusion here is a situation where they kind of understand over time that they should trade less aggressively against each other because this is going to help others' profits. And then they kind of start acting like a cartel, right? What is a cartel? A cartel is basically when, instead of each one of them making their own decisions, they're making decisions collectively.
19:10 Speaker 10 And the surprising thing here is that these bots were not explicitly communicating with one another. Instead, each of them is using their own machine brains to crunch the data and come up with the best investment strategy. And it just so happens that the best investment strategy turned out to be for them to act like a price-fixing cartel.
19:29 Speaker 05 Now, in some of the simulations that E. Ty ran, there'd be a bot that did not want to cooperate with the others. And this did not sit well with the cartel bots.
19:39 Speaker 13 If they see that someone deviated, then there will be some punishment that others are going to start trading aggressively to punish the party that deviated.
19:47 Speaker 05 Vicious.
19:48 Speaker 10 Yeah, they sent out some digital bots to break their digital bot legs.
19:52 Speaker 05 Oh, goodness gracious.
19:54 Speaker 10 I mean, what's wild about this is that if humans engage in this type of financial market collusion and manipulation, they'd be breaking the law. They might get in trouble with the Securities and Exchange Commission or the Department of Justice. But the crime of collusion and market manipulation has historically required human intent, you know, intent to do the crime.
20:16 Speaker 05 So here's where things get kind of philosophical, right? Because can autonomous trading bots even have intent? And more to the point, who's responsible if a gang of trading bots go on a financial crime spree? Nicole Turner Lee of the Brookings Institution says that's a question we don't have good answers to right now.
20:35 Speaker 11 When things go wrong, because AI is not a person, who do you sue, right? Who holds the liability for these things? Who is actually liable when you're actually overusing or dependent on AI systems in this marketplace? And how do you do it in a way where, again, everyday people still have levels of protection?
20:55 Speaker 05 This is a legal gray area, and Nicole says regulations are probably needed to fix that. Like all the experts we spoke to, Nicole says AI is not inherently a bad thing for financial markets. It can be used, for example, as a tool for detecting fraud.
21:11 Speaker 10 But with regulators still playing catch up, that means a lot of power rests with the financial firms who are experimenting with these AIs and still discovering what they can do. Nicole's advice to them?
21:22 Speaker 11 Put this on your radar and have literacy around it for your employees and your customers so that you can ensure if there are bad actors, it's not you.
21:34 Speaker 05 Are we the baddies?
21:36 Speaker 10 I don't know. I mean, are we?
21:38 Speaker 05 You're not the baddie, Adrian.
21:40 Speaker 10 If we have to ask ourselves that question, what does that say about us?
21:46 Speaker 05 Remember, The Planet Money Book is available for preorder, and we've got some special gifts available when you buy the book early. And the more books we sell on preorder, the more momentum we get on book websites and in bookstores. So please help us kick off the snowball. Go to planetmoneybook.com, and thank you.
22:06 Speaker 03 Today's stories were just two parts of a five-part series The Indicator is airing this week. Check out the other episodes on The Indicator from Planet Money's podcast feed. We've got a link in the show notes. Today's show was produced by Cooper Katz-McKim, was engineered by Robert Rodriguez, and fact-checked by Sierra Juarez. Kaitlyn Cannon edits The Indicator. Alex Goldmark is our executive producer. Thanks for listening.
22:34 Speaker 06 Stay tuned for the following announcements and messages from our sponsors.
Previous How to design an economics GAME Next How the government got hedge funded Page updated November 1, 2026 · transcript and summary are machine-generated