At The Money: Algorithmic Harm with Professor Cass Sunstein

What is the impact of “ Algorithms” on the prices you pay for your Uber, what gets fed to you on TikTok, even the prices you pay in the supermarket? Cass Sunstein, professor at Harvard Law School co-author of the new book, “Algorithmic Harm: Protecting People in the Age of Artificial Intelligence” Previously he co-authored “Nudge” with Nobel Laureate Dick Thaler. We discuss whether all this algorithmic impact is helping or harming people. Each week, “At the Money” discusses an important topic in money management. From portfolio construction to taxes and cutting down on fees, join Barry Ritholtz to learn the best ways to put your money to work. See omnystudio.com/listener https://omnystudio.com/listener for privacy information.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  At KKR, we've spent 50 years understanding what matters to our clients and companies. From pioneering private equity to investing across credit, real assets, insurance and sports, KKR has built the experience to navigate complexity, the judgment to recognize opportunity, and the conviction to create lasting value. Because when people and institutions are counting on us, understanding what matters isn't just important, it's everything. KKR, understanding what matters. Visit kkr.com/whatmatters.

• 0:30Speaker 01

  If you're a business owner, you need a card that can keep up. With the Delta SkyMiles Reserve Business American Express Card, everyday purchases transform into miles you can use towards future travel. So business as usual can lead to a well-deserved getaway. And for a limited time, card members can earn 200,000 bonus miles, the highest miles offered this year. Whether you're traveling for business or planning your next adventure, now's a great time to make every purchase go further. Apply today at www.delta.com/podcast. Offer ends November 4th. Minimum spending requirements and terms apply.

• 1:07Speaker 02

  This is the Bloomberg Tech Minute, brought to you by ChatGPT. I'm Carol Muster. Getting hired at SpaceX requires exceptional ability and may include having Elon Musk review a candidate's resume. So writes Bloomberg Businessweek's Lauren Grush. She reports that the company culture is defined by Musk and job candidates must understand that a commitment to SpaceX means adhering to this culture and exhibiting loyalty to Elon Musk. To get hired, candidates must demonstrate their achievements from past jobs and hands-on experience matters more to recruiters than advanced degrees, with the company looking for people with raw, innate intelligence. A spokesperson for SpaceX didn't respond to a request for comment on its recruiting

• 1:49Speaker 02

  and hiring practices, but according to recruiters, advisors, and those who've interviewed for jobs there, it's the space exploration dream that draws people to the company, and Musk invokes that dream regularly to remind workers why they're there. Prospective hires are told that the job will require stamina, including in job ads that candidates, quote, "must be willing to work extended hours and weekends as needed." One major perk for all that hard work? Employees' access to equity, either the right to buy shares or payment in the form of restricted stock units that vest over time. That's the Bloomberg Tech Minute, brought to you by ChatGPT. Get started at ChatGPT.com.

• 2:32Speaker 02

  Bloomberg Audio Studios. Podcasts, radio, news.

• 2:56Barry Ritholtz?

  Algorithms are everywhere. They determine the price you pay for your Uber, what gets fed to you on TikTok and Instagram, and even the prices you pay in the supermarket. Is all of this algorithmic impact helping or harming people? To answer that question, let's bring in Cass Sunstein. He is the author of a new book, Algorithmic Harm: Protecting People in the Age of Artificial Intelligence, co-written with Orin Bargill. Cass is also a professor at Harvard Law School and is perhaps best known for his books on Star Wars and co-authoring Nudge with Nobel laureate Dick Thaler.

• 3:41Barry Ritholtz?

  So Cass, let's just jump right into this and start by defining what is algorithmic harm?

• 3:50Speaker 04

  Okay, so let's use Star Wars. So let's say the Jedi Knights use algorithms and they give people things that fit with their tastes and interests and information. And people get, if they're interested in books on behavioral economics, that's what they get at a price that suits them. If they're interested in a book on Star Wars, that's what they get at a price that suits them. The Sith, by contrast, take advantage with algorithms of the fact that some consumers lack information and some consumers suffer from behavioral biases. So we're going to focus on consumers first. If people don't know much, let's say, about healthcare products, an algorithm might know that, that they're likely not to know much.

• 4:34Speaker 04

  And might say, "We have a fantastic baldness cure for you. Here it goes," and people will be duped and exploited. So that's exploitation of absence of information. That's algorithmic harm. If people are super optimistic and they think that some new product is going to last forever, when it tends to break on first usage, then the algorithm can know those are unrealistically optimistic people and exploit their behavioral bias.

• 5:00Barry Ritholtz?

  So I referenced a few obvious areas where algorithms are taking place. Uber pricing is one. The books you see on Amazon is algorithmically driven. Clearly, a lot of social media, for better or worse, is algorithmically driven. And even things like the sort of music you like on Pandora. What are some of the less obvious examples of how algorithms are affecting consumers and regular people every day?

• 5:37Speaker 04

  Okay, so let's start with the straightforward ones and then we'll get a little subtle. So straightforwardly, it might be that people are being asked to pay a price that suits their economic situation. So if you have a lot of money, the algorithm knows that. Maybe the price will be twice as much as it would be if you were less wealthy. That, I think, is basically okay. It leads to greater efficiency in the system. It's like rich people will pay more for the same product than poor people, and the algorithm is aware of that. So that's not that subtle, but it's important. Also not that subtle is targeting people based on what's known about their particular tastes and preferences. Let's put wealth to one side.

• 6:22Speaker 04

  And so it's known that certain people are super interested in dogs, other people are interested in cats, and there we go. And all that is very straightforward happening. If consumers are sophisticated and knowledgeable, that can be a great thing to make markets work better. If they aren't, it can be a terrible thing to make consumers get manipulated and hurt. Here's something a little more subtle. If an algorithm knows, for example, that you like Olivia Rodrigo, and I hope you do because she's really good, then there are going to be a lot of Olivia Rodrigo songs that are going to be put into your system. And let's say there are no one's really like Olivia Rodrigo, but let's suppose there are others who are vaguely like her, and you're going to hear a lot of that.

• 7:07Speaker 04

  Now, that might seem not like algorithmic harm. That might seem like a triumph of freedom and markets. But it might mean that people's tastes will calcify, and we're going to get very Balkanized culturally with respect to what people see in here. So there are going to be Olivia Rodrigo people, and then there are going to be Led Zeppelin people, and there are going to be Frank Sinatra people. And there was another singer called Bach, I guess. I don't know much about him. But there's Bach, and there would be Bach people. And that's culturally damaging, and it's also damaging for the development of individual tastes and preferences.

• 7:45Barry Ritholtz?

  So let's put this into a little broader context than simply musical tastes. And I like all of those. So I haven't become Balkanized yet. But when we look at consumption of news media, when we look at consumption of information, it really seems like the country has self-divided itself into these happy little media bubbles that are either far-left leaning or far-right leaning, which is kind of weird because I always learned the bulk of the country and the traditional bell curve, most people are somewhere in the middle. Hey, maybe they're center-right or center-left,

• 8:26Barry Ritholtz?

  but they're not out on the tails. How does these algorithms affect our consumption of news and information?

• 8:37Speaker 04

  About 15, 20 years ago, there was a lot of concern that through individual choices, people would create echo chambers in which they would live. And that's a fair concern, and it has created a number of, let's say, challenges for self-government and learning. What you're pointing to is also emphasized in the book, which is that algorithms can echo chamber you. An algorithm might say, you know, you're keenly interested in immigration and you have this point of view, so, boy, are we going to funnel to you lots of information because clicks are money and you're going to be clicking, clicking, clicking, clicking.

• 9:20Speaker 04

  And that might be a very good thing from the standpoint of the seller, so to speak, or the user of the algorithm. But from the standpoint of you, it's not so fantastic. And from the standpoint of our society, it's less than not so fantastic because people will be living in algorithm-driven universes that are very separate from one another, and they can end up not liking each other very much.

• 9:46Barry Ritholtz?

  But even worse than not liking each other, their view of the world aren't based on the same facts or the same reality. Everybody knows about Facebook and, to a lesser degree, TikTok and Instagram and how it very much balkanized people into things. And we've seen that in the world of media. You have Fox News over here and MSNBC over there. How significant of a threat does algorithmic news feeds present to the country as a democracy? Self-regulating, self-determined democracy?

• 10:26Speaker 04

  Really significant. And there's algorithms, and then there are large language models, and they can both be used to create situations in which, let's say, the people in some city, let's call it Los Angeles, are seeing stuff that creates a reality that's very different from the reality that people are seeing in, let's say, Boise, Idaho. And that can be a real problem for understanding one another and also for mutual problem solving.

• 10:56Barry Ritholtz?

  So let's apply this a little bit more to consumers and markets. You described two specific types of algorithmic discrimination. One is price discrimination and the other is quality discrimination. Why should we be aware of this distinction? Do they both deserve regulatory attention?

• 11:17Speaker 04

  So if there is price discrimination through algorithms in which different people get different offers, depending on what the algorithm knows about their wealth and tastes, that's one thing, and it might be okay. People don't stand up and cheer and say, "Hooray." But if people who have a lot of resources are given an offer that's not as, let's say, seductive as one that is given to people who don't have a lot of resources, just because the price is higher for the rich than the poor, that's okay. There's something efficient and market-friendly about that. If it's the case that people who are, let's say, not caring much about whether a tennis

• 12:02Speaker 04

  racket is going to break after multiple uses, and other people who think the tennis racket really has to be solid because I play every day and I'm going to play for the next five years, then some people are given the, let's say, immortal tennis racket, and other people are given the one that's more fragile. That's also okay, so long as we're dealing with people who have a level of sophistication, they know what they're getting, and they know what they need. If it's the case that for either pricing or for quality, the algorithm is aware of the fact that certain consumers are particularly likely not to have relevant information, then everything goes haywire.

• 12:44Speaker 04

  And if this isn't frightening enough, note that algorithms are in increasingly excellent position to know this person with whom I'm dealing doesn't know a lot about whether products are going to last, and I can exploit that. Or this person is very focused on today and tomorrow, and next year doesn't really matter. The person's present biased, and I can exploit that. And that's something that can damage vulnerable consumers a lot, either with respect to quality or with respect to pricing.

• 13:19Barry Ritholtz?

  So let's let's flesh that out a little more. I'm very much aware that when Facebook sells ads, because I've been pitched these from Facebook, they could target an audience based on not just their likes and dislikes, but their geography, their search history, their credit score, their purchase history. Like, they know more about you than you know about yourself. It seems like we've created an opportunity for some potentially abusive behavior. Where is the line crossed from, hey, we know that you like dogs, and so we're going to market dog food to you,

• 14:03Barry Ritholtz?

  to we know everything there is about you, and we're going to exploit your behavioral biases and some of your emotional weaknesses?

• 14:12Speaker 04

  Okay, so suppose there's a population of Facebook users who are, you know, super well-informed about food and really rational about food. So they particularly happen to be fond of sushi, and Facebook is going hard at them with respect to offers for sushi and so forth. Now, let's suppose there's another population, which is, they know what they like about food, but they have kind of hopes and false beliefs, both about the effect of food on health. Then you can really market to them things that will lead to poor choices. And I've made a stark distinction

• 14:57Speaker 04

  between fully rational, which is kind of economic speak, and, you know, imperfectly informed and behaviorally biased people, also economic speak, but it's really intuitive. There's a radio show, maybe this will bring it home, that I listen to when I drive into work. And there's a lot of marketing about a product that is supposed to relieve pain. And I don't want to criticize any producer of any product, but I have reason to believe that the relevant product doesn't help much. But the the station that is marketing this product to people, this pain relief product, must know that the audience is vulnerable to it.

• 15:40Speaker 04

  And they must know exactly how to get at them. And that's not in the interest of, that's not going to make America great again.

• 15:48Barry Ritholtz?

  To say the very least, so we've been talking about algorithms. But obviously, the subtext is artificial intelligence, which seems to be the natural extension and further development of of algos. Tell us how, as AI becomes more sophisticated and pervasive, how is this going to impact our lives as as employees, as consumers, as citizens?

• 16:17Speaker 04

  Chat GPT chances are knows a lot about everyone who uses it. So I actually asked Chat GPT recently, I use it some, not hugely. I asked it to say some things about myself. And it said a few things that were kind of scarily precise about me, based on some number dozens, not hundreds, I don't think, of engagements with Chat GPT. So large language models that track your prompts can know a lot about you. And if they're able also to know your name, they can, you know, instantly basically learn a ton about you online.

• 16:59Speaker 04

  And we need to have privacy protections that are working there. Still, it's the case that AI broadly is able to use algorithms. And generative AI can go well beyond the algorithms we've gotten familiar with, both to make the beauty of algorithmic engagement. That is, here's what you like, here's what you want, we're going to help you. And the ugliness of algorithms, here's how we can exploit you to get you to buy things. And of course, I'm thinking of investments too. So in your neck of the woods, it would be child's play to get people super excited about investments, which AI knows the people with whom it's engaging

• 17:42Speaker 04

  are particularly susceptible to, even though they're really dumb engagements.

• 17:47Barry Ritholtz?

  Really, really, really interesting. So since we're talking about investing, I can't help but bring up both AI and algorithms trying to increase so-called market efficiency. And I always go back to Uber's surge pricing. Soon as it starts to rain, the prices go up in the city. It's obviously not an emergency. It's just an annoyance. However, we do see situations of price gouging after a storm, after a hurricane. People only have so many batteries and so much plywood and they kind of crank up prices. How do we determine what

• 18:30Barry Ritholtz?

  is the line between something like surge pricing and something like, you know, abusive price gouging?

• 18:37Speaker 04

  Okay, so you're in a terrific area of behavioral economics. So we know that in circumstances in which, let's say, demand goes up high because everyone needs a shovel and it's a snowstorm, people are really mad if the prices go up, though it might be just a sensible market adjustment. So as a first approximation, if there's a spectacular need for something, let's say shovels or umbrellas, the market inflation of the cost, while it's morally abhorrent to many and maybe in principle morally abhorrent from the standpoint of standard

• 19:19Speaker 04

  economics, it's okay. Now, if it's the case that people under short-term pressure from the fact that there's a lot of rain are especially vulnerable, they're in some kind of emotionally intense state, so they'll pay kind of anything for an umbrella, then there's a behavioral bias which is motivating people's willingness to pay a lot more than the product is worth.

• 19:44Barry Ritholtz?

  So let's talk a little bit about disclosures and the sort of mandates that are required. When we look across the pond, when we look at Europe, they're much more aggressive about protecting privacy and making sure big tech companies are disclosing all the things they have to disclose. How far behind is the US in that generally? And are we behind when it comes to disclosures about algorithms or AI?

• 20:12Speaker 04

  I think we're behind them in the sense that we're less privacy focused, but it's not clear that that's bad. And even if it isn't good, it's not clear that it's terrible. I think neither Europe nor the US has put their regulatory finger on the actual problem. So let's take the problem of algorithms not figuring out what people want, but algorithms exploiting a lack of information or a behavioral bias to get people to buy things at prices that aren't good for them. That's a problem. It's in the same universe as fraud and deception. And the question is, what are we going to do about it?

• 20:54Speaker 04

  A first line of defense is to try to ensure consumer protection, not through heavy-handed regulation. I'm a longtime University of Chicago person. I have in my DNA not liking heavy-handed regulation, but through helping people to know what they're buying and helping people not to suffer from a behavioral bias, such as, let's say, incomplete attention or unrealistic optimism when they're buying things. So these are standard consumer protection things, which many of our agencies in the US, homegrown, made in America, they've done that. And that's good, and we need more of that. So that's first line of defense.

• 21:37Speaker 04

  Second line of defense isn't to say, privacy, privacy, privacy, though maybe that's a good song to sing. It's to say a right to algorithmic transparency. So this is something which neither the US nor Europe nor Asia nor South America nor Africa has been very advanced on. So this is a coming thing where we need to know what the algorithms are doing. So it's public. What's Amazon's algorithm doing? That would be good to know. And it shouldn't be the case that some efforts to ensure transparency invade Amazon's legitimate rights.

• 22:15Barry Ritholtz?

  Really, really fascinating. Thanks, Cass. Anybody who is participating in the American economy and society, consumers, investors, even just regular readers of news, needs to be aware of how algorithms are affecting what they see, the prices they pay, and the sort of information they're getting. So with a little bit of forethought and the book "Algorithmic Harm," you can protect yourself from the worst aspects of algorithms and AI. I'm Barry Ritholtz. You're listening to Bloomberg's At the Money.

• 23:23Speaker 00

  At KKR, we've spent 50 years understanding what matters to our clients and companies. From pioneering private equity to investing across credit, real assets, insurance, and sports, KKR has built the experience to navigate complexity, the judgment to recognize opportunity, and the conviction to create lasting value. Because when people and institutions are counting on us, understanding what matters isn't just important, it's everything. KKR: Understanding What Matters. Visit kkr.com/whatmatters.

• 23:54Speaker 02

  This is the Bloomberg Tech Minute, brought to you by ChatGPT. I'm Carol Muster. Getting hired at SpaceX requires exceptional ability and may include having Elon Musk review a candidate's resume, so writes Bloomberg Businessweek's Lauren Grush. She reports that the company culture is defined by Musk, and job candidates must understand that a commitment to SpaceX means adhering to this culture and exhibiting loyalty to Elon Musk. To get hired, candidates must demonstrate their achievements from past jobs and hands-on experience. Experience matters more to recruiters than advanced degrees, with the company looking for people with raw innate intelligence. A spokesperson for SpaceX didn't respond to a request for comment on its recruiting and hiring practices.

• 24:38Speaker 02

  But according to recruiters, advisors, and those who've interviewed for jobs there, it's the space exploration dream that draws people to the company. And Musk invokes that dream regularly to remind workers why they're there. Prospective hires are told that the job will require stamina, including in job ads that candidates, quote, "must be willing to work extended hours and weekends as needed." One major perk for all that hard work? Employees' access to equity, either the right to buy shares or payment in the form of restricted stock units that vest over time. That's the Bloomberg Tech Minute, brought to you by ChatGPT. Get started at ChatGPT.com.

• 25:17Speaker 01

  If you're a business owner, you need a card that can keep up. With the Delta SkyMiles Reserve Business American Express Card, everyday purchases transform into miles you can use towards future travel. So business as usual can lead to a well-deserved getaway. And for a limited time, card members can earn 200,000 bonus miles, the highest miles offered this year. Whether you're traveling for business or planning your next adventure, now's a great time to make every purchase go further. Apply today at www.delta.com/podcast. Offer ends November 4th. Minimum spending requirements and terms apply.

• 25:53Speaker 05

  This message comes from Edward Jones, where they believe rich is about more than saving and investing. It's also taking care of what gives your life meaning. That's why your dedicated financial advisor meets you where you are with personalized financial strategies that help protect what matters, so you can preserve your progress while creating a path forward. The key to being rich is knowing what counts. Edward Jones, member SIPC.

• 26:18Speaker 06

  Congratulations, you've built a dashboard. But now comes the follow-up question, and the follow-up to the follow-up, and the dashboard for that. Meet Hex. Give everyone the power to ask their own questions, explore data, and build with AI, all in natural language. Because every answer should spark another question, limited only by your curiosity, not your data team's bandwidth. Go deeper than dashboards. Visit hex.ai.