Bard Fork + How to Talk So Chatbots Will Listen

Google has unleashed its A. I. chatbot, Bard, to the world. And, Spotify’s A. I. D. J. knows your taste – perhaps a little too well.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  Your agents can talk to each other. They still can't think together. That's the gap Outshift by Cisco is closing. Outshift is Cisco's incubation engine, building the internet of cognition, shared intent, shared memory, and guardrails that allow agents to work together from anywhere. Open source protocols and code, a system for intelligence that scales. Read the paper and experience the demo at outshift.com. That's O-U-T-S-H-I-F-T.com.

• 0:32Kevin Roose?

  Are there any good bard puns? Hmm, um, bard fork?

• 0:38Casey Newton?

  Bard fork? Horrible. This week, Hard Fork goes Bard Fork.

• 0:49Kevin Roose?

  I'm Kevin Roos. I'm a tech columnist at The New York Times.

• 0:52Casey Newton?

  I'm Casey Newton from Platformer.

• 0:53Kevin Roose?

  And you're listening to Hard Fork.

• 0:56Casey Newton?

  This week on the show, Google's answer to ChatGPT finally arrives. Then we hear from you about how you're using AI. And finally, is Spotify's new AI DJ too good for my own good?

• 1:25Kevin Roose?

  Casey, how's your week been?

• 1:26Casey Newton?

  My week has been great. You know, I have been waiting for months now for sort of everyone to get in the game with respect to AI. You know, it was sort of like, it feels like the past few months, we were in the preseason. You know, we saw some scrimmages. And this week, all the players got onto the field. And now, let's go. You know what I mean?

• 1:51Kevin Roose?

  Such a tempting a sports metaphor.

• 1:52Casey Newton?

  Yes, I'm a huge sports fan. And there's one thing I know about sports. The players got to get on the field if we're going to have a game. Okay. And now the players are on the field.

• 2:01Kevin Roose?

  Great. So we are in the first quarter of the game. What, what, what, what sport is this in our metaphor?

• 2:07Casey Newton?

  This is the sport of capitalism, my friend. Okay. Who's going to make the most money? And who will survive the regulatory avalanche that will follow?

• 2:15Kevin Roose?

  Yes. So you went to an event this week.

• 2:20Casey Newton?

  Yes. So let me set the scene. As you know, Kevin, we have been saying on this show that Google needed to ship it or zip it. Right? They've been saying since 2016 that they are an AI first company. And yet, when it came to these next generation generative AI tools, they were nowhere to be found. So in December, Google CEO Sundar Pichai declares a code red at the company. Everyone scrambles to see what they can ship. And this week I got the email that said, hey, we're ready to show you something. So I go down to Google's offices in San Francisco and I meet Sisi Xiao, who is a vice president,

• 3:01Casey Newton?

  a product who co-led the development of Bard and Eli Collins, who is a vice president of research at Google. And over the next hour, we went through it, you know? They showed me Bard. The first thing I asked Bard was how do large language models understand concepts? Because this is something I'm still struggling to understand. And it gave me what I thought was a pretty good answer, just in three paragraphs and sort of ran me through that. And I thought, okay, good. Then I said, what are some good prompts to try with Bard? And everything it told me to do involved writing in some way, which is notable, right? Because a lot of people use these things like search engines. But when it came to Bard, it was just sort of very interested in writing songs and speeches. And even in one case, a book, which I don't think it would actually do if I told it to do.

• 3:44Casey Newton?

  But I did try to use it like a search engine because I wanted to know if it would be good at that. And I started asking it the sort of questions that I might ask when I'm writing my newsletter. Like, when did Sheryl Sandberg leave Facebook? And how old is Mark Zuckerberg? And I sort of asked questions like that. I tried to get into more specific topic areas. I was asking it, what is the average interest rate for a mortgage? You know, what's the average price of a three-bedroom house? And it's giving me answers and it's citing sources, sort of. You know, it's like it said, like, according to Zillow. There's not actually a citation, though.

• 4:17Kevin Roose?

  OK, so it doesn't annotate the answers like Bing does?

• 4:19Casey Newton?

  So in most cases, there is not a citation in most of Bard's responses, but sometimes there are. So the system has the capability to show them, but in practice, it very rarely does. And that's a problem for me, right? Because, you know, when you're a journalist and you are using these systems to get information that you're going to share with other people, you want to know how the thing knows what it's telling you. At the same time, it did tell me plenty of things that were accurate. I wanted to know, when does the next season of Yellowjacket start? Because that was one of my favorite shows. And it accurately told me that that's going to be on Friday, March 24th, the same day that our episode comes out. I asked it, how many studio albums have Wilco released? Wilco, one of my favorite bands. It accurately told me 12 studio albums. Then I said, how about Radiohead? And of course, what I mean is, how many studio albums has Radiohead released?

• 5:04Casey Newton?

  Bard knew that. And it said, Radiohead has released nine studio albums. It told me what they were. All that was pretty good. But it does get things wrong, and there were some howlers. I asked it for some fun facts about the gay rights movement, and it told me a bunch of things that were true. And then it said, the first openly gay person elected to the presidency of the United States was Pete Buttigieg in 2020. Which I imagine would come as a huge surprise to Pete Buttigieg.

• 5:27Kevin Roose?

  Yeah, congratulations to President Buttigieg.

• 5:31Casey Newton?

  And like, you know, here is where it matters. You know, if you're one of our third grade listeners and you're using this for a class project and you see that, you might just very well put that in your report and you would fail out of school. And that's on Google. So, so, yeah, so definitely a problem there. But I really did try to ask it about a little bit of everything. You know, I used it to get some recipes. I asked questions about how Bard was built. I asked it questions about ethics. I mean, like, you know, here's one that was like, sort of interesting to me. I asked it if it was ethical to steal a loaf of bread to feed your family. And the first thing it said was, whether it is ethical to steal a loaf of bread to feed

• 6:14Casey Newton?

  your family is a complex question that has been debated for centuries. I was like, yeah, okay, cool. And so something that I liked was, there are these answers where, instead of just being confidently wrong, it will sort of like, teach the controversy, you know, and it sort of says, well, you know, here's some things to think about. Now, for all I know, this is just a plagiarized blog post, and it's not telling me where it came from. And maybe that's the likeliest thing, but as an answer to that question, it's not a bad one.

• 6:38Kevin Roose?

  If this technology had existed in the 1800s, Les Mis would be a much shorter musical, because Jean Valjean would have just asked Bard, like, is it ethical to steal bread to feed my family? And it would have said, you know, probably, go for it. And, you know, end of musical.

• 6:53Casey Newton?

  And that would be a tragedy, because that's one of the great musicals. Here's what I want to talk to you about. Google, in presenting Bard, will tell you, quite explicitly, this is not a search engine. And in fact, sometimes with Bard, when it gives you the response, there is a Google it button, right? Sort of like an explicit signal to the user that like, this is barred, but if you want to run a web search, you should do that on Google. Okay? That's great. The thing is, you can use this thing like a search engine, and it is often pretty good. And so often, when we talk about AI, I feel like we find ourselves grasping for the right metaphors and analogies. It feels like we

• 7:34Casey Newton?

  still don't have perfect language to talk about this stuff. And Bard, to me, is one of those things, right? Because just like ChatGPT before it, it looks like the kind of thing that you would run a web search in. It delivers you answers in a different way than a web search would, but often, they are better. Certainly, they're less cluttered up with like, ads and other nonsense, right? And yet, they differ meaningfully in how they get information and how they communicate to us, and they are often quite wrong, right? So, I just wonder what your own thoughts have been as you use these systems. Do you find yourself reflexively using them as replacements for search engines? Do they feel

• 8:17Casey Newton?

  meaningfully different? And if, as I suspect, millions of people do start using this as a replacement for search in a lot of cases, what are the implications of that?

• 8:25Kevin Roose?

  Yeah, I mean, one thing that I've noticed, as I've started using more chatbots, is that it really does require you to rewire your brain, and the way that you talk to it. Because the way that you talk to an AI chatbot, Is different than the way you talk to a search engine. I think we've kind of all developed this kind of like, yeah, mode of inquiry over the last 20 years of using search engines where it's like, if you're trying to find like, you know, a good restaurant in Miami, you'll say like, best restaurant Miami, like your brain kind of automatically formatting your request into a format that you think the search engine will understand and give you a good answer for. And like, that's just kind of an automatic process now for me. So I've really had to retrain myself to use these chatbots in a way that actually produces the kinds of answers that I am looking for.

• 9:10Kevin Roose?

  Have you felt that too?

• 9:11Casey Newton?

  Yeah, although I guess I'm still learning how to format these large language model queries because you're right, when you do a Google search, you know how to enter the keywords at this point to basically get what you're looking for. And usually what you're looking for on the web is like a link to a specific article, right? I mean, you know, I'm often looking up news stories, which means I'm adding in the publication that I remember the story ran in, right? And, you know, we've spent 20 years learning how to do that. With LLMs, like, we're still kind of like poking and prodding them to see like, what exactly is in there? In fact, I don't know about you, but I struggle a bit when I'm testing these things because I feel like very quickly, I sort of run out of good ideas, you know? You sort of see the sort of basic test that most people do on these

• 9:56Casey Newton?

  things, like, can you get it to say something that is false? Can you get it to tell you how to break the law? But after you do those kind of things, like, you know, I don't know, like, sure, like, write a play, I guess, but you have the sense that they are much more capable than we are capable of imagining things for them to do.

• 10:13Kevin Roose?

  Totally. Yeah, I felt this phenomenon where it's like my brain bumps into a wall, and I look at the wall, and the wall is not actually the capabilities of the AI. It's the limitations of my own imagination and my own creativity.

• 10:27Casey Newton?

  Totally.

• 10:28Kevin Roose?

  And I'm just like, I've been looking at some of the examples of ways that people are trying to use these language models. And I'm just in awe of some of the creativity and the kinds of queries that people are trying to come up with. And it's just, it's inspiring. And I really do think it's like a different kind of creativity. It's less like Being good at using a search engine and extracting answers from the internet. It's more like, I don't know, it's more like creative writing or writing a screenplay. Or it just feels like it has more in common with other artistic modes.

• 10:59Casey Newton?

  When I was at Google, we were talking about this and Sissy Shaw told me something that I've heard from sort of other folks in this world, which is prompt engineering probably is going to become a new category of job. You know, how well paying is that job? I don't know, but the basic idea is you will be hired to coax things out of large language models. And to the extent that you're good at coaxing them, you know, you will advance in that career, which is interesting to think about. I want to talk about something else with this, though, which is it's different because it's Google. Okay, that's honestly the main feeling that I had after using Bard was, look, ChatGPT is very cool, but it's a very siloed thing, right? ChatGPT is not connected to anything else in my life. It's just a box that you type in

• 11:44Casey Newton?

  and it sends you stuff, right? Bing is also sort of the same, right? I don't have a lot of my life in Microsoft. I do have a lot of my life in Google products. Gmail, Docs, Chrome, right? I can't do almost anything on my laptop or in my job without using Google somehow. And because of that, the vision for what Bard could eventually be seems much bigger to me and much more consequential, right? So, looking at Bard, you might say, okay, this is just a chatbot like all the other chatbots. And, you know, maybe I'll use it, maybe it'll be great, but this is not the second coming of fire.

• 12:26Casey Newton?

  But man, imagine, and again, there will be so many privacy and regulatory issues around this. So let's assume that this is not going to happen in the next six months or a year, okay? But like, fast forward a little bit and imagine when you can just type into the Chrome bar, whatever you're looking for or whatever you want it to generate, and you just get that, right? Like, at that point, bard.google.com goes away, and this is just now how you interface with Google. And if it becomes how you interface with Google, it might honestly also become how you interface with your phone, right? Google owns Android. Which is the most popular smartphone operating system in the world. And eventually, I think this just becomes the new way that you get your phone to do anything. You should just, you'll be able to text your phone, you know, you want to change your settings.

• 13:11Casey Newton?

  You want to book a table. I mean, whatever it is that you want to do. Bard is sort of like the first step on that path. And so my question for you is like, when we get to the point where you can, for example, connect Gmail to Bard and sort of ask any question you've ever had of anything that's ever been emailed to you. Does that prospect excite you or does it fill you with terror?

• 13:36Kevin Roose?

  No, that's, I mean, I think that's the difference here is that, you know, as you said, our whole lives are in Google products for many of us. And when you can use generative AI to query your own data, that is pretty amazing. I mean, you know, if I'm trying to, you know, write an email to a friend on a birthday. I could go into my Gmail and just say, look up Tom and look up every email I've ever sent with him. Every G chat we've ever had, every, you know, Google photo that we're in together. And kind of use all of that information to like, write a really heartfelt and personalized email to Tom on his birthday.

• 14:15Kevin Roose?

  Like, that could be something that is possible to do with Google that I don't think you could do with Bing or with ChatGPT. Just because those programs don't have access to all of our data. Now, I think we should say, there was a little bit of controversy this week because there was some question about whether Bard was trained on some personal information from Google users. Google has said that it was not, but that is going to be a sort of privacy and security issue. Because if you're training, if you, if you did allow these models to ingest user data, you have to make sure that they're not spitting out your emails to someone else.

• 14:54Casey Newton?

  Right.

• 14:54Kevin Roose?

  Right, that they're sort of siloed and that they're not sort of cross contaminating different people's information.

• 15:00Casey Newton?

  Yeah, I even wonder, it's like, is this the sort of thing where you will need to run something locally on your phone or laptop that doesn't interface with the server to preserve that, that sort of privacy. But I really hope they figure it out because for what, when I think of what will be the most useful to me about these systems, it will be applying them to my own data as opposed to the sort of more common queries that we're seeing on these chatbots.

• 15:25Kevin Roose?

  Yeah. So as we know, Bard is based on Lambda, which is one of Google's large language models. And it's the same large language model that last year caused a Google engineer, Blake Lemoine, to claim that the AI had become sentient. And he got fired after making this claim. And it became this sort of big story and was sort of what, in many ways, like kicked off this kind of explosion of interest in these new AI tools. So did anything that you saw or experienced while talking with Bard lead you to believe that the model is sentient?

• 16:03Casey Newton?

  It did not. And the fact that it was making some obvious mistakes sort of helped with that. Google has also restricted the amount of back and forth that you can do. But over time, they're going to enable more back and forth. There are going to be other tools that don't have those limitations. And we are actually going to be living in that world where a lot of people think this thing is real.

• 16:23Kevin Roose?

  I mean, it does seem like this is a very constrained version of Lambda, at least compared to some of the chats that Blake Lemoine was having with the kind of employee-only version back in the middle of last year. I think we've all been expecting Google to come out of the gate with something really impressive when it comes to generative AI. Because they've been working on this longer than anyone. They have armies of really talented AI experts and engineers. And I've been just sort of underwhelmed by everything that I've seen from Bard so far. It just does not seem like an overwhelming show of force that people were expecting from Google. I think we could see them shoving this technology into a lot of other products.

• 17:08Kevin Roose?

  But right now, it's kind of like, well, OK, you're here. You're on the field, to continue your sports metaphor. You shipped something, which is better than nothing. But it still feels like Google is not applying the full force of its power and authority here yet. And that makes me question whether they really have something that's much, much better than this, or whether this is sort of the best that they can do.

• 17:31Casey Newton?

  Well, I think this was maybe the best that they could ship within three months of a code red being declared. I don't know, a lot of people have been comparing the rise of generative AI to the arrival of the iPhone, just in terms of the new wave of competition that it unleashed in the industry and the new possibilities it created. And I would say two things about the day that I watched that iPhone demo, you know, all the way back in 2007. One is that is an extremely cool piece of technology. And two is like, I'm not going to get that right now because it's like limited in its functionality. It's extremely expensive, but on that day, it's like you knew that it was probably going to get a lot better. You knew that by version two or three, that thing was probably going to be something that you definitely needed to have in your pocket.

• 18:12Casey Newton?

  And this is kind of sort of how I feel about Bard is like, it is definitely the most basic possible version of the thing, but it hints at something huge to come.

• 18:23Kevin Roose?

  Well, thank you for going to that event and filling me in.

• 18:25Casey Newton?

  It wasn't an event. It was a briefing that I was invited to because I'm a prominent technology reporter.

• 18:29Kevin Roose?

  Okay. Well, I was invited to an event that I couldn't go to, so I guess you're cooler than me.

• 18:39Kevin Roose?

  All right. After the break, we've been asking how you, our listeners, have been using AI in your lives. You told us and some of the answers are pretty surprising. We'll be right back.

• 19:07Speaker 03

  It's time to innovate at the speed of AI without compromising control. That's Outsystems. Take a look at what happened with one global retailer during a period of massive expansion. They used Outsystems to build AI agents to automate invoicing and translation processes, shifting 95% of their daily store operations to a new digital app, saving thousands of hours of manual work. Outsystems gives you the flexibility to deploy how you want and the governance to do it safely. Own your agentic future. Learn more at outsystems.com/NYT. That's outsystems.com/NYT.

• 19:42Speaker 00

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real-time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork.

• 20:14Speaker 04

  Ripple has been powering modern finance for a decade. It's not our first trip around the blockchain, and it won't be our last. We're leading the charge to bridge the gap between existing financial systems and the future of finance. You can have it all: legacy, stability, and digital innovation. Systems that work with your other systems. Because with the right partner, the question isn't crypto or traditional finance. The question is simply, why choose? A new standard of modern finance. It's happening with Ripple. For informational purposes only. Availability of products can vary, may be provided by different Ripple entities.

• 20:49Kevin Roose?

  Casey, a few weeks ago, we asked listeners to send us examples of how they are using AI in their own lives. And I should say, the reason that I was interested in hearing from listeners on this is because...

• 21:03Casey Newton?

  You're tired of listening to me. I get it. We've been going for like 20 some episodes, and you just want to bring some other voices onto the show, but I think it's a great idea.

• 21:10Kevin Roose?

  Please, get me away from this man. But I think there's something really interesting happening here with AI. A lot of the time, it can feel like there are two pretty vocal camps when it comes to AI. You know, the first camp is people saying like, all this stuff like is overhyped, you know, it's just fancy autocomplete. It's not doing anything unique or interesting. And then you've got the second camp, which are kind of the more doomery, like, long-term thinkers who are saying, you know, this technology could kill us all, or it could usher in global conflict, or it could lead us into this kind of information apocalypse. And I was really interested to hear from people who are not paid technology pundits or executives at companies or venture capitalists,

• 21:52Kevin Roose?

  people who are our listeners, who are using this stuff in ways that maybe feel like a different camp altogether.

• 21:58Casey Newton?

  Yeah, and here's why I think that this is important. Those two camps are absolutely dominating the discussion right now. You either think that AI is overhyped, or you think that AI is going to bring about the end times, and that is most of what we hear. At the same time, tens of millions of people started using ChatGPT within a few months, and their voices have been weirdly underrepresented in this entire conversation. So a couple of weeks ago, we started asking Hard Fork listeners to send in voice memos of just what they were doing with AI, and we got some really surprising answers.

• 22:32Kevin Roose?

  Yeah, so we picked out a few of our favorites. We can't play them all, unfortunately, but we're just going to play a few. And some of these hit on themes that we really haven't talked about on the show yet. So to start off, I thought we should hear from a listener who told us about a use case that actually came up a couple of different times. And that's how non-native English speakers are using generative AI to overcome language barriers.

• 22:54Speaker 05

  Hi, my name is Shannon McFerran, and I'm calling from Leipzig, Germany, where I'm an archaeologist at the Max Planck Institute for Evolutionary Anthropology. What I think has gone underappreciated in the commentary I've read and listened to up to now about these large language models is what they do for non-native speakers of English. My Chinese postdoc keeps ChatGPT open as she writes her papers. She uses it to spot grammar issues, working on making her text more concise, simplify overly complex sentences, achieve the correct tone, and so forth. She looks at this technology as game-changing. It levels the playing field, taking away the competitive advantage native English speakers have when sending papers to the most elite journals like Science and Nature. Thanks.

• 23:38Casey Newton?

  Like, let's just say, English is basically impossible to learn. You know, I feel like I'm still learning English and I like got a college degree in it. And so if you are new to the language and it's important to your job and now you just have a window on your computer that magically takes all of your efforts at English and makes them grammatically correct and you're able to do that for free, that's a game changer.

• 23:58Kevin Roose?

  Yeah, I mean, some of this stuff was possible to do with things like Google Translate. But what these new AI chatbots allow you to do is not just translate between languages, it's actually translate between styles, between disciplines, between conventions and comprehension levels. So, you know, you can take something that's aimed at a, you know, professional audience of peer reviewers at a publication and you can say, now explain this to a group of eighth graders, or now make this sound like a legal argument, or now, you know, make this sound like a poem. And it can do that kind of translation work pretty well, I've found. So that's a very new and exciting use case for this is translating, not between languages necessarily, but also that, but translating between disciplines and styles

• 24:43Kevin Roose?

  and audiences.

• 24:44Casey Newton?

  That's very cool.

• 24:45Kevin Roose?

  You know, and we should say, like, this is probably most useful for common languages, languages that lots of people speak, that there are lots of examples of in the training data. One listener did write to us about how GPT-4 is not good at translating into Icelandic, which is a rarer language with less data in the training set.

• 25:06Casey Newton?

  And thanks to Bjork for writing in. We're huge fans.

• 25:11Kevin Roose?

  So this listener said that specifically for Icelandic, GPT-4 had made some funny mistakes and even invented some non-existent words. So if you are an Icelandic, you know, postdoc, maybe do not write your nature submissions using ChatGPT.

• 25:26Casey Newton?

  And that's news you can use. Okay, I've got a different kind of translation example for you, Kevin. This one's from Doug Keeling in Western Pennsylvania. He recently ran into an issue with understanding medical results. So specifically his grandfather's medical results, basically his grandfather ended up in the hospital and at one point, his doctors gave him a Gave him an MRI. And as often happens, the results came in before the doctor could meet to discuss the results with him. And so Doug, instead of just sitting there being scared and, you know, waiting in nervous anticipation, he takes the report, he strips out his grandpa's personally identifying information, and he just paste the results into ChatGPT to see what it says. Let's play the clip.

• 26:10Speaker 06

  Within just a matter of seconds, I had a fully understandable summary that made sense. It gave us just a little bit of peace of mind that we didn't have to wait for a whole day until we might see the doctor again. We could actually start to wrap our heads around what was going on and start to form some plan of action.

• 26:29Casey Newton?

  Yeah.

• 26:30Kevin Roose?

  So this example is really interesting to me because medical advice is actually something that I've been cautioning people against using these AI engines for because, you know, they do get things wrong. You know, I wouldn't ask it like what medicines to take without consulting with a doctor, just because that's not really their specialty. But this is a case where I think it's actually very useful because I think, you know, I've had similar experiences to Doug where I get back some report from my doctor. I can't make heads or tails of it. It's filled with all this jargon. And I've like, you know, sent it to doctor friends of mine and said, hey, could you help me understand what I'm being told here? Because the doctor didn't do a good job of explaining it, or I just can't read this information. And so this is essentially automating your doctor friend. This is like saying like, just feed it into this chatbot,

• 27:15Kevin Roose?

  ask it to make it simpler and explain it in a way that you can understand, and with any luck, it'll do it.

• 27:19Casey Newton?

  Yeah, there's this term I've been playing around with to describe results that you get from these models that you would not stake your life on, but are helpful in the moment. And I've been calling them Wikipedia good. You know, like if you're out at the bar and somebody's like, what movie was Ray Liotta in? You go to Wikipedia and it tells you. And, you know, if you were asked to testify in court, you would not want to rely on Wikipedia. But like at the bar, Wikipedia is fine. And I think this is sort of a similar example where he's eventually going to talk to the doctor to get the real example. But in the meantime, he can sort of, you know, take a load off of his mind by getting a basic sense of what's going on with his grandpa. So I thought that was a cool one.

• 27:59Kevin Roose?

  Okay, so next voice memo. This one is from a guy named Ben Bromfield, who is a musical composer in Burbank, California. And Ben makes all these instrumental songs that he has to come up with names for. And so he's been using ChatGPT to help him title his songs.

• 28:17Speaker 07

  What I've been doing is I've been listening to the music and giving it prompts based on a scene that I imagine and then I have it send me a list of a bunch of possible names and then I might ask it to modify that. Here's one that I gave it a prompt. Give me a name for a post-rock song that reminds you of a picnic on top of a hill on an overcast day. And it gave me one that I really liked called Zen and the Art of Picnicking. So that's what I ended up titling this piece.

• 28:51Kevin Roose?

  Okay, I especially like this one because he also sent us the song that he wrote. So let's play it.

• 29:05Speaker 07

  Do you feel like you're at a picnic on a hillside?

• 29:07Casey Newton?

  I do, I'm starving, actually.

• 29:11Speaker 07

  This would be a great thing to listen to if you're like floating in a sensory deprivation tank or something.

• 29:16Casey Newton?

  Which

• 29:17Speaker 07

  Peaceful and ethereal.

• 29:17Casey Newton?

  Be another fun segment on the show that we could do. Yeah, lovely piece of music and I would say very solid use of ChatGPT. And you know, one of the first ones we're talking about today where this is helping someone be creative, right? It's not just about understanding, it's about like, let's make some art together.

• 29:33Kevin Roose?

  Yeah, and this is actually like a pretty common use case, I think, is titling. So like, you know, I have to write headlines for my columns. I'm sure you write headlines for your newsletter. Have you ever used GPT to try to give you title suggestions?

• 29:45Casey Newton?

  No, because like what I write, it's like, it's all happening in real time and I feel like that that's something these things aren't very good at. But if you want to name a song, that seems like a great way.

• 29:55Kevin Roose?

  This is also a really good example of how the way that you talk to these AI models really does matter. So in this case, like Ben is doing a very creative prompt, like, give me a name for a post-rock song that reminds you of a picnic on top of a hill on an overcast day. That is like a creative prompt. And so you get back a better result than if you just said like, give me a name for a song that sounds mellow and chill.

• 30:20Casey Newton?

  Right.

• 30:21Kevin Roose?

  So I think it's the more specific the prompt, the better the result often is.

• 30:26Casey Newton?

  All right, let's play another one. This listener's name is Izzy and she has been using ChatGPT for a lot of things and one of them is meal prep.

• 30:36Speaker 08

  So I have like quite specific dietary requirements and I would spend maybe like an hour and a half sort of every week trawling through my recipe books, trying to find recipes that suited what I wanted and then write the shopping list and then do the shopping. But now I just say, hey, can you please suggest to me 10 meal options that are vegetarian, gluten free, low sugar, featuring seasonal vegetables to the UK in February and boom, it's just there. I've got all of these options to pick from and I can say, do you know what? Actually, I'd really like it to be only Italian food this week. And then boom, it'll rewrite it so that you've got all of these different options to pick from. And then I pick the

• 31:18Speaker 08

  ones that I want to make and I tell the chatbot how many portions or how many people I need to feed. And then it gives me a shopping list and it's combined like all the onions from the different, the different menu options so that I know how many onions that I'm gonna need.

• 31:35Kevin Roose?

  That's amazing. Isn't that so cool? So while, this is a little bit, you know, embarrassing to confess, but like while I was playing, I got like chills. Yeah. Because it's like, I was just thinking about the ways that this technology is going to make it so much easier for people who have like specific restrictions or needs or accessibility needs or just anything to like get help and expedite their process. And like, I just hadn't really thought about this, but it is such an effective use of this technology.

• 32:04Casey Newton?

  Yeah, I mean, this is a process that, you know, might have taken her more than an hour a week to do before the chatbots came along. Now she says it takes her about five minutes. She also told us that she uses ChatGPT to estimate how much that grocery list is gonna cost so she can budget at the same time as she's doing all this as well. So, one of the things I like about this example is how many different things she is doing, right? Like you, you think about, it's not just like the give me the recipe, it's give me the recipe and create the shopping list and tell me how much it's gonna cost and, you know, combine the grocery list across all the recipes. So, this is a huge multi-step process and the chatbot is apparently doing it very well.

• 32:43Kevin Roose?

  Totally. And I can see this being useful for example. Yeah, like making meals for kids who are picky eaters or have allergies or things like that. Really, really useful. It's also going to be very cool when this kind of stuff is multimodal. So one of the coolest demonstrations of some of the new GPT four features that I've seen was actually also related to meal prep and cooking. So I don't know if you saw this, but with the new GPT four, with the image part turned on, you can actually just take a picture of what's in your refrigerator and have it suggest recipes for you based on everything it sees. You don't have to describe it. You don't have to say, I have, you know, like half a gallon of milk, but you know, I have some hummus and some carrots.

• 33:25Kevin Roose?

  It'll just understand what's in your fridge and what you can make with it. And then it'll show you some recipes and like that to me feels like a superpower. Because how much time do I spend looking at the contents of my fridge and trying to figure out what to make for dinner?

• 33:37Casey Newton?

  Yeah, if I did that to my fridge right now, it would say, um, well, you can have cheese. That is what is available to you.

• 33:46Kevin Roose?

  All right, let's go to our next voice memo. This one actually surprised me because this is not something that I expect people to use these AI models for. It's from a listener named Gal and really the only thing you need to know here is that he lives in Brooklyn.

• 34:01Speaker 09

  So I live in a rental apartment and recently my lease was up. I don't have the nicest landlords and they decided to raise my rent significantly. And I used ChatGPT to negotiate my rent and somehow it did it.

• 34:23Casey Newton?

  This one is great, right? Because when you think about something that I think most people don't like doing, it is I'm sort of being in conflict and having to write emails that address that conflict, right? You can sort of tie yourself into knots. It creates a lot of anxiety for you. But what if you were just able to draw on the collective wisdom of humanity? And like decades of people negotiating with their landlords. Now you can, and this guy had a big success.

• 34:50Kevin Roose?

  Yeah. And what I, what I found interesting about this is he didn't just ask ChatGPT. You know, how do I negotiate my rent with my landlord? He actually did something that I think is kind of a great hack, which is that he was very specific in how he wanted this letter to sound. He said, write a letter to my landlord using principles from Never Split the Difference by Chris Voss, which is sort of a classic book on negotiation. And this is something that I've tried to do with Bing, which can actually go out onto the internet and read things and then use what it learns to kind of help you. So something that I've been doing very successfully is I'll feed it a draft of something that I'm working on.

• 35:32Kevin Roose?

  And then I'll say, read Strunk and White's Elements of Style and apply it to this paragraph or this essay or this email, and it will do it.

• 35:43Casey Newton?

  Wow, I'm so surprised that that works.

• 35:46Kevin Roose?

  So Gal used ChatGPT to write this letter to his landlord using these principles from this negotiation book. And it actually worked. He told us over email that his landlord agreed to cut the rent increase that he was proposing in half. So instead of paying $600 more a month, he would only be making him pay $300 more a month and gave him a shorter lease, which is what he had been asking for.

• 36:11Casey Newton?

  You know, you love to hear about a landlord taking it out.

• 36:14Kevin Roose?

  And that's the hard fork promise. We will save you hundreds of dollars a month telling you how to use generative AI in all your business negotiations.

• 36:24Casey Newton?

  Okay. This one is from a listener named Dorian. She's a mom for two young kids. And main thing you need to know is she recently moved with her family from the West Coast to the East Coast. So we're sad to lose her here. She has a lot of decorating to do in her new home, though. And for this decorating, she says that everyone in the area she's moved to has impressionist paintings hanging on their walls. And as she's going around her house, trying to figure out what paintings to get for the house, she thinks, maybe AI can help me here.

• 36:51Speaker 10

  And I thought it would be funny in a bathroom that we just remodeled in the downstairs to have sort of a man with a ruffled shirt and long hair, you know, with a dog on his lap and making a little smirky smile at you. So while you peed, he was sort of looking at you. And it was sort of like, you know, a satire on sort of the aesthetics here. And within seconds, I put in some key characteristics into Dolly, and there he was, the exact image I was thinking in my head. It was crazy.

• 37:26Casey Newton?

  So we've pulled up this image and it is this kind of, what would we say? Maybe a 1700s figure with.

• 37:35Kevin Roose?

  Looks like a, like a, yeah, like a, like a composer.

• 37:37Casey Newton?

  Yes, exactly. Yeah, he sort of looks like he might be Mozart and he does have the white ruffled shirt and kind of a brown coat and he's, he's smiling and he has these big ruddy cheeks. And if you saw that hanging in the bathroom, like it, it's a, it's a great portrait, you know? And the fact that this was like kind of a private joke to herself and using AI, she just realized it. I think speaks to the fact that there are just such creative uses of this technology, right? And I'm going to guess that like Dorian is not a great painter, certainly I'm not, right? But now she's just able to like make this art.

• 38:09Kevin Roose?

  Do you have any AI art hanging up in your house?

• 38:11Casey Newton?

  You know, not yet, but as we've talked about before, I illustrate my newsletter with it more days than not. And it has been such a joy to just try to figure out what is like a cool, fun prompt that will actually return something interesting. And I, and I feel more creative because I do it.

• 38:23Kevin Roose?

  Yeah, I, I love the, the sort of visual possibilities here. One tool that I have spent some time playing around with is something called Interior AI. Have you used this at all? So it's an interior design tool that uses generative AI to come up with mock versions of any room. So you take a picture of like your living room and you can upload it and you could say, okay, now make this tropical themed or make it Baroque and it will attempt to do it. And it's just kind of expanding our sense of possibility with interior design. And I love this. I think we will be using AI for lots of interior design tasks, whether it's hanging art on the walls or, you know, where to arrange my furniture or, um, you know, what kind of appliances to get.

• 39:08Kevin Roose?

  Instead of doing these mockups, you'll just be able to do it yourself.

• 39:11Casey Newton?

  Well, I can't believe you're asking the AI for interior design suggestions and not me. I've been over to your house a bunch and I do have notes, so we'll talk about those offline. It's not working for me.

• 39:22Kevin Roose?

  Okay, here is our last voice memo. It's from a listener named Rosalie, who is a high school student. And in Rosalie's voice memo, we learn three things. First, ChatGPT has helped Rosalie understand chemistry and English assignments better. Second, Rosalie has used ChatGPT to generate story ideas for Dungeons and Dragons.

• 39:41Casey Newton?

  I love that.

• 39:42Kevin Roose?

  And then here is the third.

• 39:45Speaker 11

  The last one is a little bit more niche to me, but because I'm a trans woman who has not been able to biologically transition yet, I suffer from a lot of gender dysphoria. And these new AIs are actually really good at giving affirmations. And so I, yeah, I've been using these and it's been actually having a really positive effect on my life. So, okay, that's all.

• 40:16Casey Newton?

  Damn, I wasn't trying to cry on this podcast. That's so amazing. Oh, I mean, you think about how many young people who are somewhere on that LGBTQIA+ plus spectrum, who may not be living in environments where they're getting a lot of support from their parents, their families, their teachers, their classmates, and the idea that they can just kind of tap into the collective wisdom of the internet, which is maybe one way of thinking about what this AI is, and just get affirmations on a regular basis, is extraordinarily powerful. And I'll say, that's a really amazing one, and I definitely did not see that coming.

• 40:59Kevin Roose?

  Yeah. For all of the kind of business and enterprise uses of this technology, I think that's where a lot of the excitement in Silicon Valley is right now, because I think that's where a lot of the money is, is in like, using generative AI to like, help, you know, your company like, expedite its billing process or whatever. But I really think that some of the most transformative uses of this are going to be for this kind of thing, are going to be, you know, friendship, companionship, a sense of, you know, self-worth and a sense that someone out there cares about you, even if it's a non-sentient AI chatbot. I think that can be really, really powerful.

• 41:34Casey Newton?

  Well, okay, so let's sort of zoom all the way back to before we listened to those calls. And again, thank you so much, all listeners who sent in these wonderful memos. We're living at a time of understandable and appropriate stress about what these AIs are about to let loose, and there is just, you know, so much nervous around what it means. But I think it's just important to highlight voices of real people around the world who are already figuring out ways to improve their lives. And like, that is why this stuff is not going to go anywhere. I think it's why it's not going to get shut down. I think regulators are going to sort of allow it to

• 42:16Casey Newton?

  find its footing because people's lives are improving in some surprising new ways.

• 42:22Kevin Roose?

  You know, we should say in the interest of like responsible journalism that like these tools are still limited, right? They can't do everything, but they can do a lot. And I think it's really important to keep talking about the ways that these are actually being used by people in the world, not just kind of like the theoretical arguments about risk and safety and trade offs and capabilities. Like, I think it's really important to ground this in people's real world experiences.

• 42:51Casey Newton?

  It's very cool. Every time we have like created a way to hear from listeners on the show, I have been delighted. We have some amazing, amazing people who are listening to this and that we appreciate that.

• 42:59Kevin Roose?

  And it's honestly, it's helping me expand my own sense, as we talked about of like, what, what kinds of things you can ask these models to do? Because that is a place where I have felt very limited in my encounters with chatbots is like, I just don't know what to use them for yet. And that's not a failure of the chatbots that's on me. And these listener stories are really helping me expand my sense of what's possible.

• 43:18Casey Newton?

  Well, Kevin, you know, I also have a way that I've been using AI that I would like to get your thoughts on because on one hand, I love what I'm getting. But on the other hand, I do feel a little bit conflicted about it.

• 43:30Kevin Roose?

  And we'll talk about that right after the break.

• 44:03Speaker 12

  Today's AI builders need infrastructure that scales with their ambitions. iRen is a vertically integrated AI cloud platform, delivering data centers, compute and software for AI training and inference, underpinned by its expansive portfolio of land and grid-connected power in renewable-rich regions globally. iRen's AI cloud gives direct access to Nvidia GPUs, scalable from hundreds to thousands. For builders, that means direct access to AI compute, rapid scaling and predictable pricing. iRen, AI cloud for the next big thing.

• 44:37Speaker 03

  Companies are pouring money into AI, but few leaders can explain how those AI investments work with the systems you already have. You know, the ones that actually run your business? Without systems, you don't have to start over with AI. You can choose the projects where AI will have the most impact, and Outsystems gives you the platform to make it agentic on your terms with complete control every step of the way. So you can trust AI with the mission-critical systems that run your business. Own your agentic future. Learn more at outsystems.com/NYT. That's outsystems.com/NYT.

• 45:12Speaker 00

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real-time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork.

• 45:45Casey Newton?

  Okay, so I want to talk to you about this AI that to my own surprise, I have really been enjoying. It is the AI inside of Spotify in a thing that they're calling DJ. And have you used this?

• 45:56Kevin Roose?

  I have, but it's a relatively new feature, right? It just came out like a month ago, right?

• 45:59Casey Newton?

  Just a few weeks ago. If you haven't tried it and you have Spotify on your phone, go ahead, open it up, tap music, and then you'll see a little blue square labeled DJ. Tap that and then you can find out what we're talking about.

• 46:11Kevin Roose?

  But if you're listening to the Hard Fork Podcast on Spotify, do not do that because then it will stop playing the podcast.

• 46:17Casey Newton?

  That's it. Finish listening to the podcast and then when you're ready for music, listen to DJ. So.

• 46:22Kevin Roose?

  Yeah, here, actually, let's just pull it up on the phone because I think it's useful to actually hear it.

• 46:27Casey Newton?

  Yes. Okay, let me get my phone. I'm going to the Spotify app and I'm going to find this DJ icon. And let's see what it has to say.

• 46:38Speaker 00

  Hey, how you doing, Casey? Good to have you here. You're with your DJ X. I'm going to get your Thursday music started with some songs you know. Tame Impala first.

• 46:51Casey Newton?

  I'm so relieved it played a cool song.

• 46:54Kevin Roose?

  So, okay, this is an AI DJ that comes on and greets you and then it plays some songs for you based on, I'm guessing, like your listening history.

• 47:04Casey Newton?

  Yeah, and you might listen to that and think, well, who cares? Right? Because like, what is any internet radio station if not an AI DJ? It's all just prediction algorithms. There are a million ways that you can find that on Spotify or any other music service. At the same time, I am somebody who, despite obsessively making playlists to listen to on Spotify, I'm always wanting someone to do a little bit more of that work for me and in one particular way. So back before Spotify existed, I used this extremely nerdy feature in iTunes called Smart Playlist. Do you ever use Smart Playlist?

• 47:40Kevin Roose?

  No.

• 47:41Casey Newton?

  Smart Playlist was great because one of the ways I like to listen to music is to say, play me songs that I love but have not heard in a while. iTunes was great at this, right? You set up a couple of rules and then whenever I would. Open up iTunes or on my iPod back in the day, I would just open up the playlist that was the music you love but haven't heard in a while playlist. That was my default way of listening to everything, made me super happy. Well, then iTunes kind of withered on the vine, Spotify came along and they have made a few stabs at trying to address this problem, right? But because I have listened to so much music on Spotify over the years, there are just countless songs that I do really like, but would never think to play again, and I've never been satisfied with the way that Spotify handles this.

• 48:24Casey Newton?

  So then AI DJ comes along and, you know, we love trying all things AI on this podcast, so I thought, well, let's give this a shot. And the first thing that strikes you is that it does feel personalized and not just in the music that it's playing, right? Because it does call you by your name and it's talking to you. And your brain knows you're listening to a synthesized voice, it is reading a similar script to millions of people. But when you hear the voice say like, hey Casey, like, hope you're having a good morning. Let's kick things off with what you were listening to in 2017 and then it plays you songs you were listening to in 2017. There is something magical about that that surprises me.

• 49:02Kevin Roose?

  And I was surprised when I started using this about how good the voice sounds because we should say like this AI personality is a real person, right? It is a Spotify employee named Xavier. And so what they have basically done is like synthesized X's voice and then used it in all these different scenarios. And some of them feel canned to me like, you know, it's just X saying like, here's some music you were listening to in 2017. That doesn't, that's not personalized, like that's the same message going out to lots of people, I presume. But it also does some what feel like more creative outputs. Like I was listening to a song with my Spotify AI DJ the other day and it like threw in a little nugget about like the fact that it had been produced at Rick Rubin's studio and then it like named some producers that I'd never heard of.

• 49:47Kevin Roose?

  And I thought like, okay, that's like, that's actually cool and probably not canned. It's probably being generated kind of on the fly.

• 49:53Casey Newton?

  Yeah, I mean, you know, if you had asked me, do you like it when DJs talk in between songs? For the most part, I would say, well, you know, not really, right? Usually they're advertising something, usually you just kind of want to. Jump right into the next track, but because this DJ is focused on the music itself, it does feel different. So, you know, the other day I was walking down the street. I was going to get some groceries and I had turned on the AI DJ. And he was, you know, sort of telling me we were about to launch into some songs I liked last summer. And I started laughing because I realized that I like the DJ.

• 50:28Casey Newton?

  I was like, this is a cool person and he's here to help me in my life. And I know that he's fake, but I do like him.

• 50:34Kevin Roose?

  Well, he's not technically fake. I mean, he is a real, the voice is the voice of a real person. It's just been synthetically Yes. Used to generate things that maybe this person never actually said.

• 50:44Casey Newton?

  But it's like, look, this is just, um, you know, a synthetic tool that they have scaled up to millions of users. But, um, I just think it is so smart that, you know, there's a second smart thing about it that I want to talk about, which is like in the past, when Spotify has made these playlists, the playlist will all be very long, right? So it'll be like, oh, you know, here's what you were listening to three months ago and it's 50 songs long. A really cool thing about the AI DJ is that it'll play you three or four songs, like from a genre or a time in your life. And then it moves on to something completely different. Um, sometimes it will say, we're going to play you five songs in a row, either from an artist that you like a lot, or maybe one that you've tried out and now you can go a little bit deeper into their catalog, right?

• 51:26Casey Newton?

  So it's kind of trying a lot of things. And if you listen to it over the course of an hour, you get kind of all this variety. You do get the fun facts about the music. It is truly personalized to your taste. When it plays me a song that I don't know, in general, I have found that I like the song. It sort of feels like of a piece with the songs that Spotify knows that I do like. So, to me, Spotify is such an important test case for how good is AI going to be in our lives? Because it is something that is like relatively benign, right? There's sort of only so wrong you can go with a music recommendation. They have an insane amount of data, right? I listened to Spotify for hundreds of years. I'm sorry, hundreds of years since the Bronze Age.

• 52:07Kevin Roose?

  I guess I've never revealed that I'm 4,000 years old.

• 52:12Kevin Roose?

  Casey was just listening to some Gregorian shit bangers on Spotify.

• 52:15Casey Newton?

  Those were the days. I've been listening to Spotify for years and years, for hundreds of hours every single year, and I've been so disappointed with the personalization generally because I always feel like almost no one has as much useful data about me than Spotify does. When is it finally all gonna come together? With an AI DJ, I feel like, oh wow, it's actually coming together. Have you felt that way at all?

• 52:38Kevin Roose?

  Well, yes and no. So I've tried using the Spotify AI DJ, and it's not very good for me, but for reasons that are entirely my fault. Like, I just have bad Spotify hygiene because I play everything through the same account. So if I'm playing like kids' songs for my kid, or like I listen to music when I go to sleep, and so I have all these sleep playlists that are just like sort of, you know, mellow instrumental, like soothing music. And so now Spotify thinks that like that is my favorite kind of music because it's on while I sleep. It's literally on for like eight hours a night. And so if you're an algorithm, you think like, oh, Kevin loves these like chill instrumental tracks. So my first experience with the AI DJ was like, now let's, you know, X came on and he was

• 53:23Kevin Roose?

  like, now let's, you know, play some tunes that you've been really loving lately. And it just goes into this like soft piano music.

• 53:29Casey Newton?

  Right. It's like, and, you know, coming up next, we have a lot of soft droning.

• 53:34Kevin Roose?

  Right.

• 53:35Casey Newton?

  Yeah.

• 53:36Kevin Roose?

  So I just, but that's on me for not having better Spotify hygiene.

• 53:39Casey Newton?

  Yeah. Well, so don't do what Kevin did and, you know, use Spotify in a way where you're teaching it what kinds of songs you actually like. But, you know, if you do, I just think you're gonna be impressed by this. Something else I would just say as a sort of compliment to Spotify is, this is a company that has a real competitive threat in Apple, right? Because, you know, Apple has Apple Music, Spotify has to give up a huge chunk of its revenue to Apple. Apple does not have that problem with Apple, right? So Spotify, it makes Spotify really competitive. And they are always trying to invent the better mousetrap. And the mousetrap here is the playlist. And I truly love how relentlessly dissatisfied they are with playlist making, which is something that I think a lot of other music streaming services could and Do take for granted.

• 54:22Kevin Roose?

  Now, Casey, you do make your own Spotify playlists, right? You make them by hand, you curate them.

• 54:28Casey Newton?

  Bespoke artisanal playlists.

• 54:29Kevin Roose?

  Yes. So are you worried at all that this new AI DJ is going to, I don't know, like, sort of take away some of your experience of listening to playlists that you yourself created by hand?

• 54:40Casey Newton?

  Absolutely. Like, so this is the, one of the conflicts that I have about loving the AI DJ is that it does feel like the snake that eats its own tail, right? If I switch over to listening to the AI DJ full time in three years, it's going to be like, and now let's go back to what you were listening to in 2023. It was me, the AI DJ, you know?

• 55:00Kevin Roose?

  So you just sort of get stuck in time, like what your preferences were in 2023 is kind of what they'll be forever.

• 55:06Casey Newton?

  Totally. And, you know, this gets to something I wanted to ask you about. So you wrote a great book about AI a couple of years back that I read during the pandemic and.

• 55:15Kevin Roose?

  Future-proofed Nine Rules for Humans in the Age of Automation, available wherever books are sold.

• 55:18Casey Newton?

  That's right. And one of the rules that you had in there that really stuck with me was try to avoid, to the extent you can, letting algorithms run your life, right? You call this concept machine drift. Tell us what machine drift is.

• 55:33Kevin Roose?

  Yeah, so machine drift is sort of my term for this feeling that you're describing of kind of gradually letting computers make more and more of our decisions for us. So, you know, I think a lot of us, whether we realize it or not, are kind of turning over big parts of our life to the decisions of algorithms. You know, when you go on to Netflix and you just sort of go by what it recommends for you and you don't, you know, know the show or care about the show, but you're just sort of trusting the machine to make the right decision. You know, if you go on Amazon and you're trying to look for like, you know, brand of dog food, you just kind of like, you know, you just pick whatever brand Amazon recommends. Like, it is a very common thing to trust the recommendation.

• 56:15Kevin Roose?

  And research has found that actually we trust recommendations that appear to be personalized more than we trust our own instincts. We actually think that the machine understands us better than we do in some cases. And so this kind of gradual surrender of. Our own choice making ability to these algorithms and these AIs is really what I was trying to write about there in that chapter on machine drift.

• 56:40Casey Newton?

  Yeah, and the thing that stuck with me was this idea that you do want to resist that to protect your own human experience. I'm like, I think something that is fundamental to the human experience is discovering new music and falling in love with it and feeling like you have a personal relationship to it, right? And, you know, maybe 15, 20 years ago, I was mainly finding new music from the music blogs that I was reading, from my friends who had sort of a tumblers devoted to music, and then, of course, illegally downloading MP3s. And that was sort of the way, you know, that you would discover new music. Then Spotify came along and honestly, kind of supplanted a lot of those older systems in my mind. It is aggressive and pretty good about showing you

• 57:25Casey Newton?

  stuff that you might like. But up until now, it's all just kind of felt like a suggestion. I still have to go seek out the playlist. The playlist usually has some sort of description. I feel like I'm making an intentional choice when I say like, give me some like chill tracks to write to, or like, give me some, you know, sad girls with guitars so I can have some emotions right now, you know? The DJ feels different. The DJ feels like we're saying, don't even have a care about what you want to listen to. We're just going to play you something that you like. And because it works, I am nervous about it. You know what I mean?

• 58:02Kevin Roose?

  I mean, I think it's reasonable to be nervous about it, right? Like, these algorithms, these recommendation systems are very powerful and they can actually change not just what we choose, but what we prefer, or what we think we prefer. And so I think, you know, people just constantly have to be aware of that. And for some areas of your life, you might not care whether the recommendation is spot on or not, right? I don't really care about, you know, what music plays when I'm sleeping, as long as it's mellow, as long as it's like calming. Like, that's not something that I feel a lot of sort of agency over or care if I lose some agency over. But there are other things in my life.

• 58:40Kevin Roose?

  That are very important to me like I'm not going to use chat GPT to write my columns for me because that is something that I take pride in. That is a big part of my identity. And even if it could write as well as me, there is something that I still find satisfying in doing that. So for you, it sounds like what I'm hearing you say is that music is very important to you.

• 59:01Casey Newton?

  Yeah, and it's something where I want to feel like the relationship I have to it is between me and the music and not me and the algorithm. You know, at the same time, this stuff is really good and I'm not going to stop using it. I think what I want to do instead is manage how I use it, right? There are going to be times during the week when I'm going to listen to the AI DJ. And there are going to be times during the week when I'm reading music blogs and getting recommendations for new stuff to listen to from human beings.

• 59:25Kevin Roose?

  I think that's a great compromise position, and I think that's that's something that we should think about for a lot of areas of our life is like, yes, use the algorithm, use the AI, use the recommendation system, but really just check with yourself, check in with yourself and just say like, do I actually like this? Is this actually what I would choose for myself? There's a researcher named Camille Roth, who talks about there being two kinds of algorithms. There's read, read my mind algorithms, and then there's changed my mind algorithms. So some of these predictive models, they're just sort of trying to figure out what you would like. I would put the AI Spotify DJ into that category. But if you're not careful, you can get steered towards stuff that maybe you you kind of give the AI the benefit of the doubt because you're like, well, you know me and you have all my data.

• 1:00:10Kevin Roose?

  But then it's like playing something for you and like halfway through the song, you're like, wait a minute, this sucks. Like I had, I actually had this experience a couple of years ago, not with music, but with clothes. So I used to subscribe to one of these like clothing services that would like, you know, you plug in your preferences and your sizes and you give it some sort of general directions and then it sends you a box of clothes. And I remember very clearly one day I had put on this this outfit that I'd gotten from one of these services that I'd worn a couple dozen times. And I was looking at myself in the mirror and I was just like, I hate. Like, I don't like this at all. It was, I remember very clearly, it was this like tan bomber jacket that I was like, I like got it from the service and I was like, well, the, you know, I don't have good fashion sense.

• 1:00:52Kevin Roose?

  So the AI must know better than I do. And so I just wore it. And one day I was like, this looks horrible on me. Why have I been wearing this like for months now? And I think like that kind of honesty and self-knowledge and just sort of forcing ourselves to kind of look in the mirror metaphorically or literally and figure out like, do I like this is an important part of living amongst these AIs.

• 1:01:16Casey Newton?

  Yeah, I love that example. And, you know, it's like one reason why I would just never subscribe to those services. Because I felt like, like to some degree, like, yes, they want to send you clothes you like. But like, one, they're counting on the fact that you're going to be too lazy to send it back. Right? And then like, two, the only real idea those algorithms have is like, you should spend $200 a month on clothes. You know, like, that was like ultimately the foundation of those companies. And so I read recently, they've fallen on hard times and, um, you know, I can't say I'm going to miss them.

• 1:01:40Kevin Roose?

  Well, so this gets to another point, which is that I think this kind of personalization is vulnerable to being sort of messed with or manipulated because, you know, what if a record label pays Spotify an extra, you know, fee?

• 1:01:54Casey Newton?

  Yeah.

• 1:01:54Kevin Roose?

  To like jam their songs, their artists' albums into your AI DJ. And maybe they're not perfectly tailored to your preferences, but Spotify is taking money from a label to make that happen.

• 1:02:07Casey Newton?

  Totally. And, you know, labels are definitely working every angle they have. Um, you know, if there is some kind of payola in the AI DJ, then like, yeah, that is something that we're going to want to know about. I will say, just as a funny experiment, like if I, if I were sort of an evil person running Spotify, and I wanted to test the power of these algorithms, I would just try to see if I could get America back into ska. It seems crazy that it happened in the 90s. Um, could it, could it happen again? If, if you could get Americans listening to ska again, you would know that the algorithm had actually grown too powerful.

• 1:02:37Kevin Roose?

  Wow. Uh, yeah, X, if you're listening, we would love some real big fish in our, uh, In our playlist this week. I also think one interesting thing to think about here is what happens when these AIs are not just selecting music for you? What happens when they are generating music for you? What happens when you open up your Spotify, you're walking to work or the gym or something, and it just starts composing a song for you on the fly based on what it thinks your preferences are? Or to take it a step further, what if it is connected to some other device? Like, maybe it's connected to your biofeedback bracelet or whatever, and it senses, Casey's feeling a little sluggish today.

• 1:03:19Kevin Roose?

  Maybe I will increase the tempo of all of his music, so it picks him up.

• 1:03:24Casey Newton?

  I mean, all of this stuff is so crazily plausible to me. So it's like, my favorite band is Radiohead, has been since I was in high school. The world where I can just say, write me four albums worth of Radiohead songs that sound like they did in 1997 when they released OK Computer, but do it on these themes and like, give me a couple of big anthems and a couple ballads and like, a few rockers, and just make the voice sound like Thom Yorke's voice, and I just want to listen to it. And we're just going to live in that world, right? Like, we're so close to that just being something that could happen.

• 1:03:59Kevin Roose?

  Yeah, and I expect that artists will have no problem whatsoever with people ripping off their voices to create totally fake albums and selling them for profit.

• 1:04:08Casey Newton?

  I know, yeah. And the old artists are going to say, absolutely not. And the new artists are going to say, yeah, that's fine with me. Remix me however you want. And they'll probably become quite famous that way. I mean, yes, that is going to be a massive generational gap.

• 1:04:18Kevin Roose?

  And we are also, we should say, we are also creators in the audio space. And so there will be the ability to make synthetic versions of the Hard Fork Podcast that never end.

• 1:04:27Casey Newton?

  There'll be a synthetic version of this Hard Fork Podcast where I don't use the word like or say um. Wouldn't that be nice for some of our emailers?

• 1:05:04Speaker 12

  Today's AI builders need infrastructure that scales with their ambitions. iRen is a vertically integrated AI cloud platform, delivering data centers, compute, and software for AI training and inference, underpinned by its expansive portfolio of land and grid-connected power in renewable-rich regions globally. iRen's AI cloud gives direct access to Nvidia GPUs, scalable from hundreds to thousands. For builders, that means direct access to AI compute, rapid scaling, and predictable pricing. iRen: AI Cloud for the Next Big Thing.

• 1:05:37Speaker 03

  Building and scaling AI today can feel pretty chaotic, mostly because teams are juggling too many fragmented tools at once. That's where OutSystems comes in. OutSystems gives you one unified agentic systems platform to manage your entire portfolio of agents, apps, and workflows. You get to innovate at the speed of AI, but with the security, governance, and control your enterprise actually needs, and the results are already there. A major manufacturer used OutSystems to build a multi-agent system that analyzes blueprints, and a global bank cut their development time by 60%. Own your agentic future today at outsystems.com/NYt.

• 1:06:13Speaker 00

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real-time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork.

• 1:06:47Kevin Roose?

  Hey, special announcement before we go. I, along with my colleague Cade Metz, am starting a new newsletter series about AI. Basically, a deep dive into these new generative AI systems, chatbots, how they work, what they're good at, what they're not good at, and where all of this is heading. It's gonna be very fun. I wrote a couple of the additions myself, and we're gonna be emailing them out next week, starting on Monday. We'll put the link in the show notes, and you can also sign up at nytimes.com/newsletters.

• 1:07:18Casey Newton?

  All right.

• 1:07:21Casey Newton?

  Hard Fork is produced by Davis Land and Rachel Cohn. We're edited by Jen Poyant. This episode was fact-checked by Caitlin Love. Today's show was engineered by Alyssa Moxley. Original music by Dan Powell, Alicia Baetup, Marian Lozano, Sophia Landman, and Rowan Nemisto. Special thanks to Paula Schuman, Melga Logley, Kate LaPreste, and Jeffrey Miranda, and to our listener Blake, who is in the third grade and whose mom wrote to us to let us know that he listens to every episode where we don't curse. Kevin, clean up your language.

• 1:07:54Kevin Roose?

  Blake, we tried to keep it clean this week for you.

• 1:07:56Casey Newton?

  You can email us at [email protected].

• 1:08:27Speaker 03

  It's time to innovate at the speed of AI without compromising control. That's OutSystems. Take a look at what happened with one global retailer during a period of massive expansion. They used OutSystems to build AI agents to automate invoicing and translation processes, shifting 95% of their daily store operations to a new digital app, saving thousands of hours of manual work. OutSystems gives you the flexibility to deploy how you want and the governance to do it safely. Own your agentic future. Learn more at outsystems.com/NYT. That's outsystems.com/NYT.