Pod Insights Decoder Recode Decode: (Bonus) How To Save the 2020 Election About this episode If you like Recode Decode, we think you'll also like Function with Anil Dash. Here's a recent episode about stopping fake news ahead of the 2020 US elections.
Are social networks downplaying their complicity in the problem that is “fake news?” Anil talks to Fadi Quran of the people powered social advocacy group, Avaaz, about how tech is used to target groups of people and spread disinformation that affects our elections, relationships, and social justice movements. Together they discuss insidious nature of disinformation and misinformation, meet its victims, and go over solutions.
Listen closely for the steps that platforms can take right now to stem the tide of fake news and fake accounts.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
Transcript 8,579 words · 14 speakers
0:00 Speaker 00 Growing teams need a corporate card built for more, something that doesn't sacrifice speed for control. Introducing the American Express Corporate Cash Back Card. Get 1.5% cash back on eligible business purchases, advanced spending controls, and real-time visibility, plus intelligent expense management. Get started at go.amex slash amexcorporate. Terms and cap apply.
0:29 Speaker 01 Hi, it's Kara. We're taking this week off for the holidays, but we have a special bonus episode for you today. It's an episode of Function with Anil Dash, which is another show from the Vox Media podcast empire. Anil is the CEO of Glitch, and you've heard him on this podcast, Recode Decode, talk about that. But in this show, Function, he talks to developers, designers, and culture experts to understand the ways tech is changing culture and what it means for us. I think you'll really enjoy it, so let's take a listen.
1:06 Speaker 02 Welcome to Function. I'm Anil Dash. All season long, we've been talking about trust on the internet, whether we've got it and how it gets broken. And I'm super interested in that topic because the internet and social media are so embedded in our lives. All of us rely on it for our work, to stay connected to our family and friends, and especially just to understand the world around us. These days, 2/3 of Americans say they get at least some of their news from social media. Those social networks weren't originally created to enable news to be shared. Sure, you could always post a link on Facebook or Twitter since they've been around, and I know because I was on them pretty much from the beginning. But the people making the technology
1:49 Speaker 02 really saw that as no different than sharing a photo or anything else. They didn't have a special treatment for news. And then things evolved over time. You know, really out of good intent. They thought they want to make it easier to discover things, or they wanted to make sure to emphasize the information that's most important to you. But they made algorithms that started to make decisions about what information we see and when, which sources are considered credible or not. These are choices. And a choice about what information matters and what information is accurate? That's an editorial choice. You know, I used to work at a newspaper. That was the decisions that editors were making. And so what you've got is the major tech companies, the social media platforms,
2:31 Speaker 02 making journalistic decisions about the world, even though, well, pretty much none of the people making those decisions were journalists. They were computer programmers, or product managers, or designers. All well-intentioned. I really do think they wanted to do good. But the reality is, you can't do well in a very complicated field that you know nothing about. And we saw the results of those choices in 2016.
2:57 Speaker 03 I've just received a call from Secretary Clinton.
3:07 Speaker 03 She congratulated us, it's about us, on our victory.
3:13 Speaker 04 I'm sickened. I'm without words. I thought for sure that Hillary would win this election, that Hillary would win Florida.
3:24 Speaker 05 Social media played a huge part in the 2016 election. It was used to get the message out for then-candidate Trump.
3:30 Speaker 06 What we're talking about is a major foreign power with the sophistication and ability to involve themselves in a presidential election and sow conflict and discontent all over this country.
3:47 Speaker 07 Starting in 2014, Cambridge Analytica funded a personality test on Facebook and paid people to take it. The alleged goal: influence the views of the American electorate.
3:57 Speaker 02 The election surprised everybody, but also prompted this deeper examination into the impact that technology broadly, and social media specifically, were having on our lives.
4:09 Speaker 02 Tech is suddenly realizing it has to confront the value of journalism in society, but also the challenges of making it happen. There's also the question of how journalism is adapted. As soon as that question came up, I thought the one person I'd most want to talk to about this is a professor of journalism at NYU, Jay Rosen. He's written a couple of different books about journalism in this new era.
4:31 Speaker 08 I studied the press as an institution and the pressures that come to bear on it.
4:38 Speaker 02 Social media has fundamentally changed the way that news is disseminated these days. So I talked to Jay to find out how we got here and also where we go from here.
4:54 Speaker 02 I'm very glad to welcome Jay Rosen.
4:56 Speaker 08 Thank you very much, Anil.
4:57 Speaker 02 There are people that have this deep and abiding reverence for journalism as an institution and
5:03 Speaker 08 Yes.
5:03 Speaker 02 almost like a priesthood and that you have to protect it. And you've never had that. You've always been a little bit challenging of that. And I think one of the seminal sort of phrases that, to me, sort of typified your challenge of, okay, what is journalism's role in the ecosystem? And how does the, how do people within this institution see themselves? Was the view from nowhere.
5:24 Speaker 08 Yeah.
5:25 Speaker 02 Can you sort of, for people who may not be familiar, can you succinctly describe the view from nowhere?
5:30 Speaker 08 Well, that's my term for a very well-known pattern in the American press, but also other countries' press, where journalists tried to persuade us to believe in them by making a claim like this. I don't have a stake. I don't have an interest. I don't have an assumption. I don't have a party. I don't
5:48 Speaker 02 No dog in this fight.
5:49 Speaker 08 I have no dog in this fight. I'm just telling you the way it is, so you should believe it because I have no view.
5:56 Speaker 02 My impartiality is my credential.
5:57 Speaker 08 Mm-hmm. I sometimes call this viewlessness
6:01 Speaker 02 Mm-hmm.
6:02 Speaker 08 as a presumed good.
6:05 Speaker 08 So it happened within the evolution of American journalism that this became the dominant way to persuade people to accept your account is to demonstrate that it has no stake interest bias in. And so not only was a profession built on that claim, but a market force was built on that claim, which is the Metropolitan newspaper, which eventually became more or less a monopoly product by appealing to everyone. So there was a commercial logic to it. There was a status logic to it, which is in American culture, if you want higher status, you can make more money, but also you have to start acting like a profession. You have to say that you deliver a public good, that you have some sort of elevated
6:49 Speaker 08 roles, elevated commitment, you see? What is that based on? How do you persuade Americans that you offer a public good?
6:59 Speaker 02 So there's a rhetoric or a narrative that you have to perform. You have to say, if you want America to believe that your institution, your business, your industry is good and important and must be defended. And it seems like the pillars of that are, one, there is a public, two, you're serving that public, and three, you do so from above the fray, being neutral, having no point of view. And it's interesting, because it's been more than a dozen years since you sort of formed this narrative of the view from nowhere. And even if it's not phrased that way, that framing of the political discourse, of the cultural discourse, has become all pervasive.
7:42 Speaker 02 Everybody sort of intuitively knows it. These days, I think it's usually phrased as both sides-ism. Right? So if we have a white supremacist gathering, then the news has to say, well, we got to hear from both sides. And it ignores the value that even attention and amplification in an ecosystem have value separate from even what the substance of the message is.
8:06 Speaker 08 Right. And that is one example of many where the view from nowhere, as I have called it, breaks down or doesn't address what's going on. So that's what I've tried to do, is name the part of what academics would call newsroom objectivity or professional objectivity, name the part of it that we don't really need.
8:32 Speaker 08 So that we can save the parts of it that are good. So like when people talk about objectivity in journalism, it means a lot of different things. Some of them, I think, are like, yeah, these are virtues.
8:41 Speaker 02 Right.
8:41 Speaker 08 Like, being able to step back from your upbringing and see how other people live, that's a kind of objectivity. Like, I definitely want journalists who can do that, right?
8:50 Speaker 02 Yeah.
8:50 Speaker 08 So what we have to do with this beast, objectivity, which is like this, you know, it's like a blob. Is you have to start naming the parts of it that work and the parts that don't. So that's why I developed-
9:01 Speaker 02 Yeah, it didn't come from bad impulse. They didn't aspire to this objectivity because they-
9:04 Speaker 08 No, many things that are called objectivity are the impulse to tell the truth, to get evidence, to show, you don't have to rely, just on my word, look for yourself, right? All those things increase objectivity. The kind of objectivity we don't need is when the journalist pretends to be above it all, when they treat everyone else as if everyone else has an argument, but they just have facts. These kinds of patterns don't do the press any good. They enrage users, right? And then with the coming of internet as the baseline for discourse on this, the people who are really dissatisfied by press practice have a way to give voice to them.
9:44 Speaker 08 You know, it's different than when there are an atomized group that can't contact each other.
9:51 Speaker 02 Right, right. Now, all of a sudden, they can say, do you feel this way too? Do you feel disconnected to-
9:55 Speaker 08 And they see evidence that many other people feel this way, right? And they can quote unquote, "talk back." And writers emerge that represent their disattitude actions. And all that's a very different environment than when I started studying the press.
10:07 Speaker 02 Right.
10:07 Speaker 08 But the view from nowhere is increasingly under attack by events themselves, as well as lots of critics, as well as a general evolution in the way people think about this, that, yeah, you know, there probably isn't a place above all the action from which to view it.
10:24 Speaker 02 Right, not anymore.
10:25 Speaker 08 Yeah, it's probably not a good thing to go about, like, claiming that.
10:28 Speaker 02 So, thank you for that framework, because that gives us- Sort of a common ground where we have, we have a vocabulary now, we have a perspective. And there's an interesting thing here too, because one of the reasons it's so important to me to understand journalism and media institutions as a starting point is that we talk about a lot of technology as social media.
10:50 Speaker 08 Yes.
10:50 Speaker 02 Right. And it used to be called social networking.
10:53 Speaker 08 Yep.
10:53 Speaker 02 And even before that, social, social software.
10:56 Speaker 08 Mm hmm.
10:56 Speaker 02 In the tradition of, you know, Microsoft Word on, on Windows in the nineties. And, you know, you fast forward 20 years from there and what we have with media is a whole different set of assumptions, but also people building this technology frame what they do in the language of media and journalism. So, so they talk about, Mark Zuckerberg goes to Congress and talks about serving the public.
11:21 Speaker 09 Our policy is that we do not fact check politicians' speech. And the reason for that is that we believe that in a democracy, it is important that people can see for themselves what politicians are saying.
11:33 Speaker 08 Freedom of speech.
11:34 Speaker 02 Exactly. Right, right. And we didn't have conversations about freedom of speech when Microsoft was making Microsoft Word in the nineties and you were copying it off of a floppy disk onto your computer. So, so, so something changed to make technology media. Again, Bill Gates, when he was, you know, sitting in front of Congress and being examined by the Department of Justice, these issues never came up. He didn't ever have to talk about freedom of speech, freedom of expression, our First Amendment rights, like that stuff didn't come up.
12:01 Speaker 08 Right.
12:02 Speaker 02 And Zuckerberg, it seems like every six months is awkwardly drinking water while sweating it out in front of the cameras in Congress and, and keeps going back to these trips. So, so that seems like a radical shift. And yet, all these folks are still, well, in their case, they're both dropouts for Gates and Zuckerberg, but for the rest of them are folks that have computer science degrees and have probably never once sat in a room of a, of a journalism school or taken a journalism class or have any fluency in media. That's weird, right?
12:35 Speaker 08 Well, it is because what started as a technology company with a engineering culture and origin on a college campus, right? Gradually came to be a media company or a company that
12:52 Speaker 08 Disrupts, pardon the expression, media hugely.
12:56 Speaker 02 Yeah.
12:57 Speaker 08 Just as it became, slightly different term, it became, I think, an editorial company.
13:04 Speaker 02 Yeah.
13:05 Speaker 08 When, for example, it began explicitly hiring journalists to do journalistic things.
13:09 Speaker 02 Right.
13:09 Speaker 08 You are an editorial company, right?
13:11 Speaker 02 Right. When YouTube chooses what's on their homepage, they're an editorial company.
13:16 Speaker 08 Yes, in some way, they are, right. When Twitter says, we're going to do moments now and hire journalists to curate them, you just created a newsroom.
13:26 Speaker 02 And send you notifications about them.
13:28 Speaker 08 Totally.
13:28 Speaker 02 Right, it's the same as the push notification for the New York Times, in a way.
13:31 Speaker 08 And I think this will address your question. When Twitter first announced that this team was being hired and they were going to do this thing, which became Moments, and they now curate, right? I happened to have been booked to interview Twitter's head of news, just by chance. So it was the day that this was announced. And I said, you know, I'm really fascinated by this team of journalists you've hired. I think it's a really interesting direction for Twitter. In my view, this is actually the moment when Twitter has kind of crossed over into an editorial company. So you're the head of news. I want to know, when Twitter does this, when it creates an editorial culture inside a tech company, what vision of journalism is it operating from?
14:14 Speaker 08 What, what tradition does it see itself as standing within?
14:19 Speaker 02 What's your conceptual model?
14:20 Speaker 08 Mm-hmm. What's your conceptual model? And also, what are your priorities? Where, where are you coming from? So I just asked a very general question like that. Like, what are you thinking when you? And what I observed was that there was literally no way to get an answer to that. They had literally not thought about that. They had instead had done something very, very predictable, very easy to do, which is to simply say, well, what do you mean? We are hiring professionals. They're going to exercise their professional judgment.
14:46 Speaker 02 Sort of a credentialism.
14:47 Speaker 08 Exactly.
14:48 Speaker 02 Huh. That's really interesting, because in tech, if you say, Yeah, we are Apple and we're going to make a better camera on the iPhone. And then you say, what is it going to be able to do? You know, it's, oh, it's going to work at low light and low light means this much, this many candle power and lux and whatever. And it's going to be able to pick up the colors and that's it, right? Yeah, so you have this answer, which is very knowable. But if you said iPhone 14 is going to have a better camera. And they said, well, in what way? And he said, well, we're going to hire professionals and they're going to make a camera. And how dare you interrogate our magic?
15:28 Speaker 08 Right.
15:28 Speaker 02 It would be a little weird, wouldn't it?
15:31 Speaker 08 Yeah, but nonetheless, this was a perfectly fine answer from the head of news's point of view, from Twitter's point of view.
15:37 Speaker 02 Right. Because that was their mandate. Their mandate was like, give us.
15:41 Speaker 08 Give us some professional credit here.
15:42 Speaker 02 Right, yeah.
15:43 Speaker 08 And now I was very surprised, for example, that it didn't. They didn't say something like when they gave rise to moments, it became a kind of an editorial company, that it didn't say, for example, that universal human rights were part of their grounding, you know, because Twitter is very associated with that in other ways. That would seem like unnatural to me if you had, right? Anyway, same thing with Facebook is they have been forced to admit that they are kind of a media company and now they're forced to concede that they have an editorial part two. And I'm told by people who may know that this is something personal to Mark, like being accused of wounding news was something that he felt personally and he wanted to
16:28 Speaker 08 try and adjust it. More with Jay Rosen after the break.
17:16 Speaker 02 The catalyst of this conversation is honestly the 2016 election here in the US and the 2020 election here in the US, right? And there's many more examples all over the world. I mean, there are actually far more egregious, you know, examples of misinformation. If I look at WhatsApp and Myanmar, it is even more serious and damaging. But I think about the, in the US here where these countries, these companies are based, the catalyst was, what the heck just happened back in 2016? And what's going to happen that's even worse going forward in 2020?
17:49 Speaker 08 Yeah.
17:50 Speaker 02 And there's an interesting thing here I see, which is, as a tech guy myself, we look a lot at security and privacy and other sort of considerations like that. And there are systemic weaknesses. You look at exploits, you look at hacks.
18:05 Speaker 08 Yes.
18:06 Speaker 02 How are they going to hack the system?
18:07 Speaker 08 Right.
18:08 Speaker 02 And it seems to me like the lack of a informed perspective and bringing in journalistic functions, editorial functions into the major platforms and the lack of fluency in things like the strengths and weaknesses of the view from nowhere.
18:26 Speaker 08 Oh, yeah.
18:27 Speaker 02 Were exploitable hacks. They were things that hackers, just as they will find the weaknesses in your security policies and in your, you're running an old version of the software and it's exploitable. These were editorial organizations running an old version of the journalism software that was very hackable, not in the technical sense. You didn't have to be Russian bots, spammers, all the things that get usually blamed here. All you had to be was somebody who understands the exploitable aspects of these legacy media systems that were adopted without fluency, and then you would be very hackable.
19:07 Speaker 08 Oh, I think that's dead on. I think the news system.
19:13 Speaker 08 Evolving at a slower rate than the network around it is exploitable. The whole view from no air contains a flaw in the code in the sense that when the system that makes public service journalism impossible is under attack because there's a political movement that's generating capital from doing that.
19:35 Speaker 02 Uh huh.
19:36 Speaker 08 The code of impartiality and objectivity contains no instructions for what to do under that circumstance. And so that's how you get, for example, Marty Baron's famous phrase, which is a very important, fascinating phrase, we're not at war, we're at work. This is his way of saying that we have to, we have to stick to what we're doing, right? We don't, and we cannot be seen as anyone's adversary. So this, that kind of idea, that's, that's another example of your point, that there's, there are these flaws in the software where bad actors can overwhelm the system and not take control of the news so much as like waste everyone's time.
20:19 Speaker 02 A denial service attack.
20:20 Speaker 08 Yeah, yeah. It's a slow mo, Sunday morning denial of service attack.
20:25 Speaker 02 That's, yeah, that's really wild because I think of this amazing shift that has happened where now the tech companies can't opt out, they can't say like, we're not going to have this conversation when Congress calls for you to testify or, or just average consumers are like, what are you doing about this? They have to engage and, and I think it's, it's very telling, they have, and in the sort of stereotype of what technologists do, chosen binary solutions. So when we talk about something like political ads, as has recently happened in the last few weeks.
20:59 Speaker 08 Tried to pay attention to that, yeah.
21:00 Speaker 02 Facebook said, okay, we're not gonna, we're not gonna filter any political ads. And Twitter's like, we're gonna ban them all and not take any money for them. You know, there's sort of this very like, you know, feast or famine kind of solution thing.
21:13 Speaker 08 Yeah.
21:13 Speaker 02 And, and it seems like both are this attempt of like, I don't want to understand this problem, I don't, I want to not have this problem.
21:19 Speaker 08 Okay, I think you really hit it there. I want to not have this problem because that, that's what I have seen in Facebook's dealings with this, this media political space where it has power within the political communications world. So it gets attacked as a player, but it doesn't want to be a player. So it can only accept.
21:38 Speaker 02 It can't opt out.
21:39 Speaker 08 Yeah, it can only accept descriptions of itself that kind of vouch for its neutrality.
21:45 Speaker 02 Ah, that's so interesting.
21:46 Speaker 08 And, and that doesn't actually describe what's going on. So I'll, I'll give you an example. When Facebook was coming up with its original fact checkers, uh, alliance, it, it collaborated with a group of nonpartisan quote unquote fact checkers like ABC News and factcheck.org. And before they announced the system, they emailed me and said, can we get your thoughts on this because we want to see how people are going to react? And I'm not a reporter, so I didn't care about breaking the story. So I said, sure, kind of thing I do all the time. So I said, sure, I'll take a look. And I said, this sounds reasonable, but let me tell you, within an hour of announcing this, the right wing is going to say that these fact checkers you've selected is careful nonpartisan, they're, they're all plants of the Democratic Party. They're just tools of the.
22:29 Speaker 02 It's been gamed.
22:30 Speaker 08 It's been, it's been gamed. Within an hour, they're going to like, they're not going to accept that the ones you carefully selected are carefully selected at all. They go, well, we're not trying to play any political role here. I said, well, it doesn't matter if you're trying to or not. It's like, this is what they're going to do.
22:45 Speaker 02 Right.
22:46 Speaker 08 Right? We don't think.
22:47 Speaker 02 If one team only wins when they work the refs, they're never going to not work the refs.
22:51 Speaker 08 Exactly. This, and this, I'm, I'm having a work the rest conversation with somebody who's saying things like, well, we don't have an ideological axe to grind.
22:59 Speaker 02 And so what?
23:00 Speaker 08 Yes. So that kind of positivity, vacancy, you know, there's, there's got to be a function to that. I don't know what it is, but.
23:10 Speaker 02 Do you think it's intentional or do you think they don't know what they don't know?
23:12 Speaker 08 I think they did for a while have a culture in which denying that you are a media company, an editorial company was the.
23:24 Speaker 08 A party line was was what the company was saying.
23:26 Speaker 02 It was an effective strategy for a decade, plus.
23:28 Speaker 08 Yeah, that's what I mean.
23:29 Speaker 02 Yeah, you can build a you can build a trillion dollar company on denying that you are what you are.
23:35 Speaker 08 And there's the additional factor of from the point of view of a targeting ads company. False information is just as good as true information.
23:46 Speaker 02 Mm hmm.
23:46 Speaker 08 Even better in some ways.
23:48 Speaker 02 Yeah.
23:49 Speaker 08 That's the fundamental.
23:50 Speaker 02 Right. The economics here, right? So there's there's this incentive.
23:53 Speaker 08 The way the system works, the way it's designed.
23:55 Speaker 02 Yeah, the incentives are misaligned here because these truth teams, the truth squad within these companies is only ever going to be a cost and they will never make the company more profitable.
24:10 Speaker 08 That's right, and they prevent scaling and.
24:13 Speaker 02 And they're inefficient. They're inefficient.
24:16 Speaker 08 Yeah.
24:16 Speaker 02 In companies that that prize efficiency almost above everything else. So we have this set of incentives and we have a gamable system. And now people are saying, how do I take advantage of this?
24:31 Speaker 08 Yeah.
24:31 Speaker 02 And when an attention has monetary value, because you have to pay for attention on these platforms, unless you can hack it.
24:38 Speaker 08 Right, and here we come to the best hack, the most potent hack of the media system, which is Trump's own media. We can't call it a strategy, but it's a presence.
24:50 Speaker 02 Yeah, intuitively is very savvy.
24:53 Speaker 08 I don't buy that part, but we can argue about that.
24:56 Speaker 02 Sure.
24:56 Speaker 08 But there's no question that his, let's say, his style, his political style floods the system with news. And almost all of it is newsworthy by the criteria that existed prior to Donald Trump. Like focused on conflict, something new and original, or the best definition of all of news. Holy shit, do you can you believe what happened?
25:21 Speaker 02 Right, right.
25:21 Speaker 08 So just on these like incredibly traditional, simple grounds of newsworthiness.
25:25 Speaker 02 Checks every box.
25:26 Speaker 08 Checks every box, pushes every buttons 24 hours a day.
25:29 Speaker 02 And because they've got this sort of factory model of how they monetize.
25:35 Speaker 08 Some do, yeah. Anyone with a factory model, overdoses on it.
25:38 Speaker 02 Right, this is like you. This guy is a is a car factory that just spits out cars 24/7 for free.
25:45 Speaker 08 Right, and so.
25:46 Speaker 02 And if you're a car dealer, you're like, great.
25:48 Speaker 08 Right, which is how we get to the famous statement by the. Head of CBS News is, "May not be good for America, but it's damn good for CBS." Right? Which is a famous line about Trump as a media phenomenon. Okay, everybody knows that now. But the reason I bring this up is because he, everything he does, is newsworthy by traditional criteria. The only way to not be controlled by him is to reconsider the criteria.
26:15 Speaker 02 You gotta change the algorithm.
26:17 Speaker 08 Yes, because he broke your definition of news, just as he broke the incentive system around fact checking. Glenn Kassner, who is the Washington Post fact checker, has said this on many occasions, that the difference between Trump and other presidents is not, is that when Republican and Democratic candidates and presidents were fact-checked in the past, they would not, like, hold up their hands and say, "You got me." But they would do something to change the situation.
26:43 Speaker 02 They would attenuate the most, the worst excesses.
26:45 Speaker 08 Yes. Or they'd make the claim, um, "Pass muster," or they'd just stop saying it, right? And Trump not only doesn't do that, he doubles and triples down, and then he does something further, which is he takes the friction raised by these false statements and taps them as a source of energy for his base and his campaign.
27:09 Speaker 02 And in fact, they're evidence of his correctness, is the fact that they're pushing back.
27:13 Speaker 08 They are, and he's kind of like delivering on a campaign promise, which is that, "I will put down annoy and drive these people crazy for you." And each time one of these fact-checking flares, you know, jumps out of the fire, he's, he's making good on his promise. So, anyway, now, there's another regular institution of journalism that he broke. What we need is for the press to be able to somehow, like, meet and... Repair these and replace them with something stronger built for this kind of information warfare. So far, we don't have it.
27:51 Speaker 02 Right. So this is really interesting because what I'm hearing in all this is exactly the kind of arms race we have in security and tech, that we have in privacy and tech, where there's all these sort of hackers that are constantly coming in the systems and you have to evolve your model.
28:05 Speaker 08 It is a kind of arms race, roughly speaking.
28:08 Speaker 02 Yeah. And it's interesting too, because you talk about the fact checkers and the mechanism by which fact checking works is shame.
28:17 Speaker 08 Yes.
28:17 Speaker 02 Right. So if you say, you said something that's not true, what we're assuming is sort of an emotionally developed maturity, where being caught in a lie makes you feel shame and stigma to the point where you address your behavior, modulated at least to some degree. So that's there. So there's this feedback loop. And what I see with this is an algorithm, right? And I look at like search engine optimization. This is like how to make your, your content show up in Google. And they've been for 15 years now iterating on this. And first it was like, make your page look a certain way. And then it was make sure you got good headlines. And then it was make sure your, your links work a certain way.
28:56 Speaker 02 So they gradually added on top of this layer upon layer of essentially hoops you had to jump through. If you wanted to publish online, or you wanted to share content online, or you wanted the, the things you were selling in your store online to show up in Google, you would just do these things. And it's funny because they would never make, they didn't do a press release, which is now all your links have to be blue and bold letters, right? It would just sort of be folk knowledge that would get shared and, and a little bit of cargo cultism, right? So there would be this sort of back channels of form. Like I heard if you, if you mentioned goats on Thursdays, your site will rank higher, you know, in Google. And people will be like, well, it works for him. I'm going to try it. And so that practice evolves, and now it's a billion dollar industry and it's evolved over 15 years.
29:40 Speaker 02 But Google tried to rationalize it a little bit. They sort of started to say, oh, we want to give you a set of guidelines or rules. They would go to the conferences and meet halfway with its algorithm. But, but the point is the people that were playing this game were playing against a software algorithm that was created at Google. And that had enormous economic value. Absolutely, I mean, perhaps trillions of dollars of economic value is tied up into this. And so there were enormous incentives to figure out how to game it. And then, once it became clear that this was an arms race between Google and these folks, and there were, at that, you know, they're called the black hat and white hat SEO hackers, just looks like they were security hackers, they, they sort of settled all this out.
30:22 Speaker 02 And in attention hacking, we don't have any of this narrative or any of this fluency. So, Facebook has an algorithm for their newsfeed. It gets hacked by attention hackers regularly. They have grand pronouncements every once in a while when there is a catastrophic failure on the scale of a ethnic cleansing or an election being undermined.
30:42 Speaker 08 Right.
30:43 Speaker 02 And even then, it is this sort of weird mush mouthed back and forth where, where Facebook will say, well, we, we are doing listening dinners behind the scenes with a couple of people on the right and a couple of people on the left, and we'll tell you afterwards after they're like, who it is. But nowhere near the systematic approach of what would happen if this were a security hack. Is that intrinsic, or do you think that's strategic? Do you think they're sort of saying like, because I, I basically think there's, are you evil or are you dumb? Right? Like, that's the question I keep asking about everything these days.
31:17 Speaker 08 Yeah.
31:18 Speaker 02 And, and there's one way, which is you're dumb and you don't know they're hacking you, and so you're just like having these dinners because you're like, that's all Zuckerberg knows how to do. The other is, you're pretty nefarious, and you're like, well, this'll put them off the trail and feel like we're doing something long enough for us to keep profiting off of this.
31:34 Speaker 08 Yeah. I really don't know, but my, my bias is towards one part of this, which is, they build a machine that they couldn't control, and they couldn't know exactly what it was doing.
31:47 Speaker 02 Mm-hmm.
31:48 Speaker 08 So, we've built this thing, and in a sense, no one is running it, in, in that there are. Things that it's doing to the culture and the environment that we cannot track.
31:59 Speaker 02 Right. It's like the weather. It's too complicated to fully predict.
32:03 Speaker 08 Something like that. And we've, and we've built this thing and it's, and in that sense, that specific sense, it is out of control. Nobody wants to say that. Nobody wants to hear that. Nobody in the regulators wants to really know that.
32:16 Speaker 02 Yeah.
32:16 Speaker 08 It's kind of like goes beyond our measures of control, our institutions are built for it. So I think it's like, part of what happens at Facebook especially is, is that. But also that they, this part might be strategic, that they keep themselves politically stupid and dumb about media. So that they can just blunder into the, whatever is the easiest thing for the business. They kind of like play like six layers dumber than their engineering degrees would attest. I think this is starting to change now because Facebook is interacting with more critics than it used to. And it has teams working and stuff where they need to like consult with other people and they're learning what Facebook.
32:59 Speaker 08 But the part that really interests me, and you would know more about this than I do, is I wonder when these things begin to become huge factors in the recruitment of talent, technical talent. Because I think technical talent has a, if anybody has power here, it's them.
33:14 Speaker 02 Yeah. So that moment is right now.
33:16 Speaker 08 I thought so.
33:16 Speaker 02 What we see in tech and, you know, I've talked to, you know, the people who organized the Google walkout a year ago and lots of people. That's, that's been my network for, you know, 10 or 20 years in this industry is, is sort of the people who love tech, but are dissenters within it. You know, what I, I think we all came to understand five or 10 years ago was consumer boycott is not going to happen. Nobody's going to stop looking at Instagram and disconnect themselves from their family on WhatsApp. Almost no matter what happens, because you'd be complicit in anything in order to know how to talk to people you love. So given that, that there is not going to be a consumer boycott, and we can't anyway with the amount of data they have. Then you have a. A challenge about how do you have any accountability?
33:59 Speaker 02 And one, you know, one vector is regulation, but that's a very slow one, somewhat by design, and also because of lack of fluency from policymakers. And so then the big lever is their biggest expense, which is people and they're highest in demand. And with that resource, I already see it. People are way, way more reluctant to go out there. They're not wearing their Facebook hoodie and they are looking at their options around where they want to work when they're, they're an engineer coming out of school. I think, and also there is a lot more competition for talent. So they're like, you know, the difference between an extraordinarily wealthy salary and a merely very, very high salary when you're 23 and you just got your degree is like, it's all monopoly money.
34:43 Speaker 02 You know, it all seems like it's a fiction. And so I think that that's starting to have some leverage. It is fascinating to watch, but it gets into, that's the workers. That's their leverage. That'll start to have some cost. I look at society though, right? We're talking about these algorithms being gamed. We're talking about whether it's playing dumb or being dumb, uh, this, this, this real social cost. And, you know, going all the way back to the beginning, you talked about journalism as a institution that serves the public and has a role to play in a civil society. And now the narratives are going, talking about fifth estate versus fourth estate. This is very, very fundamental, highfalutin language about the roles that things play
35:27 Speaker 02 in a functioning democracy and a functioning society. And, you know, attention hacking sounds kind of trivial. It sounds like, you know, uh, this is kids playing online. This is people sharing memes. But, but at a fundamental level, you're talking about undermining elections, right? You're talking about destabilizing institutions that matter for civil society. How does this play out? How bad is this going to get?
35:53 Speaker 08 I am.
35:56 Speaker 08 Pessimistic and in a darker mind every month or so about it. I think we're at a point now where between 25 and 30% of the electorate in the US has been effectively siphoned off into a different media system where Trump is the leading source of information about Trump. And the rest of the news system effectively cannot get through or penetrate. Right. And this is also the conspiracy world. And that's where the conspiracy world is strongest, yes. And of course, it is the original and very strong bond between Trump and his core supporters involved in that.
36:35 Speaker 08 But it's very important to realize that rejection of the information in the press is a condition of that bond. It's not a nasty word he flings in his tweets. It is a form of political mobilization. And it is also promise keeping on Trump's part. As I said, one of the things he ran on, that he definitely delivered on, was these fucking media people, I'm gonna put them down for you, baby. You just watch. And you're gonna humiliate them. Totally. And he did it. And he completely delivered on that. And continuing to deliver on that promise is the presidency. It's not like a weird feature, a weird bug. Right. It's a platform.
37:18 Speaker 08 It is the heart of his political method, the heart of his political method. So then you take an institution like the American press, which has difficulty changing under pressure, right? It's not an on-the-fly institution because... It's a lot like policymakers. It's slow. It's slow to change, right? But partly because it has to produce every day. It's not like you can stop the news engines and say, yeah, we're gonna... Pause and redo this. Yeah, let's redraw that, or let's put a new operating system in. There's no such thing. Just like everybody knew that 2016 was a massive failure by the institutional press... And in the election, but the next day they had to start, oh my God, there's going to be a Trump presidency.
38:01 Speaker 02 Now, what are we going to do?
38:02 Speaker 08 What are we going to do? Like, it's already a huge story before he's even started.
38:06 Speaker 02 Right, we have to do Ivanka Puff pieces.
38:07 Speaker 08 And so the idea of like, well, let's take some time and pause and think what happened in this election. Like, that never happened because in journalism, you're under this constant pressure to produce. And there and and one of the consequences of that is that you always make mistakes and things get printed and published that are a result of half-done work, right? And so journalists are always vulnerable to criticism because their work is vastly imperfect. It has to be sent out every day. It would be like if you had to ship software every day, no matter what.
38:36 Speaker 02 Right.
38:36 Speaker 08 As good as it was, maybe you get lucky and it's.
38:38 Speaker 02 Right. But we have that right now, right? Where Apple rushes out the iOS update because they got new phones coming out. And everybody's like, man, this version iOS is all buggy and the flashlight doesn't work and all this stuff's going wrong. And you're like, oh, well, that's because they had a deadline and they had to get this out because the new phones had to come out. And hopefully they'll fix it later. But fixing it later is okay if it's like my iMessage is a little slow and laggy sometimes. It's not okay if you're like, we undermined an election.
39:05 Speaker 08 That situation has always been there. It's been weaponized by Trump. And so it's it's not just that people mistrust the New York Times. It's way beyond that. It's they now have an information sphere that can elude the facts in New York Times and carry them all the way through the campaign to the election.
39:24 Speaker 02 We've gone to the darkest depths now. Everything's broken.
39:28 Speaker 08 Mm hmm.
39:28 Speaker 02 Everything's doomed.
39:29 Speaker 08 Yes, and getting worse.
39:30 Speaker 02 All the incentives are misaligned.
39:31 Speaker 08 Yep.
39:32 Speaker 02 We have all this pessimism. The optimist in me still always believes there's something we can do. I'm curious for me as a engaged social media consumer, somebody who pays for journalism as much as I can. What can I do?
39:52 Speaker 08 Well, of course, you can support the news organizations whose work you use, and that's obvious. But I've been working on a better answer for that in my directorship of the Membership Puzzle Project, which is a research project studying membership models to support journalism. So our founding distinction is between subscription and membership. Subscription is a product relationship. You pay your money, you get your product. If you don't pay, you don't get it. If you're dissatisfied with the product, you just stop paying, and everybody understands. Membership is different. You join the cause because you believe in the importance of the work. If you join the cause because you believe in the importance of the work, then you should
40:36 Speaker 08 be able to support it, yes, with your dollars, which go to an open service that anyone can access, that that's part of what you're doing with your money. That's part of what you want to support.
40:47 Speaker 02 You're subsidizing it for everyone.
40:48 Speaker 08 Right. But also, you can contribute. If we create participation paths where you can actually improve our journalism directly, for example, a database of expertise you have so that when we need it, we can call on you if you're a member. Crowdsourcing projects that try to bring a lot of distributed information together in one place through the members, right? Lots of facts you cannot otherwise find unless you have lots of hands picking up stones, right, and collecting them. So a better answer to your question would be, when we have a fully developed notion of membership, and people are involved in sustaining the news organizations they support,
41:33 Speaker 08 and they do so because they believe in the values and the way those institutions are run and funded, and they get the whole thing, and they get why they're part of the business model, not just a consumer of news, right? And that they have to call out errors, and they have to participate when necessary, right? That's the future that I am optimistic about, but we're not there yet.
41:56 Speaker 02 To that point about the calling out and participating... What about me as just a ordinary social media participant? I see manipulation and misinformation all around me. Maybe I participate in it without even knowing. How can I be a better citizen? How can I be a better consumer of media and a better sort of participant in social media? Like, what are the ways that I get exploited, that I become complicit in these systems that I might not know about?
42:22 Speaker 08 Yeah. Anytime you're talking about something that lots of other people are talking about, and that's why you're talking about it, you're in a vulnerable position.
42:31 Speaker 02 Hmm.
42:32 Speaker 08 Because it's possible that you were brought there.
42:34 Speaker 02 Wow.
42:35 Speaker 08 You know?
42:35 Speaker 02 And these platforms encourage that.
42:37 Speaker 08 They do. Yeah, that's one of the normal ways of using them.
42:40 Speaker 02 Yeah.
42:40 Speaker 08 Um, I also try to observe this rule for myself. Don't always succeed of chill before serving. I think there's great value in cooling down before. It's not censorship, it's like self-control. So chill before serving is good.
43:02 Speaker 02 The flip of the vernacular.
43:04 Speaker 08 I think it's really important, and I think you're quite aware of this, it's really important not to sort of like join gangs and, you know what I mean? Like attention gangs.
43:15 Speaker 02 Yeah.
43:15 Speaker 08 And I'm probably guilty of that sometimes with, you know, myself. You really have to watch it.
43:21 Speaker 02 Yeah.
43:22 Speaker 08 Attention gangs can be dangerous.
43:23 Speaker 02 I think about like networks like Twitter, like some of the most fun is when everybody's jumping in on something.
43:27 Speaker 08 That's true.
43:28 Speaker 02 If we're like, we're joking about something and we're all having a good time. But the line between that and the gang can be thin.
43:35 Speaker 08 Yeah. I'll tell you one more rule I use on Twitter and Facebook too. Uh, I don't do much on Facebook anymore, but on Twitter, I try to be 100% personal, 0% private. So what I mean is everything that I do is an expression of Jay. It's like what I think, what I think about, what I care about. It's authentic me. It's like, I wouldn't talk about it if I didn't care about it. So it's personal. But 0% private means you can't tell where I am. I don't talk about my family. I don't talk about my lunch. I don't, I don't position myself in social space. It's jrose underscore NYU that is focused on the things that I know a lot about.
44:19 Speaker 02 That's you as, as, as a sort of public intellectual and as a voice of what you are, but not as a, you know?
44:25 Speaker 08 No. And so that limits.
44:30 Speaker 02 Yeah.
44:31 Speaker 08 Uh, what I can do.
44:32 Speaker 02 Do you think that's compatible with influencer culture today where people are literally like famous because of how much they open up about this is what I'm wearing? This is what I'm eating? This is where I'm at? This is who I'm next to?
44:42 Speaker 08 It is intended to limit influence. I want to limit influence to the thing that I'm expert in. That's the only kind of influence I can gain from. Any other kind is actually lowering my, uh, my profile and where, in ways that matter.
44:58 Speaker 02 Well, it's interesting. Your framing there is stick to what you know. And that's a, that's such a powerful foundation, it feels to me, of both, one, how we can be responsible individually and what we do in social media.
45:13 Speaker 08 It is, yeah.
45:14 Speaker 02 And two, in what we should demand of these platforms, whether that platform is a journalistic institution or that platform is a, a social media, social networking technology institution, maybe asking them to stick to what they know may be something that can reduce some of our, our social vulnerabilities. Jay, thank you for joining Sun Function.
45:33 Speaker 08 Thanks, thanks for having me.
45:35 Speaker 02 So we've been taking this deep look at journalism in the current era of social media and the internet and a trust broadly, this entire season of function is about trust on the internet. And it reminds me of a story of a personal experience I had, you know, back in 2015, when marriage equality passed to the Supreme Court here in the United States. Like a lot of people, I was celebrating. It was really exciting. And one of the things that happened that day is a lot of public spaces and public buildings got lit up with rainbow lights, which was just incredibly moving. I had a friend send me a picture from the White House that had lit up in rainbow lights and celebrating the decision.
46:11 Speaker 02 And I took that picture and a couple others that I'd found online that people were tweeting out of rainbows lighting up everywhere in public. And I put them all together into a tweet, just sort of saying, you know, this is a wonderful day. And it wasn't until I got tens of thousands of retweets and people amplifying that message that I found out that some of those photos weren't from that day. I had inadvertently shared a message that was inaccurate. That tweet got so many retweets, it may be the most visible thing I've ever written in my life. Now, this wasn't a lie. I think those photos were from a different day. So it wasn't something where I was trying to mislead people. But I had had a role in amplifying inaccurate information.
46:56 Speaker 02 All of us have a responsibility to think about the information that we share. And the platforms don't always do a good job of reminding us of that. There's not often enough nudges to say, is that really a credible news source? Is that really the information you want to share? And even maybe at a fundamental level, is that even something that you're amplifying just because it feels good to you or because it's true? Those are the kinds of deeper, tougher questions that really drive the spread of misinformation and disinformation online. They appeal to our more basic emotional instincts. Sometimes they're good, they're celebrations. Sometimes they're not so good.
47:38 Speaker 02 That question about how disinformation spreads online and what's causing it to happen on social media is so important and it's so fundamental. And it's what we're going to go deep on in the next episode of Function. I hope you'll join us as we go even further into getting ready for 2020 by taking a look at the role that social media has and being part of the political and journalistic process that we all rely on. Function is produced by Bridget Armstrong. Our Glitch producer is Keisha TK Dutes. Nishat Kurwa is the executive producer of audio for the Vox Media Podcast Network. And our theme music was composed by Brandon McFarland. Thanks to the whole engineering team at Vox and a huge thanks to our team at Glitch.
48:22 Speaker 02 And you can follow me on Twitter at @AnailDash, but you should also follow the show at Podcast Function, all one word. Please remember to subscribe to the show wherever you're listening to us right now. And also check out glitch.com/function. We've got transcripts for every episode up there, apps, all kinds of stuff to check out about the show. We'll be back next week and we hope you'll join us then.
48:53 Speaker 10 In this life, you can't win.
48:55 Speaker 11 When the world gets you down.
48:56 Speaker 10 No!
48:57 Speaker 11 Escape to Pluto TV. This is objectively fantastic. Relax into the movies and shows you already know and love, all for free.
49:04 Speaker 10 Schwing!
49:04 Speaker 11 Even our news is uplifting.
49:06 Speaker 12 You stay classy, San Diego.
49:08 Speaker 11 Watch School of Rock, Crazy Ex Girlfriend, Anchorman: The Legend of Ron Burgundy, The X-Files, Wayne's World, and so much more.
49:13 Speaker 13 We're not worthy!
49:15 Speaker 11 The best things on TV really are free. You just have to know where to look. Escape to Pluto TV. Stream now, pay never.
Previous Best of Recode Decode: 2019 Next Recode Decode: Bruce Schneier Page updated October 13, 2026 · transcript and summary are machine-generated