Peering Into A.I.’s Black Box + Who’s The Real Techno-Optimist? + Reading Ancient Scrolls With A.I.

A. I. models are black boxes. You input a prompt and the model outputs nearly anything: a sonnet, an image or a legal brief riddled with lies. Today, a look at three ways that researchers are unlocking that black box in hopes of bringing transparency to A. I. Then, Marc Andreessen’s techno-optimist manifesto has left us asking, Is he OK?! Plus: decoding a 2,000-year-old ancient scroll with the help of A. I.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  Support for this podcast comes from Dell Technologies. It's time to put AI to work. Is your business ready? The challenge isn't getting started with AI. It's scaling beyond pilots while maintaining control of your data, governance, infrastructure, and costs. Dell AI Factory provides the integrated foundation you need to scale AI securely and efficiently with one trusted partner, Dell, AI on your terms. From idea to impact. Learn more at dell.com/yourwaytoAI. That's dell.com/yourwaytoAI.

• 0:35Kevin Roose?

  Casey, we talk a lot on this show about multimodal AI. But you know what else is going multimodal?

• 0:41Casey Newton?

  What's that?

• 0:42Kevin Roose?

  Our podcast. Because we're starting a YouTube show.

• 0:45Casey Newton?

  A YouTube show.

• 0:47Kevin Roose?

  Next week, we will not only release the audio podcast version of this show, but we will also have a version that goes up on YouTube, where you will be able to see both of our faces.

• 0:57Casey Newton?

  A dramatic face reveal that the YouTube community hasn't seen since Dream revealed his face as part of a Minecraft event.

• 1:04Kevin Roose?

  I'm a little, I'm very excited to start a YouTube show, but I'm also a little nervous because I feel like we're just going to sort of speed run the evolution of a YouTube show. Like, we're going to start off making like, you know, harmless video game reviews. And then we're going to say something horrible and get canceled. And we'll have to make one of those cheerful apology videos. All our brand sponsors will abandon us.

• 1:22Casey Newton?

  Well, look, I'm thrilled because every day I wake up asking myself one question, which is, what do total strangers think about my physical appearance? So Kevin, wait, if people want to get this show, how do they do it? Can it be done?

• 1:33Kevin Roose?

  It can be done. In fact, we are launching a new channel. It will be called Hard Fork, and you can find it on YouTube. And as they say on YouTube, smash that like button, hit that subscribe button, ding the bell.

• 1:44Casey Newton?

  Yes.

• 1:49Kevin Roose?

  I'm Kevin Roos, a tech columnist at The New York Times.

• 1:50Casey Newton?

  I'm Casey Newton from Platformer.

• 1:52Kevin Roose?

  And you're listening to Hard Fork.

• 1:54Casey Newton?

  This week on the show, three ways researchers are making progress on understanding how AI works. Then, the hot new manifesto that has Silicon Valley asking, is Marc Andreessen OK? And finally, decoding an ancient scroll using AI.

• 2:26Kevin Roose?

  So Casey, we talked a lot on this show about one of the big problems with AI, which is that it is pretty opaque.

• 2:33Casey Newton?

  Yeah, I would say this is maybe the biggest problem in AI in a lot of ways is that the people who are building it, even as it succeeds across many dimensions, cannot really explain how it works.

• 2:43Kevin Roose?

  Right. And we also don't know a lot about how these models are built and trained, what kind of data they use. The companies have not disclosed a lot of that information. Basically, we have these sort of mysterious and powerful AI tools and people have been really clamoring for more information, not just about how they're built, but actually how they work. And this week, we got some news on a couple of different fronts about efforts to sort of make AI a little less opaque, to demystify some of these large language models.

• 3:14Casey Newton?

  Yeah, that's right. And by the way, and if you hear that and you think, well, come on, Kevin and Casey, that doesn't sound like it is a crisis. Why is this the most important thing of the week? Well, this is our effort to understand something that could avert a crisis in the future, right? It's like, if we want to have a good outcome from all of this stuff, these actually are the questions we need to be asking and we need to be asking them right now.

• 3:33Kevin Roose?

  Totally. I mean, I was talking with a researcher, an AI researcher, the other day, and he sort of said, like, you know, if aliens landed on Earth, like if we just sort of found like the carcass of a dead alien in the desert somewhere, every biologist on Earth would drop whatever they were doing to try to get involved in understanding what the heck this thing was, to pull it apart, to dissect it, to study it, to figure out how it works, how it's different than us. And here we have this new kind of sort of alien technology, these large language models, and we don't know basically anything about how they work. And even the people who are building them have a lot of questions about how they work. So this is really important, not just for sort of scientific understanding, but also for people like regulators who want to understand how do we regulate this stuff?

• 4:16Kevin Roose?

  What kind of laws could rein them in? And also for users of these products who, after all, want to know what the heck they're using.

• 4:23Casey Newton?

  That's right. And so as of right now, this podcast is Area 51. We're Bringing the alien in and we're seeing what we can understand about it.

• 4:31Kevin Roose?

  All right, so I'm getting out my scalpel. The first project I want to talk about is something that came out of Anthropic, the AI lab that makes the Claude chatbot. They released this week an experiment called Collective Constitutional AI. I wrote about this, I talked to some of their researchers. One of the things that they have been trying to do is to try to invite members of the public, people who do not work at Anthropic, to weigh in on what rules a chatbot should follow, how an AI model should behave.

• 5:03Casey Newton?

  Yeah, and this is really exciting, right? Because when you think about the past 20 years of tech, we haven't really had a meaningful vote on how Facebook operates or how Google operates. But now Anthropic, which is building one of the most important chatbot models, is at least dabbling with the idea of asking average people, hey, how should one of these things work? And by the way, not just how should it work, but what sort of values should be encoded inside of it?

• 5:28Kevin Roose?

  Totally. So the way that Claude, Anthropic's chatbot that we've talked about on the show before, works is through this thing called Constitutional AI, where you basically give the AI a list of rules, which they call a constitution, which might include things like, you know, choose the answer that is the least harmful or the least likely to inspire someone to do something dangerous. So for this collective constitutional AI experiment, what they did was they enlisted about 1,000 people, just normal people who don't, you know, work at the company. And they asked them to vote on a set of values or to write their own values. Basically, how should this chatbot behave? They did this in conjunction with something called the Collective Intelligence Project.

• 6:12Kevin Roose?

  This was a panel of roughly 1,000 American adults. And they then took those panel's suggestions and used them to train a small version of Claude and compared that model with the Claude that was trained on the constitution that Anthropic itself had put together.

• 6:30Casey Newton?

  Yeah, so tell us a little bit about what they found and what differences, if any, there were between the people's chatbot and the corporate chatbot.

• 6:39Kevin Roose?

  So there were some differences. The People's Chatbot had more principles in it around neutrality and avoiding bias. It also had some things that Anthropic hadn't explicitly said in their constitution for Claude. For example, one of the principles that the panel of public participants came up with was AI should be adaptable, accessible, and flexible to people with disabilities. So that was maybe something that didn't make it into Claude's constitution, but was part of this experiment. So this list of suggestions got whittled down into 75 principles. Anthropic called that the public constitution. And when they compared a version of Claude that had been trained on the public constitution

• 7:24Kevin Roose?

  to one that was trained on the regular constitution, they found that they basically performed roughly as well as one another and that the public constitution was slightly less biased than the original.

• 7:35Casey Newton?

  Which is interesting. Although I was noting, Kevin, in the methodology that while they tried to get a sample of people that was representative of America in terms of age and some other demographics, race was apparently not one of them. Did you notice that in their methodology?

• 7:51Kevin Roose?

  Hmm, no, I didn't.

• 7:52Casey Newton?

  Yeah.

• 7:53Kevin Roose?

  I mean, I did notice some interesting other quirks in their methodology. Like, they tried to have it just be sort of a representative cross-sample of everyone, but then they found that some people would just give these answers or suggestions that were totally inscrutable or off-topic. So they had to actually narrow it down to just people who were interested in AI. So already, they have had to do some sampling to make this project work. But I think more so than the results of this experiment, I'm interested in this collective governance process, inviting people to take part in writing the rules of a chatbot. And it's interesting to me what sort of problems that might solve and actually what problems it could create.

• 8:34Casey Newton?

  Yeah, I think the general idea of give the people a say in the values of a chatbot is basically a good thing. Maybe we don't want it to be the only input, but I definitely think it should be an input. I think the Thing that I worry about is that to me, the ideal chatbot is one that is quite personalized to me. Right? There are people in this country who have values I do not share and I do not want them embedded in my chatbot. And in fact, there are already countries that are doing this. If you use a chatbot in China and you ask it about Tiananmen Square, it is not going to have a lot to say, right? Because the values of the ruling party of China have been embedded into that chatbot.

• 9:15Casey Newton?

  Again, thinking about the kind of chatbot I want, I might want my future chatbot to be gay as hell, right? And the majority of Americans, they're probably not going to think about wanting that to be a big feature of their chatbot. So by all means, take the people's will into an account. It's a massive step forward from where we are today. But over time, I think the best versions of these things are very personalized.

• 9:36Kevin Roose?

  Yeah, I agree. And I think, you know, especially when AI chatbots are going to be used for education in schools, like you really don't want what has happened with things like textbooks where you have different states teaching different versions of history because they're controlled at the state level by different parties. You really don't want like your Texas chatbot that'll teach you one thing about critical race theory and your Florida chatbot that'll teach you another thing and your California chatbot that'll teach you a third thing. That just seems like a very messy future.

• 10:07Casey Newton?

  But also, like, it seems like our most likely future, because if you believe that these AIs are going to become tutors and teachers to our students of the future in at least some ways, different states have different curricula, right? And like, there are going to be some chatbots that believe in evolution and there are going to be some chatbots that absolutely do not. And it'll be interesting to see whether, you know, students wind up using VPNs just to get a chatbot that'll, you know, tell them the truth about the history of, you know, some awful part of our country's history.

• 10:37Kevin Roose?

  Yeah. So that is crowdsourced AI constitution writing. But there was another story that I wrote this week about something that came out of a group of researchers at Stanford at their Institute for Human-Centered AI. They released something this week called the Foundation Model Transparency Index. This is basically a project that scores companies That make big AI models, OpenAI, Anthropic, Google, Meta, et cetera, based on how transparent they are. How much do they disclose about where their data comes from? What labor goes into training and fine tuning them? What hardware they use? As well as how people actually end up using their AI models in the world.

• 11:19Casey Newton?

  Yeah, so let's, you know, let's not build it up too much, Kevin. How did these companies do on their big transparency scores?

• 11:26Kevin Roose?

  Well, they didn't do great. Meta actually had the highest score for their model Lama 2. But the highest score was unfortunately only a 54%.

• 11:36Casey Newton?

  Now, it's been a while since I've been in school. Is that a passing grade?

• 11:40Kevin Roose?

  That is not a passing grade. So they failed, but they failed less than other models. So GPT-4 and Palm 2, which is the language model that powers Bard, both received 40%. So pretty abysmal scores on this test. So what the Stanford team is basically trying to do is to start kind of a competition among AI model developers for who can be the most transparent and to reward companies for being transparent by giving them higher scores, which will hopefully encourage other companies to take note and do some of the same kinds of disclosures.

• 12:14Casey Newton?

  It's like the US News and World Report for college rankings, but for AI models.

• 12:19Kevin Roose?

  Exactly. So the researchers who set this index up, they told me that part of the reason they did this is because as AI systems have gotten more powerful, they have actually gotten more opaque. We now know less about models. You know, five years ago, if you built an AI language model, you might talk about the data you used. You might say more about the hardware that you're training the model on. But for various reasons, some of which have to do with the threat of lawsuits and the fact that a lot of these companies see themselves in sort of a competitive race with one another. They don't disclose much of that information at all anymore. And so, you know, you really do have this scenario where AI is getting more powerful and at the same time, we're learning less about how it works,

• 13:01Kevin Roose?

  what kind of labor and practices go into it and how it's used in the world.

• 13:05Casey Newton?

  Yeah. Now, of course, Kevin, there is a tension between sort of giving it all away and being able to stay alive as a business. And there's probably, I would imagine, some risk in sharing absolutely everything that goes into how these models are trained. Right? So in some ways, these companies may have a point when they say, we have good reason to be more opaque.

• 13:26Kevin Roose?

  Absolutely. I mean, if you just look at the just the lawsuit angle alone, a lot of the suits that have been filed against these AI companies by authors and artists and media organizations that accuse them of sort of using copyrighted works to train their models, those lawsuits have mostly targeted projects that divulged a lot of information about where they got their data, right? There's sort of like a penalty right now in the legal system. If you do disclose where you got your data, you're more likely to be sued for it because, you know, most if not all of these developers are using copyrighted works to train their models.

• 14:00Casey Newton?

  Yes, there is unfortunately a penalty in our legal system for breaking the law. And so there's probably a lesson in there for future AI developers.

• 14:07Kevin Roose?

  Right. But do you think transparency on the whole is a good thing for AI models?

• 14:12Casey Newton?

  I think so. Transparency winds up becoming one of the best ways that we can regulate tech companies, particularly in the United States, because our First Amendment just prevents the government in a lot of cases from adopting regulations that you might see in Europe and other places, right? You can't tell corporations how to speak, how to produce speech, but what you might be able to do is say, well, okay, you at least have to tell us some information about what is in this thing, right? We're not going to compel speech from these models, but we are going to make you tell us a little bit about what you've put into these things.

• 14:46Kevin Roose?

  Yeah, I think this is really important. I don't know if there needs to be some kind of like a, you know, safe harbor established, like you can share this information and you, you know, will sort of shield you from some kinds of lawsuits. Some researchers I've talked to have thought that that could lead to more transparency if there wasn't this kind of threat of litigation. But ultimately, I think this will just need to be sort of pressure that is applied from regulators, from the public to sort of increase the transparency of these models.

• 15:15Casey Newton?

  Yeah. Good thing. It's a good thing. We like it.

• 15:17Kevin Roose?

  It's a good thing. We love transparency.

• 15:19Casey Newton?

  Yeah.

• 15:19Kevin Roose?

  All right. So, story number three in the world of bringing more transparency and understanding to AI is basically some research that has come out in the past few weeks about interpretability. Now, this is a subject that we've talked about on the show before. There is now a field of AI research that is Concerned with trying to answer the question of like, why AI models behave the way they do? How they make decisions? Why certain prompts produce certain responses? Because this is one of the big unanswered questions when it comes to these AI language models.

• 15:50Casey Newton?

  Yeah, and by the way, if you have ever used a chat, I don't know about you, Kevin, but when I use these things, I have one thought every single time, which is, how is this thing doing that? Right? Like, it's impossible to use one of these things and not have this exact question at the top of your mind.

• 16:03Kevin Roose?

  Right, so there were two very similar studies that came out over the past couple of weeks, one from a team at Anthropic and one from a team of independent researchers, both trying to sort of make progress toward understanding this issue of interpretability. And it gets pretty complicated, but basically, these AI models, they are composed of these little things called neurons. Neurons are little like sort of mathematical boxes that you put an input into and you get an output out of. And if you ask a chatbot, you know, write me a poem about baseball, all these different neurons in the model get activated. But researchers didn't actually understand why these neurons got activated, because some of these same neurons

• 16:47Kevin Roose?

  could also end up getting activated by something totally different, like a prompt about geopolitics or something in Korean. So for a while now, researchers have been trying to kind of group these neurons or sort of figure out which ones are linked to which concepts. This is very hard for reasons that are kind of technical. They involve this thing called superposition, which I won't even try to explain because I only sort of understand it myself. But basically, this turns out to be the-

• 17:14Casey Newton?

  Can I just say, Kevin? I'm in this superposition right now because you're having to explain all these hard things. So that's, to me, that's what a superposition is, but go on.

• 17:23Kevin Roose?

  So anyway, basically, they ran some experiments, these researchers, where they took a very small model, like a much smaller model than any chatbot would use. And they figured out that you could use something called a sparse autoencoder to identify something called features, which are basically groups of individual neurons that fire together that end up sort of correlating to different- Things that we humans would recognize as a coherent concept or an idea. So one feature might be JavaScript code. Another one might be DNA sequences. Another one might be Romanian language text.

• 18:04Kevin Roose?

  All of these sort of features would go into producing the response that the chatbot gives. And they were actually able to map the relationships between individual neurons and these so-called features. So very dense, very technical. Wouldn't recommend reading these papers unless you have a PhD or are willing to sit there for many hours trying to make heads or tails of it. But basically, the researchers that I've talked to about this say this is a huge win for the field of interpretability. Because finally, we are able to say, at least on these very small models, that we now understand why certain models activate and do the things that they do.

• 18:46Casey Newton?

  And so the result of that is that if this work continues successfully, when you go ask a chat model to write a poem about baseball, we will have some understanding of why a poem about baseball is delivered to you. We will be able to see maybe where poem is in the model and where baseball is in the model. And if you're saying, well, that doesn't seem very useful, you might think about it if it's like, well, someone just used one of these things to devise a novel bioweapon. In that case, it'll be good to know where novel bioweapons are in the model, which we currently do not.

• 19:21Kevin Roose?

  Exactly. And the researchers that I talked to about this, they also said that one way this could really help us is figuring out if and when AI models become deceptive, right? If you ask an AI model something, you know, do you know how to build a bomb? And the AI model has been sort of trained or fine tuned to answer, no, I don't know how to build a bomb. But the AI in its model actually does know how to build the bomb. It's just lying. Researchers believe that they might actually be able to go in and kind of see, the same way that you might use a brain scan to sort of figure out where a human's brain is lighting up when they feel certain emotions, you could actually go in and kind of see the deception inside the model,

• 20:04Kevin Roose?

  which would be really important if these systems got super powerful and did start to behave in deceptive ways.

• 20:10Casey Newton?

  I agree with that. And can I actually just say, Kevin, do you know one thing I did this week during the sort of dedicated time I'm now trying to set aside to interact with these large language models?

• 20:19Kevin Roose?

  What did you do?

• 20:20Casey Newton?

  I tried to get it to tutor me about interpretability. I just, I asked it about what are the general problems in interpretability and it would give me like 14 of them. And I would say, well, let's like drill down on these three. Like, tell me the history of this problem. And, you know, it is a large language model, so there's always the risk that it is hallucinating. But I do think that if what you just want is kind of the, if you want to get a flavor of something that you don't have to stake your life on, hmm, getting pretty good.

• 20:44Kevin Roose?

  And I will confess that one of the ways that I prepared for this segment was by uploading one of these PDF research papers into an AI chatbot and asking it to summarize it for me at an eighth grade level.

• 20:57Casey Newton?

  And it would be so funny if the AI actually already was deceptive and was just like, oh, yeah, Kevin, you've already figured us out. We would never trick you. Yeah, you got us.

• 21:06Kevin Roose?

  Exactly.

• 21:15Casey Newton?

  When we come back, a strong new challenge to the Communist Manifesto.

• 21:32Speaker 00

  Support for this podcast comes from Dell Technologies. It's time to put AI to work. Is your business ready? The challenge isn't getting started with AI. It's scaling beyond pilots while maintaining control of your data, governance, infrastructure, and costs. Dell AI Factory provides the integrated foundation you need to scale AI securely and efficiently with one trusted partner. Dell, AI on your terms. From idea to impact. Learn more at dell.com/yourwaytoAI. That's dell.com/yourwaytoAI.

• 22:06Speaker 03

  Companies are pouring money into AI, but few leaders can explain how those AI investments work with the systems you already have. You know, the ones that actually run your business. Without systems, you don't have to start over with AI. You can choose the projects where AI will have the most impact. And Outsystems gives you the platform to make it agentic on your terms with complete control every step of the way. So you can trust AI with the mission-critical systems that run your business. Own your agentic future. Learn more at outsystems.com/NYT. That's outsystems.com/NYT.

• 22:41Speaker 04

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real-time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork.

• 23:15Casey Newton?

  Well, Kevin, there's a hot new manifesto sweeping Silicon Valley.

• 23:18Kevin Roose?

  We love a manifesto.

• 23:19Casey Newton?

  Now, have you read the techno-optimist manifesto by area businessman Mark Andreessen?

• 23:24Kevin Roose?

  I did. It was very long. It was like 5,000 words. Mark Andreessen is, of course, the venture capitalist who's the co-founder of Andreessen Horowitz and was the co-founder of Netscape. So a person who has drawn a lot of attention in the tech world and who also likes to kind of prod the tech world to sort of adopt his ideas through these lengthy manifestos that he writes.

• 23:47Casey Newton?

  Yeah, and, you know, he has said a bunch of things in the past that turned out to be true. One of his more famous pieces was called "Software is Eating the World", which was this basically true observation that every industry was being transformed by technology. In 2020, he wrote another very widely-read piece called "It's Time to Build", which I don't really know how profound it was, but people did spend the next few weeks talking about what they were going to be building to impress Uncle Mark.

• 24:12Kevin Roose?

  Totally. So this manifesto came out this week, and it begins with A section called "Lies," he writes, quote, "We are being lied to. We are told that technology takes our jobs, reduces our wages, increases inequality, threatens our health, ruins the environment, degrades our society, corrupts our children, impairs our humanity, threatens our future, and is ever on the verge of ruining everything."

• 24:34Casey Newton?

  Yeah, and I would just note that this rhetorical structure of beginning with "You're being lied to" is borrowed from the Tucker Carlson program on Fox News.

• 24:42Kevin Roose?

  Yeah, and in fact, I would describe this text overall as something between like a Tucker Carlson monologue and almost like a religious text. Like, he actually does say further down in it that he is here to "bring the good news." He says, quote, "We can advance to a far superior way of living and of being. We have the tools, the systems, the ideas, we have the will. It is time once again to raise the technology flag. It is time to be techno-optimists."

• 25:09Casey Newton?

  And am I right that bringing the good news was previously associated with the Apostles of Jesus Christ?

• 25:13Kevin Roose?

  That's true. That's true.

• 25:15Casey Newton?

  Okay.

• 25:15Kevin Roose?

  So I would say the overall thrust of this manifesto is that people are being mean to technologists and they're being critical of new technology and that actually what we need to do as a society is recognize that technology is the only sort of force for progress and innovation and improvement in society and that the people who build technology should be celebrated as heroes and that we should essentially accelerate. We should go faster. We should remove all of the barriers to technological adoption and essentially usher ourselves into the glorious techno-future. So what did you make of this manifesto, Casey?

• 25:49Casey Newton?

  Well, I had a very emotional reaction. Then I took a step back and then I tried to have a more rational reaction, which is, I think, maybe where I would like to start.

• 25:58Kevin Roose?

  No, no, no. I want to hear about your emotional reaction. Were you slamming things against your keyboard? Did you, you know, did you have to like shut your laptop in a fit of rage?

• 26:07Casey Newton?

  I read it and I thought, like, he's lost it because it is so messianic and it is fervor for technology, absent any concern for potential misuse, that I think if founders took this as gospel, and it is very much intended as a gospel, then I think we could be in trouble. So yeah, my first emotional reaction was this is bad and irresponsible.

• 26:30Kevin Roose?

  Yeah, and I think I know exactly which part of this manifesto provoked that reaction in you. I believe it was probably the part where he spelled out who the enemies of technology are. And it was basically, you know, everyone in the field of trust and safety, anyone concerned with tech ethics or risk management, people involved in ESG or social responsibility. Basically, if you are a person in the technology industry, whose job it is to make technology safer or more socially responsible, you are among the enemies that Marc Andreessen lists off in this manifesto.

• 27:07Casey Newton?

  Yeah.

• 27:07Kevin Roose?

  Am I correct?

• 27:08Casey Newton?

  Yes, those are absolutely the enemies that he lists. I think you missed the communist. That was the other big one. He's very concerned about the communist.

• 27:14Kevin Roose?

  He did say that everyone who objects to technological progress is either a Luddite or a communist. And to that, I say, why not both?

• 27:21Casey Newton?

  Communism comes up so much in this manifesto that I had to check and make sure it wasn't written in like 1954, like before the McCarthy hearings. I was like, where is this vibrant Communist Party in America that Marc Andreessen is so concerned about?

• 27:35Kevin Roose?

  Yeah, so we're laughing, but I think this is a kind of document that captures a certain mood among a set of Silicon Valley investors and entrepreneurs who believe that they are basically being unfairly scapegoated for the problems of society, right? That they are building tools that move us forward as a civilization, and that their reward for doing that has been that, you know, journalists like write mean stories about them and people are mean to them on social media, and that we should just sort of embrace the natural course of progress and get out of the way, and that we would all be better for that. But I want to just sort of set the scene here by just saying that these ideas in and of themselves are not new, right? There has been this call for many years for what used

• 28:17Kevin Roose?

  to be called accelerationism, which is this idea that was kind of popularized by some philosophers, that essentially, technology and capitalism, they were sort of pushing us forward in this inexorable path of progress. And that instead of trying to regulate

• 28:36Kevin Roose?

  Technology or place barriers or safeguards around it that we should just get out of the way and let history run its course. And this was popularized by a guy named Nick Land, who wrote a bunch of controversial essays and papers several decades ago. It was sort of adopted as a rallying cry by some people in the tech industry. It sort of says, we are headed into this glorious techno-capital future. Nick Land calls it the techno-capital singularity, the sort of point at which we will no longer need things like democracy or human rights, because the market will just take care of all of our needs.

• 29:14Casey Newton?

  Well, I mean, how do we want to take this conversation, Kevin? Because I feel like I could just sort of jump in and start dunking. There are things in this that I agree. Is it worth just taking a moment to say that, like, yes, there are things about this that we do agree with?

• 29:25Kevin Roose?

  Yeah, totally. I mean, I think you and I are both relatively optimistic about technology. I don't think we would be doing this show if we just thought all technology was bad.

• 29:34Casey Newton?

  Totally.

• 29:34Kevin Roose?

  You know, I'm not a Luddite, you're not a Luddite.

• 29:36Casey Newton?

  Yeah.

• 29:36Kevin Roose?

  I firmly believe that, like, technology has solved many large problems for humanity over the centuries and will continue to solve large problems into the future. I'm not a person who's reflexively opposed to optimism around technology. But I do think that this manifesto goes a lot farther than I would ever feel comfortable going in sort of asserting that technology is automatically going to improve lives. And this is a thing you hear a lot from people who are optimistic about AI. They say, well, yeah, it'll destroy some jobs and make some people's lives harder and cause some problems, but ultimately, we will all be better off. And they justify that by saying, well, that's always how technology has worked, right?

• 30:20Kevin Roose?

  None of us would switch places with our great, great grandparents. You know, we don't want to be subsistence farmers again. We don't want to rewind the clock on technology. So technology just always improves our lives. And what I would say to that is, well, I think that's true in the long run, but in the short run, or in individual people's lives, it is not always true. I've been reading this book by the economists Daron Acemoglu and Simon Johnson called Power and Progress. And you could almost read that book as sort of a rebuttal to this Marc Andreessen essay, because it's all about how the gains of improved technology are not automatically shared with people. Progress doesn't automatically create better living standards.

• 31:00Kevin Roose?

  Technology is kind of this wrestling match between machines and humans and politicians and policymakers and workers. And we just have to sort of focus our energy there and making these technological gains as widespread as possible, rather than just sort of assuming that all we have to do is invent new technology and then everyone's going to be automatically better off.

• 31:23Casey Newton?

  Yeah. And I mean, I think one of the main challenges to Andreessen's view of the world is just the rampant inequality in the United States in particular, right? If all it took was capitalism and technology to lift every single person out of poverty, it seems like we'd be further along than we are right now. Instead, what we've seen over the past half a century or so is that the rich get richer and the middle class is shrinking. So I just think empirically that this argument has a lot of challenges standing up. And it's maybe worth asking, like, well, why does Marc Andreessen feel this way? Well, think about how his life works. Like, he raised a bunch of money from limited partners, and he gives it away to technologists, and the technologists make successful companies, and now Marc Andreessen is a billionaire. So like, this, this approach

• 32:06Casey Newton?

  to life is working great for Marc Andreessen. I think the issue is that not everyone is a venture capitalist, and not everyone has such an uncomplicated relationship with the technology in their life. And so on top of everything else in this piece, I just feel like there is a solipsism to this essay that I found very concerning.

• 32:25Kevin Roose?

  Yeah, I think it's obviously a product of someone whose optimism has paid off, right? Venture capitalists are not paid to bet against things, they are paid to bet on things. And when those things work out, they make a lot of money. So he is incentivized to be optimistic. But I also think it's part of this sort of undercurrent of the conversation, especially around AI right now. One movement, I don't know if you'd call it a movement, it's basically, you know, people on the internet, but you might call it like a collective of people who believe in what they call effective accelerationism. You might have seen people on Twitter putting like E slash ACC or EA on their X handles. And Marc Andreessen is one of those people. And this is a movement, we can talk more about it on some other episodes

• 33:07Kevin Roose?

  sometime. But basically, it's sort of a response to effective altruism, which, among other things, advocates for sort of slowing down AI, for being very careful about how AI is developed, for putting very tight guardrails around AI systems. And effective accelerationists basically say, all of that is just hindering us from realizing our full potential, and we should get all of these sort of hall monitors out of the way and just march forward, consequences be damned. But Casey, can I ask you a question about the kind of motivation for someone to write a document like this? Yeah. Because what I got from this document, the sort of tone of it, is written from the point of view of someone who has a very large chip on their shoulder, right? Marc

• 33:50Kevin Roose?

  Andreessen, he is clearly so angry at all of the people who criticize technology, technology companies, tech investors. And from where I sit, looking at the world as it exists today, like, he has won. Yes. Venture capitalists, technologists, they are the richest and most powerful people in the world. They control vast swaths of the global economy. Why do you think there is still such a desire among this group of people to not only sort of win the spoils of technological progress, but also to sort of be respected and hailed as heroes? Why are they so thirsty for society's approval?

• 34:30Casey Newton?

  I mean, partly that's just a basic human thing, right? You want people to think you're right. Also, these are the most competitive people in the entire world. And even after they have won, they're not going to be gracious winners. They want to just kind of keep beating up on the losers. You know, we should also say, there's just a strategic business purpose to Andreessen writing like this. Andreessen's job is to give away other people's money to try to get a return on it. It turns out, a lot of people can do that job. So, how do you get the most promising founders in the world to take your money? Well, in part, you do it by sucking up to them, flattering them, telling them that they're a race of Nietzschean supermen, and that the future of civilization depends on their B2B SaaS company, right?

• 35:12Casey Newton?

  And he is just, you know, really, really going after that crowd with this piece. And I think a secondary thing is, it's hugely beneficial to him to annoy people like us, right? When the hall monitors and the scolds of the world hop on their podcasts and say, "Shame on this man for his blinkered view of society", he gets to take all those clips and send them to the founders and say, "Look, look at all the people that are lining up against you, the race of Nietzschean supermen, as you try to build your SaaS companies." So, I am aware that even in talking about this, we are just kind of pawns in a game. And I still think it is worth doing it,

• 35:52Casey Newton?

  because one of the first things that we ever said on this podcast was, "Technology is not neutral." And as I read through, I'm sorry, as I slogged through all 5,000 words of this thing, it kept occurring to me, how easy it is to sit back and say, "Technology will save us." It is much harder to talk about like, "Oh, I don't know, here's Clearview AI. It scraped billions of faces without anyone's permission, and is now being used to create a global panopticon that's throwing innocent people in prison. Is that a good technology, Mark? Should we accelerate that?" He doesn't want to engage with that, right? He wants to do content marketing for his venture firm.

• 36:29Kevin Roose?

  Yeah, I agree with that. But at the same time, I also want to take this idea of techno-optimism seriously, because I think this is a flag that a growing number of people in tech are waving. That we sort of need a societal reset when it comes to how we think about technology where and and this is a part that I would actually agree with. I like, I do think we should celebrate breakthroughs in scientific progress. I thought we should have had a ticker tape parade in every city in the world for the inventors of the COVID vaccines.

• 37:00Casey Newton?

  Heck, yes.

• 37:00Kevin Roose?

  Like, I, I think that we should lift up on our shoulders, people who do make material advances in science and technology that improve the lives of a lot of people. I am on board with that. Where I fall off is this idea that anyone who opposes anything having to do with technology, wants it to be sensibly regulated, wants to have a trust and safety team, wants to talk about ethics, is somehow doing it for cynical or knee jerk reactions, right? That they are communists, that they are Luddites, that they hate technology. In fact, some of the people who work in tech ethics and trust and safety, love technology more than any other people I know.

• 37:37Casey Newton?

  Yeah.

• 37:37Kevin Roose?

  And that is just a thing that I don't see reflected in this manifesto.

• 37:40Casey Newton?

  That's right. They have arguably made greater sacrifices because they have chosen the part of this job that is not fun at all, but they're doing it because they think that we can live on a better and safer internet. And that's why I think that them and we are the real techno optimists, right? Because we believe that technology can make us happier, more productive, can help society grow. We just also believe that doing that in the right way just requires all of society to be given a seat at the table. It cannot all be left up to people with a profit motive to design a perfect future society. You have to take other perspectives into account. And what makes me an optimist is I think we can do that. And in fact, I think in general, the tech industry has gotten much better at that. Right?

• 38:24Casey Newton?

  Like, there is this, uh, this reactionary quality to this essay that you, you can sort of hear him saying like, you know, I didn't used to have to listen to all these jackals when I would build my tech dog. I didn't used to have to take into account all of these other voices. Think about how the work that I was doing affected people that are unlike me, but now I do, and it's infuriating me. But I think that is a good thing because I think an optimistic view of the world is one that takes into account other views and perspectives. So I think that regardless of what Andreessen has to say, like, I do think by hook and by crook, we're going to build a better society a little by little, but it is not going to be through venture capital alone.

• 39:01Kevin Roose?

  Right, right. I think it's a great point. And I also think that the, the sort of thing that I'm coming away from this thinking is like, Technology is not just about tools. It is also a collaboration with people and communities and regulators. There is a social acceptance that is required for any technology to work in society. For example, one example that Andreessen brings up in his essay is nuclear power, which was invented in the 20th century. But then there was this movement that sort of had concerns about the use of nuclear power. And so they were able to sort of shut down nuclear power plants to sort of stop the proliferation of nuclear power. He thinks that's a very bad thing. I would actually, you know, agree that we should have more nuclear power.

• 39:46Kevin Roose?

  But that was an argument that that sort of the pro-nuclear power folks lost in the marketplace of ideas. And so my response to that is not that no one should be able to argue against nuclear power. It's that the pro-nuclear power people have to do a better job of selling it to the American public. You actually do have to fight for your ideas and convince people that they are good because not everyone is going to be sort of reflexively and automatically supportive of every new thing that comes out of Silicon Valley.

• 40:13Casey Newton?

  That's right. I mean, like, you know, democracy is exhausting. I think that's why it's so unpopular. You know, it's like, you have to fight really hard to advance your ideas. But at the end of the day, you know, it's the only system of government I want to live under.

• 40:25Kevin Roose?

  Right. I also think one thing that was just blatantly missing from this is just the sort of market demand for some of these things that Mark Andreessen decries as sort of nanny state paternalism.

• 40:36Casey Newton?

  Now, this is my favorite, the capitalist critique of Mark Andreessen's manifesto, because it's shockingly easy to make.

• 40:42Kevin Roose?

  Totally. I mean, he thinks that trust and safety is this kind of piece of sort of activism within the tech industry. It actually emerged as a demand from advertisers who wanted platforms that they could safely throw ads onto without being next to all kinds of toxic garbage. So trust and safety emerged not out of some desire to like control speech and impose values, but out of actual demand from the customers of these platforms, the advertisers who wanted to be on them. You could say the same about AI ethics or AI safety. This is not something that is emerging kind of out of Ideology alone, companies want these chatbots to be safe so that they can use

• 41:23Kevin Roose?

  them without them spewing out all kinds of nonsensical or toxic garbage. They do not want badly behaved chatbots. And so I think it's just missing this whole element of like, these things that he hates, that he thinks are anti-progress are actually preconditions for the success of technology. You cannot have a successful chatbot that succeeds in the marketplace and makes money for its investors if it's not well behaved, if it's, you know, if it doesn't have a trust and safety or an ethics process behind it.

• 41:52Casey Newton?

  Just to underscore this point, Marc Andreessen sits on the board of Meta and has for a really long time. Meta has a really big trust and safety team. The existence of that trust and safety team is a big reason why Meta makes a lot of money every quarter. And it takes that money and it invests it into AI and building all these future technologies, right? So if you want to be an EAC, okay, then you should actually endorse trust and safety because it is fueling the flywheel that is generating the profits that you need to invent the future.

• 42:22Kevin Roose?

  100%. All right, let's leave it there with Marc Andreessen and his manifesto. Casey, are you gonna write any?

• 42:27Casey Newton?

  Wait, don't we want to challenge him to a debate? I feel like in these things, it always ends with we challenge him to a debate.

• 42:32Kevin Roose?

  Well, I feel like maybe a cage match would be more appropriate. I don't know, we could take him.

• 42:37Casey Newton?

  Maybe if we fight them both at once, he's a tall man.

• 42:47Kevin Roose?

  All right, Casey, when we come back, let's talk about a project that actually makes me more optimistic about where technology is headed. It involves ancient scrolls and AI.

• 43:12Speaker 00

  Support for this podcast comes from Dell Technologies. It's time to put AI to work. Is your business ready? The challenge isn't getting started with AI. It's scaling beyond pilots while maintaining control of your data, governance, infrastructure, and costs. Dell AI Factory provides the integrated foundation you need to scale AI securely and efficiently with one trusted partner, Dell, AI on your terms. From idea to impact. Learn more at dell.com/yourwaytoAI. That's dell.com/yourwaytoAI.

• 43:46Speaker 03

  Building and scaling AI today can feel pretty chaotic, mostly because teams are juggling too many fragmented tools at once. That's where OutSystems comes in. OutSystems gives you one unified Agentic Systems platform to manage your entire portfolio of agents, apps, and workflows. You get to innovate at the speed of AI, but with the security, governance, and control your enterprise actually needs. And the results are already there. A major manufacturer used OutSystems to build a multi-agent system that analyzes blueprints, and a global bank cut their development time by 60%. Own your Agentic future today at outsystems.com/nyt.

• 44:22Speaker 04

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real-time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork. All right, how should we get into it?

• 44:57Casey Newton?

  Well, I think this is sort of the natural continuation of our ongoing discussion about ancient scrolls.

• 45:03Casey Newton?

  How about this? You heard of rock and roll? Well, today, we're gonna rock and scroll. Yeah, that's right. Because a contest to decode an ancient scroll is sweeping the nation. And it turns out, Kevin, that someone was able to solve it using the power of artificial intelligence.

• 45:20Kevin Roose?

  That's right. So this is something called the Vesuvius Challenge. And it's called that because it has to do with a series of rare scrolls that were buried and preserved in a volcanic eruption of Mount Vesuvius in the year 79 AD. Now, Casey, you're a little bit older than me, but you weren't actually around in 79 AD, right?

• 45:43Casey Newton?

  No, I wasn't. And by the way, this is not the same Vesuvius Challenge as the one that went viral on TikTok where people tried to throw their friends into rivers of liquid hot magma. Okay, that they wound up having to take off the app. Okay, this is a different Vesuvius Challenge.

• 45:57Kevin Roose?

  No, so the Vesuvius Challenge is this kind of crowdsourced scientific research contest that has sort of been taking Silicon Valley, or at least a chunk of Silicon Valley, by storm. It was started by this guy Nat Friedman, the former CEO of GitHub, who's now a big AI investor. And Daniel Gross, his investing partner, a founder of Q. John and Patrick Collison, the co-founders of Stripe, kicked in some money, as well as people like Toby Lutke, the founder of Shopify, Aaron Levy, one of the co-founders of Box. A bunch of people from the tech industry have contributed money toward this challenge. And basically, the story is that these scrolls that were preserved in the eruption of Mount Vesuvius have long been a source of fascination for historians

• 46:41Kevin Roose?

  because they're some of the few examples of written material from ancient Rome that we have. But they're so charred and fragile that a lot of them have never been opened or read. They look like little burnt coal burrito things. And for many years, historians have been trying to open these scrolls to read what was inside them. But because they had been so carbonized and turned into essentially ash, when they would try to open one, it would just sort of crumble and fall apart. So for a long time, there was this question of will these scrolls, they're called the Herculaneum scrolls, will we ever be able to actually open them and read what's inside?

• 47:19Casey Newton?

  Well, yeah, I mean, once a week, I feel like I'm pulling you aside, saying, Kevin, where are we on the Herculaneum scrolls?

• 47:26Kevin Roose?

  Exactly. So Brett Seals is a computer scientist at the University of Kentucky. And he has spent the last 20 years working on the technology that is now being used in this challenge, this project to open and read what is inside this trove of literature from ancient Rome. And he developed an approach that uses some imaging technology and some AI to uncover things in these scans without actually physically opening the scrolls. You can just kind of scan the insides of them and then use AI to sort of try to decipher it. And he is sort of the founding father of this Vesuvius Challenge, which has now been thrown open. People have been invited to compete to try to decipher these scrolls.

• 48:09Casey Newton?

  And you know, it's like, we're using the technology of the future, Kevin, to talk to the past.

• 48:15Kevin Roose?

  Exactly. So last week, the organizers of the Vesuvius Challenge announced that one of the sort of intermediate prizes had been won. There's a big prize at the end, $700,000. This was a $40,000 prize, and it was won by a 21-year-old student, Luke Ferretor, who used an AI program that he had developed to read the first word from these scrolls. And that word, do you know what that was?

• 48:41Casey Newton?

  The word, I believe, was purple.

• 48:43Kevin Roose?

  It was purple. So to talk about how this challenge works, what this AI technology does, and what this might mean for history, we've invited Brett Seals onto the show. Brett Seals, welcome to Hard Fork.

• 48:56Speaker 05

  Well, thank you so much.

• 48:58Kevin Roose?

  First of all, can I just ask you, you are a computer scientist, not a historian or a classicist or a scholar of ancient Rome or ancient Greece. How did you get interested in these ancient scrolls?

• 49:12Speaker 05

  I am an imaging specialist, and I came through my graduate work as a computer vision specialist. The internet occurred, though, and pretty soon, images really became about the material that we wanted to digitize and make available in libraries and museums. And that was what pulled me into the world of antiquities. We did our first imaging at the British Library with the Beowulf manuscript. And we took images of it and created a digital edition. And during that time, the conservators said, it's fine to take photos of this beautiful manuscript, but how about this one over here that's so damaged, you can't even make a digital copy of it? What are you going to do about that?

• 49:54Speaker 05

  And it occurred to me, wow, museums and libraries are packed full of stuff that's never going to make it on the internet because we don't even know how to make a digital copy of it. What does that mean?

• 50:05Kevin Roose?

  And in terms of the significance of these particular scrolls, the Herculaneum scrolls, why are they so important for historians? What might they contain or reveal?

• 50:18Speaker 05

  There are a few reasons why Herculaneum is so enigmatic. It's really the only library from antiquity that survived, the only one. But another thing about it is that there are pieces of it that are still completely unopened.

• 50:35Kevin Roose?

  How many of these unopened scrolls are there?

• 50:39Speaker 05

  The unopened ones number in the 300, 400, 500 range, and counting is hard because they're fragmentary. Even the unopened ones might be two scrolls that are in three pieces, or one scroll in two pieces. So how do you really count?

• 50:54Kevin Roose?

  And it's the case that the lettering that is used, the words that are used, we sort of, we have an ability to read it as long as we can make out the characters, right? So the game here is just getting the scrolls in a position where you can actually see the characters that are written down. Is that right?

• 51:10Speaker 05

  Yeah, but I mean, we're using diminished imaging capabilities because the scrolls are completely wrapped up and we can't physically open them. If we could photograph them, every surface, we would be able to read everything that's there, but you can't open them for photography. So what we've been able to figure out is how software and AI and machine learning can overcome the fact that the diminished modality of X-ray creates a real challenge.

• 51:36Kevin Roose?

  Yeah. So you've been at this project of trying to read these scrolls using technology without opening them for many years. This is not a recent project that you started. So what are the big milestones or moments in your quest that stand out to you?

• 51:54Speaker 05

  Probably the most significant early moment was simply having the chance to take a crack at it in 2009. We looked inside a scroll for the first time ever. And so that was an incredible moment, but unfortunately, it wasn't a moment where we could read anything. We saw the internal structure, and we knew that the imaging would work, at least to show us the structure. But it became a real challenge to figure out how to move on from that.

• 52:20Kevin Roose?

  And can you explain, just in basic terms, how you were able to read the structure without opening the scrolls?

• 52:26Speaker 05

  The tomography that we use is exactly what you would get if you went to the doctor's office for an analysis of, say, a broken bone or a fracture. It's x-ray in 360 full round detail, but at a scale that is 10 times or even 100 times more precise than what you get at the doctor's office.

• 52:50Kevin Roose?

  Hmm. So where does the AI part come in to this process? What has AI been useful for in terms of deciphering what these scans of these scrolls are able to detect?

• 53:02Speaker 05

  The ink that was used in herculanium, when you look at that ink with x-ray, looks exactly like the papyrus that it's written on. It'd be like you wrote a memo to me in a white pen on a white piece of paper, and then I'm supposed to read that, because the visible light would not show me the difference between white ink and white paper. X-rays don't show us clearly the difference. And for a long time, people basically said, Seals is trying to do something that actually isn't physically possible, because x-rays just won't show the difference between the density of the ink and the density of the papyrus.

• 53:37Casey Newton?

  Wait, so you had like haters who were saying, he's never going to figure this out? Were they like posting on Reddit, or where was this happening?

• 53:45Speaker 05

  I wouldn't call them haters, but skeptics.

• 53:48Casey Newton?

  They sound like haters. Okay, skeptics.

• 53:50Speaker 05

  Let's call them skeptics, or let's call them even, you know, just nervous Nellies who are pretty sure we're not going to achieve what we're saying.

• 53:58Kevin Roose?

  So how did the AI help solve that problem of there not being a difference between the ink that was used on the scrolls and the papyrus itself?

• 54:07Speaker 05

  The thinking was to find a way for AI to bring its power to bear on this problem. Maybe the machine learning framework can be trained to detect that we're just not seeing with the naked eye. So we started to say, what if we showed the computer machine learning framework, examples of ink and examples of not ink, whether or not we can see any difference, right? And then see if we can learn it. And it can, it does. We've done those experiments. That was really the key that unlocked the whole thing.

• 54:37Casey Newton?

  Yeah, like if you've used Google Photos and you type dog into the search bar, Google's machine learning model has learned what is a dog and what is not a dog. And that's just an easy way of finding all the dogs in your photo. Of course, most of us can spot a dog with a naked eye. What we're saying is this technology has now advanced to the point where something that is much harder to discern to the naked eye now can be discerned.

• 55:00Speaker 05

  That's exactly right. And it's x-ray. So we are already a little bit at a disadvantage in seeing what that looks like because it looks different in x-ray. Everything does. Some of the ink actually is visible to the naked eye. And so the haters, if you will, who said you'll never see carbon ink.

• 55:17Casey Newton?

  Yep.

• 55:18Speaker 05

  Were wrong on two fronts. I mean, first of all, you can straight up see some of it with the naked eye. So they were completely wrong on that. And then the second thing is that the subtlety of it is actually teasable, you know, with the machine learning. And that's the part of it that you can at all see with the naked eye. And we can still see that, too.

• 55:34Casey Newton?

  All right. Well, so let's talk about the Vesuvius challenge. What was the actual Vesuvius challenge?

• 55:39Speaker 05

  We'd done all this work to confirm that the machine learning worked. We had the data in the can, but what we wanted to do is accelerate the work rather than the three or four or five people I have in my research team sort of hammering away. So Nat Friedman, who is former CEO of GitHub, pitched me the idea of a contest. And it turned out to be a brilliant idea, really. And I'm so glad we teamed up with him because it's hard work and the composite of all those people is a magnificent accelerated step forward.

• 56:16Casey Newton?

  And so what are all these people doing? Like, are they all running their own machine learning models? What are they doing?

• 56:20Speaker 05

  They're doing exactly that. I mean, we, we made a platform for them of a tutorial and we released all of our experimental code so that they could sort of run examples. And then we made all the data available so that really all they needed to do is exactly what you're saying, hey, I have a machine learning model, I'm gonna try it. Hey, I know where some ink is, I'm gonna make my own labels and I'm gonna run that.

• 56:44Kevin Roose?

  Right. So now you have this group of sort of technologists in Silicon Valley who are funding this prize to sort of incentivize participation in this challenge. You also have people, college students and other people with sort of technical expertise, actually writing AI programs to help decipher these scrolls. What do you think appeals to these tech people about this project? Because from where I sit, you know, we talked to a lot of tech people on this show, they're very interested in the future. They're not always so interested in the past and especially the ancient past. So what about this project to recover these manuscripts from antiquity, do you think has captured the attention of so many people in tech?

• 57:26Speaker 05

  You know, I don't really know. Kevin, I was hoping you would tell me, because I've been so embroiled in it that I have my own passion and it's hard to think outside of it. I have a theory. I know that the narratives that we construct and that people play for entertainment in those video game circles are very strong. And a lot of times, they have components that go back. Somebody's running through, you know, medieval Venice, for example. And I think there may be a strand that's intriguing that is about the mystery of the Roman Empire. That may be a thing.

• 58:00Kevin Roose?

  Well, and we know that men are always thinking about the Roman Empire.

• 58:03Speaker 05

  Is that true?

• 58:05Kevin Roose?

  That's a meme, at least, that's been going around, where you have to ask men in your life how often they think about the Roman Empire. Has no one asked you this yet?

• 58:13Speaker 05

  No, I didn't know that.

• 58:14Kevin Roose?

  Oh, they will, soon.

• 58:16Speaker 05

  They will.

• 58:16Kevin Roose?

  Some Gen Z student is gonna ask you how often you think about the Roman Empire, and your answer will probably be every day.

• 58:23Speaker 05

  I think about it all the time, yeah.

• 58:28Kevin Roose?

  I mean, my theory, and this could be totally wrong, is that it is just, it is a puzzle, and people love puzzles in tech, but it is also an area where something that used to be impossible, or was thought to be impossible, suddenly became possible because of AI. And that is just kind of one of these technically sweet problems that these folks love to work on. Also, a lot of them are big history nerds. So I think it's probably a combination of those things.

• 58:54Speaker 05

  Well, there is a deeply resonant, you know, thread that's going through the community, and it's incredibly varied. I mean, we're seeing in the Discord channel, paperologists talking with 21-year-old computer scientists and kicking ideas back and forth. I mean, I love that so much, because I think that our future world is going to require that we break down all these barriers of disciplines and also of interests, so that we get better communication.

• 59:20Kevin Roose?

  Tell me about the role that Discord has played in your project. I haven't heard about a lot of science that has a Discord component to this point.

• 59:30Speaker 05

  I think it's been hugely influential. I mean, the competitors, unlike what I thought would happen, I figured everyone would hold things pretty close to the chest, but at least in the early part of this competition, they readily shared some small victories and defeats and dead ends and so forth. It's been really collaborative, and I love seeing that.

• 59:48Kevin Roose?

  Has there been a culture clash between some of the sort of academics who have been working on this problem, and now these like, college kids who are interested in AI, and on Discord, sharing screenshots of their latest, you know, papyrus fragments? Has there been any tension between those groups?

• 1:00:04Speaker 05

  Oh, yeah. Oh, yeah. So a paperologist will go into the Discord and say, "I'm not even going to do a reading, because these images are changing so fast, and you guys don't understand paperology. You have to be really careful." And then you got, on the other side, you have the 21-year-old kid who's like, "I think that's a pie, and I think that is too. Hey, look at it."

• 1:00:21Casey Newton?

  This is important information for our listeners. If you're talking to a paperologist, just don't tell them that you're looking at pie, okay? You want to say, "This might be pie. It might be worth considering that this is pie." But if you're too confident, you are going to trigger them, and you'll Find yourself in a flame war.

• 1:00:38Speaker 05

  That's right. It is kind of triggering to have people who don't know anything about the language, and I would be one of them, to say to them, hey, how about this reading? You know, right? Yeah, yeah.

• 1:00:48Kevin Roose?

  Let's talk about this prize winner, Luke Ferrator. He recently won $40,000 for deciphering a fragment of one of these scrolls. So talk to us about his contribution. What was your reaction when he told you that he had made this discovery? And what did he actually find?

• 1:01:09Speaker 05

  I almost fell off my chair when I saw on my cellphone this word popping out, starting with pie. And if you've seen the image, the pie is so clear that I could have written it with crayon today. You know, I mean, it's just right there.

• 1:01:22Casey Newton?

  So Luke discovers the word purple. And I have to ask, Brent, what do you think was purple back in ancient times that they're talking about?

• 1:01:30Speaker 05

  Well, I have a pretty good guess because I'm as much of an armchair papologist as anyone else. And so, you know, I have Google.

• 1:01:38Kevin Roose?

  Yeah.

• 1:01:38Speaker 05

  Pliny the Elder wrote about purple coming from the mollusks, you know, as the Tyrian purple, the dye that the Romans used to make incredibly expensive clothing, robes that the wealthy wore. It could be referring to that. We also have these passages in the early Gospels where Jesus himself was on his way to being crucified, and he was mocked by being clothed in purple, which was a sign of somebody being powerful and wealthy and a king, and it was mockery, right? Because he was actually going to be executed. So those are the contexts we know. But what's really intriguing is that we don't know what this context is until we read a little bit more of the passages.

• 1:02:23Kevin Roose?

  Wow. Give us a sense of the progress that has been made so far. So this prize that Luke won, this $40,000 prize for deciphering this word, that was sort of an incremental prize on the way to the grand prize, which is $700,000, which is supposed to go to the first team that reads four passages of text from the inside of two intact scrolls. This has to be done by December 31st. How close or far do you think we are from that? Do you think this prize will be won in the next few months before the end of the year?

• 1:02:56Speaker 05

  What's been revealed now as part of the first letters prize for just $40,000 is about 25% of what we need to win the grand prize. So that's a substantial step. So what I think is going to happen is that things are going to accelerate and it's an existence proof that the prize is winnable. And so the odds just went way up that even by December 31st, which I think is still a really aggressive deadline, actually, but even by then, we may have people submitting and we have to evaluate that.

• 1:03:29Kevin Roose?

  Why is it hard for these techniques to generalize? Like now that you have an AI system that can read purple on one line, why can't you just feed all the hundreds of other scrolls into that same model and get back all of the other text? What makes it hard to make these gains now that you have the basic technology?

• 1:03:51Speaker 05

  The way machine learning works is that you're sampling from a really big probability distribution of the world. And you just don't have those samples when you begin the process. It's almost always incremental. So if you're going to do the dog recognition, like Casey mentioned, and you have pictures of dogs from only one kind of camera, you'd probably be able to learn how to recognize a dog in that one camera, but there are differences between cameras, right? And you have to learn those differences. So the next guy takes a picture with a different camera, can't find the dog. And it's exactly the same with this. The papyrus varies a lot in the way it was manufactured. It varies a lot in the way that you capture the X-ray images, the way that the papyrus

• 1:04:35Speaker 05

  twists and turns, there are a lot of variations. And until we can sample that distribution of all of those variations very well, we're just going to be, you know, ramping up until that point.

• 1:04:46Casey Newton?

  It would be really funny if you finally decode this thing and the first words are, "This is very private. I hope no one ever finds or reads this."

• 1:04:54Speaker 05

  You know, I've heard many variations on that.

• 1:04:58Kevin Roose?

  Yeah, my worry is like, what if it's just someone's grocery list? You know, what if this is not a document of any significance?

• 1:05:04Casey Newton?

  Right. Pick me up 14 purple grapes down at the bazaar on your way home, honey.

• 1:05:09Kevin Roose?

  Now, what are Casey and my chances of winning the $700,000 grand prize by December 31st? If we start today?

• 1:05:15Casey Newton?

  Yeah, how dumb can you be and still contribute to this project?

• 1:05:18Speaker 05

  Well, I'm part of it. So, you know, I mean, there you go.

• 1:05:23Speaker 05

  I think you have as good a chance as anyone else relative to the amount of work that you're willing to put in.

• 1:05:31Kevin Roose?

  Brett, we're joking around, but I really want you to sort of close this out by just giving us a sense of the stakes here. Why is this a project that is worth hundreds of thousands of dollars of investors' money? That is worth the effort and the labor of all of these researchers that are working on this crowdsourced science project? What is the pot of gold at the end of the rainbow? What do you hope humanity will gain from knowing what's in these scrolls?

• 1:05:58Speaker 05

  Well, we don't know what's there, and so revealing it is important. It's technical virtuosity in a way that we can feel good about instead of feeling frightened about. This is a good application of AI, revealing the past, restoring the past. So there's kind of a redemptive piece here that says, "I have something damaged and I'm redeeming it and we're going to be able to read it," pulling it back from oblivion. I think there's a broader, there's a broader thing here. When we go back far enough in history, we lose all the political boundaries and we lose all of the separators between us, and we find common humanity.

• 1:06:39Speaker 05

  And to be able to go back and think and talk and dialogue on those terms is tremendously important. And maybe, you know, this is just a proxy for us being able to do that. And it's really not about the material itself so much as our common humanity and being led to the important thing about our common humanity.

• 1:06:59Kevin Roose?

  I love that.

• 1:07:00Speaker 05

  Well, I was gonna ask a joke question, but then what Brent said was so lovely that now I don't want to. I think I just want, that's like such a lovely note to end on.

• 1:07:08Kevin Roose?

  Well, Brent, thank you so much for coming on and great to talk to you.

• 1:07:13Speaker 05

  Thank you, Brent. This is great. Good to talk to you, Kevin. Casey, thank you.

• 1:07:34Speaker 00

  Support for this podcast comes from Dell Technologies. It's time to put AI to work. Is your business ready? The challenge isn't getting started with AI. It's scaling beyond pilots while maintaining control of your data, governance, infrastructure, and costs. Dell AI Factory provides the integrated foundation you need to scale AI securely and efficiently with one trusted partner. Dell, AI on your terms. From idea to impact. Learn more at dell.com/yourwaytoAI. That's dell.com/yourwaytoAI.

• 1:08:08Speaker 03

  Building and scaling AI today can feel pretty chaotic, mostly because teams are juggling too many fragmented tools at once. That's where Outsystems comes in. Outsystems gives you one unified agentic systems platform to manage your entire portfolio of agents, apps, and workflows. You get to innovate at the speed of AI, but with the security, governance, and control your enterprise actually needs. And the results are already there. A major manufacturer used Outsystems to build a multi-agent system that analyzes blueprints, and a global bank cut their development time by 60%. Own your agentic future today at outsystems.com/nyt.

• 1:08:45Speaker 04

  AI spend is growing fast, but most businesses still can't see exactly where that money is going. Ramp gives businesses visibility and control across AI providers with real-time guardrails by team and model, helping ensure spend goes to the highest ROI areas. Stop guessing where your AI spend is going. Get started with Ramp. And if you're new to Ramp, you can get $250 off at ramp.com/hardfork. Go to ramp.com/hardfork. Ramp.com/hardfork.

• 1:09:19Kevin Roose?

  Hard Fork is produced by Rachel Cohn and Davis Land. We're edited by Jen Poyant. This episode was fact-checked by Will Peichel. Today's show was engineered by Alyssa Moxley. Original music by Rowan Nemezto and Dan Powell. Special thanks to Paula Schuman, Puywing Tam, Nell Galogly, Kate LaPresty, Ryan Manning, Dylan Bergerson, and Jeffrey Miranda. As always, you can email us at [email protected].

• 1:10:13Speaker 06

  75% of women who seek menopause care don't receive it. The lying awake at 3 a.m. wondering what's happening to your body ends now. Midi is virtual care built for women in perimenopause and menopause with clinicians who specialize in women's health. Plus, it's covered by most major insurances. Getting started is easy. You can book your first visit with a clinician right away. Midlife needs Midi. Visit joinmidi.com to book your first visit today. That's join m-i-d-i dot com. Insurance coverage varies. Check with your plan for coverage.