Humans secretly prefer AI writing

Reid and Aria unpack three emerging fault lines in the AI era: where real power sits in the AI stack, how AI is reshaping human creativity, and whether governments could ultimately treat AI as critical national infrastructure. Reid responds to Jensen Huang's "five-layer cake" framing of AI, arguing that while compute, infrastructure, and models carry geopolitical weight, the greatest economic value tends to emerge at the application layer. The episode then turns to a broader debate over a viral NYT experiment that pitted humans against AI writing. Reid and Aria close by examining Palantir CEO Alex Karp's warning about AI nationalization, weighing the tensions between innovation, national security, and democratic values as AI becomes foundational technology.

• 0:00Speaker 00

  Reid, delighted to be here with you today. Let's jump right into some AI questions. So Jensen Huang recently said that AI is a five-layer cake. The idea is that people talk about AI like it's just a chatbot or a model when it's really a full stack. So you have energy, chips, infrastructure, models, and applications. And his argument is that every flashy AI application at the top pulls on everything beneath it, all the way down to the power plant. And so it's not surprising that Jensen, of all people, would be saying this, but his comments suggest that the AI race may not ultimately be won just by whoever has the best app or even the best foundation model.

• 0:41Speaker 00

  It may be won by whoever controls the deepest layers of the stack, compute, power, data centers, and the individual base required to support all of it. And so, in other words, what looks like a software boom may really be an infrastructure and maybe even geopolitical build-out in disguise. And so I would love to hear from you. Do you agree with this framing? And when you hear AI described as a five-layer cake, does that change how you think about where the real power in the industry sits?

• 1:11Speaker 01

  Well, obviously Jensen and Nvidia have been doing amazing work. And, you know, one of the things I think Jensen is very good at is, you know, arguing, you know, his position very strongly. So it's like, no, no, what's most relevant is the people who are producing the chips. All right, let me tell you why. But, you know, by the way, the chips are super important. So I agree with the five-layer cake. There's actually even some additional complexity around data and all the rest. And I think that the fact is that when you think about kind of geopolitical power, actually, in fact, compute capabilities and compute infrastructure is probably actually something that's now highly relevant to geopolitical power.

• 1:58Speaker 01

  And you know, people think, oh, do I have the supercomputer to train a model? And digital sovereignty is one part of that. And I think that's potentially navigable. Like, it doesn't have to be that, you know, each significant country has its own, you know, hundred billion dollar computer for training its own model. But you will still need compute for inference. You'll need, you know, some kind of digital sovereignty in not having models be able to potentially be rug pulled from your nation's industries, national security apparatus, et cetera, is, you know, is kind of part of where to work. So I think it's absolutely right that it's geopolitical. Now, the thought that the, that that's where the real economics are, it's a place where real economics are.

• 2:43Speaker 01

  But it's a little bit like arguing, well, the internet's going to be a geopolitical thing. And so it's ISPs. ISPs are real control. And you look around, it's like, no, not really at all in terms of how this operates. And I'm not suggesting these are exactly the same. Because, among other things, you know, the ISPs are much more, you know, commodities and, you know, can hook up a whole bunch. But it's the reason why it's not necessarily the most foundational part of the layer is not necessarily where the most value or power accrues. I do think that the, that all of the five layers that he describes are actually, in fact, pretty important.

• 3:24Speaker 01

  And I think that historically, when you get to where the most economic value ends up, you know, kind of accruing, the kind of, the area where there is the most, you know, kind of, you know, economic power in these kind of things tends to be closer to the top of the layer, you know? And so, like, for example, it's like, it's like Google, right? Makes its money from AdWords. And yes, it powers the whole thing from having a, you know, very deep computational stack. It's kind of the most of a complete, the five-layer cake, you know, from the search realm and just trying to do that from the AI realm.

• 4:03Speaker 01

  It's not necessarily it's because, oh, because we have all this lower level of chips that this, that this particularly plays out. So I think that it's, it's, it's, there's real power at every level, more so than just the ISPs. Uh, and I think it's an important thing for You know, kind of countries, industries to think about all these and additional things like data, like data is one of the things where there's a lot of vague claims and actually is going to play out in particularly interesting ways.

• 4:33Speaker 00

  Well, obviously, this is not an investment advice podcast, but if you had to choose only one layer of the cake to invest, what would you choose?

• 4:43Speaker 01

  Well, it's a complicated answer in part because I'm a software guy. So it's like, you know, what do I?

• 4:48Speaker 00

  So for you.

• 4:49Speaker 01

  Yes, for me, that's the one part. But also, by the way, it tends to be the, well, you know, what kind of investing game are you doing? Like you're investing in startups, investing in startups that have to do with compute, have to do with power, have to do with data centers, you know, kind of are all, you know, hazardous investments from the viewpoint of intensity of capital, ease of failure, you know, et cetera. It can be done. There are good, there are good things that happen there, but like tons and tons of very high costly failures. One of the benefits of software is that software tends to be more capital efficient.

• 5:26Speaker 00

  Right.

• 5:27Speaker 01

  Now, it's a little tricky when you get to the, to the, you know, AI model construction, which is closer to the high capital.

• 5:35Speaker 00

  Totally.

• 5:36Speaker 01

  You know, kind of ways of doing it. But that's the reason why, like, I tend to be in applications and models and, you know, other places where high, you know, high capital efficiency for how you play them.

• 5:47Speaker 00

  Well, so let's move from the economic to the more philosophical. So many of our listeners probably saw that the New York Times, they published a blind quiz and they were asking readers to compare human writing versus AI writing. And the result definitely hit a nerve online. And so this was taken by more than 86,000 people and readers slightly preferred the AI passages overall. And what was interesting is the reaction was sort of in two directions. Like one camp said, this proves that most writing people encounter every day is already generic enough that AI can beat it. Other camp said, like, the quiz misses the point, like, short, decontextualized passages

• 6:27Speaker 00

  are exactly where AI performs the best and the real value of human writing is, is voice, is investigative reporting, is structure, is taste over long arcs, is long novels, is writing style. And so what do you think, like, people are actually reading into these human versus AI writing debates? Why does this strike such a nerve?

• 6:48Speaker 01

  Well, I'll answer your direct question first and then go to the rest. Look, it strikes a nerve because people are fearful of replacement in multiple ways. They're fearful of replacement for economic job and safety and security. They're fearful of replacement from a, you know, kind of the notion of purpose in terms of what like my significance is, like what makes me like, what makes me as a writer, me as a human being, me as a, you know, et cetera, et cetera, unique. And so all of a sudden you go to, well, wait a minute, you know, what's going on here?

• 7:28Speaker 01

  So it's that whole range of things is why people have such intensity on this discussion. And by the way, it's one of the reasons it's important because, you know, I as a, you know, as you know, I kind of think of myself as a techno humanist. So I think that, you know, what is human is super important and what is, and, and, but I also think of as homo techne that we evolve through our technology. It's, you know, everything from fire and, you know, agriculture that causes us to be, you know, be able to aggregate in the cities, you know, all the way up into, you know, creation of machinery and power and books and all the rest.

• 8:10Speaker 01

  And that's how we evolve and changes our, our, our, our, our way that we think of ourselves, the way we think of the world, the way we have epistemology. You know, the whole world changes through the lens of a microscope, you know, as a, as a kind of instance. And AI is, I think, another one, which of course has the, the greatest, you know, kind of challenge so far. Because it's like, well, you know, we think of ourselves as the only things that have agency as humans, with some asterisks around animals and maybe some blindnesses around corporations, you know, as collections of humans. But the, the reason our super agency is because it's like, oh my God, this new thing challenges our agency in a way

• 8:52Speaker 01

  that other technologies, which we had discussion about how they change our agency is more fundamental because maybe it's somewhat autonomous. And maybe it does things that we previously said was only human, e.g. like writing, you know, as an instance of this. And that's why the navigation of this is really important. And that's part of the reason why we do this podcast, we're at super agency and everything else to say, here is how we navigate. Getting a stronger agency through this path. And it doesn't mean that doesn't transform, doesn't mean that previous things that you would really like, you know, are now different in the age of AI. And I think this, you know, I think that the times that a clever thing with this blind quiz, because I think both camps are right.

• 9:38Speaker 01

  I think that the, that the camp that says, look, a lot of writing is already pretty generic. And by the way, AI is already good enough to do it. That's pretty straightforward. And by the way, everyone who uses these, you know, kind of AI agents to, for example, produce a custom kind of equivalent of a Wikipedia page answer or report or something else goes, this is perfectly good for the kinds of things I'm looking for, for my, for my search for, for something. And by the way, short form makes it even easier. I mean, this is, you know, one of the things I missed when, you know, Twitter was created was like, it's like, God, this dumb, it's like, no, no, actually people want short form

• 10:21Speaker 01

  because in short form, no one can be particularly smart. It was very hard to be particularly smart and everyone looks kind of sufficiently also banal. And so it goes across the whole thing. And that was part of the reason why it was something in addition to blogging or blogging was no, you had to write something, you know, substantive. And so I think that the, that there is a lot of the short form and AI does that. And by the way, I think AI does some long form perfectly well too, for different contexts. But that doesn't mean that there isn't like, like I can still tell, like, there's a whole bunch of writing tasks where humans, yes, they have, it's more expensive, it's more challenging to do, but like, humans do a much better job.

• 11:04Speaker 01

  Now, the challenge will be which areas will be economically viable for the humans doing a much better job than the automation of the AI. And that's the kind of the, the brass tacks of it. And you said, well, you know, I used to hire human writers to write the manual for the product. And it's like, well. You're probably not going to have to do that anymore. And it doesn't mean that there won't be someone who, a human who is iterating with the human, the AI to get the writing of the manual done the right way or done in new ways or better ways, because it's now kind of this more efficient way. But it's like, I no longer have to pay a writer,

• 11:45Speaker 01

  you know, at whatever the going market rate for writers is in order to do that, if I had some reason not to do it or wasn't trying to get better. And that's part of the last underlying thing in this, in this issue. Now, as per super agency, my hope and expectation and part of what we try to shape it to is actually, there's still a lot of role for doing writers, not just because there's a bunch of stuff where AI falls flat itself today. Just try to get it to write good dialogue as one example, just as an example today. But there's a lot of other things, including all the things, the, you know, question of, you know, reporting, lived experience, believability. Do I want to be hearing from a human on this particular topic versus, you know,

• 12:30Speaker 01

  the canned synthesis of AI, you know, et cetera, et cetera. But it's also the question of which of these areas are going to be the areas that we go, this economic model works for the production and consumption. I think people will begin to realize that it's actually, in fact, useful and even good in some ways. Like I, you know, here's the thing is I, the part of the canary that I've been tracking for where will job replacement really happen is customer service, as you know.

• 13:01Speaker 00

  Yep.

• 13:01Speaker 01

  And I think we're still in the early days of that here in 26. You know, I think that from what I see is, you know, companies are engaging, you know, companies like Sierra, Parlor, or others in customer service and getting good results. And I think they're expanding their footprint with it. I think they're still working out a lot of different things. And I think the businesses are doing quite well as part of it now. But like, What you really want to get to is where the customer says, please put the AI on.

• 13:31Speaker 00

  Right?

• 13:32Speaker 01

  Right? Right, where it's like, they, no, no, no. And, and they'll do that through experience because they'll go, well, wait a minute. Actually, in fact, the AI that directly interfaces with all this stuff as opposed to a human who doesn't really understand all of it, is trying to follow a database script that what they are, and the human kind of stumbling over themselves, following a database script and probably outsourced to the Philippines or India because it's much cheaper and then is even a little bit more, you know, not sharing in context that the AI is so much better. It's like, well, that's better. Right? And that, that's why I think, and then, then, once people begin to get to the, oh, AI's better here. Then I, then I have areas where I prefer it.

• 14:14Speaker 01

  And, and this is part of the thing where I'm trying to get people to own their own agency is like, obviously, if you have exposure, if you have a, have a, have a doctor, you should always talk to your doctor for these things. But by the way, if you're talking to your doctor and the two of you aren't using frontier models to second, second, you know, opinion, what you're doing, like on the spot, it's, it's bad for both of you. You should be wanting the AI, wanting to do that because it helps you in really critical ways. And by the way, if you don't have access to a doctor, it was like, oh, the doctor is like a clinic that's a four hour drive away, or I don't have one whatsoever, well, stir with the AI. Know whether or not you should get in the car and bring, be bringing your, your kid to the clinic.

• 14:59Speaker 00

  All right. So we talked about economics, sort of humanity philosophy. Now we're going to end with still AI, but politics. So Alex Karp recently warned the tech industry that they may be headed towards nationalization. So his argument was basically the tech companies are simultaneously saying that AI is going to wipe out huge numbers of white collar jobs, but they're also refusing to align with US national security interests. And so if that's true, they shouldn't be surprised if it ends up that the government is moving towards some kind of nationalization of this technology because it's sort of a direct threat to our way of life. When Alex Karp said this, he was obviously poking a bit at Anthropic.

• 15:43Speaker 00

  We all know sort of their, their fight with the State Department recently and the Department of War. But people took the idea further than that because AI is starting to look less like a normal consumer product and more like critical infrastructure. It has implications for war, intelligence, labor markets, industrial policy, sort of all of those things at the same time. And so with this technology becoming foundational enough, maybe it's, makes sense for governments not to treat it, you know, just like a normal private market company. So when someone like Alex Karp talks about the possible nationalization of technology, how much do you think this is just rhetoric? He wants clicks, he wants headlines? And how much do you think we should actually pay attention to what he's saying?

• 16:24Speaker 01

  In this kind of age of disruption, everything going on, people might do a lot of stupid, foolish things. So you should always pay attention, especially when, you know, people with some, you know, technological knowledge and position are also kind of making what I think is incorrect and clumsy arguments. Now, part of it is you get to this kind of question of, you know, this old parable about wise people and elephants. Now, this one has a trunk and that one has the tail and these two have different legs and that one has a tusk and so forth. And part of what you have to do is you have to kind of look at AI as the whole elephant. And you go, look, there's a national security thing, you know, one of the legs really, really matters, of course. And so it's like, well, if you guys don't confer to what's best for the national security

• 17:07Speaker 01

  thing, then, you know, you could just get nationalized, kind of a simple argument. The question is, you know, like, okay, how do you look at the whole elephant? Because you don't get the national security without all of the economic power and everything else. And going and nationalizing an industry is a sure way to say, stop innovation.

• 17:27Speaker 00

  Right.

• 17:27Speaker 01

  Don't build anything more here, et cetera, et cetera. And when the thing that matters is the most speed and iteration and compounding going in the future, that's, that's the definite way to kill the golden goose, but you know, it might be like, you know, dump radioactive acid on the golden goose as a way of doing it. So I think it's a, an unwise statement, thought, et cetera. Now, that being said, I didn't say that it wasn't important for national security in countries to be thinking about like, okay, we've got this fundamental technology. How does this play into our national security interests and companies? Need to, to, to, they're located in countries, they're located in countries that provide the national security, you know, you know, fortunately so far, you know, the,

• 18:12Speaker 01

  the AI leads have come from countries that have an interest in, you know, global stability, although, you know, the recent year and a half with the, with the current administration, you know, seems to be less interested in global stability than former American administrations. But like so far, like, you know, we, China, US, you know, and bits in Europe, that interest in global stability, it's not Russia, you know, it's not, you know, it's, it's, it's kind of like, it's folks who are like, you know, kind of playing for, we should have global stability and everything else. And I think that's an important thing. And I think tech companies, like every tech company I talk to, is actually bought into being

• 18:56Speaker 01

  an American company, you know, participating in global stability and so forth. And like one of the things that was way under commented in the Anthropic discussion, you know, from what I can tell is, you know, Anthropic's point was, you know, no mass surveillance of American citizens, which is by the way, just saying legal. And so you could, we can ignore that because that's just saying we're operating legally. You could say, you know, obey the American law. And it's like, okay, that, I, I, any contract in America, you could say, that's fine, I can ignore that sentence, right? That doesn't need to not be in the sentence. And then the other one is autonomous lethal weapons, which is that's our technology is not ready for it yet.

• 19:40Speaker 00

  Right.

• 19:41Speaker 01

  And so you're like, okay, the provider is saying our technology is not ready for that yet. So we don't want to be, we don't want to be doing that. And by the way, country that's free, we can say, hey, like, we can provide services or not provide services. And if you want to go provide, take services from someone else, who says their technology is ready for, for, you know, AI autonomous weapons, you can do that. We think that's super dangerous, but that, we're not, we're not, you know, we're not standing in your way of doing that. We're not saying you can't do that. And then of course, this all becomes reframed entirely in this basis by those people,

• 20:23Speaker 01

  which is, by the way, value destructive. It's anti-American versus serving the American interest in terms of what this is. And so, so it's like, you know, it's like, look, that, that, the, the whole threatening position of this is, I think frankly, anti-America's interests, you know, anti, you know, kind of what we should be doing. We should be going, great, we have, like, for example, say, well, but, you know, Anthropic with Claude Code has the best coding agent that we're all using. Great, that's awesome for us as Americans, you know, how do we navigate this? Not, you know, you need to be, you know, because by the way, American companies do not have to do whatever the Department

• 21:05Speaker 01

  of Defense tells them to do, right? Especially when we're not, you know, they're like, well, we're not in a time of war. It's like, well, yeah, because Congress hasn't declared war yet.

• 21:15Speaker 00

  Right.

• 21:16Speaker 01

  So, so the issues around being in a time of war is when Congress declares war. And Congress can tell companies, you're now behaving as, as if you're in a time of war. Right? That's part of why we have Congress and the declaration of war. And so, it's like, okay. And I do think that this technology, now that the underlying thing that's really important here is, the technology is important geopolitically for power, for national security. And I think it's really important that, that we do that. But by the way, even in this recent, you know, brouhaha, the Anthropic people think that too. They're like, how do we help America in this position?

• 22:00Speaker 00

  Totally.

• 22:01Speaker 01

  So, it's, it's, it's only the, the framing of, you have to, you know, you have to do exactly what I tell you to do, which is not land of the free. I suspect it's not even home of the brave, you know, in this. And so, I think it's, it's important for the tech industry to say, hey, look, like, yes, we are providing, we are partnering. I mean, I think, you know, Microsoft has always done a really good job of, we collaborate with, you know, the, the US and Western democracies for a well-ordered global society. That's what we do.

• 22:40Speaker 00

  Well said. Reid, appreciate it. Thanks so much.

• 22:43Speaker 01

  My pleasure. Possible is produced by Palette Media. It's hosted by Ari Finger and me, Reid Hoffman. Our showrunner is Sean Young. Possible is produced by Tanasi Delos, Katie Sanders, Spencer Strasmore, Imo Zhu, Trent Barboza, and Tafadzwa Nirmurundwe.

• 22:59Speaker 00

  Special thanks to Surya, Yala Manchili, Sayida Sabieva, Ian Alice, Greg Beato, Parth Patel, and Ben Ralas.