Can Humans Stay Smart in the Age of AI? (David Krakauer, President of the Santa Fe Institute)

David Krakauer is a leading complex systems researcher and the president of the Santa Fe Institute, a unique institution dedicated to studying complex systems across disciplines. In this episode, David challenges conventional wisdom about AI, arguing that large language models pose a more immediate threat to humanity than commonly discussed existential risks—not by destroying us directly, but by eroding our cognitive capabilities through addictive, low-quality information. We explore: • Why David believes LLMs aren't intelligent at all and how the AI community misunderstands emergence • The three dimensions of intelligence: inference, representation, and strategy—and which one LLMs lack • How AI acts as a "competitive" rather than "complementary" cognitive technology, atrophying our thinking abilities • What makes great minds unique, from analogical reasoning to the cultivation of unconscious creativity • How Cormac McCarthy's approach to knowledge and creativity offers lessons for the AI age • Why David believes the greatest threat from AI isn't existential risk but cognitive atrophy • How to protect your mind against AI's addictive pull and maintain cognitive autonomy — Thank you to the partners who make this possible Brex https://www.brex.com/mario: The banking solution for startups. Enterpret https://www.enterpret.com/mario: Transform feedback chaos into actionable customer intelligence Persona https://withpersona.com/generalist: Trusted identity verification for any use case — Transcript: https://www.generalist.com/p/maintaining-human-intelligence-in-the-ai-era-david-krakauer — Timestamps (00:00) Intro (04:39) The Santa Fe Institute’s approach to complex systems (06:45) Murray Gell-Mann’s ‘Odysseus vs. Apollonian’ (10:35) How SFI was shaped by the legacy of Los Alamos (12:45) Traits David looks for in great minds (14:43) Cormac McCarthy on naivety and how thoughtful people treat knowledge (19:24) A simple explanation of complexity science (22:50) Why vantage point doesn’t matter when studying systems (24:36) Aesthetic preferences among complexity scientists (26:07) Films and directors with complexity science themes (29:57) Why David argues LLMs are not intelligent (32:10) What’s missing in the study of LLMs (36:40) The three qualities of intelligence and how LLMs measure up (42:19) Lessons from "The Glass Bead Game" (44:00) David’s perspective on reinforcement learning (45:38) The greatest threat of LLMs: overreliance and the decline of thinking (47:40) Competitive vs. complementary cognitive artifacts (51:55) Why exposing yourself to quality ideas matters (54:00) How to derisk LLM use (58:32) Cormac McCarthy’s legacy at SFI and beyond (1:02:40) The Kekulé Problem: cultivating the unconscious (1:05:01) Why David and McCarthy were inspired by Wittgenstein (1:09:00) What Cormac McCarthy liked to talk about (1:12:20) David’s questions to a higher being (1:14:46) Final meditations — Follow David Krakauer Website: https://davidckrakauer.com/ — Resources and episode mentions —Books— • “The Hedgehog and the Fox”: https://www.amazon.com/Hedgehog-Fox-Tolstoys-History-Second/dp/069115600X • The Birds and The Frogs: https://www.amazon.com/Aristophanes-Frogs-Birds/dp/B000QBPUTY • The Glass Bead Game: https://www.amazon.com/Glass-Bead-Game-Magister-Novel/dp/0312278497 • Frankenstein: https://www.amazon.com/Frankenstein-Mary-Shelley/dp/0486282112 • Blood Meridian: Or the Evening Redness in the West: https://www.amazon.com/Blood-Meridian-Evening-Redness-West/dp/0679728759 • Stella Maris: https://www.amazon.com/Stella-Maris-Cormac-McCarthy/dp/0307269000 • The Passenger: https://www.amazon.com/Passenger-Cormac-McCarthy/dp/0307268993/ • Pale Fire: https://www.amazon.com/Pale-Fire-Vladimir-Nabokov/dp/0679723420 ... Episode resources continued at: https://www.generalist.com/p/maintaining-human-intelligence-in-the-ai-era-david-krakauer — Production and marketing by penname.co https://penname.co/. For inquiries about sponsoring the podcast, email [email protected].

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Mario Gabriele?

  You've spoken before about your concern that LLMs act as such a tempting mental prosthetic for people that if we're not careful, and perhaps even if we are careful, can't help but allow it to atrophy our own cognition.

• 0:13Speaker 01

  I think it's really much more dangerous than people realize. You just have to look at the opioid crisis or the sugar crisis. These are all essentially about easy access to either long-term, non-nutritive sources of foods or materials that are addictive. I'm concerned that LLMs in their current incarnation are like sugar cocaine.

• 0:37Mario Gabriele?

  The optimistic part of me hopes that we're going to see people find ways to use LLMs and AI in a more complimentary way. What is a thinking person's best course of action?

• 0:53Mario Gabriele?

  Hey, I'm Mario and this is the General's Podcast. As the saying goes, "The future is already here. It's just not evenly distributed." Each week, I sit down with the founders, investors, researchers, and visionaries who are living in the future to help you see what's coming next and understand it more clearly. Today, I'm speaking with David Krakauer, a leading complex systems researcher and the president of the Santa Fe Institute. David leads one of the world's most unique institutions. It's home to a dizzying interdisciplinary collection of scientists, artists, and thinkers, united by the mandate to "search for order in the complexity of evolving worlds."

• 1:35Mario Gabriele?

  In our conversation, we explore why large language models may not be intelligent at all, the risks of AI usage destroying our cognitive capabilities, the surprising qualities of great minds, and what David's friendship with legendary novelist Cormac McCarthy taught him about the single-minded pursuit of excellence and the cultivation of unconscious creativity. I walked away from this discussion fizzing with new ideas about the nature of intelligence, the unique representational value of literature, and how each of us must work to maintain our human agency. If you liked today's discussion, I hope you'll consider subscribing and joining us for some of the incredible episodes we have coming up.

• 2:18Mario Gabriele?

  Now, here's my conversation with David Krakauer. This episode is brought to you by Brex. Fred Adler, the influential venture capitalist of the 1970s, was known for displaying decorative pillows in his office that featured a signature business philosophy: corporate happiness is positive cash flow. In today's post-Serp environment, Adler's wisdom feels particularly relevant as founders need to make every dollar work harder. That's exactly what Brex delivers. Their modern finance platform was built specifically for startups like yours and designed to help extend your runway when capital efficiency matters most. With Brex, you get global corporate cards with up to 20x higher credit limits

• 3:01Mario Gabriele?

  and no personal guarantee required. Their banking solution has no minimums and no transaction fees, while letting you earn high yield from day one with same-day liquidity. Best of all, Brex knows you were born to build, not juggle spreadsheets and finance tools. Their AI-powered platform brings cards, banking, expense management, and travel all in one place. It's simple, scalable, and designed to get you back to what you do best: building. More than 30,000 companies, including 1 in 3 US venture-backed startups, trust Brex to help make every dollar count toward their mission. Join them at brex.com/mario.

• 3:45Mario Gabriele?

  This episode is brought to you by Interpret. Interpret is a customer intelligence platform used by leading CX and product orgs like Canva, Notion, Perplexity, Strava, Hinge, and Linear to leverage the voice of the customer and build best-in-class products. Interpret unifies all customer conversations in real time, from Gong recordings to Zendesk tickets to Twitter threads, and makes it available for your team for analysis and action. What makes Interpret unique is its ability to build and update a customer-specific knowledge graph that provides the most granular and accurate categorization of all customer feedback and connects that customer feedback to critical metrics like revenue and CSAT. If modernizing your voice-of-customer program is a 2025 priority, like it is for customer-centric companies

• 4:29Mario Gabriele?

  such as Canva, Notion, Perplexity, and Linear, reach out to the team at interpret.com/mario. That's E-N-T-E-R-P-R-E-T.com/mario.

• 4:41Mario Gabriele?

  I must say, I've been really looking forward to this. I've followed your career from a distance for a long time and some of your writing and public thinking. I can't say that I can fully grasp all of it, but I've certainly enjoyed it. And maybe the place to start is with a brief introduction about the Santa Fe Institute, of which you're the president. For folks who might not have heard of it, or really just heard of it in passing, how would you describe SFI's mandate and place in the world?

• 5:13Speaker 01

  Yes, so the Santa Fe Institute is in Santa Fe, New Mexico. People ask, so I have to say that. And so, up on a mountain, we have two campuses. We were founded in 1984, essentially to study complex systems. And our mission statement is "Searching for Order in the Complexity of Evolving Worlds." Okay? So it gives you a sense of the modesty of the enterprise. We're not particularly interested in disciplines. It's not how we think. Where, one way to think about it is we're principles first.

• 5:58Speaker 01

  So collective intelligence, scaling, robustness, that sort of thing, information computation. So we make those the central hubs, and then disciplinary domains become spokes. And the wonderful thing about that is you get this very natural affinities being established between researchers from very different fields. And so, in a way, we're, on the one hand, very foundational, new principles for the complex world, we can get into that, but we're also interested in the systems of the world. Right, so how does the economy touch the climate?

• 6:43Speaker 01

  How does that touch psychology and so on? So in our sense is that if there's anything that's changed in the 20th century, it's the density of connections between the systems of the world or among the systems of the world. And so how do we think about that in a principled way as opposed to just bloviate? Or have opinions without a rigorous foundation?

• 7:04Mario Gabriele?

  I think the dividend of that is that, yeah, SFI seems to have collected and sort of moved through this rotating cast, as you said, of some of these really fascinating interdisciplinary minds. And in reading more about the history of SFI, I was reading how one of the founding fathers and legendary physicist Murray Gell-Mann describes the desire to find Odyssean or Apollonian figures. And on the one hand, I know what he means, but on the other hand, I'm curious how that really shows up. And so I wonder, how do you think about what that sort of Odyssean figure looks like, especially in the modern world?

• 7:44Speaker 01

  Yeah, so that's interesting. There's a long tradition going back to classical antiquity of creating binary oppositions to establish, if you like, forms of disposition. The most famous comes from Archilochus, and it was made famous by Isaiah Berlin. That's the fox and the hedgehog, right? That's what most people know. Sort of the hedgehog is interested in one big idea and pursues it. The fox is restless and pursues multiple ideas, but somehow with less dead. Both are important, right? And he was interested in Dostoevsky and Tolstoy. That was the contrast that he was making, where in that case Tolstoy was the frogs.

• 8:29Speaker 01

  The other one that's famous, and I'm getting there, is Aristophanes, The Birds and the Frogs, and that was made famous by the physicist Freeman Dyson. And in particular, as a means of classifying mathematicians.

• 8:44Speaker 01

  And the frog, it has a very aerial view and everything looks vast and they pursue problems right in front of their face. They're very difficult problems. Whereas the bird has a synoptic view of mathematics as a whole, an aerial view. And, you know, you can think about langlands as maybe bird-like and coxata as maybe frog-like, both extraordinary. So I think Murray was a bit envious and wanted his own version. So he stole from Friedrich Nietzsche. In his first book, The Birth of Tragedy, Nietzsche talks about the Dionysian and the Apollonian, the interest in chaos on the one hand, and the interest in order,

• 9:26Speaker 01

  the timeless and the timeless-ness, the immortal versus the mortal. And so he said, if in some sense, complexity is about the balance of the order and disorder, what comes in the middle? What's between Apollo and Dionysus? He sort of, in some sense, fused Hesiod and Homer and said, well, let's take Odysseus, who's kind of in another domain to Apollo and Dionysus. And the idea of the Odyssean is the complex, which is the world that is ordered and disordered in equal measure. And Odysseus is coping with that world, the

• 10:07Speaker 01

  world of the gods, the classical world, the world of order, and the world of humans, the world of disorder. And so he felt that would be a good model for the kind of scientist he wanted, on this long, sort of hopeless voyage back to Penelope, you know, where in this case, Penelope stands for truth. And what that turns into in practice is my problem.

• 10:35Mario Gabriele?

  Wow. So interesting. I'm so glad I asked that. So much of SFI seems to have these tendrils into with Los Alamos and the history of that group of scientists, with the history of the desert. How has the tenor of SFI been influenced by that heritage, would you say? Because there's sort of these, you know, this obvious intellectual transference, maybe that happens. But when we're talking about things like order and disorder, I imagine even at this like very philosophical level, there are connections there.

• 11:07Speaker 01

  Yeah, I mean, it's a whole... Part of our mythic foundation. On the one hand, yes, that we're born from the most destructive force ever invented by humanity.

• 11:22Mario Gabriele?

  Yes.

• 11:23Speaker 01

  In the Manhattan Project, that's significant. So that as backdrop is important to us. You know, talk about creative destruction. There you go, there you go. And so, but of course, that project was supported by an extraordinary cast of minds. And so to the extent that independent almost of the particular project that they were working on. If you look at that cast of extraordinary, mainly Hungarian immigrants, you know, Wigner, Zillard, Ulam, von Neumann.

• 12:04Speaker 01

  That mindset, super polymathic, unbelievably rigorous, very historically rooted, aware that there was a, an issue in the world they had to apply their mind to that was important at the time. Of course, at that time, it was World War Two. That conjunction of a sense of importance

• 12:25Speaker 01

  and a belief that your rigorous ideas that seemed detached from application were important has always informed our sensibility. So both dimensions, that the, the, the grandeur and scope of the project and the kinds of minds those projects require.

• 12:45Mario Gabriele?

  In your role as president, I imagine you're sort of have to play the part, a bit of a talent spotter or perhaps a talent wrangler. Have you come up with your own heuristics of what an Odyssean looks like, or, you know, a bird or a frog or something else that you think, you know, I'm able to turn over all the shells on the beach and, and find the one that is, you know, inflected in just this magical way that, that really fits us.

• 13:12Speaker 01

  No.

• 13:14Speaker 01

  So, I mean, although there are characteristics, there are characteristics. And

• 13:23Speaker 01

  so a deep appreciation for expertise.

• 13:28Speaker 01

  Right, that, you know, we all know that, right, when we see it, if you become expert, you spot experts. That's what you're good at. That's true in sport, it's right, it's true in mathematics, it's true in music. If you're a good violinist, you know what a good violinist looks like. And it takes an expert to spot an expert often, not always, but often. That's one. And, and that has all sorts of sequelae, right, what that looks like, what that feels like. And the other one is a kind of interesting one, which is analogical reasoning. I feel very often talking, you know, that I've spent too much time in a bath of Nobel laureates.

• 14:06Speaker 01

  And one of the things that I note is, oh, this is like that. Oh, let me explain, this feels like that. Or that, that desire to communicate via structural analogy, it seems very strong as an impulse. It's not always illuminating, right? And it's not necessarily always exact. But I think there's this kind of looking at the Rubik's Cube from many different angles and rotating it into new configurations seems to be something like, that's an empirical observation, really, more than anything else.

• 14:43Mario Gabriele?

  Wow, how interesting. One of the, you know, members of the institute, I don't know if you, if you call them members or not, but, you know, one of the cast of characters was, you know, the great writer Cormac McCarthy. And in your, your essay that you wrote about him a few years ago, you talk about how he sort of almost considered some degree of inexperience important in generating novel ideas. And, you know, I think you also at some point cite Montaigne and how, you know, he talks about the minds of critics being bogged down with the sort of almost too much context. And when you talk just now about sort of expertise, experts recognizing other experts, I wonder how you find people who

• 15:25Mario Gabriele?

  both have expertise, but somehow have enough of that ingenuity or creativity to not be sort of bogged down by it.

• 15:35Speaker 01

  So in relation to Cormac in particular, he was very interested in naivety.

• 15:44Speaker 01

  As a principle and he was very interested in ancient Greece and their belief that everyone else was a barbarian, interested in what did that, why was that? And their enormous naive belief in the excellence of their understanding. So there's a kind of juvenile characteristics to antiquity that attracted him. And I think it's the same structure as his interest in early quantum mechanics, where a lot of very young gifted minds, you know, Heisenberg, Schrödinger, all these, De Broglie, all these people. I think he was drawn to the same thing.

• 16:29Speaker 01

  So when, when we talk about Montaigne and, and those interests of Cormac, I think he associated that with a certain attitude towards being limitless and, and that knowledge would become a hindrance to your intellectual ambition. That's one part of it. I think that's very strong in him. And I think it just, it recurs throughout his interests. And I guess we'll talk about that concern at some point, but it's there in him too, right? It just keeps coming up over and over again. This, I guess it's kind of a profile of combination of a sort of extraordinarily wise infant. I mean, it's just weird combination. And it feel, and

• 17:14Speaker 01

  you feel it in his novels, right? I mean, many of his characters have that character too. And I think, now with respect to the other question of being bogged down in knowledge, I mean, it's, it's, you know, there's this quote I quite like, which is that you can become knowledgeable with other people's knowledge, but you cannot become wise with other people's wisdom. And I don't think you can be too knowledgeable. And I think it comes down to how you use it. So here's an, here's an analogy for you. So me, I can give you a building. Yes.

• 17:52Speaker 01

  I'll give you Gaudi's beautiful, and Théophile Familia. And you look at it, you dissect it, you destroy it in your mind, not in, not in reality, in your mind. And in order to reconstruct for yourself an edifice. And for me,

• 18:14Speaker 01

  Thoughtful people treat knowledge that way. They treat it as a composite to be understood in terms of its parts and its rules of construction.

• 18:27Speaker 01

  People who are not so thoughtful just take on the structure wholesale. And so, and that has the character of fact, not of knowledge. This is what such and such says. It it it's often, it manifests as an appeal to authority. And I feel as if the right way to use knowledge is to disrespect it. And and respect it, right? Respected by disrespecting it in the most profound way, by using it as a means of constructing your own. And I think one of, again, one of the problems of the current moment, actually, with L L Ms and so on.

• 19:06Mario Gabriele?

  Yes.

• 19:07Speaker 01

  Is that it's really knowledge as fact.

• 19:10Mario Gabriele?

  That is very true.

• 19:10Speaker 01

  Knowledge as system.

• 19:12Mario Gabriele?

  Yes.

• 19:12Speaker 01

  Which is somehow a different way to think.

• 19:15Mario Gabriele?

  Yes, in a way, to disrespect something properly, you at least have to understand it.

• 19:20Speaker 01

  Exactly.

• 19:21Mario Gabriele?

  Rather than just repeat it. Well, I definitely want to talk more about L L Ms, but I'd love to sort of discuss your specific discipline first a bit more, which is complexity and complexity science. And in trying to ground myself at least a little bit in understanding what that is, I sort of went through your colleague, Melanie Mitchell's, has sort of any learning experience about the introductions to complexity science. And I was gratified to discover that it's very hard to explain even to people who, or, you know, even from practitioners, you know, many of the different experts she talks to offer different explanations of of what this discipline really is. And so, how do you describe your work?

• 20:07Speaker 01

  So it depends who I'm talking to. But but I would say, most of all, a little background, because, you know, think about it.

• 20:19Speaker 01

  What is a work of art? What is a joke? What is love? What is physics? There is really, if we're honest, no easy way to explain or describe any of those things. True. And and what's happened is we're so habituated to their existence that we take them for granted. So you think, oh, I know what physics is. But in fact, if you spent a few years studying it, you'd very quickly feel less confident about what physics is. Yes. And one of the characteristics characteristics of complexity is it's so young that we haven't habituated to it. So the question remains out there, as it should always remain out there for everything. Yes. Okay, so I like this kind of unstable nature of everything, quite frankly.

• 21:04Speaker 01

  Um, so that's one thing to say. But at a very coarse grained level, at a very average level, um, one way to say it is that if you think about physics and chemistry, we are, we are a kind of natural science. We are a mathematical science, natural social science. We've been very successful at studying ordinary matter. You have the standard model, we know about quarks and gluons and fermions and all the rest. And in fact, many of our founders worked on those. But what we're not very good at is understanding what we call problem solving matter. And problem solving matter is not just computers and it's not just brains, it's also markets. It's also civilizations, it's also cities.

• 21:49Speaker 01

  Yes. And in one way, to think about complexities, think about all those principles that give us insights into how problem solving matter works and how different problem solving machines, and I have a very capacious understanding of what that that is, um, connect. And in a way, if you think about it, when you're building through an evolutionary process, cultural evolutionary process, a city, you're kind of connecting.

• 22:20Speaker 01

  Various machines together in the hope that it's going to operate. And it often doesn't, sometimes it does. And so that's what we study. We study problem solving matter and their connections. And our belief is that we have to understand adaptation to understand that. We have to understand computation to understand that and so on. And the history of complexity is, in some sense, a whole series of new models, new principles, new frameworks that are better and better at allowing us to understand that domain.

• 22:51Mario Gabriele?

  A question I wondered as I was learning about this discipline at the very, very basic level is how does one as a complexity scientist decide at what altitude to study this problem? Because you could, it seems, very easily, you know, look at this at a city level or at a molecular level or at an entomological level or, you know, any number of different spaces where you could decide to focus your attention.

• 23:17Speaker 01

  Well, here's the beauty of it. One of the things that we study, as you know, is fractals. And the complex world is a fractal, which means it has a kind of scale invariance. So it doesn't matter, is the answer. So in other, right, in other words, right, if you think about it, it wouldn't surprise you if I said to you, look, a cell has to adapt to its environment. It has to process signals. It has to enact some kind of policy and so on. I could have used exactly the same language for you or a firm. And you would have said, yes, of course.

• 23:58Speaker 01

  And so now an interesting question is, is it truly scale invariant or scales? Presumably, right, as you get very large, you move back into ordinary matter. Stars, planets, and then it's no longer relevant to use our vocabulary. Or if you get very, very small in the other limit, get down to atoms, so no. So there is this range of scales at which a series of questions, the same questions, can be asked of objects that appear to be superficially totally different. So I think it actually doesn't matter, is my view. As long as you understand your scale, you can ask all those questions.

• 24:37Mario Gabriele?

  Then I suppose my question becomes, do you find you have a preference? Like, as the investigator that you start to think, for some reason, this collection, this type of system, I get better data out of, or speaks to me in some way that it like sparks my, my mind in an interesting way, or, or, yeah, or, or even deeper than that, perhaps?

• 24:58Speaker 01

  Yeah, there are, I mean, it gets to the sort of Aristophanes, Dyson, you know, frogs and birds question, right? I think there are people who really, really like studying, you know, the order book, you know, in, in, in the market. And that's the, they're like natural historians.

• 25:19Mario Gabriele?

  Yes.

• 25:20Speaker 01

  Of that object, but they also apply these principles, right? So they're also theorists. Whereas there are others, like my colleague Jeff West, for example, who really is not one of those, and he really loves super generality. His aesthetic, I think this is actually aesthetics.

• 25:38Mario Gabriele?

  Is it? Yeah.

• 25:39Speaker 01

  It's not science, it's not science anymore, right? Because I think the science takes care of itself. It's aesthetics and I, you know, as you know, I mean, we all have, there are people who just love natural history and love studying butterflies and flowers and all the rest. And there are other people like studying stars. I view that all as a natural history. And there are others who have an interest in the underlying mathematical structure, you know, like the, the algebra that describes certain things. It's a different kind of aesthetic preference.

• 26:08Mario Gabriele?

  In a interview, I think it was, you know, 10 plus years ago at this point, you were asked what you would do perhaps if you weren't a complexity scientist. And I believe you answered, you might do a film directing, which has some of the, the flavor of complexity to it. And it made me wonder, you know, speaking about analogizing, if there were any films that you felt particularly well captured the spirit or sensations or thoughts of, of complexity science to them.

• 26:35Speaker 01

  In a way, you just look for those directors who have this.

• 26:39Speaker 01

  World systems thinking. And I mean, just to give some examples, I mean, obviously Bergman, obvious, you know, so in his The Seventh Seal, which is his epic meditation on games, life and death. I think, you know, this is this famous scene where a knight plays chess against death. And the winner of that, if he wins, he gets to remain alive. And he loses, he dies. I think that is what we're talking about. Those are the stakes. And understanding the rule, the tactics and the strategies of some model of existence is what we're doing. So I love, I love that. I think, you know, Kurosawa's film Rashomon is also fascinating

• 27:24Speaker 01

  because that film is about an event that takes place, a murder, and it's seen through multiple different perspectives, each of which is true to some extent. And fractal perhaps somewhat. And maybe even fractal. Yeah. No, I think so. I mean, absolutely different levels, different depths of field. And you're trying to reconstruct reality from all of these multiple perspectives. And the only way to reconstruct reality is from multiple perspectives, if if you can at all, right, which is the ultimate apirea in that film. So and then you get, you know, just masterpieces like Tarkovsky's two sort of sci fi movies, Stalker and Solaris, which

• 28:07Speaker 01

  are, they're really the boundary of physics and metaphysics. That is, on the one hand, they're scientific subjects, right, one a post apocalyptic landscape populated at some point, probably by some extraterrestrial civilization, making sense of abandoned artifacts that you can't really work out. And and Solaris, the the concept of a sentient planet, and your absolutely futile efforts to communicate with it, right. And and yet, in the process, making outrageous discoveries that are shockingly amazing. So, and anyway, so I think a lot of directors, and I could go on, Bunuel's The Exterminating Angel, I think, has this

• 28:49Speaker 01

  character. There are many great directors who take on projects that

• 28:58Speaker 01

  Integrate the big questions which would be familiar to us in complexity science. But what they do that we do not do is they bind them to the meaning of life.

• 29:09Speaker 01

  And and I feel that's something that novels and films and art does much better. Science is not good at that, right? That's not science's superpower. We do the other side well. And and I love film and novels because it many, not all, try to do it, try to connect them. And in a way that feels subjectively meaningful.

• 29:31Mario Gabriele?

  Hmm, yes. Did you say the director's name was Tarkovsky?

• 29:35Speaker 01

  Tarkovsky, yes.

• 29:36Mario Gabriele?

  OK, I haven't I haven't seen those, so those I I'm excited to.

• 29:40Speaker 01

  It's a must, they really are. Just honestly, I mean, Solaris, I love two thousand and one. But I think I would make a claim that Solaris is the better of the two.

• 29:50Mario Gabriele?

  Wow, OK.

• 29:51Speaker 01

  And and they're both masterpieces, so it's almost impossible to make that judgment.

• 29:55Mario Gabriele?

  Huh, wow, incredible. Well, we're talking about complexity and knowledge and intelligence. And you have been investigating and studying this new form of, I don't know whether we should call it intelligence or not, but artificial intelligence and large language models in particular. And you had this paper not long ago, Large Language Models and Emergence. And I thought it was so interesting and so many interesting ideas sort of came out of it for for me. And and actually put language to some things that I wouldn't have been able to articulate, but perhaps observed. To to sort of bring folks along with us, how would you sort of describe that that work? And these sort of arguments within it?

• 30:41Speaker 01

  So the the the impetus for that paper was the claim that has been made by now in many papers that intelligence in L L M's is just a matter of scale. That if you Add GPUs or add data, something you can scale that multiplies up. Then you go from no function or minimal function to some kind of miraculous discontinuity, a kind of singularity where intelligence, general intelligence, superintelligence, whatever language people prefer, emerges, emerges.

• 31:24Speaker 01

  And this paper was a sort of reckoning with those overblown claims, trying to root this discussion in what is a very rigorous science of emergence, right? And which they are completely unaware of. And so I think it was partly a little bit of us saying, you should be familiar with these ideas because maybe they'll be useful to you. So it wasn't entirely critical, but also questioning whether or not what they were saying was true at all. And I think the conclusion that we reached there is that there's nothing intelligent about an LLM.

• 32:04Speaker 01

  And that shocks a lot of people and we can talk about why, but that was the impulse behind that paper.

• 32:11Mario Gabriele?

  And just to explain to people, why is emergence sort of the wrong way to talk about the capabilities that we see here and that we should expect to see as LLMs and this paradigm scale, let's say?

• 32:26Speaker 01

  Yeah. So emergence is another one of those ideas, right? That people don't agree on, but that's different from saying that there isn't a very rigorous literature out there. You don't have to reach and say, no one agrees on quantum gravity, but we have great theories of gravity and great theories of quantum mechanics.

• 32:43Mario Gabriele?

  Yes.

• 32:44Speaker 01

  So we haven't put it all together, but the parts are pretty impressive. I think just a little bit on emergence, there are two ways to think about emergence. One is ontological about the nature of reality itself, and one is epistemological, which is how we model reality or think about it. The ontological observation is if you look out into the world, there are lots of little quarks or lots of subatomic particles, but somehow they come together to make planets.

• 33:11Speaker 01

  And how does that work? How do you get large bodies of stable matter made out of elementary constituents? Where these large bodies have properties which aren't obviously rooted, not obviously rooted, in the properties of the elementary particles? And hence, we have fields that we call high-energy physics or particle physics, condensed matter physics and astrophysics. And they reflect the fact that we describe each of these levels differently. Now, that second point about describing these levels differently is about epistemology, because it's saying coincident with these different forms of organisation are different theories.

• 33:54Speaker 01

  And each of these theories is an efficient set of propositions about its respective scale, right? You don't use particle physics to do astrophysics. They overlap, right? Okay. So emergence is about ontology on the one hand, part-hold relations, which have nothing to do with us, but also about epistemology, which is what the best theory for the human mind is to describe each of those levels.

• 34:19Mario Gabriele?

  Yes.

• 34:20Speaker 01

  Now, all of them have, both the theories and the reality, a very important characteristic, which is thinking about the mapping from the micro to the macro. So any emergence theory has both. What is the microstructure? What is the macro property? Now, if you look at LLMs and read all these papers on emergence, they do not even talk about the micro macro, except in the most superficial sense. And in fact, most of the scaling emergence literature doesn't even look at the micro. It'll say, look, we added data and now it can do three-digit addition, right? Big deal. Okay. Now.

• 35:03Speaker 01

  How does it do it? Well, that we don't look at. So that's part of our argument was how should we in a principled way think about what should you be looking for such that you are entitled to say that that property is surprising or emergent, right? And the paper sort of goes into different ways to do that. So I think that's one thing. And the other point, of course, is that the whole point of the epistemological approach to emergence is coming up with parsimonious theories. So if you look at L L M, what is the parsimonious theory of a trillion parameter model? There isn't one. It's a trillion parameters.

• 35:44Mario Gabriele?

  Yes.

• 35:45Speaker 01

  And whereas my theory of you would be parsimonious, I say, you know, tell me a bit about your family, tell me a bit about your interests, tell me a bit about where you went to school, tell me a bit. In other words, it's all very high level, right?

• 35:59Mario Gabriele?

  Yes.

• 35:59Speaker 01

  It's very psychological. It's all sort of folk psychological. And it would give me a deeper, not a perfect, but a deeper understanding of you. I would not really get much of an understanding of you if I put you in an FMRI experiment.

• 36:16Mario Gabriele?

  Yes.

• 36:17Speaker 01

  And so the deepest point here is that the L L M community is not committed yet to a theory of L L M psychology or L L M cognitive science. At that point, they're going to have to reckon with neuro to cognitive to psychological, which they're not. And that can be turned into a kind of complexity speed.

• 36:39Mario Gabriele?

  Fascinating. You've spoken elsewhere, or perhaps you've written about it. I can't remember where I found it. But the sort of three qualities of intelligence being inference, representation, and strategy. Do you see sort of any of those embodied in an L L M at this point? And more broadly, you know, what are your questions about whether this is really intelligent or just strictly knowledgeable?

• 37:07Speaker 01

  Yeah, right. So I should explain why. There's a huge literature, it's 100 years old, if not more, on what intelligence is.

• 37:17Speaker 01

  And the problem with ninety nine percent of it is it's entirely human. And if you're an evolutionary person like I am,

• 37:29Speaker 01

  then you have to worry about where that came from. It's not then a miracle happened, right? There are people who believe that, which is fine. It's just not my particular church. And so the, so then I wondered, what would be a general framing of the concept that would allow for the possibility of talking about intelligence in viruses? Or intelligence in bats and intelligence in humans and intelligence in companies?

• 37:56Speaker 01

  Hence this three dimensional approach, which is, if you like, one way to say this is, any intelligence system has to perform calculations on representations of the problem to achieve a strategic objective.

• 38:12Mario Gabriele?

  Yes.

• 38:13Speaker 01

  And it turns out that we have different kinds of theories for all three. The strategic bit is all about game theory. That's what game theory is for. It's about strategy. It doesn't worry too much about, it does now in algorithmic game theory, but that's quite new. Certainly not in the world of von Neumann and in a Nash. So strategy is that what it's for? What's the utility? What's the benefit? And inference is what L L M's do well. Right, they do calculations well. That's what they were built for by McCullough and Pitts in nineteen forty three. They basically perform logical operations on quasi binary valued units. And what they're also not good at is representation.

• 38:57Speaker 01

  And that's the bit, by the way, that we would require for emergence to look at the internal wiring, so to speak, to see what they're actually, how they're encoding reality. And that's something that artists do beautifully. So, you know, art or the novel is not particularly powerful inferentially. It doesn't look like quantum mechanics, but it's representationally extraordinarily deep. It's not particularly strategic either. I mean, it doesn't really have an obvious utility. So I think what I wanted to do is have a space that was very capacious in which you could put all things that have elements of all three, but to different degrees. And so I think that you can see what's happening with L L M's now.

• 39:41Speaker 01

  The current obsession with L L M's, as you know, is, is agentic. Agentic is just code for strategy. They're just saying, we need to have a strategic game theoretic dimension to what an LLM is. But the representational one has been somewhat neglected, except in the trivial sense of this thing can make kitschy artworks.

• 40:03Mario Gabriele?

  Right.

• 40:04Speaker 01

  But that that will get better.

• 40:07Mario Gabriele?

  But even when it is making kitschy artwork, let's say, it doesn't seem to me that it is actually doing sort of representative representational work in the way that you're really referring to it. Is that a fair appraisal?

• 40:20Speaker 01

  I think that it's absolutely right. I think that which requires for me, again, looking inside to see what what is the elementary principle of of representation? What are the atoms? What are the how are you composing things? And I think if you think about music, when we learn music theory, we learn notes, which are representations of tones. Then we learn phrase structure, right? Then we learn forms, the sonata form, the symphonic form, what have you. These are representations. They're clearly not strategic in a utilitarian sense. They're kind of weird. I mean, what is the album Kind of Blue strategically trying to do other than delight you, right?

• 41:04Speaker 01

  You know, so it we need a space to allow for the possibility of forms of experience, which are not about utility, which is a big part of intelligence.

• 41:14Mario Gabriele?

  This episode is brought to you by Persona, the B two B identity platform, helping businesses verify users, fight fraud and build trust. Fraudsters are already using AI to spoof faces, voices and documents. So your defenses need to adapt just as fast. Persona helps secure some of the internet's largest and most trusted platforms with identity verification. If you're building a product where trust matters, identity should be a priority. You've probably already experienced Persona without realizing it. Verifying your LinkedIn profile, signing up for Etsy, or renting a scooter with Lime. Trusted by leading companies like Square, Brex, and Twilio. Persona gives you the building blocks to create identity flows that adapt to your customers, risk tolerance, and locales you operate in.

• 41:59Mario Gabriele?

  Whether you're verifying age, onboarding businesses, or automating KYC. It's fully configurable, so you can launch in days, not quarters. Want to see for yourself? Generalist listeners get a free year of the starter plan. Head to withpersona.com/generalist and check it out. This makes me think of a book I think you must have written about at some point, which is The Glass Bead Game. Because it strikes me that actually what Herman Hesse does in that book then is turning representational into strategy in that there are sort of warring or dueling compositions of music and literature and art. Does that sort of sound roughly right to you?

• 42:42Mario Gabriele?

  Am I understanding some of what you're saying there?

• 42:45Speaker 01

  No, it is absolutely right. And I think that, and that's for me, a very important book. Because the whole world that Herman Hesse evokes in The Glass Bead Game is kind of the center of the institute. And the game they're playing, The Glass Bead Game, is a little bit, as far as I'm concerned, a precursor to complexity science. I believe that quite strongly. In fact, John Holland, who invented genetic algorithms, that was his favorite novel for a reason. And interestingly, Marie-Germain's favorite novel was Frankenstein.

• 43:19Mario Gabriele?

  Oh, wow. No way. Wow.

• 43:21Speaker 01

  Yeah, that's very interesting, too. But the, so yes, I think you're correct. I think in the end, all three come together, right?

• 43:27Mario Gabriele?

  Yes, exactly.

• 43:28Speaker 01

  In different orders, in The Glass Bead Game, it was different. It started with the aesthetic impulse, and then it moved into the strategic.

• 43:35Mario Gabriele?

  Yes.

• 43:36Speaker 01

  I think we're living in a world now which is a little bit too led by the strategic, inferential. And I think it's going to be felt. I think we're already feeling it because there's a, how to put it? There's a certain sterility, to my experience with AIs. And I think it, for want of a better word, it doesn't have the art in it.

• 44:00Mario Gabriele?

  Definitely. I think that's definitely true. It makes me wonder how you would view reinforcement learning through this lens, because in some respect, it seems like that maybe has more of that strategy piece, certainly, but I don't know, maybe that's too simplistic. Maybe it's playing strategy in the same way that generated art is playing representation, so to speak.

• 44:21Speaker 01

  Yeah, the thing about agentic matter is it has intentions. It has purpose, it has function, it has desire, if you like, in the book. And you don't require that for RL, right? All you're saying is, here's an input, here's an output. That's not the output I want. Don't do that again. Try that, right? In other words, some form of Pavlovian conditioning or what have you. And I think that that's very simple and it works for pigeons and it works for ants. And I think, but what happens, I think, as a system becomes more duly strategic

• 45:00Speaker 01

  and representational is that this forward-looking, intentional dimension starts to expand. And I mean, I think that is that, if you like, in the space of this three-dimensional space, the human prognostication, the human planning, the human counterfactual future is our special characteristic. And so I'm not sure RL, I think it's kind of agnostic. It's, I think it's a slightly, it's like an orthogonal dimension, I think, to that discussion.

• 45:37Mario Gabriele?

  Very interesting. You've spoken before about your sort of concern, which I think is very well founded, that LLM's act is sort of such a tempting mental prosthetic for people that, you know, if we're not careful, and perhaps even if we are careful, we kind of can't help but allow it to atrophy our own cognition. What is the state of your concern about that these days? And do you think there's a way that we sort of manage to navigate a path where that that doesn't happen in a profound sense?

• 46:11Speaker 01

  I think it's really much more dangerous than people realise. You know, I've been listening to people like Jeff Hinton talk about the existential threat of AI. I think this is the greater threat.

• 46:24Speaker 01

  Because we have, you see, with his concerns, which are very real, we don't have good precedent. But my concerns, we have great precedent. And you just have to look at the opioid crisis, or the sugar crisis, processed food, whatever. The obesity crisis. These are all essentially about easy access to either long-term, non-nutritive sources, right? Of foods of some kind or another, or materials that are addictive.

• 47:01Speaker 01

  And I'm concerned that L L M's in their current incarnation are like sugar cocaine.

• 47:12Speaker 01

  It's a really low-quality diet of pre-processed factual knowledge that flatters you into addiction. And the consequences are not insignificant. I mean, people have talked a lot about what social media has done to the world. And there are good things it's done too, I don't deny it, but there are some dreadful things it's done. And I think they, and the dreadful things it's done relate to this problem, I think, of low-quality addictive substances. And so in an attempt to formalise that, I've been trying to develop a theory of intelligent artefacts. When they work for you, they make you smarter, and when they don't.

• 47:53Speaker 01

  And I have been to talk about it, but briefly speaking, I basically divide them into what I call competitive cognitive artefacts.

• 48:05Speaker 01

  And these are things like the GPS in your car that will not make you a better navigator without it. Okay. In fact, you're going to become a worse navigator.

• 48:14Mario Gabriele?

  Yes.

• 48:15Speaker 01

  You have no idea what space even means.

• 48:17Mario Gabriele?

  Yes.

• 48:17Speaker 01

  When you've become a customer, right? And so as opposed to complementary artifacts like a map.

• 48:23Mario Gabriele?

  Yes.

• 48:24Speaker 01

  Where if you have the map in your mind, you don't need the map to be physically present to navigate through the world. And I think we can start thinking about all of technology, which is what I've been doing, and developing a kind of a mathematical theory for this, which shows when you plus a technology works, you plus the technology for a while minus it technology works.

• 48:49Mario Gabriele?

  Yes.

• 48:49Speaker 01

  Like the map case. And I think we have to think very carefully about this because the consequence of the human desire to minimize its energy expenditure, our natural tendency towards slothfulness, our natural tendency to have excessive belief in authority. And here I am waffling on. Don't believe me. I think, you know, I think, I think those, those two predilections in combination with this technology are deeply troubling to me. And I think it won't be long, right, before you outsource all of your judgment. I mean, you know, what should I eat today? Who should I talk to today? Who should I vote for?

• 49:33Speaker 01

  I mean, at that point, what are we?

• 49:35Mario Gabriele?

  Yes. Not only who should I talk to, but what should I say to them? They've just responded. What should I say back? I think, I mean, that I already see to sort of a startling extent that you can see it on social media, certainly, but you can see just in people's correspondences with one another. You're like, ah, what's actually happening here functionally is your AI is talking to this person's AI. And, you know, the, the, the human is actually sort of more or less just a, a delivery mechanism at this point. Which is.

• 50:06Speaker 01

  Yeah. It's a kind of enslavement.

• 50:10Mario Gabriele?

  Yes.

• 50:11Speaker 01

  Right. And it's, and I think we should understand this. And, and again, we do understand this at some level, we know, right? Because everyone is making this judgment call, which is, I know that this company just wants to profit from me. I mean, that's just a fact.

• 50:25Mario Gabriele?

  Yes.

• 50:26Speaker 01

  There's nothing wrong with that. That's great, you know, that, that will hopefully be a source of innovation. At the same time, you need to develop resistance.

• 50:33Mario Gabriele?

  But it's so hard to do, to do that. I, I wonder, you know, if, if that expects too much.

• 50:40Speaker 01

  I don't think it does. I don't think it does. I feel as if, you know, it's interesting. Here's why I'm optimistic about that. It's a battle. It's a battle between our addictions and our greed against our desire to be stimulated, right? Human beings, very interesting. You know, at a certain point in your life, tiddlywinks or what we call in English naughts and crosses. I can't remember what you Americans.

• 51:10Speaker 01

  Just doesn't, it's not interesting anymore. Right. It's like, that's not interesting. I want to play chess now, I want to go, I want to play a video game that challenges, I don't mind. But that's not enough for me. So there's something in us that craves challenge. Most people enjoy going out on the weekends and engaging in sport. They're challenging their body, right? It's not effortless. I don't want to, someone else, as I always say, I don't want someone else to go to the gym for me. That sort of somehow fails to understand the premise. So there's that side in us which wants to be challenged, wants to be surprised and be thoughtful. And it's fighting this other thing. And what happens in life is that some people win that battle and others lose it. And I would like more people to win it.

• 51:53Speaker 01

  You know, and I feel that it is a battle.

• 51:56Mario Gabriele?

  A battle that I fear, the part that makes me maybe more pessimistic is that, are we as a species becoming more resilient towards that? Because certainly the other side is becoming, you know, the, the temptation is only becoming more and more strongly weaponized. So unless we're sort of at least commensurately raising ourselves, are we sort of railing against a more and more powerful foe? But I suppose we'll, we'll have to be hopeful.

• 52:23Speaker 01

  You know, it's, it's, it's a, I don't know. And, um, you know, it was interesting, I, um,

• 52:30Speaker 01

  I remember when Christopher Nolan, whose brother I know, Jonah, made his Batman films. And I think everyone who went to see those films thought, those were great.

• 52:43Mario Gabriele?

  Yes.

• 52:43Speaker 01

  Those were good Batman films, right? And then we go to all these other Marvel DC movies and they're shit.

• 52:50Mario Gabriele?

  Yes.

• 52:50Speaker 01

  Not all of them, but basically they are.

• 52:52Mario Gabriele?

  But yeah, they're a very different category, right?

• 52:55Speaker 01

  They're in a different category. You go to the Batman films, you think, wait a minute, that's a good one.

• 52:58Mario Gabriele?

  Yeah.

• 52:58Speaker 01

  And these are, they're fun. It's a roller coaster ride. No problem. And I think for me, what he did there is proof that the human being knows the difference and can appreciate it. And it's our responsibility to provide those, right? I mean, you've talked about Cormac, you know, if you've read Cormac McCarthy, let's say you've read Blood Meridian, which is his masterpiece. And you've read some kind of whatever, I'm not going to mention anyone because I'll get in trouble. You know the difference.

• 53:29Mario Gabriele?

  Of course.

• 53:30Speaker 01

  But you have to have experienced that to know the difference. If you haven't, you'll say, oh, who, don't be snobbish, don't be elitist.

• 53:36Mario Gabriele?

  Yes.

• 53:37Speaker 01

  There is no hierarchy in the arts, but there is. And, and I think it takes really having spent time with it. And that's the thing I think we need to do, right? Is we need to give people enough time with high quality ideas. And they will know the difference. I don't think we should tell anyone what's better or worse, just have the opportunity.

• 54:02Mario Gabriele?

  Yes. I like this idea very much of, of complementary technologies. And the optimistic part of me hopes that we're going to see people find ways to use L L Ms and A I in, in this sort of more complementary way. Alan Kay was one of the guests of the podcast and he had such a brilliant way of just condensing the question, which is how much help is too much help? And I think that was a really good way of sort of putting, you know, it succinctly of like, what we really want these technologies to do. You perhaps want them to educate you, but not give you the answer and guide you and, you know, so on and so forth.

• 54:40Speaker 01

  I know, Alan. I think that's a very nice way to put it. And I think, let me add to that. One of the areas that we work on at S F I is emergent engineering. Which is engineering emergent systems that you don't fully control. And the key concepts in emergent engineering are twofold. One is improving signal to noise. And the other one is improving gradient. So when Alan makes that point, what he's really saying is I want to give you a gradient. I don't want to give you the answer.

• 55:13Mario Gabriele?

  Yes.

• 55:14Speaker 01

  But I want to give you a path towards the answer. And and I think they're radically different.

• 55:19Mario Gabriele?

  Yes.

• 55:20Speaker 01

  And I mean, that's what good pedagogy education is. It's not giving you the answer. It's saying this is how you can arrive at one. And of course, they're an infinite number.

• 55:29Mario Gabriele?

  Yes.

• 55:29Speaker 01

  They'll give you that, then you'll have navigational tools for any problem. So in this emergent engineering framework, I think it makes explicit that point. Make the signal clear and provide mechanisms that induce in the problem space gradients.

• 55:45Mario Gabriele?

  What is the right way to protect one's mind against these temptations? Like, do you do you just choose to not use this technology at all in your day to day life? Do you sort of treat it more as if, you know, a brief investigation with it? That you sort of figure out its capabilities and then try and really almost blockade yourself from it? How do you? What is a thinking person's best course of action?

• 56:09Speaker 01

  Yeah, I mean, I don't know. I think that I'm very interested in this concept of autonomy, which is, you know, when you learn a mathematical science, you solve problem sets, right? That's how you do it, right? You here's a problem, solve it. And you solve them on your own. And they're ruthlessly, fruitful benchmarks of your capability.

• 56:43Speaker 01

  And I'm interested in ruthlessly truthful benchmarks of capability. And we could think carefully about that, what that means for each of us. And I feel as if it gets to the earlier point, the Alan Kay point. And so I'm always testing myself, right? Which is, I think I know the answer. Do I know the answer? Can I do this on my own or do I need to ask someone else? And it is actually a part of my practice. It's like going for a run in the morning, right? Or meditating, whatever it is you do.

• 57:14Mario Gabriele?

  Yes.

• 57:15Speaker 01

  I think you have to develop this, sit down with a pencil and paper and say, do I understand it? And it's interesting, by the way, because the current sort of renaissance in the Zettelcast and Nicholas Luman's way of organizing his knowledge is actually an effort, I believe, to encourage people to distill for themselves, right? The essence of an idea. Don't copy and paste it from Wikipedia.

• 57:43Mario Gabriele?

  Yes.

• 57:44Speaker 01

  Write it yourself in your language. And I think that's, that is actually a very nice example of what I'm talking about in terms of autonomy. So I think people should be out there developing truthful benchmark, benchmarks of their abilities. I think it depends on the field, but in the end, right? If I give you a violin and I say, can you play this beautiful piece by Bach? And you, I mean, you either can or you can't. And weirdly enough, that's why AI now is so effective. When the, when ImageNet was introduced as a test, all of a sudden there was a common standard for what it meant to do well. Everyone agreed. It was like, well, can you do it or not? Is that an elephant or is it a bicycle?

• 58:26Speaker 01

  And, and I think we need our own, build your own benchmarks.

• 58:30Mario Gabriele?

  That's a good practice. I'm going to do that for myself, I think. We've talked a little bit about Corin McCarthy and I'd love to, you know, talk a little bit more. I think in his, his last two books, Stella Marison, The Passenger, you see so much of the influence of SFI on his thinking and, you know, how he was really spending his days at the institute to a certain extent. What do you think his legacy is at SFI? What, you know, reversing the roles a little bit there?

• 58:59Speaker 01

  I think it's interesting. I think there are many. One is, what does the single-minded pursuit of excellence look like? Okay, that you can never get enough of that. I really believe that. I'm extremely gung ho for that deep sense of mentorship or apprenticeship, or whatever you want to call it, which is, I think the only way to really know is if you're lucky enough to spend time in the company of, and it doesn't matter what it is, it could be a swimming coach. I think, but you know, oh, that's what it means to really strive to be excellent. And I think he, regardless of how different his medium was, he wasn't writing science papers, that

• 59:43Speaker 01

  was evident to everybody. And that's true for all of our Miller scholars. We have a whole program of other writers as well, of course. He was a reader before he was a writer, right? People don't realize this. And at some point, I might write something on this. He read everything, right? And he read a lot of stuff he told the public he didn't like, you know, that. And so I remember when I first met him and we were talking about Henry James and Vladiby and Nabokov. He said, Oh, I don't like them.

• 1:00:17Mario Gabriele?

  Wow, no kidding.

• 1:00:19Speaker 01

  Yeah, but years later, he recited to me from memory, the first page of Nabokov's novel Pale Fire. And it was like, okay, I see. I see what you mean by not liking, right? Not liking means reading it and not liking it. Or, or my earlier remark about how you deal with knowledge, break it down, as opposed to being ignorant of it, which is a completely different game. So I thought that his engagement with all of this world that didn't necessarily show up in the work that he produced that we know, that was important. And also the thing I'm interested in him was how he carved out time for himself, or space for himself

• 1:01:02Speaker 01

  to think, where he was apparently non-productive. I mean, essentially, where would you find Cormac McCarthy in Santa Fe?

• 1:01:11Speaker 01

  At the Center for Institute, at Baskin Robbins, having an ice cream.

• 1:01:16Mario Gabriele?

  Right.

• 1:01:17Speaker 01

  Coffee, ice cream. Watching a movie. He understood that the number of productive hours in a day is, you could count on the fingers of one hand, optimistically, and that he needed to gather himself together. And so he was not in the slightest bit interested in, in, in, um, slightest bit interested in posturing productivity.

• 1:01:42Speaker 01

  If he was bored, he'd get up and go get an ice cream. He didn't, he didn't hang around and do nothing. And I think part of the reason he was able to do that is because he never used a computer.

• 1:01:51Mario Gabriele?

  Typewriter, right?

• 1:01:53Speaker 01

  Only a typewriter, but, but more importantly, no internet, no, there was no such thing for him.

• 1:01:57Mario Gabriele?

  Wow, wow.

• 1:01:58Speaker 01

  And the rest of us, unfortunately.

• 1:02:00Mario Gabriele?

  Yes.

• 1:02:01Speaker 01

  When we get bored, we will know what we do, right? We say, what email have I got? Or what's

• 1:02:06Mario Gabriele?

  Hundred percent.

• 1:02:06Speaker 01

  things should I look up on the web? And I think so our time gets filled with a kind of low quality busyness, whereas his time is filled with sort of high quality hedonism. Whatever that was for him. And I think to see that in practice and to see how beautiful his work was and how productive he was, I think that's important to know. It's like, oh, I see. You don't have to do all this nonsense. It's okay. It's okay that when you're working, you're working with an extraordinary focus. But when you're not, it's fine. You don't have to do all sorts of rubbish that actually isn't work.

• 1:02:41Mario Gabriele?

  Wow. There's so many lovely tidbits there that I think about. One of them, well, one, I love that he sort of disdained pale fire, but clearly had, had memorized it so much. And, and to a certain extent, it makes sense because there is such a stylistic difference between them. But, but on the other hand, I think if you had to pick maybe the two great stylists of the 20th century, you would arguably pick those two, or at least I would. So anyway, fascinating. But it also strikes me that it sort of gets at the heart of, um, you'll have to remind me exactly the pronunciation. Is it the Kellululele problem? Um.

• 1:03:19Speaker 01

  I mean, if you want.

• 1:03:20Mario Gabriele?

  Caculele?

• 1:03:22Speaker 01

  Yes, better.

• 1:03:23Mario Gabriele?

  Thank you.

• 1:03:24Speaker 01

  Cacule, cacule.

• 1:03:25Mario Gabriele?

  Cacule. The idea that, which is basically the idea that the subconscious arrived before language that Cormac wrote about, in a way, I wonder if that sort of hedonistic time was him sort of allowing the subconscious to do its work.

• 1:03:42Speaker 01

  Absolutely, absolutely. That's actually, that is the correct conclusion. I think he understood better than the rest of us that

• 1:03:54Speaker 01

  the way you cultivate the unconscious is different to the way you cultivate the conscious mind.

• 1:04:01Speaker 01

  It has different gyms, right? It has different exercise regimens, and they're not the same. And it turns out, and we know this actually from the writings of the great mathematician Quan Quan and Hadamar, where they studied the unconscious processes of mathematicians, including Einstein, actually, where they were very interested in this idea of what is the kind of leisure time that contributes to solving hard problems? And it had nothing to do with solving the hard problem. It really was about the obvious stuff, like spend time in the woods, or whatever it is. Things that we're told to do all the time, walk. Yeah, all thinking is walking, as far as I'm concerned.

• 1:04:43Mario Gabriele?

  Yes.

• 1:04:44Speaker 01

  And so, right, and I, but again, it doesn't come to us from our education at school, that sort of insight.

• 1:04:52Mario Gabriele?

  Yes.

• 1:04:53Speaker 01

  It comes to me from spending time with extraordinary minds, and that seemed to violate so much that I was told to do.

• 1:05:00Mario Gabriele?

  Hmm, yes. We mentioned Wittgenstein earlier, and seems to be an obsession both for you and for Cormac. What do you think it was about him that sort of managed to unite, you know, both of you coming from very different disciplines, but in this sort of deep fascination?

• 1:05:19Speaker 01

  First of all, I remember when I was 17, in a bookshop in

• 1:05:26Speaker 01

  Chelsea and in London and I found I saw this slim little volume with the title Tractatus. And to me, that was like, what? Sort of like this occult knowledge. What is that thing? I didn't know what it meant, but I have no idea what it meant. And so I pulled it out of the shelves and I was not disappointed because when I opened it in hand, you know, that beautiful enumeration of propositions, each of which was a kind of little bit of poetry in its own right. I mean, it's like, is this, what is this book? Is this, I don't know what this book is. And so me, of course, I bought it and I spent the rest of my time obsessing over it. And then, of course, you learn about the origins of the project and

• 1:06:06Speaker 01

  his time with Bertrand Russell and G E Moore at Cambridge and the problems he was wrestling is his influence on the positivists. And then his own life, his interest in architecture. By the way, that's very important because Cormac started as an architect. Wittgenstein spent time as doing architecture, the house that he made for his sister, which he never lived in because he thought it was so brutal. But nevertheless, nowadays, we love it because it's very modern. And his life in the trenches, his bravery in the war and his austerity. He was, he was a kind of monastic figure. He had no, came from the richest, one of the richest families in Austria, lived in palaces, gave it all away and lived in a hut

• 1:06:47Speaker 01

  in Norway. So he's a kind of, he's, he fulfills many latent desires, doesn't he? Because he created a work sort of out of whole cloth. He, he was quite disdainful of, talk about your earlier question about knowledge. And of course, he was much more knowledgeable than he let on, like Cormac.

• 1:07:05Mario Gabriele?

  I've been so well educated because of his wealth, right?

• 1:07:08Speaker 01

  Exactly. And the access to extraordinary figures at the time when Vienna was sort of, you know, the New York, it was an extraordinary city. So it's his life, it's his work. Of course, the content of his philosophy as well, because his image is worth remembering. People remember, of course. The two translations, in English at least, Ramsey's translation of The Tractatus and Elizabeth Anscombe's translation of Philosophical Investigations, both whose graves I've gone to visit in Cambridge.

• 1:07:43Mario Gabriele?

  Oh, wow.

• 1:07:44Speaker 01

  And but of course, he wrote all these other books on the philosophy of mathematics, on the philosophy of psychology that weren't published in his lifetime. And that's the other thing, he was a polymath like a novelist. He covered so much territory. So interestingly, if you were to visit our campus, here we have two campuses. One of them is the Miller campus. When you enter, there is the Wittgenstein mural.

• 1:08:07Mario Gabriele?

  Oh, wow.

• 1:08:08Speaker 01

  And on the Wittgenstein mural is Proposition 1.13, not 1 and not 6, which everyone knows. And Proposition 1.13, which is the facts in logical space of the world. And that's a homage to Cormac, it's a homage to Bill Miller, who supported the campus. And of course, it's, I can do it because it's my interest as well. And so he's very important. And Wittgenstein's biographer, Ray Monk, spent time with us. And that that book was extremely important for Cormac. He considered it one of, I think it's fair to say, one of maybe the two greatest biographies ever written.

• 1:08:52Speaker 01

  Certainly, Ray Monk's, and the other one would be Elman's Joyce. And it was Elman's Joyce that really convinced him that he had to be a novelist.

• 1:09:01Mario Gabriele?

  Huh, I never do that. Wow, how fascinating. I think you've said before that there was sort of nothing less interesting to him than than discussing his own work. Within the the world of literature, what was worth his energy to him, you know, beyond his work? Were there? Uh, you know, maybe Nabokov was not up to snuff.

• 1:09:24Speaker 01

  No.

• 1:09:25Mario Gabriele?

  What did he, what did he actually like talking about?

• 1:09:28Speaker 01

  Well, he liked talking about everything, right? Except his own writing.

• 1:09:31Mario Gabriele?

  Yes.

• 1:09:32Speaker 01

  Right? And so that's important. I don't think there's anything he wasn't interested in talking about. That's something to bear in mind. And, uh, I mean, I really mean that quite sincerely. I mean, and I think in that article I wrote on him, I give a list of some of the things we talked about.

• 1:09:46Mario Gabriele?

  Yes.

• 1:09:47Speaker 01

  Pretty much everything, right?

• 1:09:48Mario Gabriele?

  Yes.

• 1:09:49Speaker 01

  In terms of reading, though, um, I mean, I think the way it worked with him is that in his youth, he read everything in the world of fiction, not everything, but a lot, more than you might imagine. And very carefully, I mean, I lent him books over the years and they always came back with scribbles all over them. And, uh, yeah, his books are highly annotated. So he was a careful reader. Nietzsche once said, um, he defined a philosopher of someone who reads with a pencil. And I think in that extent, to that extent, he was a philosopher. As he aged, he settled on a few writers who he loved. And of course, preeminent among them was Melville. I think he considered Moby Dick just without peer.

• 1:10:33Speaker 01

  And I'm not sure I agree with that, but there's no doubt that it's kind of a divinely inspired work of literature.

• 1:10:40Mario Gabriele?

  Yes.

• 1:10:40Speaker 01

  But then huge numbers of biographies and then books on everything. If you go to his library, very interested in philosophy, very interested in the philosophy of mathematics, philosophy of physics and, um, and everything else. I mean, you know, it's six volumes on rattlesnakes of Texas or, you know, it, it, it just didn't matter. He was, if you think about Judge Holden from Blood Meridian, the model of his voraciousness is Cormac himself.

• 1:11:09Mario Gabriele?

  Wow, fascinating. And in some respects, in the kid, I see some of that wise infant, uh, energy that we talked about, um, uh, earlier. Perhaps not genius in, in that sort of sense, but there's something about that having almost being a two sides of a spectrum, both old and young at the same time.

• 1:11:30Speaker 01

  You know, that is very true. I mean, I mean, that his interest in, in Frank Lloyd Wright, um, is very similar. I think he's very interested in these people who are.

• 1:11:43Speaker 01

  Or at least constellations that do both well. He's not really interested in the middle ground very much. Right? So you either get to be a kind of wunderkind naive, where you're sort of effortlessly brilliant and you're kind of by practice and iconoclast, because, not because you want to be, but because you are.

• 1:12:04Mario Gabriele?

  Yes.

• 1:12:05Speaker 01

  And then on the other end, as you say, these kinds of polymathic sensibility of wanting to devour the ninth and 11th edition of the Britannica.

• 1:12:14Mario Gabriele?

  Yes.

• 1:12:14Speaker 01

  And, and I think he, I think he felt himself over the course of his life occupying those two roles.

• 1:12:22Mario Gabriele?

  In an interview from a long time ago, you were asked, if you could ask an omniscient higher being scientific questions, what they might be. And I really liked your answer and I wanted to follow up on it. Your answer was, does physics plus enough time imply life? Does life plus enough time imply intelligence? And does intelligence plus enough time imply consciousness? Does consciousness plus enough time imply catastrophe? I followed you and then to the last sentence, I wondered why in your mind, consciousness plus time might imply catastrophe?

• 1:12:58Speaker 01

  Yeah, I mean, I think about that in sort of through three lenses, I think.

• 1:13:04Speaker 01

  One is, let's call it existential. One is strategic, game theoretic. And the other one is technological, in reverse order, right? Technological is what we're experiencing now. We build machines, we infuse them with facts, we give them agency and they annihilate us. That's the, that's the, that's the preferred marketing speak of large tech companies.

• 1:13:35Speaker 01

  That's possible. The.

• 1:13:38Speaker 01

  Strategic game theoretic one is of course mutually assured destruction, right? I mean, that's the doomsday device.

• 1:13:46Mario Gabriele?

  Yes.

• 1:13:46Speaker 01

  Um, that we think through our consciousness and our own sense of malice that others feel as we do and we preempt them.

• 1:13:59Mario Gabriele?

  Yes.

• 1:13:59Speaker 01

  And, and so in the process, we initiate a red queen dynamic whose resolution is our annihilation. And the existential one is a kind of malaise. It's the other outcome of the, of the other two in a way. I mean, technology that makes us a kind of surrogate proxy for itself, strategic machinations that make us despair and we kind of fold into ourselves and disappear. It's a kind of omega point of human consciousness that just annihilates itself out of desperation. And I mean, I know it all sounds rather miserable, but I think that's what I was thinking when I answered the question.

• 1:14:44Mario Gabriele?

  I think that's fascinating. Um, well, as we sort of reach the end here, there's a few questions that I always like to sort of end with that are more abstract and philosophical. One is, if you had unlimited resources and no operational constraints, what's an experiment you would really like to run?

• 1:15:02Speaker 01

  So I hate the idea of unlimited resources. There's nothing more boring to me than unlimited resources. Everything that I've ever seen that's great works under constraint. You know, that's famous Robert Frost, you know, poetry without verse is like tennis without a net. And I, and I really believe that. And I feel that there's something enormously invigorating and thought inducing in overcoming obstacles. So I don't want unlimited resources. Thank you very much.

• 1:15:37Mario Gabriele?

  It would be too much of a cheat code.

• 1:15:40Speaker 01

  It's a cheat, it's a cheat code. Yeah. Why play the game?

• 1:15:42Mario Gabriele?

  Yeah, exactly. No, that, that makes sense, actually. No one said that before, but, but I understand that.

• 1:15:47Speaker 01

  Yeah. I mean, it's sort of weird. People think they want more, but you, it more just makes for a kind of a, a kind of a maximum entropy distribution over possibilities. I want to, you know, if you think about it, constraint forces you to double down on what you do well.

• 1:16:08Speaker 01

  With his new constraints, you can talk about anything and it doesn't matter. There are no consequences. There have to be consequences. So I'm a real constraint junkie.

• 1:16:18Mario Gabriele?

  Fascinating. What tradition or practice from another culture or era do you think we should more widely adopt today?

• 1:16:27Speaker 01

  I think, I love this. I, um, yes. You know, I was born in Hawaii. My father was in the air force, US air force, and I am a huge admirer of Polynesian navigation. And I think that that appreciation of what Timothy Morton came to call a hyperobject, this massive object, that's the Pacific Ocean, right?

• 1:16:53Mario Gabriele?

  Yes.

• 1:16:53Speaker 01

  This dynamical system that has these hidden currents and, and forms of order that you have to learn in order to navigate in the open ocean in an extraordinary way. So learning the world's hyperobjects is, I get from Polynesia. I think from Japan, this

• 1:17:18Speaker 01

  aesthetic of the worn, you know, that there's beauty in the old and in the imperfect, that, you know, the, the teacup that's not perfectly.

• 1:17:31Mario Gabriele?

  Kintsuki.

• 1:17:32Speaker 01

  Exactly. And I think that's just beautiful.

• 1:17:33Mario Gabriele?

  It is, yes.

• 1:17:35Speaker 01

  And it's very interesting. If you go, where in the world do you find the best preserved old technology? Well, it's beautiful old cars in Cuba and it's electronics in Japan. And they just have the deepest respect. They give burials to, to machines and electronic gadgets. So there's something there which is so deeply presumably rooted in their Shinto origins, but I, I very much admire that. I think from Germany and England, certainly England in the 19th century and Germany in the 18th and 19th, the pursuit of these giant synthetic works. I'm thinking about Burton's Anatomy of Melancholy, James Frazer's

• 1:18:14Speaker 01

  The Golden Bough, Immanuel Kant's Three Critiques, Schopenhauer's The World is Will and Representation. These are these massive lifelong projects to bring it all together. And they always fail, but they're always exquisitely beautiful. Right? I love that. I love that. And maybe Italy.

• 1:18:37Speaker 01

  Not contemporary. So again, well, maybe partly the, the way that in Italy, under people like the Palladian architecture or in the 20th century, Scarp, certainly Piranesi, turned mathematics and geometry into physical form. So to be in a Brunelleschi building is like to be in a theorem. And I love that. And I think that in, in the age of disposable environments, I want to move into a timeless platonic environment. And I think that I feel that more strongly in Italy than anywhere else. I'm sure I could go on, but those are some that I admire.

• 1:19:15Mario Gabriele?

  Oh, gosh, that was, that was an amazing collection. Okay. Sort of last question. If you had the power to assign a book to everyone on earth to read and understand, what would you like to give them?

• 1:19:26Speaker 01

  I'd say, choose your own adventure.

• 1:19:28Mario Gabriele?

  Hmm. Very good.

• 1:19:30Speaker 01

  I, I don't think we should tell people that. You'll find meaning in, in something that you find. So told to read, it's like being at school ruins everything.

• 1:19:39Mario Gabriele?

  Yes. Takes the pleasure out of it.

• 1:19:42Speaker 01

  It does. There's nothing more exquisite than believing, like I did with the Tractatus, that you discovered it for yourself and that no one else knows about it.

• 1:19:51Mario Gabriele?

  Amazing. Well, David, this was such a joy. And thank you so, so very much for spending your time with me.

• 1:19:58Speaker 01

  You're welcome. Thank you very much for good questions.

• 1:20:01Mario Gabriele?

  Thank you. That's it. Thank you for listening to this episode of the Generalist Podcast. Please subscribe on Apple Podcasts, Spotify, or your preferred podcast app. Ratings and reviews help others discover these discussions. So if you enjoyed the conversation, I'd be grateful if you could take a moment to leave one. For all past episodes and more, visit us at thegeneralist.substack.com. See you next time as we continue to explore the future.