AI's Energy & Water Demands: Sorting Fact from Fiction with Andy Masley

Andy Masley on AI energy and water use unpacks common myths and brings an Effective Altruism lens to the debate. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. You’ll get memorable heuristics—one ChatGPT query ≈ running a microwave for one second; 10,000 queries ≈ a cross-town car trip, burger, or hot shower—and clear comparisons about data center power, solar land area, and an estimated 80 GW buildout. We also cover local impacts, water trade-offs, uncertainty drivers, and why AI’s global resource footprint is smaller than many fear while noting where caution is still warranted. LINKS: Andy Masley Substack homepage Power Hungry Processing paper PDF Energy Efficiency AI Benchmarks PDF Deep neural network energy paper Gemini Deep Research report ChatGPT 5.1 Pro report Claude Opus 4.5 report Altman “The Gentle Singularity” SemiAnalysis AI datacenter energy dilemma Epoch OpenAI compute spend Dean Ball Out of Thin Air Sponsors: Framer: Framer is the all-in-one tool to design, iterate, and publish stunning websites with powerful AI features. Start creating for free and use code COGNITIVE to get one free month of Framer Pro at https://framer.com/design Agents of Scale: Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U. S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Nathan Labenz?

  Hello and welcome back to The Cognitive Revolution. Today, my guest is Andy Masley, a blogger and thinker who's done some of the best recent independent analysis of the energy and water demands associated with AI. Andy is the Director of Effective Altruism, Washington DC, and this conversation served as a great reminder of why I appreciate the EA community. Their emphasis on identifying causes that are neglected, tractable, and large in scale seems right on to me, and the culture of epistemic humility and earnest truth-seeking is genuinely admirable. What's more, Andy is a great example of how EA thinkers are generally very pro-progress, even as they worry about extreme risks from AI, a consistent pattern, in my experience, which contradicts the popular "doomer" caricature.

• 0:44Nathan Labenz?

  In all sincerity, the main reason I've never gone around calling myself an EA is simply because I don't consider myself virtuous enough to deserve the label. But regardless of affiliation, this conversation also demonstrates how a genuinely curious, truth-seeking, numerate person can, with AI help, make a meaningful contribution to the discourse on a complicated topic even without formal credentials or deep experience. In this conversation, we tackle the prevailing narratives around AI's consumption of energy and water. While we acknowledge that there can be local issues associated with large-scale data centers that really do matter to specific communities, such that local leaders should be careful about the deals they strike with data center companies, the bottom line is that AI is not

• 1:28Nathan Labenz?

  a huge deal when it comes to global emissions or water use. The main reason is simply that bits really are that much less massive and therefore easier to manipulate than atoms. For the purposes of quick mental math, I find it helpful to remember a few key heuristics that we develop in this conversation. A single ChatGPT query uses roughly as much energy as running a microwave for one second. A single crosstown car trip, a hamburger, and a hot shower all use roughly as much energy as 10,000 ChatGPT queries, which means that if you can save just one car trip with AI use, which I've done a number of times in just the last couple of months, you have more than offset your AI use for a year.

• 2:13Nathan Labenz?

  Meanwhile, a 1 gigawatt data center uses as much electricity as 1 million American homes, and that 1 gigawatt of power requires roughly 10 square miles of solar panels to produce. Big picture, the full $7 trillion buildout, which is estimated to use something like 80 gigawatts of power over time, would represent a 1% to 2% increase in global energy usage, which is less than the expected increase due to general global economic development over the same period of time. And finally, that full 80 gigawatts of power, if it were all powered with solar panels, would require 800 square miles of area, less than 1% of the size of the state of Nevada.

• 2:55Nathan Labenz?

  The water usage analysis is very similar, albeit a bit more complicated for reasons that you'll hear. Obviously, there is some uncertainty associated with all of these numbers. And of course, things will continue to change with forces such as increased usage and longer thinking times pushing AI resource intensity up, even while increased efficiency and new energy sources push it down. Nevertheless, I feel very good about the back of the envelope calculations and the memorable comparisons in this conversation. And I hope that it gives everyone a confident, grounded sense of how resource intensive AI really is. With that, let's get into the fundamentals of AI energy and water use with the Director of EA DC, Andy Masley.

• 3:40Nathan Labenz?

  Andy Masley, Director of Effective Altruism DC, Internet Truth Warrior, online at andymaseley.substack.com. Welcome to the Cognitive Revolution.

• 3:49Speaker 01

  Yeah, so great to be here. A longtime listener, first time caller. Like, really, yeah, crazy privilege to be here. Thank you, David.

• 3:55Nathan Labenz?

  My pleasure. Thank you. That's very kind. So today, we're going to get into AI use of energy and a little bit of other resources, focusing on water, probably. This has been something that, for me, has really kind of surprised me over the last couple of months. In particular, I went and did a talk at an AI for Public School Educators event in October. And There's a lot of questions right on everybody's mind across society and certainly in the education space right now, like, what is this going to mean, whatever, whatever. But aside from the very education-focused questions they were asking, I think the number one question that kept coming up over and over again is, what about energy? Like, is it gonna ruin the environment? You know, is it gonna blow up our electricity bills?

• 4:38Nathan Labenz?

  Like, what's gonna happen with this energy thing? It is clearly something that people have understood is a potentially big problem. And I think you and I are both, spoiler, generally on the same page that a lot of the fears that are out there circulating are pretty overblown relative to what we actually have to worry about, which is not nothing, but, you know, hopefully is something that we, as a society, can manage. So, maybe for starters, why don't you just introduce yourself a little bit? I mean, I think one thing that is striking is, you know, I already gave the, your role as the Director of EA DC. This is, I think you may surprise some people with your profile, as I, you know, hope to do sometimes as well, with a mix of opinions which aren't super easily bucketed into doomer

• 5:22Nathan Labenz?

  or accelerationist. Maybe give like your kind of big-picture worldview and, you know, relationship to AI as it exists today, and then we'll really dig into the resources question.

• 5:32Speaker 01

  Oh, but full theory of the world, yeah, we'll take a little while to think. Yeah, I mean, basic place I'm coming from is the general EA perspective that it seems very likely that machines that can replicate a lot, or even most or all of what can happen in the human mind, might not be too far away. They seem more likely than not to happen in my lifetime, with massive error bars there, obviously, and that can come with a lot of risks. So, I'm pretty agnostic about P-Doom stuff. I would probably lean in the direction of like a lower P-Doom purely because I'm a little bit wary of the very specific philosophy arguments that get made around like advanced AI, like rising up and having misaligned goals and stuff, like, that's kind of a separate conversation.

• 6:14Speaker 01

  But I am very high like P-weird, like, I do expect the world to get very weird. In very potentially dangerous ways as like more and more powerful AI systems come online. And this is all kind of downstream of me believing that AI systems as they currently are and as they will be in the future just seem very likely to be very capable in general. And as a result of AI being capable, I'm also just like pretty excited about AI tools as they currently exist. I think this is a big disconnect that actually just makes complete sense. If you think about it from this perspective of AI being capable. But I think a lot of people are also thrown off by where I'm very visibly, you know, like a massive chatbot user, you know, like Opus 4.5, basically my new best friend, it's so cool, love it.

• 6:55Speaker 01

  But I'm also quite wary and worried about AI's overall impacts on society in the long term. And so I think like that combination is actually pretty common behind the scenes. And a lot of people probably identify with both being excited about AI as it exists and scared in the future. But I think a lot of people have this really simplified version of the debate where you're either like a Luddite doomer who hates all technology, including AI and wants to stop it. Or you're an accelerationist who wants to go full speed ahead and loves AI because they think nothing bad will ever happen. And there's just an obvious middle ground here, like a pretty easy Venn diagram intersection where it's like, yeah, I don't know. Like for the same reason that I think nuclear power is really good. But also, you know, nuclear stuff comes with some tail risks too.

• 7:37Speaker 01

  Like machines that mimic a lot of what happens in the human mind, like very useful for me personally. Very excited about a lot of what they're doing, but also like, man, this could get really crazy, really fast. And there are a lot of potential risks that come with that. So that's the general background attitude that I'm coming in with.

• 7:51Nathan Labenz?

  Yeah, I think that is pretty representative of the EA. You know, it's obviously hard to paint a movement with such a simple descriptor. But when I've attended EA events, for example, my own personal experience has been mostly what people seem to want to talk to me about is like, hey, could you maybe help advise my organization on how we can make better use of AIs as they exist today? While at the same time, maybe one of the things that they're trying to do is.

• 8:18Nathan Labenz?

  You know, either raise awareness or try to figure out, you know, some of these big picture, long-term tail risks, you know, wrap their heads around them better in any number of ways. But the, that fear is, in my experience, like, very often packaged, I would say, you know, much more often than not packaged with a appreciation for what the technology can do for us today. And certainly, you know, nobody is, not nobody, but, you know, there's, I'd say, very few who fail to recognize that in the EA movement, as I've encountered it.

• 8:50Speaker 01

  Very much, yeah. And I think behind the scenes, EA is much more heterogeneous than a lot of people might be aware of, where there are wildly different takes about like the basic AI X risk case. Definitely different scenes where you can maybe receive like some social capital or punishment for like believing different things. And I think that's bad, obviously, but at least where I am in DC, which is one of the largest EA communities anywhere, like, I've never personally experienced any kind of like social pressure to like believe the absolute craziest things about like AI risk. Like, I feel very confident, being very agnostic about that, actually, which is very nice. So I'm a fan there. And yeah, I think like, most EA's I know are like, coming at this from a general, like, we're very excited about a lot of technology. And like, in some ways, it wouldn't really

• 9:32Speaker 01

  make sense if everyone were like, oh, AI is going to be so capable in 20 years that it could kill everyone, but it's not currently capable enough to be useful in answering my emails or something like that. Like, that combination, I think, is like, becoming pretty rare, pretty vast. And like, usually, a lot of like skepticism about current AI models is also paired with skepticism about like future risks from misuse or like misalignment and stuff like that.

• 9:57Nathan Labenz?

  Yeah, the coalitions are a little odd. These, that's the scrambling is well underway, which is probably healthy, I think, and, you know, better that than just total polarization.

• 10:07Speaker 01

  Yeah.

• 10:07Nathan Labenz?

  But it does mean people sometimes incorrectly project certain beliefs onto, you know, their debate partners.

• 10:14Speaker 01

  Yeah.

• 10:14Nathan Labenz?

  So.

• 10:15Speaker 01

  Oh, sorry, go ahead.

• 10:16Nathan Labenz?

  No, please.

• 10:17Speaker 01

  Oh, yeah, like, without calling anyone out, like, every now and then, I'll bump into someone being like, oh, you know, like, this guy's in EA, he's like a communist Luddite who wants to destroy all technology and just like, level everything because he hates freedom and stuff. And like, I don't know, like, this doesn't really describe the profile of like, the people I'm bumping into. I think there's just like, A lot of AI doom in the air right now from a bunch of different directions, including like climate doom, which we're going to get into here. And I think like in most cases, like there are just a lot of examples of like worry about AI that a lot of EAs just don't really share. That I like, I think my takes on AI and the environment is shared like not just in EA, but in a lot of other with a lot of other people who are just knowledgeable about the technical aspects of this. But there's a huge disconnect between there and

• 11:00Speaker 01

  like the broader society and a lot of circles who are much more worried. So yeah, I tend to say about that. But basically just, yeah, basically a part of this has just been like presenting like, hey, look, you know, like, I'm an EA, like, I can like, say what I believe very directly about this stuff. And like, I definitely don't believe a lot of the like standard environmental worry about AI as it's presented in a lot of the media right now.

• 11:20Nathan Labenz?

  Yeah. So let's get into that. How would you describe what people broadly are hearing from the media? Like, what is the, you know, baseline mainstream narrative that you are kind of setting out to correct?

• 11:34Speaker 01

  Yeah. I mean, there are different levels of confidence I have about different claims here. So the media is covering the general data center build out a lot. And there are like a huge amount of uncertainty and concern is, I think, definitely warranted because this is just this huge new industrial project. We don't really know how it's going to go or what the consequences are going to be. So I think that there, the main thing I'm trying to correct is there are a lot of assumptions that this will just automatically definitely be bad for the environment, or it's already causing these huge cataclysms. And I think I want to adjust people more to observing like, what are the actual facts on the ground? What are the potential trade offs here? Let's not just assume automatically that using more energy or water is always necessarily bad. Like, there are a lot of

• 12:15Speaker 01

  places where this can potentially be good for communities that receive like a new massive taxable industry that's using like a normal amount of water and providing a lot of new revenue for utility and stuff like that. And I'm not saying this doesn't also come with problems. I'm just asking that the positives be weighed against the negatives on kind of a case by case basis. And I do worry that a lot of the coverage there especially is kind of framing like, oh, any environmental harm cannot be traded off with the positives. There's nothing good that's coming from this. And I kind of just want to push against that extreme case while still leaving a lot of uncertainty. And then the main, the thing that I feel most confident about separately that I do want to Demolish, honestly, I'm just like so tired of this talking point bouncing around.

• 12:55Speaker 01

  It sounds like you bumped into this as well, is the idea that your personal chatbot use is significantly contributing to your emissions or your personal water footprint. Like, we can have a debate about like, maybe, like, personal footprints don't even matter, and all that matters is big systematic stuff. Like, I actually think that's pretty healthy as a way of thinking. But if you are worried about this stuff, I'm just, I'm more convinced than I can be of most things, that poking around on chatbots, even if you use them a lot throughout the day, is just not going to add a meaningful amount to your carbon or water footprint, and in many cases, might actually reduce it. And like, we can get, we can get into that more later. So I think like that, I still bump into so many people with such wild misconceptions about this, including people who are very influential in like, big institutions and stuff, who are making decisions saying like,

• 13:40Speaker 01

  "The people in my institution cannot use chatbots because the individual environmental harm of those individual prompts is too much," basically. And like, that, I think, is ridiculous. We just have the numbers, it's looking pretty good, there's uncertainty, but the range of uncertainty is enough to justify this right now. So like, that's a big thing I'm pushing back against.

• 13:57Nathan Labenz?

  Yeah, that's crazy. I haven't heard of any, like, organization leaders giving dictates along those lines.

• 14:05Speaker 01

  Yeah, I'm sworn to secrecy on who, basically, unfortunately. Like, basically, I recently interacted with like, a large educational institution, where like, the people in charge of the technology there were just completely convinced that like, this isn't actually so bad, and like, we should really like, be able to pay for this for like, our low-income students especially, to like, have access to chatbots and stuff. But we're mainly, we're getting a lot of pushback from a lot of different places, basically being like, "This will be like, bad for the environment if we do this, to the point that we can't do this." And like, using that logic, like, it also wouldn't make sense to ever purchase books for any students and stuff like that. There's just a lot of stuff to say about that. But this is happening, and I think it's like, a lot of people who are focused on AI, like, on the ground, are pretty shielded from this, because like, I think they're much more aware of what the actual numbers look like.

• 14:50Speaker 01

  And I think there's People might be blind to just how common this is and like how many people have not touched chatbots at all specifically because they're completely convinced that this is a significant add to their personal emissions. And you know, all that more to say about that, like, some people are not touching them because they're worried about contributing to a systematic thing. Can say more about that. But like, the general misconception here, I think, is just so widespread still. And it's like, a massive tragedy. I think, like, in blogging about this, it kind of feels like shooting fish in a barrel. It's like, it's just like, a little bit goofy when you actually look at the numbers. But, yeah, I tend to get into there. But that's the other main thing that I'm trying to address.

• 15:26Nathan Labenz?

  Yeah, one strategy for rising to prominence in an online, building your online voice is pick an area where people are dramatically and consistently wrong, and then you can be very consistently right. Okay, so, so where do you think, like, what is the sort of, what is the move that's happening that's like distributing this bad information, you know, incorrect understandings in the first place? I mean, one thing I've observed in general is just that, like, the world is really huge. And so when you aggregate numbers associated with almost anything, you get to these, like, really big numbers. So I think one pattern that maybe is happening is people are sort of saying, here's how

• 16:07Nathan Labenz?

  much energy AI is going to use. It's, you know, yada, whatever kind of watts. And isn't that insane? And people are like, that is insane. And then there's just no reference to anything else. And so it's like, this sort of very big number hangs out in a vacuum and intimidates people because they don't see the other, you know, even much bigger numbers that maybe they should be comparing it to. How much of it is that? What do you think is kind of going on that is creating this sort of broad misconception in the first place?

• 16:33Speaker 01

  Yeah, it's coming from a lot of different directions. I think for the, there was a lot of coverage of this early on. There was a lot of individual news coverage about the cost of individual prompts. And there's an outdated talking point about how it's 10 times as much as a Google search. And I think for a lot of people, this was the first time they had ever seriously thought about their internet activity using resources in general. And I think there's actually something that just feels really wrong to people about that, because digital goods are ephemeral, and they're just this like 2D thing on your screen. And especially if you don't like AI, or if you think AI is all silly or whatever, like, it's this ridiculous, like, meaningless use of these valuable resources, especially water. Actually, I think the idea of AI burning through water really sticks with people because they kind of imagine it as this, like,

• 17:16Speaker 01

  dwindling resource that we might eventually run out of and we need to conserve it and protect ourselves from that. And there's this like, you know, ridiculous new thing that they don't like burning through a huge amount of it for silly reasons. Like, I think there's almost like religious sense of sin about that, like, really gets to people at some deep level, just because they might not have thought about how, oh, data centers have used water for a while for other things. And like, you know, people also watch Netflix shows that I don't think are very good, and that uses water. And maybe like, I would be more upset about that if I thought it was a serious problem. But like, even there, like, not too much water is being used. I think there's just been a lot of really weird and bad media coverage of this that's definitely caught on in social media a lot, too. Like, there are a lot of just like TikToks and tweets, like, kind of giving, I think, very silly explanations of how, like,

• 17:59Speaker 01

  you know, very grimly talking about how a chatbot is 10 times as much as a Google search. You're multiplying your emissions by 10 times. And they never stop to mention, like, oh, by the way, 10 times a Google search is still not that much. You know, like, if I prompted Google, like, 1,000 times, if I search Google, like, 1,000 times throughout the day, that's actually still not going to add too much to my emissions. And so I shouldn't expect that 100 chat UPT prompts will either. And so there's a lot of hyper focus on these relative numbers, because almost no one, including, like, me too much before I actually started looking into this, like, actually knows where a lot of the energy they use, like, is, or like, how much it is and stuff. So, a lot of different stuff. There's, like, general anti-AI attitudes, which, you know, otherwise understand worrying about. There's, like, a sense that this is, like, all these valuable resources. One

• 18:43Speaker 01

  very last one is this very strong sense that people have that because we're in a climate crisis, it is never acceptable to add a new source of emissions. This is very common. I bump into this all the time, where, like, even if AI is adding so little, it's like new emissions that didn't exist before. And this is actually a really strange category when you think about it, because, like, every day we all wake up and cause new emissions in everything we do. You know, like, every time I drive my car, I'm adding new emissions to the atmosphere that will stick around for, like, 1,000 years or something. And the source doesn't really matter, in my opinion. Like, it definitely matters to an extent. But I think a lot of people are really hung up on the idea that this is like a new thing or a new way of emitting and like thinking less about other stuff. And then like a very last thing I'll say is that like the data center build out is objectively

• 19:26Speaker 01

  huge and I think people have a lot of trouble computing how such a huge new use of energy can relate to such small amounts on a personal level. And I think a lot of this is just that data centers are these really weird paradoxical buildings that aggregate huge amounts of very tiny emissions in one place. So like they all look really huge together, but this would all appear like if we were able to aggregate anything else we do in society as well, like if all toasters or all microwaves were in one spot, like that would also look very large by the standards of an individual person. So a lot to say, a lot of stuff that's floating around in the background here, but all of this is kind of congealed in to this very broad sentiment that using chat GPT is bad for the environment and in my opinion it is not.

• 20:06Speaker 02

  Hey, we'll continue our interview in a moment after a word from our sponsors.

• 20:11Nathan Labenz?

  Yeah, I, one of my general principles is don't psychologize others AI takes because I think the whole city, you know, the facts are confusing enough and the, you know, the fog of AI forecasting is pretty thick in many cases. So I really do try to avoid that. I guess I'll, you know, maybe break that rule very slightly, very briefly by asking like, do you think this is primarily coming from the environmental movement and is just bad tactics or misunderstanding? Or another corner, and maybe it can be both, but another corner it could be coming from is sort of an anti-AI motivation that is like trying to find things that are resonant

• 20:52Nathan Labenz?

  with the public, even if, you know, that's, even if those arguments that work aren't necessarily at the sort of core of the motivation, like what would you say you've encountered in your online battles?

• 21:05Speaker 01

  Yeah, I actually mostly don't think this is coming from the actual environmental movement, like on the ground environmentalists, like maybe a few of them like get mad about this in the way that other people do, but it's not really originating there at all. I think it's mostly coming from a much broader swath of people who I would say are like fired up and sometimes a little bit confused about climate where they engage with a lot of like. Do me like climate social media and like I just want to flag throughout all of this that I am very worried about climate change. I don't want to say that this is not a problem or whatever. But there's this like separate category of person who isn't actually involved in actual environmental work, but just engages with a lot of like very guilt ridden media about very specific things that they do in their personal lives. I think the environmental movement for the most part has like correctly moved on from policing personal lifestyle

• 21:49Speaker 01

  stuff so much into like focusing on systematic changes to the energy grid, like huge wind there, that's great. But the public discourse hasn't really followed along. And so a lot of people like, I don't know, I used to be a physics teacher for seven years, which is also like important context here. And I just like, remember a lot of my students actually really believe really strange things about climate, mostly because of like TikTok, where they'd be like, oh, we're all gonna die by like 2024 or something, you know, because of climate change, or society's gonna fall apart. And I think this is mostly coming from people who have this like cluster of beliefs about climate, who have kind of memed themselves into this idea that like any tiny amount of new emissions is always a catastrophe. And oh, the silly thing AI is using new emissions, and so that's bad, basically. So yeah, that's my basic guess about like the main culprit here. There's

• 22:34Speaker 01

  like a general broader social media sense of climate doom that sometimes causes people to not think so much about the actual numbers involved.

• 22:41Nathan Labenz?

  Yeah. Okay, great. Well, let's get into some of the actual numbers involved. How do you want to attack it? I mean, I think we can come at it from multiple angles. There's the sort of, you know, unit of one chat GPT request and, you know, what that uses. There's also, you know, all sorts of comparisons we could use like to a microwave or to a, you know, heating one's home or driving one's car. There's also kind of top down economic stuff, which I think is often like way too quickly brushed past as well. Like chat GPT is 20 bucks a month, you know, that sort of puts a pretty clear limit on like how much energy it could really be using. Of course, they could be subsidizing it, but they are subsidizing the free users, presumably in part, you know, with the revenue from the paid users.

• 23:26Nathan Labenz?

  What do you find to be the most, probably at least dabble in all three of those and maybe even more different ways of thinking about it. But what do you find to be the most intuitive or resonant way to start to break this down for people?

• 23:38Speaker 01

  For a while, I was mostly making those kinds of individual comparisons and I was finding that in a lot of places they didn't hit. And I was trying to figure out why, whereas like, oh, you know, it's this much to charge your phone. It's, you know, a microwave can add up to being like hundreds or even like if you use it for long enough, like, yeah, I all limit it to hundreds for now, chat GPT prompts and stuff like that. But for some reason that wasn't getting through to people and people would still be like, oh, but it's still more, you know, like no matter how little it is, it's still more emissions in total. And I realized that they weren't getting this other big intuition I had. So my elevator pitch, like if I meet someone at a party now, my general pitch is that, to the best of my knowledge, based on all the resources that we have on this, once you add up all the ways that a chatbot can cause emissions,

• 24:20Speaker 01

  like not just including the inference, like the cooling, the training, the embodied cost of the hardware. My best guess like right now is that lands you at about 0.3 grams of carbon emitted per prompt on average. And I'm making a lot of assumptions, assuming that's actually kind of high. And that's about one one hundred thousandth of your daily emissions. And so what that means is that you would have to prompt chat GPT something like a thousand times to increase your emissions by 1%. And if you did that, if you were spending the entire day, you mean nothing but prompting chat GPT and reading all the responses, that would probably take you something like 10 hours or something at least. And if you think about it, like spending 10 hours a day on something that only uses 1% of your emissions,

• 25:04Speaker 01

  actually implies that your emissions will be way lower than they would otherwise be, if that makes sense. Because most other things that we do in our lives, like we're not just going to be sitting, not doing anything all day. Like we would be like taking a walk or like driving our car or something like that, or even like watching a show on TV. And so if chat GPT is this small, it actually probably means that anything you replace it with will emit more, except for other things online, like. Computing is just so wildly efficient that like almost nothing else we do uses as little energy, basically. And so like my elevator pitch is basically like it's ChatGPT actually uses so little energy that on net, it actually seems much more likely to reduce your emissions. Because in general, like probably the single most like climate optimized way you can live

• 25:46Speaker 01

  your life is living in a big city, being vegan and spending literally all your day on your computer. And like I checked two of three of those boxes. Like I try to get out, you know, but like, you know, and like, I don't spend all day on my computer, but like computing is just so efficient compared to most other things that we do that it's just not a good thing to trade off if that's what you're worried about for the climate, basically. So that's my basic pitch. And like can go into a lot of the other comparisons, like I like making the comparisons to microwaves and stuff like that. But like, basic ground level thing is that this is going to reduce your emissions if you trade it off against anything that's not on the computer specifically. And it's just so small that it would kind of be sad if we were focused on this in any other context. It's taking like a little dropper from your pot of spaghetti and like, oh, I need to save a few drops for later, you know,

• 26:31Speaker 01

  like something like that. I think we would call correctly a distraction for someone so focused on climate and environment stuff. So that's my basic pitch in a nutshell.

• 26:39Nathan Labenz?

  Yeah, I think the bits versus atoms distinction is a pretty strong place to start. It is, I often think about the, the energy that it takes to charge a phone. I was really, and this is something actually GPT four, a little bit of lore, is that the original GPT four, while I was doing the red teaming, this is now like, you know, basically three years ago, a little more than three years ago at this point, it, you know, really took me through some of these energy analyses very early on. And it was one of the kind of eureka moments where I was like, man, this thing can really help me educate myself in all these different areas. But I was shocked to learn that a typical cell phone to charge

• 27:17Nathan Labenz?

  it fully is something like 20 watt hours of energy, which in my jurisdiction in Detroit, Michigan is about a third of a cent. Worth of electricity. And we've now also heard a lot recently that the brain itself runs on 20 watts. So the energy that your phone works on for, say, a, you know, whatever, depending on how intensively you use it, a 12 or a 24 hour cycle, that's the same energy that your own brain is using in just one hour. So already, you know, all the things that your phone is doing, and, you know, obviously we've seen language models that can run on phones and we've, you know, not the frontier ones, of course, but, you know, you can run Jemma models, you can run things on your phone, you can run things on your laptop.

• 27:58Nathan Labenz?

  Those are literally running on less energy than your own brain, which is a, you know, an interesting start.

• 28:04Speaker 01

  It's crazy.

• 28:04Nathan Labenz?

  Comparison.

• 28:05Speaker 01

  Yeah.

• 28:06Nathan Labenz?

  And it really just kind of goes up from there.

• 28:07Speaker 01

  Yeah, yeah. And like, this is actually a reason why I've mostly moved away from comparisons to individual objects, because I've realized that most people, including me before I started, like, don't actually have much of a solid idea of how much energy individual objects use. Like, I've actually come to think that most people seem to have a scale in their head where something either uses a little amount of energy, a normal amount, or a lot. And it's one of those three, basically. And so they might think like, oh, ChatGPT uses like, this isn't actually true, but like, let's say ChatGPT uses as much energy as it takes to charge your phone. They might think like, oh, that's a normal amount. So ChatGPT is adding this new significant thing to my carbon emissions. And they're not thinking about just how big the scale is.

• 28:50Speaker 01

  Like, you know, without getting into Twitter stats too much, I just had a guy respond to me the other day and being like, oh, ChatGPT uses as much as charging your phone or running a microwave for an hour. And I wanted to hit the brakes and be like, well, those are two very different quantities. You know, like, almost nobody seems to notice just how little energy it takes to charge your phone specifically, and this is like a comparison that gets made a lot. And so, like, I can make these other comparisons where it's like, yeah, it's something like 60 chatbot prompts per like phone charge or something like that, or per like minute of microwave or something like, a chatbot prompt is effectively like a second of a microwave. I will flag actually here that like, whenever I say a prompt, I'm talking about like the median chatbot prompt and like, this is a whole separate thing we can get into with like much longer prompts and stuff like that, but like, we need a place to start.

• 29:32Speaker 01

  And so, yeah, these comparisons to household stuff can sometimes be less helpful than I expected because a lot of people still, including me, a lot of the time, don't have much of an idea about this. But yeah, it's something like 60 prompts per phone charge or like about a prompt per second of using a microwave or something like that.

• 29:49Nathan Labenz?

  Yeah, that's helpful. Well, maybe let's dwell on it a little bit more and maybe we can kind of help popularize a few of these memes. So.

• 29:58Nathan Labenz?

  I guess, you know, orders of magnitude are always kind of helpful, right? Like, the human body runs on basically 100 watts, 20 watts of that is the brain. So now we can just look at a few household appliances. The microwave typically runs at about 1,000 watts. An electric teapot, and the themes here obviously are like, heating things is energy intensive, right? So the microwave is heating, the electric teapot is also about 1,000 watts. Those are heating things. Running my furnace here in the wintertime, you know, though a lot of energy is going through that, and obviously it depends on how cold it is outside and all that kind of stuff. It roughly shakes out to, at least for electricity, from what I understand, the average US home is doing about 1,000 watts of electricity on an averaged out basis.

• 30:42Nathan Labenz?

  And obviously, you know, when you turn on your microwave and whatever, that spikes up relative to your baseload. But like, rough intuition is, a home is running on 1,000 watts, a body is running on 100 watts, a brain is running on 20 watts, and ChatGPT then comes in with, you said, one, one prompt roughly equal to one second of a microwave?

• 31:05Speaker 01

  Yeah, uh huh, yep, yep, just like that, yeah. And like, you know, inner physics teachers coming out, so I just want to flag for the listeners, yeah, a watt is a rate of using energy, and then a watt hour is a unit of energy, because it's that rate multiplied by a certain amount of time, basically. So yeah, 1,000 watts, if you run that amount of power for an hour, you use up 1,000 watt hours specifically. And so, yeah, a ChatGPT prompt from best I can tell is between like, 0.3 and 0.6 watt hours for the median prompt, and that is going to, yeah, it's effectively like, running a one watt thing for about like, 0.3 to 0.6 hours. And like, a one watt thing is also like, an alarm clock or something. So like, if your clock is just running, a digital clock specifically, so if your digital

• 31:49Speaker 01

  clock is running normally, 0.3 watt hours is about the same as like, 0.3 hours of running a digital clock specifically.

• 31:58Nathan Labenz?

  Yeah, that's really, and I guess it's also worth noting the a kilowatt hour is the typical unit of electrical billing. So when I said it's, you know, 20 cents in my power jurisdiction, that 20 cents is for a kilowatt hour, which also then leads to another kind of interesting comparison that if my $20 ChatGPT subscription went entirely to energy, it would buy 100 kilowatt hours, which would be basically four days of a typical home electrical usage. And that would assume again that they're taking, obviously, we know that we can get into this in more detail too, but obviously, we know they're

• 32:41Nathan Labenz?

  not turning around and spending all of my $20 on electricity because for one thing, you know, they've got chips to buy and they've got, you know, researchers to train and all sorts of other costs. But that kind of gives you a absolute max. If you were to just spend $20 more on electricity, you know, that's kind of roughly increasing your typical home electrical bill by 10%. And so again, it's like way less than that. So we kind of seem to be coming down to these like 1% ish numbers. It's probably still significantly less than that today. You had said like, you got to get to 1,000 prompts a day to increase your overall footprint by 1%. And I do think that's where, you know, certainly the people at the model development companies think we're going. And that's why they're, you know, planning

• 33:22Nathan Labenz?

  such big build outs. But it is hard to imagine usage that moves one's overall energy footprint all that much more than that.

• 33:33Speaker 01

  Yeah. And I will flag too, that when people talk about energy, obviously, there's some concern about electric bills around data centers. But mostly when people talk about this, they're actually using it as a proxy for carbon emissions, right? Because like we're worried about climate. And something else that I think doesn't get through to people a lot is that something like I don't have the exact number, but it's something like 25% to a third of our carbon emissions come from the electricity that we use and two thirds come from other sources, like direct use of fossil fuels, like driving your car as an example. And so like even within that electricity, so assuming that like all of your money, all of the $20 is going to chat GPT and it becomes like four, four days of your like household bill and 10% of your electricity

• 34:14Speaker 01

  use because your electricity use is only about 25% of your actual emissions, like that actually drops even more to something like maybe, you know, like 3% of your actual emissions. So like the absolute most ridiculous situation where like OpenAI is taking your money, spending all of it on electricity all the time, which it's actually just much smaller than that. Like even there, the absolute most this could possibly be raising your emissions is something like 3%. And that would actually be significant, you know, like something that raises your emissions by 3% is like definitely not nothing, but my claim is also that it's much smaller than that. And that's like the absolute most that can be economically, unless of course like chat GPT is just giving everyone huge amounts of free energy, which just doesn't seem likely, you know, like AI companies just don't want to do that if they can avoid it.

• 34:59Speaker 02

  Hey, we'll continue our interview in a moment after a word from our sponsors.

• 35:05Speaker 01

  Yeah, well, there's maybe a good way. I don't know if this is the next place we should go immediately, but another good angle of attack on that question is what does it cost to buy chips? And then what does it cost to run chips? Do you think we should dig into that now? Yeah, let's do it. Yeah, I was looking into this a little bit and it's actually pretty counterintuitive where the cost of a chip versus the cost of running it in money actually doesn't seem to tell you very much about like the carbon costs involved because most of the actual cost of the chip seems to be like the Nvidia premium and like the cost of like these incredibly complex supply chains all working so well together and like the market, you know, basically, you know, Nvidia running a lot of this stuff basically. And so there's this huge premium

• 35:48Speaker 01

  that you're paying. And so as an example, so in eight, in eight GPU H100 server node costs about $300,000 and over a four year lifespan, the server will consume about like Thirty five thousand dollars in electricity, which is only about 10% of its purchase price. So like this chip, as an example, 90% of the cost is in purchasing it and only 10% is in actually running it. And so you might think that like, if that's the case, maybe most of the carbon cost is also in actually producing it. But the price is actually just mostly reflecting other stuff. One way that one intuition I have that's pretty useful for this, and I'll talk about more of the proportions in a second. But like ultimately, when you think about it, like an AI chip is just designed to have electricity flowing through it

• 36:31Speaker 01

  as much as possible, like over its entire lifespan, you know? And it's if I designed a wire and it just started to flow electricity through the wire until the wire burned out. And I was like, okay, what took more carbon, like making the wire itself? Or like making all that electricity to flow through the wire to the point that it eventually blows out. And like, I don't know, it's kind of similar to like, I've never once thought about the carbon emissions of like the wires in my home. But I have thought about the carbon emissions of my electricity bills a lot. And so in the same way, I, because so much electricity flows through AI chips, we should basically expect most of their carbon cost to actually be in the electricity itself, rather than in the embedded cost of making the chip in the first place.

• 37:13Speaker 01

  And Nvidia conveniently actually shares the carbon cost of all its chips. Now it seems like one positive aspect of people focusing more on the environmental stuff on this is that a lot of companies are just doing this more. And based on what I can tell, it seems like the ratio is something like 20 to one of the carbon of the electricity versus the actual embodied cost of making these chips itself. So it's actually like wildly disproportionate where it's something like, like at least 10 to one in the other direction of the cost of like purchase, purchasing the chips in money versus like the cost of the electricity. But the carbon cost is completely flipped where most of the carbon cost is in the electricity.

• 37:49Nathan Labenz?

  Yeah. So another way to think about that or kind of validate that would be if it costs $300,000 to buy this pot of eight chips and then $35,000 to run it over a lifespan of four years, then

• 38:07Nathan Labenz?

  We all knew right off the bat that Nvidia's margins are something like 80%. So that takes down their, you know, cost of marginal production to something like $60,000. And that still includes, you know, the relationship with TSMC and, you know, shipping the things all around the world and all that sort of stuff. And so you kind of have at least a governor there on the top of like, well, it can't be more than that because they've, you know, we know what their margins are. And then you're also, you know, highlighting that they're just straight up publishing an analysis of what their energy is and saying it's like, did you say 1% of total?

• 38:42Speaker 01

  Oh, it's 10%. It seems like that or like about the energy cost of running energy in like dollars is about 10% of the cost of actually purchasing the chip in the first place with money. And then the carbon cost is flipped towards something like 20 to one. The carbon of the emissions of actually using the electricity is like 20 times as much as that. And it could get even higher because like a lot of AI data centers are built with grids with obviously like reliable, cheap energy. And unfortunately, right now, in the reality we live in, that tends toward more fossil fuels being used. And so as a result, like their electricity might actually be even dirtier than the grid average. And so like, that's another thing where that's actually raising the carbon cost even more.

• 39:22Nathan Labenz?

  So out of a $300,000 pot of eight, you can then expect a, call it, you know, 10 to one, call it a $30,000 energy bill over the lifetime of the chip. And then if you flip back to, well, what was the energy cost of that on the production side? It's another 20 to one reduction, AKA something like $1,500 spent on energy. Or in other words, like half a percent basically of the original cost of the chip. It's always interesting to kind of flip these things back and forth between money and emissions. But

• 39:58Speaker 01

  Yeah, because the markets are so like weird here, it just like doesn't track very closely like money just tells you like very little about like how much was emitted at different points. And I think that in general, this is a really funny area where sometimes when I talk about the carbon cost of a median prompt, people will be like, oh, but you're not including these hidden costs, you know, like these things like the embodied cost of the hardware itself. And like they'll never actually try to make a guess at what that actually is. And like when you poke at the embodied cost of chips, that anyway, seems pretty marginal, you know, it's like 10%, 5% sometimes. So that doesn't really concern me super much. It doesn't add too much to the cost. Like the real like secret cost that I do think actually significantly raises it is the cost of training the models.

• 40:41Speaker 01

  But that's like a software question rather than my hardware question, obviously. So that's like something else we can talk about, but there like my best guess right now is that maybe it like doubles the full energy or emissions cost. So it goes from like point three to point six watt hours or something like that has pretty wide error bars, but yeah, I can go into that separately, but at least for like, at least for the hardware, I think it makes about as much sense to worry a lot about the embodied carbon cost of AI chips as it does to worry about the embodied carbon cost of like the wires in your home that electricity flows through. You know, like these things are just so hyper optimized. And there's also just like something, a common theme about this is that like so many people are being paid to think in really complicated ways of optimizing the energy use of these chips as much as possible. You know, there's just like a huge amount of incentive to do that. And so like, we should expect that like,

• 41:27Speaker 01

  yeah, there's a lot of electricity flowing through them, but also that they're like relatively optimized, just a lot of stuff to say basically, but yeah, I expect that most of the costs in general of a chip to be in like running the energy through it rather than in the energy used to make it.

• 41:41Nathan Labenz?

  Yeah, okay. I think that's quite helpful. Do you want to do, I know you said these don't always hit, but I want to I think I love person to them. You want to do one to like driving a car or taking a flight?

• 41:52Speaker 01

  Yeah. So like, this is actually, let's see, best I can tell is that if you're driving a car for 20 miles or so, that's going to probably emit three to four kilograms of CO2 if it's a sedan. And that's something like 10,000 chatbot prompts or so. And so like, I sometimes think about it like if I didn't want to feel guilty about chatbot prompts, like if I was worried about that, you know, if I avoid a single car trip, I get 10,000 free chatbot prompts to use however I want. This is also like an interesting argument for ways that chatbots might be able to on-net reduce someone's emissions in other ways. Like, I think in these conversations in general, something else I try to flag is that almost all of the climate impacts of AI and environmental impacts in general are almost definitely going

• 42:36Speaker 01

  to come from how AI is used rather than the actual energy used in data centers. Like, for the same reason that all other computing works the same way. Like, if we're trying to think about Amazon's impact on the environment, you know, there's like shipping and like other things that it affects. But like, looking at the energy cost of running the Amazon website in data centers isn't going to tell us very much about its total impacts. And so, like, if AI is actually changing your behavior at all, like, that's just where most of the impact is going to be. And so, if one of those 10,000 chatbot prompts that equals a 20-mile car ride, like, prevents you from taking that trip, like, you realize, oh, I looked into this and I don't actually need to drive out to do this thing, or I can get it somewhere else, like, that's at least going to modify your behavior enough that, like, that's going to significantly change your emissions. Like, potentially not for the better either, like, maybe it's the case that it will cause

• 43:20Speaker 01

  you to do something else that is maybe silly, but the comparisons here get kind of comical. Flights can get up to, like, the millions at times, so like, a single intercontinental flight, or, sorry, transcontinental flight, can, I think, go over, like, at least 1 million and potentially 2 million chatbot prompts, which is more than I'll probably do in my lifetime. Like, I consider myself to be a chatbot power user, but I'm probably not going to hit that, you know? And so, like, if I decide, you know, if I make a very extreme decision, like, oh, I won't take that, you know, European vacation this year, but at least now I can use chatbots basically forever without any guilt. Water comparisons actually get even more ridiculous because, like, I think the average person just doesn't actually know where most of their own water footprint is because the

• 44:03Speaker 01

  main way we experience water in our lives is, like, in the water we drink, maybe a shower, water in our lawns if we have one, and most of the actual ways that our lifestyles consume water is way far away from our homes. It's like, in the food that we It's in like the power that generates our home or that is used to power our home and stuff like that. And there's some like, I'm pretty sure that the average water cost of a prompt, if you include everything, including the offsite cost, rises to something like one eight hundred thousandth of your daily water consumption. When you include everything else. And so there the numbers get really silly. Like, I'm pretty sure that if someone avoids buying a single additional pair of jeans, like that is worth a million chatbot prompts worth of water or something, just because like jeans

• 44:47Speaker 01

  might require like irrigated cotton to grow or something like that. And so, and this kind of is like, this makes intuitive sense to me because if I think about how water is being used. In the jeans case, like huge amounts of water are flowing to like grow plants and like they become part of the plant itself. Whereas with AI, it's flowing in the vicinity of hot computers, basically. And like, it's capturing some of the heat that my individual prompt generated. And I'm like, well, how would I expect the proportions here to look? Ultimately, it makes sense that there can be these huge order of magnitude differences between those things. So, yeah, a lot more comparisons I can make, but at least with like energy, yeah, like a single second of your microwave is probably about a chat GPT prompt, or even like three

• 45:29Speaker 01

  or so, it just gets pretty comical pretty fast. And so, like, if you're willing to like, use your microwave for a few additional seconds, you should be okay with a few additional chatbot prompts too. And this is actually a good comparison for longer prompts, because some people will be like, oh, what Andy's saying is about median prompts, but obviously there are all these other things. There are these long like coding tasks and reasoning tasks and stuff like that. And it's true that those use a lot more energy, but it seems kind of like just running your microwave for longer. And like, if I had a friend with a microwave that if you used it for a minute, could produce like a very thorough research overview of a field, you know, or it's like, ooh, I heated up a new like, you know, some, a ton of new useful code for whatever I'm working on.

• 46:11Speaker 01

  Like, I wouldn't actually be super bothered if they were using the microwave for that, you know, like I use it to heat like vegan chicken nuggets, and I don't feel bad about that. And like in comparison, like when these larger models start to get talked about, and it's like, oh, like, you're either using, the prompt is much longer, or the reasoning time is much longer, like that definitely adds to the cost, but I think like anyone who's used like a deep research prompt or a coding prompt also knows how valuable the outputs are compared to like even a normal prompt. And so like, Basically, the microwave comparison is really useful here because it can basically be like, oh, this thing is like a microwave and like however long it takes is kind of like running a microwave that long with error bars, obviously. But like, at the end, if like I had a microwave in my home

• 46:53Speaker 01

  that produced a deep research level response to something, like I would be using that quite a bit and not feel super bad about the results personally. So yeah, all I have to say about that, but like the comparisons can be useful here in a lot of ways. Once you like get the context down.

• 47:08Nathan Labenz?

  Yeah. So let's, let me just kind of re-derive maybe a hard one again, just for my own and everybody's benefit to get the reps on kind of stepping through it. So let's say I have a 20 gallon tank in my car. That's one way I like to think about it. The unit of the fill up, right? So I've got gasoline weighs about five pounds a gallon. Water is eight pounds a gallon. Gasoline is lighter. So roughly you fill up your car with a 20 gallon tank. You have put 100 pounds of fuel into the tank. Now that actually becomes a lot, somewhat surprisingly or weirdly becomes a lot more massive as it gets converted to exhaust because your hydrocarbon is basically just a

• 47:52Nathan Labenz?

  chain of carbons with hydrogen atoms alongside it. And each carbon atom becomes a CO2 in in full combustion. You can have CO, I guess, in there as well. But obviously, we're going to simplify away a lot of details. So we'll call it CO2. Oxygen weighs more than carbon. So you've more than roughly speaking, you've tripled the mass for every carbon atom that gets combusted. You have a CO2 triple the mass. So I've gone from 100 pounds of fuel into the car to 300 pounds of emissions, which if I convert that to kilograms, we'll call it 150. And then that

• 48:34Nathan Labenz?

  becomes 150,000 grams. 150,000 grams compared to one chat prompt was a third of a gram. So my full tank of gas gets into the range of roughly half a million.

• 48:50Nathan Labenz?

  Chatbot, median chatbot prompts. And then you had scaled that down by, let's say I took just one 20 mile trip. That would be like one of my 20 gallons. So if I divided that by 20 from half a million, I get down to 20, 25,000, like 10,000. So I kind of came at it from a different angle, but we ended up within like 50% of each other.

• 49:11Speaker 01

  Yeah, yeah, I should double check the numbers there, obviously, because it gets a little hand wavy at the extremes here. But yeah, yeah, exactly. I think like that this brings back when I was first learning about climate change. Actually, I remember hearing the fact that like, oh, if you see a huge pile of coal and that's all emitted, the CO2 weighs so much more than the pile because oxygen is being added to it. And I remember just having this deep sense of like evil, like coal is just such like the ultimate bad guy in like climate conversations, that it's just like a really funny fact that like this stuff that you use will end up actually adding way more to the atmosphere than it itself weighs. It's pretty crazy. But yeah, that's a really good intuition. Yeah, like a full tank of gas can use like at least like hundreds of thousands of chatbot prompts. And like, we do that pretty regularly.

• 49:53Speaker 01

  This leads into another interesting general comment on like climate stuff where the main way that we emit and like the main way that like most of our emissions happen is actually with stuff that is otherwise very useful to us. Like, I think people sometimes have this idea that like, oh, well, I should focus on chatbots a lot because I think chatbots are useless and it's a useless form of emissions. And I think that like, something like 99% of the actual emissions reductions that we need to make are actually going to be in like the useful category and like highlighting these like tiny little useless quote unquote emissions, like it makes sense to worry about those, like obviously we want to emit less if we can, and if something's useless, we want to cut it. But in terms of the amount of attention it should actually take up, like the big challenge

• 50:35Speaker 01

  of climate change that's actually preventing us from making change is how much emissions are actually very useful, like driving a car is very useful to me. And so like, another part of this debate that I find comes up a lot is that no matter how small I can express the chatbot as how much, how small the emissions are, like people will be like, oh yeah, but it's useless and it's just a silly plagiarism machine. So it's, we should somehow focus on it more than all these useful emissions. And like, I kind of want to get it through to them that like the useful emissions are actually so large and so much more difficult to change. That's what needs the most of our attention. And so a lot to say about that, but like the car example just brings up a lot of different associations there.

• 51:13Nathan Labenz?

  So just to repeat it one more time.

• 51:14Speaker 01

  Yeah, yeah, yeah.

• 51:15Nathan Labenz?

  One crosstown 20 mile trip is worth order of magnitude 10,000 chatbot prompts. One tank of gas, 28 times more than that is worth something like a quarter to a half a million chatbot prompts. And then if we go up to a cross country flight, we take basically another couple orders of magnitude up and we get to basically like a million, which again makes sense if you think figure, you know, just the cost of the flight and how much of that goes to energy from what I've seen, like a non trivial, unlike the AI companies, like the airlines are actually indeed turning around and spending a pretty significant share of your money on

• 52:00Nathan Labenz?

  the jet fuel. And so, you know, you might be spending north of a hundred dollars per passenger on jet fuel to get this country.

• 52:08Speaker 01

  Yeah, like it actually brings up like a funny intuition where like driving solo actually seems to emit about as much as like a long plane flight as a passenger specifically, which I think people have some weird intuitions about where they think like the plane might be a thousand times worse. But driving actually is just surprisingly bad. And the main way that like flying adds to our emissions is that it just causes us to travel a longer distance rather than like per mile being worse. And so like, it makes sense that like the plane scaling up is going to be about the same as like an equivalent amount of like distance traveled in the car. And yeah, this all just adds up to like comical amounts of like chatbot prompts. It's just like, you know, even if you thought this was evil, but you saw any value in chatbots at all, you could just like skip a single car trip and be good for like at least a year of prompting or something like that, you know?

• 52:51Speaker 01

  And so like, I try to get across that, like all these cuts just seem very depressing to focus on in the first place. Like back when I was talking a lot more about climate change, when I was in college, there was just like a really great general consensus that the name of the game is systematic change and like changing the energy grid. And like there, you can have hundreds of thousands of times as much individual impact as anything you can do in your personal life, even more extreme things like, you know, I'm like vegan and you know, I live in a city and stuff like that, and that's good, but like, that's just not nearly as impactful as just like. Being one small part of a group of people who opened a new solar plant or a battery facility or keeping a nuclear power plant open or something like that. And so like within personal lifestyle stuff, just like if you're going to litigate anything,

• 53:33Speaker 01

  like litigate like a few big things specifically, just like by the time you get to chatbot prompts, it's like as if you're like pausing YouTube a few seconds early for the sake of the climate or something. It just it like honestly, a part of this debate is like quite depressing to me because I feel like the general climate conversation has receded or gotten worse since I was talking about it. We're like, there's so much hyper focus on these tiny things that just aren't going to matter compared to like big systematic stuff we need to do.

• 53:58Nathan Labenz?

  Yeah, that's, that's weird.

• 54:00Speaker 01

  Yeah.

• 54:01Nathan Labenz?

  I really know, it's, I don't really know what to say about that.

• 54:03Speaker 01

  It's upsetting, yeah.

• 54:04Nathan Labenz?

  But I guess that's why we're here.

• 54:05Speaker 01

  Yeah.

• 54:06Nathan Labenz?

  Okay, so 10,000 prompts per 20 mile car trip, a million prompts ish for a cross-country flight. One prompt is one second of microwave. Hopefully these start to put people's minds a little bit more at ease.

• 54:28Speaker 01

  Yeah, I, I, actually, one other comparison that I realized we hadn't made yet is that like, I just want to make it completely clear that there's a really common talking point that I just want to never be mentioned again because it's just so wrong and so off, which is the like, a chatbot prompt uses a bottle of water, basically. Like, if you look into where this came from, it was this really misleading article from the Washington Post that basically like took this really wild estimate of how many chatbot prompts it would require to write a hundred word email. It seems to assume like 10 to 20 prompts to write the single email. And like, you know, I'm a power user of chatbots, but I don't use that many. And like even there, it assumes all these other wild things like chips hadn't gained any efficiency in like five years since before they were commercialized, like specific things

• 55:11Speaker 01

  about training and evaporating water from like hydroelectric plants, like all these things that together just tell this really, I think, misleading story. And the actual amount is something like one two hundredth of that. It's something like two milliliters of water. And like, this just seems pretty conclusive based on a bunch of different estimates and different studies from people. And so like, yeah. The general comparison to water specifically, I always just want to flag that like maybe the single most popular wrong piece of information about these chatbots is that they consume a bottle of water for prompt. This is like not the case. You'd have to prompt them about 200 times to use a bottle of water. And also you use like thousands of bottles of water, or maybe not thousands, but at least hundreds of bottles of water every day in your consumptive use. That you don't see because most of that is offsite in the electricity you generate and in the food that you eat.

• 55:57Nathan Labenz?

  Yeah, I didn't pre-run the numbers on a hot shower, but I suspect there's an awful lot of prompts in a hot shower.

• 56:02Speaker 01

  Yeah, and like I could say all kinds of crazy things about hot showers, actually where like a lot of the water that goes into the hot shower is the water used to generate the electricity to heat the water. Basically, it's just like the way we use water is just like very like interesting and sometimes comical. Because like so much of the water we use is actually used to generate electricity where like even your alarm clock like has a big offsite water cost. Like my best estimate is that like the average digital clock uses something like three liters of water offsite at a power plant per month. And so like even there, that might be invisible to you and you might not know that this thing is burning through three liters at a time. So yeah, a lot of stuff to say about that, but like a part of the reason why I've been writing about this so much recently is that it's honestly just pretty cool. There are a lot of like a lot of counterintuitive ways that we use energy and water and stuff like that.

• 56:47Speaker 01

  And I think like the chatbot conversation can honestly be really fun and once you contextualize it in like the counterintuitive ways that like society uses water. And didn't even touch on like all the like kind of goofy excesses in like animal agriculture and stuff like that. Like that's its own separate topic.

• 57:02Nathan Labenz?

  Yeah, well, I I think agriculture would definitely be worth doing a couple little comparison exercises with too. But maybe before we do that, can how should we think about the relationship between energy and water? And like, what does it mean to use water? I think there's conflation going on in many cases where people in some cases think like this water is used like it's like destroyed or it's like contaminated. And obviously. Contaminating water is a big problem. My sense is that's not really what is going on. When that's not what people are referring to when they refer to water use, right? This is more like

• 57:44Nathan Labenz?

  evaporative cooling kind of processes where the water is not like removed from the water cycle entirely. It's just sort of put into the air from, you know, wherever it was before that. But, you know, help me sharpen that up.

• 57:56Speaker 01

  Yeah, three different categories of using water that is useful to think about. So first of all, there's, I think the most important category to know about is consumptive use of water, which is water that withdraws from a very local source and either evaporates it or does something else to it that causes it to leave that very specific source of water. And that can be disruptive for like high water stress areas because the water might not be returned at the same rate and over time things can dry up. So consumptive use is kind of like the main harmful way that water can be used, basically. There's also water pollution where water is returned polluted in some ways. AI itself, data centers can contribute to this a little bit because they can use specific chemicals in the water to keep it like very clean,

• 58:40Speaker 01

  but they might return some of it to a local system polluted with these chemicals. This doesn't seem to be nearly as big of a problem as like the pollution that might come from agriculture, but it's definitely not nothing like that's something to worry about a little bit. And then the other thing to focus on is non-consumptive withdrawal of water, which is where you take water, use it and then basically give it back to the source. And a lot of the ways that we generate electricity, as an example, mostly use like non-consumptive like water withdrawal where takes water, maybe returns it a little bit warmer than it was before. That can sometimes create some problems. But for the most part, it's just taken and put back. And so this can lead to some really wild confusing statements about how AI uses water, like

• 59:22Speaker 01

  one very popular statement about AI water use is that by 2027, it's projected to use 50% as much water as the entire United Kingdom. And like, if you actually look at what that means and like what that 50% is, something like 90% of that is the water that power plants withdraw and then immediately put back after.

• 59:42Speaker 01

  And I think that paints a very different picture. And then another something like 5% or 7% of that water is the water consumed in the power plant and not in the data center itself. And only about 3% of that amount is going to be like in data centers themselves specifically. And so like when people hear that, I think they imagine like half of the UK's water flowing through data centers. And what's actually happening is that that's only going to be like, you know, at most, maybe like 5% of the UK's water, which is definitely significant. It's not nothing, but it just shows how easy it is to really wildly and sometimes unintentionally mislead people about it. Because like the way we use water is so counterintuitive. One other thing to note is that there's an important difference between fresh water and potable water, which is water that's been improved enough to basically be like drinking quality.

• 1:00:25Speaker 01

  Data centers themselves rely a lot on potable water because it's very important for the water to be very clean as it moves through the data center. So as not to like dunk things up, basically. But from what I can tell, actually, like, there's not too much of a problem right now in converting fresh water to potable water. And like, there are actually economies of scale where if you're converting more of it, like that can actually make it cheaper rather than more expensive. There's a lot of stuff to say about that, but another common thing that gets said is that AI is using drinking water. And that sounds like a big emergency because obviously people need water to drink and stuff like that. And I think people have a really weird understanding of the relationship between drinking water and fresh water, which is basically just like not salt water. And it's actually like, the big constraint in a lot of areas is just how much access to fresh water people have.

• 1:01:09Speaker 01

  And not so much how much access to like drinkable water people have, because there can be times when economies of scale can kick in. And there's a lot of uncertainty about this. Like, I want to flag that like, I'm basically just some guy here who's done a lot of deep dives on this topic over the past few months. And so I'm reporting what I know to the best of my ability, but I'm not an expert. And if you think I'm getting anything wrong, like, please email me right away. Like, that would be very embarrassing. But what I'm saying is based on just like a lot of reading and a lot of like individual ideas that each aren't actually super complicated, but can be like confusing when you first bump into them, basically. So like, yeah, a lot more to say about water, but those are the like really useful categories to understand.

• 1:01:47Nathan Labenz?

  So let's bottom line that again, one more time. We got the three categories. A lot of what we're taking out to do this cooling can be put back. That's not without any issues.

• 1:02:01Nathan Labenz?

  What should I say at a party?

• 1:02:03Speaker 01

  Oh, so super quick, I will, God, yeah, what should you say at a party? I will find that most of the water that flows through data centers themselves actually does seem to be consumed where it's evaporated, where like maybe 20% of it is returned to like local sources and stuff. And sometimes a little bit polluted that needs to be treated. What should you say at a party? Okay, so my best guess right now is for like, first of all, I would just describe like consumptive versus non-consumptive use. Where if someone's like, AI uses half as much water as the UK. I would say about 90% of that is withdrawn by power plants and then returned. So we're actually talking more about like 5% of the water that's actually consumed by the UK. Like consumption is the big problem. That's like, obviously withdrawal has some issues, but like the main thing I'm worried about is water that's not returned.

• 1:02:46Speaker 01

  And then within that, AI is like kind of a small percentage of that. Like my best guess right now is in 2023, and obviously lots changed since then, but this is the last time we have good data. My best guess is that I'm from a town of about 15,000 people. And in 2023, I'm pretty sure that AI in America used like eight to 10 times as much water as my town used. And that's not nothing, but it's basically like spreading 10 towns of 15,000 people each all across America. And if you just ask like, how big of a water problem would this be for the country? I don't actually think that would be a super big deal. Like it comes with some interesting planning problems, but like I usually keep in the back of my pocket like, oh, it's about this much, at least it was two years ago. And then I can talk about how much it's changing and how much it's going on.

• 1:03:30Speaker 01

  But like, the two things I would say are, yeah, like those water statistics, here's how much of it is actually consumed. And then within that consumption, how much is AI, like maybe 20 to 30%? And how much does that compare to like just towns or like other things that are using water? And I kind of lose sight of like how clear this is to other people when I'm talking because I've been sowing the weeds. So like, if you want to rephrase that for yourself, that might be useful here.

• 1:03:52Nathan Labenz?

  Yeah, well, I'll do, I do think the comparison to towns and cities is really helpful. I've done that for myself a little bit more on the energy side. So maybe I'll do the energy and then you can try to do the water. It is pretty handy that the latest chips basically run 1,000 watts as well. The H100 was like 700 watts. There's a little bit of extra, you know, kind of padding on top of that for the auxiliary things that also consume power at the data center. The, you know, bigger and better chips use a little bit more, they're getting a little bit more efficient, not necessarily like. A ton more efficient in terms of like flops per, per energy these days because a lot of the low hanging fruit there has been picked.

• 1:04:37Nathan Labenz?

  But roughly speaking, we can still sort of round to 1,000 watts per chip. So that notably is like the same as a home. And then you can kind of work that to these like big data center build outs. So if somebody's going to do a gigawatt data center, that is a billion watts, which would be a million chips if each chip is at a thousand. And that would translate to basically a million homes worth of electricity. What I've seen from the Stargate plans, for example, is that they are trying to get to five gigawatts over, you know, a couple of years of this build out.

• 1:05:20Nathan Labenz?

  So five gigawatts would be five million chips or five million homes or a city of, you know, five million homes, which would be maybe more like 10, 12 million people, something maybe around the order of magnitude of New York or Los Angeles, which again is not small, but is, you know, only single digit percentage of the American population, for one thing. And as you noted earlier too, is with electricity being like roughly a quarter of our emissions footprint. If you say, okay, well, you know, New York City is, I don't know, four or five, depending on, you know, whatever metro area, whatever you want to draw the line, call it 5%, call

• 1:06:01Nathan Labenz?

  it 4% of the US overall footprint and then dial that down by the 25, only 25% of your overall emissions footprint is electricity. In the first place, you're basically saying Stargate in its full five gigawatt build out is roughly a 1% contribution to.

• 1:06:22Nathan Labenz?

  US emissions as they exist, you know, baseline.

• 1:06:26Speaker 01

  Yeah, man, a ton to say about this. I actually want to flag that now that we're talking about like big data center level stuff that like all the confidence I just had about the individual prompts. Like I have way less confidence about like how much the data center build out affects things and like some people get a little bit confused by that because like, isn't there some relationship there? I can go into details on like how I think about like how these individual prompts like contribute to the overall stuff and like why this is confusing and why it's not. And once we get into here, like I have to say like gigawatt data centers are just mind blowing. It's crazy to think about buildings like just stepping back and being like, oh yeah, you know, a single building could use like a percentage point of America's household electricity, like

• 1:07:09Speaker 01

  insane that's happening. Like that's just completely mind blowing to me. So like a lot to think about here. And when it comes to this level, like at the individual prompt level, I'm not worried about electricity or water. At the global level, at the level of data centers, I think it's very clear that electricity is going to be the big challenge here, at least from the estimates that I've seen, very like even at the maximum amount of projected data center growth over the next few years. It seems like basically adding about like the water cost seems to be about like an additional 1% of America's irrigated corn, which again, it's not nothing. It's actually quite a bit, but like that's potentially like adaptable, like the system can handle an increase at that size.

• 1:07:50Speaker 01

  But the electricity stuff is like orders of magnitude larger as a proportion of like America's total grid right now. Like that's going to be the huge challenge and like there I'm a lot more uncertain about like, oh, you know, like I could totally believe that this will be very bad for local environments. So I tend to say about that. But yeah, gigawatt data centers, like yeah, very useful comparison, like each of these chips is effectively like a home or at least an apartment where yeah, a thousand watts. Really great, simple comparison to a home and it's like very convenient that it's around there because you can just do the like orders of magnitude multiples. So yeah, the gigawatt is something like a million homes worth of energy. Five gigawatts, five million homes, like completely wild. So yeah, this is a place where I'm like, yeah, I don't know. I'm like quite worried about the local environmental effects of the electricity specifically.

• 1:08:34Speaker 01

  A ton to think about there, but yeah, the yeah, I'm shooting off in a lot of different directions here because I'm kind of awed by the number as a baseline and just want to flag a ton of stuff. So yeah, that's a really great comparison between homes and like data center stuff.

• 1:08:45Nathan Labenz?

  So how do you think about the? I guess we're basically, if I had to summarize the conversation so far, it's like, at the very aggregate level, we are looking at something like a low, single-digit increase in emissions from AI, even with the like mega projects that have been announced, all kind of coming to fruition. From a individual user standpoint, you almost can't get there. Like, those visions are obviously predicated on a vision for the evolution of AI where it's going off and doing like long-running autonomous science and like coming back with discoveries.

• 1:09:26Nathan Labenz?

  And it's sort of like, working in the background for you nonstop. And how does one get to 10,000 prompts a day where you would be potentially using as much energy with AI as you are with like a daily commute? The answer is like, well, it's got to be just doing an unbelievable amount of stuff in the background for you, right? So this is like a very different regime of AI use. And we're accounting for all of that when we say we're getting to kind of low, single-digit percentage increase in emissions. And then water is even less. So that's kind of, okay, great. Now, the next level of analysis that the concerned citizens, including yourself, would get to would be like, okay, well, maybe that's true. And by the way, I would say, just

• 1:10:11Nathan Labenz?

  as a brief anecdote for myself, the offset has been very real for me personally recently. I've talked about this on another episode, but my son currently has Burkitt lymphoma, Burkitt leukemia. And I've used AI nonstop to try to help me understand what that is. And are the doctors doing the right thing? And is there anything else we might be doing, et cetera, et cetera? Okay, how many prompts is that across? And I do everything in triple also. I would go to ChatGPT and Gemini and Claude, and sometimes even Grok, although it's really the main three that I trust the most. So even doing everything in triplicate, I'm probably like, A few hundred prompts over the last, you know, month worth of doing this, maybe a thousand.

• 1:10:56Nathan Labenz?

  So I've still got like a long way to go even to like one crosstown trip. And I would really emphasize how much it has indeed saved me in the real world. Because the things that we were considering that the AI kind of helped us understand like we didn't really need to do. Were like, maybe we should move our entire family to another city to, you know, take advantage of some other medical center that might, you know, have better care. Or another thing is because we had a, again, I talked about this in the other episode, but like, it just so happened that I had a possible issue of mold in my basement. At the same time that my kid is going through this and it was vulnerable to possible mold infection. So I've got these kind of like, well, jeez, what do I do about? The fact that I might have mold in my house and my kid's, you know, extra vulnerable to it.

• 1:11:41Nathan Labenz?

  And I was able to, with the help of AI analysis, get comfortable with, buying a few HEPA filters, putting them, you know, around my house. And I mean, that does have its own energy costs, which again, probably trumps the AI use by a lot. But it's also still a lot cheaper than, you know, going out and renting some other house. You know, and having to, you know, heating, heating my own house and living in another one. You know, and having two houses that I'm heating for the winter, you know, would be even another order of magnitude up easily. So I have personally, in just the last month, you know, offset enough, real world, you know, transporting of my family or like, you know, renting, heating another house kind of stuff. To basically pay for your and my like lifetime of, you know, at least like conventional prompting,

• 1:12:25Nathan Labenz?

  AI use, if not necessarily the full, you know, Altman vision of like, you know, tons of agents working for you around the clock in the background. But I think that part is like, it is worth highlighting because,

• 1:12:39Nathan Labenz?

  I think it is kind of. It can feel hand wavy to people, but you know, like I've definitely lived in a very concrete way that this has saved me from having to do, you know, dramatically more energy and resource intensive stuff and not obviously, you know, financially intensive as well. So the ROI and kind of every dimension there has been outstanding, not even mentioning, you know, the impact that it's hopefully had in terms of reducing the, you know, the overall risk to my son's, you know, long-term wellbeing. So, so that's notable. But okay, so let's get into the local stuff now. We've got, these things are mega projects, no doubt about that. One, you know, big building or cluster of buildings might use as much as a million person city, or you know, you could even imagine that getting

• 1:13:22Nathan Labenz?

  into a couple million people's worth of energy consumed at a particular site. One way I started to think about this is that I was just looking at like, I mean, we can also maybe talk about what kinds of energy are used because that's going to change things a lot too. But, and I get the sense that in the short term, we're going to burn a lot more gas. In the medium term, we hope to have a lot more solar. We hope to have a lot more nuclear perhaps as well. I look at solar and I found that one gigawatt can be provided with basically 10 square miles of solar panels, which is, you know, not

• 1:14:05Nathan Labenz?

  a small area. But then I looked at, okay, let's say that's one gigawatt for, you know, you can get one gigawatt powered for 10 square miles. Okay. What if we go to the full 80 gigawatts that is kind of projected as like the total usage of the, you know, the grand vision, Altman's like $7 trillion build out or whatever. Now you're going from 10 ish square miles to let's say 800 square miles. And that is still less than 1% of the land area of the state of Michigan where I live, or the state of Nevada, which is, you know, sunnier and much emptier. Although there's a lot of empty space everywhere. That's another thing that I think is like dramatically underappreciated. You know, the view from

• 1:14:48Nathan Labenz?

  the cockpit of the plane is like, just so much of the time is like, there's just no, you know, no sign of civilization in front of you. The, you know, the cities are kind of these like relatively small things over the vast landscape. So if we can

• 1:15:05Nathan Labenz?

  Power all of the, you know, grand vision of the $7 trillion build out 80 gigawatts with less than 1% of the land area of either Michigan or Nevada. It seems like it's not like land use per se that is the problem. So how should we start to think about the impact in, you know, localities, right? I mean, there obviously still is like, well, what about Memphis, you know, right by where the, you know, the Colossus thing is being built? What's happening there, you know? Is there something that's like unfairly locally concentrated that we should be more concerned about, even if, you know, this like aggregate is all sounds fine?

• 1:15:44Speaker 01

  Oh, yeah. A ton to say about that. A lot of different directions. Wanted to circle back and just say that your story's been like really amazing to follow over the last few weeks, by the way. And so like, just, yeah, really grateful that you're sharing so much. And yeah, obviously you're doing a ton. Yeah. The Memphis example actually brings up like the single thing that I'm most worried about by far as environmental impact of data centers, like, you know, it kind of like a ranking in my head and like far and away, I think the biggest threat that I'm worried about is air pollution, like much more so than climate impacts as a whole. I can explain why they're much lower on my list, much more so than water. Land use gets really ridiculous where like America just has a lot of land, honestly, like, and data centers are just so incredibly compact for what they're doing. Like, it's just like, if you think about the processes that are happening inside of

• 1:16:28Speaker 01

  them, they're in some ways like miracles of compactness, you know? It's like Moore's Law of the building or something like that. It's crazy. But yeah, like with climate stuff, I think that it seems very likely to me that most of the impacts that AI will have on the climate will be in how it's used, not in the data centers itself. And it seems very likely that there are just so many opportunities to reduce emissions using AI, even just like, you know, this isn't a great example of like current AI, but just like Google Maps, like if you believe that Google Maps has reduced total car emissions on net by like a percent, that's already a huge portion of all global data centers. And that's like one app, you know? And so like, But the thing about climate is that it's actually very fungible.

• 1:17:10Speaker 01

  So like if I emit one unit of carbon somewhere and reduce 10 units of carbon somewhere else, like the harm is exactly equivalent to me just removing nine grams of carbon, right? Because, or nine units of carbon, because the impact of carbon is over the long term. It's not like an immediate bad thing. But air pollution is very different, where it's just not fungible in the same way. Where like if a nearby coal plant built a pipe directly into my home and we're like, "Oh, sorry, Andy, we did the math." And like on net, this will reduce air pollution as a whole, even though it will make it much worse for you. I'd be like, "Well, that's not cool." You know, because like air pollution has immediate, very bad health consequences. Something that really puts this into stark perspective is that like every year,

• 1:17:52Speaker 01

  it seems like millions of people are dying from the effects of indoor air pollution especially. And this is more than like the WHO expects will die from climate change every year, even into like the 2040s and the 2050s. And so like air pollution is actually already a much bigger disaster than climate change will be in the medium term anyway. And so like, and in America, like we have pretty clean air, but there's still a lot of bad things that can happen. And like, it's just such a normalized part of our lives that I expect that like even if AI is just using the normal grid and it's just like increasing a lot of like natural gas and some combination of that and renewables. Air pollution stuff actually seems like the biggest threat because like as a baseline, it's already just very bad for us. Memphis, I'm like very worried to comment on because like I really don't wanna like get this wrong,

• 1:18:37Speaker 01

  basically, because it does seem like the local community reported that they were like literally smelling gas in the air. There was a lot of movement about this. There was recording of the colossus using more gas turbines than they were permitted. I have to admit, I just like don't know nearly as much about this as I should. There's a lot of contested stuff that happened. It does seem like the city has run a lot of tests since and like. This is not a continuing problem, but it might have been happening at the time. But again, like I, I wanted to like quadruple check this before like making any big claims about this. But like it's illustrative of the broader point that like, even if data centers operate as like just normal parts of the grid. Like the normal grid is actually somewhat bad for us right now.

• 1:19:15Speaker 01

  And like, that's often like, that cost is often shifted to very poor like communities who live in like undesirable areas with like more air pollution as a baseline. Like the area that Memphis, the Memphis data center was polluting already had like grade F air. It's just like a like obvious case of like how pollution is distributed. And if you look at the forecasts for AI, it's just like forecasted to use a lot of coal and a lot of natural gas at least into 2030 or so. And like, there are all these complicating factors where it's also like, there are all these agreements to buy like new renewable energy as well. And there can be these huge benefits to renewable energy from economies of scale there. And so the climate impacts get really uncertain for me where I'm like, you know, on net, this could actually be a benefit for the climate, both in how it's used.

• 1:19:59Speaker 01

  And in building out so much new renewables that economies of scale happen and they become cheaper overall. But air pollution, I actually really worry about as like something that communities need to take really deathly seriously. And like, this is actually the environmental impact I'm most worried about. Like water just doesn't seem to add up in most places, like most places I've investigated. I just can't find a single place where it's impacted water access at all. A lot of people will immediately be up in arms if I say that because they've seen a lot of scary stories. My claim is that basically every scary story about water access doesn't really add up when you actually look at the numbers. Or is related to the construction of a data center rather than the normal operations. But and so I'm not really worried about water in the short term, but I am just pretty worried about

• 1:20:39Speaker 01

  the air pollution effects of a lot of additional gas and especially new coal plants opening up like that seems really bad. So like somewhere there's like, you know, I'm moderately worried about climate impacts, not really worried about water. And like, there's a huge power gap where I'm like extremely worried about air pollution, just because air pollution is just a very normalized, very bad thing in the country right now.

• 1:21:01Nathan Labenz?

  Yeah, I've learned a little bit about air pollution and how bad it is for us over time. It seems like it is kind of like lead in the sense that you want basically as little as you can possibly get.

• 1:21:10Speaker 01

  Yeah.

• 1:21:10Nathan Labenz?

  My sense about those, the numbers that you led off with there in terms of like millions of people dying annually from indoor air pollution.

• 1:21:16Speaker 01

  Yeah, that's different, I realize.

• 1:21:17Nathan Labenz?

  That's like people mostly like heating and cooking their homes with like wood fires in the home, right?

• 1:21:23Speaker 01

  Yeah, yeah. On America, I can't get good numbers on how many people are dying from air pollution in America, but a lot of the estimates are really shocking and will range from like 30 to 100,000 people a year, which is like more than guns, you know, and it's like in the same range as cars and stuff. And like, you know, it seems like it's pretty hard to actually understand the causality here and it could be more and it could be less. But like, you know, if this is, you know, I get fired up a lot about how like, oh, you know, I'm excited about Waymo because 40,000 people die in cars each year and I'd like to at least automate that away. That would be really amazing. But like, air pollution specifically just does seem by like any measure to be killing at least tens of thousands

• 1:22:03Speaker 01

  of people every year. And just like thinking about like, oh, well, this building of like, you know, these new data centers contribute to additional deaths from air pollution. Like that is something I would really want communities to be really careful with. And like, that's the main way. I'm like, not really gung ho about building these really massive data centers in around like vulnerable communities specifically. Yeah, I tend to say about that. And I'm like, pretty agnostic about the specifics where I haven't done the deep dive on like exactly how bad it is to have like a gas turbine like a mile from you versus like a coal plant 10 miles away or something like that. But, you know, that's the main thing I would be concerned about. And in some ways, I like get quite frustrated by the water conversation for distracting so much from what I think is a much more serious issue.

• 1:22:45Nathan Labenz?

  Do we, how much do we know about like, how much of that is a sort of threshold effect problem versus a?

• 1:22:55Nathan Labenz?

  You know, should I, do you have any advice for like, you know, everyday listeners who are like, geez, I hadn't thought about air pollution. Should they go buy HEPA filters for their own homes? You know, like how, if you're just living in a place where you don't smell gas, should you still be taking action on the margin to clean your own air more or?

• 1:23:13Speaker 01

  I haven't really thought about this enough to comment. I know, like, I've read scary stories about how like back when toll booths were common, like there were disproportionate amount of like surprising negative health impacts of like people in toll booths standing next to idling cars so much. And so like, I sometimes worry about just like being in a city with a lot of traffic specifically where like maybe that on its own is pretty bad. But I, this is actually a place I haven't really done a deep dive. So like, I don't know the exact thing. Like basically just like maybe prioritizing the general quality of the air where you live actually probably matters a lot for your health. Besides that, it's not really something I know very much about, honestly. So I don't really want to comment too much.

• 1:23:48Nathan Labenz?

  Yeah. It's, I do, one thing I think we'll never go back on probably is having upgraded to the highest quality filters that you can put into your furnace. We have just a central, you know, forced air furnace in the house. And, you know, those things do come out amazingly dirty after, you know, eight weeks or whatever they're in there. So that seems like just off the top, you can see that there's, you know, some benefit to it. I think we'll stay top of the line on that. On the HEPA filters, it's interesting because it's like, they also bring a noise pollution element, which, you know, there's a lot of, you know, sort of, I guess, no pun intended, but some increasing noise being made about the evils of noise pollution too. So I'm not sure how to think about trading those off, but at a minimum, the furnace filters are a no brainer,

• 1:24:32Nathan Labenz?

  it seems like. And then maybe having a couple HEPA filters around one's home is the kind of thing that would be a good, you know, kind of precautionary investment in one's long-term health.

• 1:24:41Speaker 01

  Yeah, yeah, yeah. It's super interesting. And it's kind of fun. Like, it's just like evidence of how actually like interesting the AI environment conversation can be where it's like, oh, by the way, HEPA filters, you know, like, it just bleeds into so many other things that can be pretty interesting. The, what was I gonna say? Do you? Also worry a lot in these conversations that in purely focusing on the negatives and like, I'm not really trying to bracket off like air pollution here, like actually air pollution is uniquely bad, but like assuming that a data center contributes minimal air pollution and we think instead about noise pollution, I do worry that by the time we get down to noise pollution, a lot of the positives of the data center might not be being considered where I kind of think about a data center as like a new huge taxable industry in an area and like a lot of people

• 1:25:24Speaker 01

  will talk about how like, oh, so many parts of America are in decline and the people are having so much trouble because industry left, you know, and like a lot of those industries were also sometimes noisy, you know, like if there was a factory near you, like you would probably sometimes hear noise pollution and stuff. And so like now, when new data centers are being built, they just often contribute so much to the local tax base and can sometimes help the economy in other ways too, that I don't want to say they're always good, but I do sometimes worry that people will be like, oh, maybe they contribute millions of dollars a year to the town, but oh, they make some noise, you know, and like, well, this would have prevented us from building factories and stuff too, back in the day, and the town would have really never got off its feet in the first place. So like, I'm very happy to go into the like nitty gritty of like, what about land use? What

• 1:26:09Speaker 01

  about noise? What about these other kind of weird aspects of data centers? But I do worry that at that point, we're starting to lose the forest for the trees and stuff like that and not consider like, oh, yeah, there's a trade off to be made here. Like this introduces some new noise pollution and you get like a million dollars a year in tax revenue for your town or something like that. And like, is the trade off worth it? Like, I would say so in a lot of cases, like obviously with the consent of the people around it, but like, yeah, definitely important to consider the positives as well.

• 1:26:36Nathan Labenz?

  Yeah. I mean, another thing that makes noise is neighbors, you know, I've got Yeah. to run their lawnmowers during the day and, you know, have a leaf blower or whatever. And it's like, yeah, nothing's quieter than a ghost town. So that doesn't, in a limit, that doesn't really work. How about just the sort of energy cost to the consumer? I think one of the big complaints we're hearing now also is this is going to jack up the cost of everybody's electricity and that's not fair. And I think there's at least something to be said for that. So I guess maybe a two-part question would be like, how big of a deal is that? What have we seen so far? And then maybe you could sort of play like, Policy advi-- it seems like at the macro level of policy, you'd be like, do the AI

• 1:27:20Nathan Labenz?

  build out is it kind of sounds like your main line recommendation. It'll probably have enough offset. It'll probably work. But then there's the local policy level of like, okay, what if you were advising the, you know, Memphis, you know, whatever city council there, they have more particular concerns around these like water, land, air pollution, noise pollution sort of issues. So how much of a issue have we seen in like electricity bills? And how would you advise the local decision makers that are like, you know, everybody wants to get, you know, these industry investments? The companies are often pretty good at playing jurisdictions off against one another. Like, where would you say, okay, you know, hold the line here for your people to make sure you're getting a good deal, you know, versus

• 1:28:05Nathan Labenz?

  like, you know, what can you accept that, you know, maybe you give some ground on because again, it might just be worth it?

• 1:28:09Speaker 01

  Yeah, like going into the electricity thing for a second, the, again, the Lawrence Berkeley National Laboratory, who are just like some of my favorite sources on data center stuff, they just produce a lot of really good work. They had produced a general report, at least very strongly implying that almost all of the recent increases in electricity costs at the average national level, anyway, seem to be due to mostly inflation, downstream effects of inflation, and a few other bumps. Like, there was a point where like, you know, the war in Ukraine was raising gas prices for a little while and stuff like that. I can't really figure out exactly what's going on, but the general overview takeaway seems like the, a lot of the cause of increased average electricity prices at the national

• 1:28:51Speaker 01

  level in the past five years has been like, been caused entirely by issues with supply rather than demand. And so even though we've had a lot of additional energy demand, data centers don't seem to have contributed to that rise. Like, so there's this common statistic going around right now that since 2020, the average American electricity bill has risen by 35%. And from what I can tell, data centers don't seem to have contributed at all to that 35% rise. Like, a huge amount of it is just inflation. When you factor out inflation, the rest seems to be a combination of a few weird issues with supply. And I'm deferring here to the report itself, the report's making these claims, and I'm just trying to summarize it and doing a good job there. So, at the national level, it doesn't seem to be an

• 1:29:35Speaker 01

  issue. There have definitely been local places where utilities have come out and said, "We have had to raise electricity rates because of the data center." I haven't found anywhere that they've done that with water, yet. I could be wrong, but with electricity, that's definitely happened. There's a whole, like, separate weird debate to be had about this, where it's like, "Oh, maybe we need to, like, pressure utilities to do more build-outs of infrastructure anyway for the green energy transition." And so, like, they maybe don't want to, but we have to pay higher electricity bills for the green energy transition anyway, because electrifying anything, everything is going to require huge amounts of new green energy. But also, maybe data centers eat up too much of that, and like, they're like, very zero-sum altogether and don't actually add too much to that process. There's so many unknown unknowns here, that's very hard to talk about too much. And I don't feel fully

• 1:30:20Speaker 01

  equipped to diagnose it. But, basically, like, I think there are definitely places where data centers have so far affected electricity prices. I think they're pretty overblown in that most of those price rises have come from these other things. But, this could all change in the future as well, just because data centers are projected to use such a massive amount of new energy in America. One other complicating factor here is that, from what I can tell, American total electricity use over the next five years will definitely rise significantly, primarily driven by data centers, also a few other things like the electrification of cars and stuff. But this rise will actually be slower than it has been in the past. We were in this really weird state from, like, 2008 to the present,

• 1:31:00Speaker 01

  or till, like, 2021 or so, where electricity consumption in America was mostly staying flat, because we both optimized a lot of things, and also just shifted more to a commercial economy. And so, we lost industry, and as a result, used less total electricity. And so- Total American electricity use is rising for the first time in the sense like the financial crisis, basically. And this is a weird new situation for us to be in in the short term. But in the long term, it's actually projected to rise less than it did historically from like 1950 to the year 2000 or something like that. And so I think we have it in us to manage that. Honestly, like the big difference here is that now we really don't want to be building a ton of new fossil fuels, which, you know, we didn't really know in the 1960s or whatever.

• 1:31:43Speaker 01

  And so it's going to be harder to do that as we build out green energy, but not impossible. And as that rise happens, it seems like manageable to keep bills low, but also data centers are so much more concentrated compared to other sources of demand. So like, I have to throw my hands up and say, I don't really know. And there are a lot of people smarter than me who have looked into this a lot more, who are pretty concerned about future electricity bills rising a lot. One like very last note is that there's this funny thing that I think a lot of people have this bad misconception where like, if demand for electricity goes up in your region, your electricity costs stay higher forever. And that's not actually the case at all, because that would imply that very large cities would always have higher electricity bills than very rural areas. And like, what's actually happening is that there's a lot of like economies of scale

• 1:32:27Speaker 01

  happening where like, as more demand comes online, there's a temporary increase in cost, but over time that can level out. But another thing that's happening that's weird is that like, data center demand might just keep going up and up and up and not give grids enough time to catch up. And so we might be facing very long periods of higher electricity bills to fund the like continuous build out to support data centers. So like, it's really fascinating. It's like one of the most interesting topics I've ever scraped up against, which is how the American energy grid is actually going to deal with this. And I'm kind of left like, first of all, believing that like, people actually have a surprising lack of understanding of what's actually causing electricity bills to rise and fall. Like even experts disagree about this a lot. And yeah, the future is just so wildly uncertain. I will say that like, I'm

• 1:33:11Speaker 01

  very agnostic about whether we should do the AI build up in general, because you know, I'm excited about AI, but you know, you know, I want to maximize the benefits and minimize the risk and stuff. And like, I'm totally open to there being a huge amount of risk involved in this for like the uses of AI. So yeah, just want to flag that. And then like, finally, one last thing is that like, at the community level, I actually don't feel like I have enough knowledge to give to specific communities on this. Outside of like, do a full thorough analysis of the pluses and minuses here. Like, don't just look at the fact that The data center uses water at all. Like also consider like the tax revenue and the utility revenue and like there are some cases where using water is actually good because it gives the utility more revenue to upgrade aging pipes and stuff like that and like

• 1:33:55Speaker 01

  really push for renewable energy if you can and build out like battery stuff and like maybe pressure utility to build out a lot of high transmission stuff anyway. But this is all very hand wavy. Like this is like I'm kind of just some totally just some guy on this. So I don't want to speak more confidently on this one thing than I am.

• 1:34:11Nathan Labenz?

  So to try to bottom line a couple of things there. One is if there's a concern about the macro AI build out, it's the macro issues of controlling the AIs long term, not the the marginal emissions. Locally, there can be a lot of issues, but the, you know, it seems like maybe what we need for sort of the general protection of the population is some sort of federal standard, you know, and not to invoke the impossible, but like it seems like we do have a challenge where, you know, we saw this with like Amazon with its second headquarters famously, you know, all these sorts of things where even just pro sports teams, you know, build us a stadium, we'll go to some other city that will build

• 1:34:55Nathan Labenz?

  us a stadium. We do have a problematic dynamic where companies will, they have direct incentive and often they do choose to locate themselves in the jurisdiction that will give them the most breaks and the least, you know, obligations. And so it does seem like we are probably headed for at least instances of local governments making deals with companies where they effectively raced to the bottom in terms of what protections they insisted on for their local populations, ultimately leading to what might not be a great deal for those local populations. But the real solution to that seems to be we need some sort of.

• 1:35:40Nathan Labenz?

  You know, cooperate equilibrium to be established. Or if not equilibrium, you know, maybe some sort of, you know, higher level rule to just insist that like certain things get paid back into the community or, you know, get remediated. So that, you know, whoever's living in the area isn't breathing bad air. That seems like there's enough surplus to go around for it for sure. It's just a question of, I mean, and I don't mean to dismiss this because this is always the case, right? It's like, the same was said about the China shock in the first place, or that, you know, that left a lot of towns that are now looking for new industry in a bad place. Well, sure, you know, the aggregate welfare goes up, you can always redistribute. Is that effectively going to happen? It hasn't always. Some might say it hasn't, you know, in most cases. So we face that same challenge again.

• 1:36:25Nathan Labenz?

  But it seems like the bottom line on kind of all these resource dimensions and even the sort of pollution externality dimensions is the surplus is definitely there for it. If we want to take one big takeaway, it's like, let's get our act together this time and actually make sure that we do insist on, you know, reasonable standards or, you know, get the right compensation for people that are, you know, directly locally affected. And if we do that, we should be fine. And it seems like it still shouldn't be so much that it would like see the AI race to China or, you know, prevent us from like being able to use all the chatbots and AI agents and, you know, for that matter, image and video generation models that we could

• 1:37:09Nathan Labenz?

  possibly want. But the local political economy of this can be problematic if we're not careful about it.

• 1:37:17Speaker 01

  Yeah. It's funny, this is something else that like I worry doesn't always come through where I feel like I'm often writing in response to the most extreme takes about data centers, where people will write implying that like, it is literally always bad to use water on data centers. I'm like, well, here are all these trade offs. In a lot of America, it is good to use more water because economies of scale happen and the main access problem is like aging infrastructure and not raw access to fresh water. But in doing that, I often like, don't also stake out that like, yeah, I'd like a lot more like rigorous environmental regulations on this stuff, like with the goal of doing A green energy build out, you know, like there's another nuance you can get into where it's like, oh, certain environmental regulations can actually stifle the types of builds that we need for like

• 1:38:00Speaker 01

  green energy and stuff like high transmission, long distance power and stuff, a lot to get into there. Yeah, and the race to the bottom thing is interesting too, where it's definitely a huge problem. Like you read about how like people are just delaying taxes on data centers for longer and longer periods of time, other things, and like, people will talk about this, but then in the same breath be like, oh, and there's no benefit to communities anyway. And like, my question is always like, well, if there's a race to the bottom, like, why are all these city governments racing in the first place? You know, and like, a big part of it is that like, there are some tangible benefits, you know, to having a data center, like, all else equal, like, you know, I'm from, like, like, I grew up pretty well off personally, but I'm from like a not super well off area that is in some ways like left behind by like industry and stuff.

• 1:38:43Speaker 01

  And like, I think I would be actively excited if like a medium sized data center were built in the vicinity that the town could then tax and use for stuff. Like, I think that would be net good personally, but there are a lot of other places where I would probably be much more hesitant, especially like a super large data center that was going to build like, you know, a huge amount of gas turbines everywhere. And so, yeah, I'd be personally pretty excited about a lot of very specific targeted regulation that prevented like air from being polluted in significant ways, but didn't like, prevent like the types of, you know, otherwise like grid upgrades that we need for the green energy transition anyway. Again, you know, this, I'm kind of a hobbyist here, so like, I'm not speaking from a position of authority, but like, yeah, I think my general ask for most people considering this is like, even in like

• 1:39:25Speaker 01

  race to the bottom dynamics, like, it's kind of important to just consider, like, what are the actual trade offs here? Is this worth it? Like, definitely say no, like, I don't think that data center should be built everywhere, but just like, it's important to consider the positives and the negatives as opposed to just deciding that like, because they don't see any value in AI, like, it shouldn't be able to use any of the community's water, because there are a lot of instances where even if the thing inside the data center is useless, like, it can actually sometimes have positive effects on the local community.

• 1:39:50Nathan Labenz?

  Are there any rules of thumb that you could venture around like who should not build a data center? I mean, one candidate would be like, if water is already really scarce in your

• 1:39:59Speaker 01

  Yeah.

• 1:40:00Nathan Labenz?

  area, like, maybe you're not a good candidate for a data center?

• 1:40:02Speaker 01

  Uh huh. I have a really crazy take on the water stuff, actually, which is that like, I think that data centers are actually like quite good candidates for very water scarce areas like Maricopa in Arizona. So like, a lot of new data centers are being built around the Phoenix area. And you might think like, this is ridiculous, you know, Phoenix is a city built in a desert. But there are a lot of other industries and commercial buildings that use a lot more water than data centers do. So like, the golf courses around Phoenix, from what I can tell, use something like 30 times as much water, or like, the golf courses in the state of Arizona overall, might use like 30 times as much water as all data centers in Arizona. And like, that on its own is pretty crazy to me that there are these like, you know, golf course, I don't know if you've ever been to that area specifically, but it's like, kind of eerie

• 1:40:47Speaker 01

  to like stumble on this like sickly, sweet green in like the middle of a desert, you know? And like, if these industries are using water, the difference between them and data centers is that data centers are often generating way more tax revenue per gallon of water used. Like, best I can tell right now is that, like, if you add up the total, like, tax revenue and water used from both golf and data centers in Arizona, like, data centers are generating something like 50 times as much revenue per gallon used. And so like, basically thinking about it, like, if you want, like, I wouldn't support additional water being used in Arizona. But I would definitely support, like, less effective industries being swapped out for data centers. Like, if I could, like, close all the golf courses in Arizona and replace them all with data centers in the state,

• 1:41:31Speaker 01

  like, that would just generate billions of dollars in revenue for the state without increasing the water bills at all. And so like, because data centers generate so much revenue per gallon used, at least right now, like, they actually seem like surprisingly good candidates for the desert. But, you know, a lot to say about that. I definitely don't want to increase water use more there than it already is. Yeah, I don't know. Besides that, like, main rule of thumb is just like, I'd really like, It just seems really preferable to not build data centers near where you have to open new coal plants or keep coal plants running to operate them. Like coal is just so bad for people's health and for the climate that like, that seems good. Beyond that, though, like, I don't have any clear rules of thumb. It's not to say I wouldn't object to more specific cases. It's just, it's kind of hard to think about on a case

• 1:42:13Speaker 01

  by case basis. And I haven't really developed an overarching like, oh, here's the like Andy strategy. And it seems a little bit goofy because like, all of this started with me, like, wanting to win arguments at parties about using chatbots. And I've like escalated to, here's my complete plan for the data center build out, you know? And at some point, I have to step back and be like, I don't know. Like, I kind of trust like, people who've been thinking about the very local ecologies of these regions and the local economics and stuff to, like, know enough to make good decisions here. I think I'm just like, in general, like, somewhat deferential to like, local experts.

• 1:42:43Nathan Labenz?

  Yeah, well, I would say, you know, the world is grappling with this in real time, for one thing. So, one of my big themes of this overall journey of making this show is like, there AI is intersecting with everything. And we need people to kind of step into these niches, you know, whether they started in a particular niche or are kind of jumping into it based on, you know, even a motivation as, you know, as pedestrian as being annoyed by, you know, stupid stuff other people are saying. It is, it is important that people kind of take ownership of like, figuring out different corners of this whole phenomenon. So I applaud you for doing that. And I would say, you know, obviously, all more expertise

• 1:43:26Nathan Labenz?

  and, you know, more local knowledge, always good. But we are kind of moving very quickly into this. And I think you've definitely done the overall discourse a service by, you know, piping up in many times and many places with more grounded analysis than we're otherwise typically getting. And then, yeah, I mean, I guess the local stuff is, I'm glad we got to golf, you know, because that was another one that I was really marveling at. I was looking at LA area golf courses. And again, this is sort of these like, giant numbers. One thing I did want to double click on for a second is like, are we using the same meaning of use when we talk about use water? Like, I've seen An LA golf course uses 90 millions of, 90 million gallons of water a year,

• 1:44:09Nathan Labenz?

  or LA area golf courses, plural, is like 1.6 billion gallons per year estimated. That's like a ridiculous number and it dwarfs, you know, like what it took to train GPT-3 and, you know, things like this. But are we talking about the same use? Because those like sort of seep back into the ground, right? Or are they the same? I can't tell. Is that the same or different?

• 1:44:32Speaker 01

  This is where I start to scrape up against some issues here. Yeah. I have to admit like that I'm not an expert on, so I don't want to comment on too closely. Yeah, it is. I mostly do try to stick to like places where water is being actively chosen to be delivered by people. So like, I don't count, I try not to count rainwater as an example. So like if crops are mainly reliant on rainwater, that would otherwise just be falling into the ground. Like, you can say that crops are using that, but it's like different. And so at least for agriculture, I mainly focus on like irrigated agriculture specifically. And I have to admit, I don't know too much about the water dynamics of like how this like eventually flows back. So I would have to like circle back on this. They're like, you know, this is a autodidact curse that you're bumping up against where,

• 1:45:16Speaker 01

  you know, like, I know a lot about the specific water that is being delivered to these places, but like whether this counts ultimately as consumption or withdrawal is a little bit beyond me. And like what the difference is and how big of a deal it is. There was one other, yeah. One other important difference here is that the water used in data centers themselves, like I said, is potable, whereas a lot of water delivered to like crops or golf courses is just like fresh water, but like sometimes it's potable as well. So like that's an important difference to keep in mind as well. And but like, it just doesn't seem too costly to turn freshwater potable, based on my understanding. Like, there's an initial upfront infrastructure cost of like a water treatment plant. But yeah, a lot of unknowns there. Like, I wish I had a better answer there. That was a good question. I think like in general, the singular, like really weird way that we use water that I

• 1:46:00Speaker 01

  would like more people to know about is like irrigated alfalfa farms, which like, again, I'm not entirely sure how this eventually flows back into the system, but they seem to use something like a thousand times as much as all AI used in 2023. And there are a lot of like irrigated Irrigated alfalfa farms like in Arizona and other places too, where these are also just like blooming in deserts. And they're most, a lot of alfalfa is used to feed animals, which we then eat, you know? So like, I I'm biased here because I'm against animal agriculture for like animal welfare reasons. But like, this is another place where like, if we're going to focus on one water bad guy in the country, I would like to start with like, the bizarre amount of irrigated alfalfa we have. And all the corn that is eventually converted into ethanol that we then use for gas, where maybe we could use something else instead.

• 1:46:43Speaker 01

  Strong recommendation, like Hank Green recently did like a big video on data center AI water stuff that I thought was just like, masterful, like I definitely disagreed with some of the ways that he hedged and some of the specific things he said, but like, for the most part, it was like some of the best single media I've ever seen about it anyway. And like, he talks a lot about corn there and like how goofy it is that we use corn, how like, goofy it is that we use so much water on our lawns every year. And like, he just puts things into a lot of like really useful contexts too. So if people are looking for like more of a deep dive on the water stuff, like that's probably like the best single resource to start with. So yeah, we definitely start there.

• 1:47:16Nathan Labenz?

  Yeah, cool. Just to fill in a little bit of the detail on food, since you'd mentioned animal agriculture, I had TBT in the background answer the question. How much energy slash emissions goes into the production of a hamburger? And the answer comes back at a few kilowatt hours of primary energy and a few kilograms of CO2 equivalent. So the, if we just again, kind of do a energy to energy quick conversion, let's say it's 2,000 kilowatt hours that would be running your microwave for two hours. Thirty six hundred seconds in an hour, you're talking, you know, seventy two hundred seconds in two hours.

• 1:47:59Nathan Labenz?

  And we already previously established one chatbot prompt is worth about a second of a microwave. So we get again to a sort of comical ratio of something like. Five to 10,000 chatbot queries for one hamburger. And by the way, the exact same number came back with the question of how much for a hot shower. So again, five to 10,000 chat GPT queries for one hot shower.

• 1:48:27Speaker 01

  Totally forgotten if I've already like shared the story, but a friend was in a pizza place like a few weeks ago and overheard two teenagers talking and one of them had said like, oh, this mutual friend of ours uses chat GPT, so it's ridiculous that she calls herself an environmentalist. And then she immediately went and like ordered a meat lovers pizza specifically. And like, this is kind of just like, sums up a lot of the debate here for me where I worry that in hyper focusing so much on this, like people are really losing sight of where the big environmental bad guys are. They're not where you'd expect. A lot of them in your personal life are probably going to involve like very different things, like maybe the food that you eat. But even there, like, you know, I'm mostly like not eating animal products for like animal welfare reasons.

• 1:49:10Speaker 01

  And I have to admit that like, if someone's eating like a chicken sandwich around me, like, I actually think that like, it uses more resources than like some of the things that I eat. But even there, I actually like, don't want to litigate the small amounts of like environmental harm. Like usually if I wanted to talk to them about it, I'd be like, oh, that was a little guy who had a really bad time, you know, in his life and like try to talk more about the animal welfare thing. And I think like, saying like, oh, and it uses this many like tofu slabs or something, would actually kind of dilute the point worth of energy, I mean, that would kind of dilute the point that I'm making. And like, I think one other theme of a lot of my writing is that I'm quite concerned about most other aspects of AI. Like, you know, I love it and fear it, like current chatbots are great.

• 1:49:53Speaker 01

  I'm very worried about like the consequences of even very near term AI. And I'm pretty worried that a lot of my fellow AI critics and warriors are like potentially diluting a lot of the points that they make by just adding on like, oh, this thing could make surveillance so much more effective. And every time it does that, it uses like a drop of water. Isn't that terrible? Like, the second point just takes away from the first, I think, in a way that I think a lot of people are kind of missing. And so a big background motivation here isn't to say like, oh, everything's fine. Data center is built out, it's fine. Like, you don't have anything to worry about. It's more to say that like, I'd really like us to focus on these actual things and not just like throw everything we have at AI. Because I think like, people who are listening to us notice very fast when you're just kind of reaching for any tool that you can to attack something as opposed to actually building up like.

• 1:50:37Speaker 01

  Like actual legitimate criticisms that you're really worried about?

• 1:50:41Nathan Labenz?

  Yeah. Another way to put that, I guess, is in terms of contribution to overall P doom, the climate change contribution of AI is very minimal.

• 1:50:52Speaker 01

  Yeah, yeah. And potentially even positive. Like, again, I like the International Energy Agency projects that by 2035, like, all AI applications might together be like preventing something like four times as many emissions as all data centers cause. And that's wildly uncertain for a lot of different reasons. And another weird thing about that is that will mostly rely on deep learning models that aren't the big chatbots that are being powered in these huge data centers. So a lot of hand wavy stuff to say about that. But like, I think like, the existence of AI in the short term like reduces my odds of like, severe climate change by like, a little bit, but like, also increases the worry in a lot of other ways. And like, other environmental stuff like air pollution I do take seriously.

• 1:51:32Nathan Labenz?

  Yeah, I'm really glad you mentioned that point about non LLMs or non general purpose models driving a lot of value. And I think that's something the world would do well to keep in mind in general. But specifically on this resources point, it's always really striking to me how small some of the models that are driving breakthrough contributions to various fields of science actually are. One, I did an episode not long ago with Professor Jim Collins, who has discovered new antibiotics with models that are just like, I forget exactly how small they are, but I think we're talking millions of parameters, you know,

• 1:52:12Nathan Labenz?

  tens of thousands of data points, like, super small stuff that they can run on, you know, a couple of computers in like, a couple of days' time. And you get new antibiotics out of it. It's like, okay, this is a big deal. The similar things probably are going to start to happen with material science, you know, with just all sorts of optimizations. You know, one thing we had kind of touched on a little bit in preparing for this is just like, optimizing energy use in buildings. You know, there's so much waste all over the place, right? That you could just get smarter about some of these kind of core operations and get a ton of value from there. But then you, when you get into material science, I mean, then you really can move, you know, the sort of fundamentals of energy

• 1:52:55Nathan Labenz?

  in a significant way. And, you know, literally like, one material science breakthrough, you know, could very plausibly Offset like all the, you know, all the inference that the world is going to use. So

• 1:53:07Speaker 01

  Yeah, exactly. Like especially material science for like batteries and like solar panels. Like there have already been some really exciting like photovoltaic improvements like enabled in part by AI anyway. And like that on its own, like the scale of that could like just start to dwarf a lot of what happens in data centers specifically. It's just like another obvious example where like computing is just so wildly efficient per task. Basically, it's like comically optimized. Like I'd run some like kind of goofy back of the envelope calculation where I'm pretty sure that to like run a game of Minecraft in 1950 would have required like half the energy of the United States. And now it can run on your computer. You know, like I think people really underestimate just how much energy has been optimized in computers in the last 70 years or so.

• 1:53:52Speaker 01

  And because it's just so wildly optimized, just like what you're getting out of it is just going to have so much more effect on the world than the actual energy that went into it. And like the big hold up to this case is that like a lot of people believe that chatbots are still like completely useless and are going to be the main things in data centers. And so like if you're still in that camp and like you don't believe that chatbots will ever have any value, then like my case becomes more tenuous. But like I do just, I have to put my chips in and be like, man, like chatbots are like a miracle to me. Like I'm sure they're adding quite a bit of value and changing a lot of my behavior outside of like the computer itself. So like, I think that for anyone who is very worried about the environment and AI, like just all the game is going to be in the way that AI is used and not necessarily in the data centers itself.

• 1:54:34Speaker 01

  And like worried about specific consequences of data centers, but like framing the debate around like the energy used in data centers does feel disturbingly similar to me to like seeing Amazon take off and thinking, oh, I should mainly worry about how much energy the website's using.

• 1:54:49Nathan Labenz?

  Yeah, maybe one kind of final point of comparison and then invite your kind of closing thoughts. But it does touch on this, you know, how AI is going to be used.

• 1:54:58Nathan Labenz?

  Obviously, you know, there were some confidence bars around these estimates. But again, 80 gigawatts seems to be the sort of grand vision, you know, with the Stargate project being five gigawatts of that and, you know, imagining the full $7 trillion bill out, whatever, that's kind of come in at 80 gigawatts in the analysis and estimates that I've run. Compare that to total global energy use today is estimated at 6,000 gigawatts, which kind of backs out when we talked about like one gigawatt being a million people, then, you know, 1,000 gigawatts could be like a billion people. That's like at US energy levels. Six gigawatts would be like 6 billion people. There's the sort of electricity to non-electricity conversion factor there.

• 1:55:40Nathan Labenz?

  But roughly speaking, that seems like a order of magnitude reasonable estimate. So we're talking basically about like a little bit more than 1% increase. And another thing to keep in mind is that is almost certainly going to be dominated by the increase in energy use in the developing world by the just general background process of people getting wealthier, people being able to afford more energy. And like, you know, that's something that I think, certainly I do not begrudge, you know, the global poor for their like marginal energy use over the coming decades. Maybe some do, but like I certainly want to go on record saying like, I think it's good when people can, you know, do more stuff and have better lives. So I don't know if there is any downside scenario that you think would be worth worrying

• 1:56:24Nathan Labenz?

  about in terms of like how it's going to be used. And we've kind of focused on the rosy side. I mean, one other short version, super compressed would be like, AI makes everyone richer and then we can all afford more energy. You know, maybe there's just a lot more energy used broadly, but is there anything more specific that you think would be the kind of surprising, you know, possibly negative story in the macro sense?

• 1:56:46Speaker 01

  I mean, like I can get into really goofy sci-fi scenarios where it's like, oh, you know, if there's some like global war over AGI, which like I don't actually put super strong probability on, but I'm like, oh, you know, like very powerful AI systems in the future, maybe destabilizes things like nuclear war is bad for the environment. So that's something like at the edge cases, it just gets really ridiculous. So I don't want to like go quite that far. So I'll bracket that for now and just say that like, AI can probably reduce a lot of emissions. It does seem like there are a lot of potential ways it could really radically increase how much energy we use as well. That might just make the green energy transition harder, like super optimized shopping apps might just make it much more tempting to buy more stuff. Or just like economic, like making manufacturing more efficient in some ways might make us like use a lot more energy

• 1:57:31Speaker 01

  in total without transitioning that to green energy. I also do want to like make it clear that I'm also coming from like a very specific perspective of like, it is definitely important to get the poorest people in the world a lot more access to energy, basically by any means. And like when I talk about like cuts to emissions, I'm mainly talking about for people like us in like global, very wealthy communities in comparison, like just motivated a lot by like, very much not like a G growth person as an example. So, yeah, a lot to say about that. I'm trying to think about, yeah, I don't know, even just like self-driving cars, like I could see a world where like that just makes driving much more tempting because suddenly like a five-year-old kid can take a self-driving car to like their friend's house if the parents okay it or something like that. And that just opens up

• 1:58:15Speaker 01

  so much additional travel that like on net, that creates a lot more energy use. And like, it's a funny world where like both like the like value we're getting per energy will probably be way higher because we'll have all these nifty gadgets and stuff. But like, if that doesn't come with like the green energy transition specifically, like we'll still be emitting more on net. And like ultimately, the climate only cares about the total amount of CO2 that's in the air. And so like, I don't know, like this all just feels so speculative and weird where I'm like, oh yeah, AI could like radically reduce car trips, but maybe increase it and like reduce, you know, like building stuff, but also like or decrease building energy use, but also increase it elsewhere. Or like material science for green energy is good, but like certain scientific discoveries for

• 1:59:00Speaker 01

  the military might make global war more likely. It starts to get really hand wavy really fast, basically. There are a lot of really cool papers on this. I could maybe like, I know the, I'm pretty sure it was the London School of Economics that recently published one that was really good. Yeah, there are a lot of cool like speculative stuff about this, but it's so uncertain that like, if environmentalists are gonna really focus on this, like I'd really want them on as like soldiers in the battle to make sure that like the way AI is used is good for the environment. And data centers definitely worry about, but don't treat them as the big central part, central part of the story.

• 1:59:32Nathan Labenz?

  I think that's probably a good place to leave it unless you want to bottom line it any other way for us.

• 1:59:37Speaker 01

  Um, yeah, basically that was super comfortable. So thank you. That was a blast. So just enjoy the conversation a lot. Yeah. Again, just a big fan of the show. So very grateful to make it on.

• 1:59:46Nathan Labenz?

  Love it. Andy Masley, thank you for being part of the cognitive revolution.

• 1:59:51Nathan Labenz?

  If you're finding value in the show, we'd appreciate it if you'd take a moment to share with friends, post online, write a review on Apple Podcasts or Spotify, or just leave us a comment on YouTube. Of course, we always welcome your feedback, guest and topic suggestions, and sponsorship inquiries, either via our website, cognitiverevolution.ai, or by DMing me on your favorite social network. The Cognitive Revolution is part of the Turpentine Network, a network of podcasts, which is now part of A16Z, where experts talk technology, business, economics, geopolitics, culture, and more. We're produced by AI Podcasting. If you're looking for podcast production help for everything from the moment you stop recording to the moment your audience starts listening, check them out and see my endorsement at ai podcast

• 2:00:33Nathan Labenz?

  dot I N G. And thank you to everyone who listens for being part of the cognitive revolution.