The rise of flexible data centers

As the buildout of data centers accelerates on a dramatic trajectory,its strain on the electric grid has increased in turn; forecasts suggest they could consume up to 17% of all US power by 2030. To avoid higher rates and slower AI growth, the industry has embraced a promising solution: data center flexibility. In this episode, Shayle speaks with Varun Sivaram, the CEO of Emerald AI. Coming on the heels of a $25 million investment round led by Energy Impact Partners, Varun returns to the show to provide an update on the "wickedly complicated" challenge of aligning utilities, cloud providers, and the grid. Shayle and Varun explore topics like: Tapping into the 100+ gigawatts of unused grid capacity Why the "Watt-Bit spread" is shifting to make power flexibility profitable The differences between training and inference flexibility, including Google’s new "flex" and "priority" tiers The "mini dispatch curve" for data centers created by batteries, gas turbines and fuel cells Emerald’s plans to collaborate with NVIDIA and other partners on the world’s first 100-megawatt, truly power-flexible AI factory Resources Catalyst: The mechanics of data center flexibility Catalyst: The potential for flexible data centers Latitude Media: How the world’s first flexible AI factory will work in tandem with the grid Latitude Media: Nvidia and Oracle tapped this startup to flex a Phoenix data center Latitude Media: A reality check on flexible data centers Latitude Media: Can VPPs unlock grid capacity for data centers? Credits: Hosted by Shayle Kann. Produced and edited by Max Savage Levenson. Original music and engineering by Sean Marquand. Stephen Lacey is our executive editor. Catalyst is brought to you by FischTank PR, an award-winning climate and energy tech, renewables, and sustainability-focused PR firm dedicated to elevating the work of both early-stage and established companies. Learn more about their PR approach and how they can support your company’s messaging by visiting fischtankpr.com. Catalyst is brought to you by EnergyHub. EnergyHub helps utilities build next-generation virtual power plants that unlock reliable flexibility at every level of the grid. See how EnergyHub helps unlock the power of flexibility at scale, and deliver more value through cross-DER dispatch with their leading Edge DERMS platform, by visiting energyhub.com.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:02Speaker 00

  Latitude Media, covering the new frontiers of the energy transition.

• 0:08Shayle Kann?

  I'm Shayle Khan. I lead the early-stage venture strategy at Energy Impact Partners. Welcome to Catalyst. So my friend Varun Sivaram came on this podcast back in August 2025, or roughly a century ago in AI terms. At that time, we talked about his mission at Emerald AI to make data centers flexible, specifically at that time by shifting AI workloads to deliver compute flexibility in response to grid signals. It was then, and remains now, a somewhat controversial concept, largely, I think, because the history of data centers, dating back to the emergence of the cloud industry, always suggested that they are perhaps the most inflexible load on the planet. Not only would they generally pass on participation in demand-response programs,

• 0:53Shayle Kann?

  but they actually needed N plus two reliability, just to ensure that the spikes would always continue to flow. But the world has changed in a bunch of ways since then. The strain that the data centers are putting on the grid has become clearer and more present than ever. Pressure on electric power rates is high, and so affordability is top of mind across the board. And data center flexibility, either through compute orchestration or through behind-the-meter resources, has started to become a mainstream concept. I actually went on my own journey on this concept and spent a lot of time on it over the last year. And here's where I came out. From first principles, data centers should be flexible assets. They just should. They have many different types of workloads with different degrees of urgency,

• 1:38Shayle Kann?

  and it's crazy to think that they couldn't differentiate. And in fact, some of them are now starting to differentiate. But the actual mechanics of getting them to do so and getting all the players aligned is really tricky. Anyway, long story short, I invested in Emerald. We announced just a couple of weeks ago that we at EIP led a $25 million round in Varun's company. So I brought him back on today for an update, really, on the extremely dynamic world of data center flexibility. That's coming up next.

• 2:15Speaker 00

  Demand flexibility is now an essential part of the data center's speed to power playbook. But how do data centers actually curtail load? Grid Beyond is the end to end solution for flexible energy management. Grid Beyond's advanced derms and VPP platform is tailored to what data centers care about most. Maximizing reliability, intelligently meeting curtailment obligations, reducing costs, and managing all your distributed resources in one place. Ready to transform your distributed energy management? Get started at gridbeyond.com. Catalyst is brought to you by Antenna Group, the communications and marketing partner behind the most influential companies in energy, climate, and infrastructure. For three decades, Antenna has helped ambitious companies stand out, build market leadership,

• 2:59Speaker 00

  and become category defining brands. From breakthrough startups to global industry leaders, their team brings the expertise, relationships, and track record to accelerate your momentum. Learn more at antenna group.com.

• 3:12Speaker 02

  The power plant for the modern grid isn't a building. It's a network. Energy Hub's derms platform connects batteries, EVs, thermostats, and commercial and industrial sites into virtual power plants that over 230 utilities dispatch as reliable grid capacity day in, day out. VPPs deploy in 60 to 100 days at 40 to 60% less cost than traditional infrastructure, and they perform like conventional generation from day one. Learn about the flexibility platform for the modern grid at energyhub.com.

• 3:48Shayle Kann?

  Varun, welcome back.

• 3:50Speaker 03

  Shayle, thank you for having me back.

• 3:52Shayle Kann?

  It's nice to be on the other side and talking as partners in crime in your business. I want, so you were back on this podcast in August of last year, which depending on how you look at it, is either a very long time or a very short time ago. I guess I want to start with just like your high level perspective on what has happened in the market. And I guess by the market in this context, I mean data centers in the grid. And then specifically also in your market, which is the provisioning of flexibility for data centers in the grid. So just over that last, whatever that is, nine, 10 months, like. What do you see as having happened?

• 4:28Speaker 03

  I think, Shayle, it is a very long time, given the dynamics of data centers and the grid. But actually, before I answer that question, let me first say how delighted I am to get to work with you as a partner in crime. 10 years ago today was when you and I co-authored a Nature Energy article. We wrote this article about setting a new cost target for solar power, a really ambitious one, 25 cents per watt fully installed. And I think the latest prices in China show that the cost is roughly double that. So we're almost there.

• 5:03Shayle Kann?

  More to come on that because I have been doing some things that are still trying to hit that target. As you said, even in China, we have not hit that target yet. I still think it's possible. But yes, it's fun to know. I did not realize it was 10 years ago to the day. But obviously, it's been a fun journey.

• 5:22Shayle Kann?

  So good to be on the same team here.

• 5:25Speaker 03

  Absolutely.

• 5:25Shayle Kann?

  Data centers and the grid.

• 5:27Speaker 03

  Absolutely. So let me get back to that overview. It's been a long 10 months since I was last on the pod, and here's what's changed. Data centers are even more of an energy issue than we thought was the case back in 2025. The latest numbers show that in January of this year, NERC forecasts a summer peak increase of 224 gigawatts, almost all of which will come from data centers. Data centers now account for 94% of PJM's projected peak load growth. And by 2030, EPRI forecasts that data centers could use up to 17% of America's power.

• 6:06Speaker 03

  All of these are incredible, insane statistics, and they're reshaping the landscape of energy as we know it. And you've obviously talked about this a lot on your other podcast sessions. But I also think that this particular topic we're talking about today... It's important to keep talking about it. The last time we talked about it was a different context than today. 224 gigawatts of peak load growth is between a quarter and a third of peak demand. And so that's a massive increase that data centers are going to be driving. And if we try and build our way out of this, as I told you on the last podcast, we risk higher rates and slower AI growth, and that's good for nobody.

• 6:50Shayle Kann?

  I would add, you said higher rates. I mean, I think one thing to me, like, yes, it is true that the the build out, the data center build out has just continued to accelerate over the past nine or 10 months, like, nothing has stopped that upward trajectory. And maybe it has gone parabolic, like, it's hard to tell exactly because we're in the middle of it. The one thing, though, that I think is much more front of mind today than it was in August of last year, you alluded to, which is affordability. Like, that has become, that has come front and center now in a way that I think it wasn't quite there, you know, nine, 10 months ago, it was just starting to be. And now it's like every conversation is about affordability.

• 7:27Speaker 03

  Oh, absolutely. And look, we should be clear that historically, the drivers of rate increases may very well not have been data centers. Data centers may have been conflated in the data. And, you know, some data shows that in areas where data centers grew more quickly, rates actually increased more slowly. But I think it's incontrovertible that going forward, if data centers do drive most peak load growth, and peak load drives most rate increases, data centers, absent some mitigations to help with this exorbitant grid build out, data centers could very well drive affordability difficulties. And that's why I think that, you know, there's a risk that they become a problem, but there's

• 8:12Speaker 03

  also a real opportunity for data centers to become the true hero of solving this affordability challenge.

• 8:17Shayle Kann?

  Right. And there's multiple ways to do that, and lots of them are starting to emerge. These, you know, unique tariffs that data center operators or developers are starting to sign with utilities, I think, are interesting, and there's a bunch of different structures of those. Let's narrow in, though, on the portion of that that is most relevant to you, which is making data centers flexible assets. So on that front, over the past nine, 10 months, like, what has changed?

• 8:42Speaker 03

  A lot and a little has changed, I'd say. Let me put it this way. There is this deep divide that I observe between the level of flexibility, service levels and tiers that the compute industry offers, and the level of flexibility in the service tiers and level that the utility and grid operator ecosystem offers in terms of electric service. And that schism is one of the reasons that this is such a hard problem to solve. That even though, you know, I'm super excited and want to talk to you about the five commercial demonstrations we've done since you and I just last talked at Emerald AI, it's still a fundamental challenge to make sure that we can take advantage of all of what I call the stranded power on the grid. So to back up, Shayle, for those viewers who didn't hear the last episode,

• 9:27Speaker 03

  data center flexibility, why is it important? Data center flexibility is important because if these new AI factories, as Jensen Huang at Nvidia calls them, if they can be flexible just a little bit of the time, they can utilize this vast amount of unused capacity on the grid. The grid is utilized at roughly 50% or less during most of the year. And therefore, we have all of this 100-plus gigawatts of stranded power capacity that could power AI factories connecting to the grid today if during those rare peak moments, AI factories could ramp down, partially for a limited amount of time. That's why flexibility is so important. Now, I mentioned the schism because just this month, we've seen a lot of movement on the AI and compute side

• 10:12Speaker 03

  in terms of flexibility tiers. Just earlier this week, Google announced its flex and priority inference tiers. So if you're a developer and you are buying tokens of artificial intelligence, you're running models, you're being served inference, you can choose to have those delivered absolutely immediately, or you can choose to have those delivered after a delay. And you'll, you know, pay different prices. But more importantly, it's not just the price component. It is the service component. The service literally changes between those tiers. And it's not just Google that does this. You know, Anthropic has a peak period for serving tokens, and you tend to hit your rate limits earlier. And it has a non-peak period.

• 10:57Speaker 03

  I know all of this because we have one of these token maxers, Nick Hill, on our Emerald AI team. And he always tells me every time he hits a rate limit. So given that there are literally different service levels... It's going to be possible, I believe relatively quickly, to take advantage of all this flexibility and the different ways people use compute to throttle their power consumption. The question, however, is on the other side. On the utility side, it is still a work in progress for a utility to offer a different service level, right? Today, you typically get one service level. The service level is you get power. There isn't a service level that says, for most of the year, you get power, but some of the year, we're going to ask you to be flexible.

• 11:39Shayle Kann?

  There is, to some extent, which is demand response. That's the legacy version of what we're talking about, which is a you enroll in a program. This is less so for data centers historically, but for large loads. You enroll in a program, and as that enrollment, you know, we are going to send you a signal or we're going to call you, as it's been historically, a couple of times a year at peak hours, and we're going to ask you to ramp down. This is kind of an extension of demand response, right? Like, what do you think of as being the same and different?

• 12:08Speaker 03

  I completely agree that, first of all, there are natural pricing tiers. So if you're in ERCOT in Texas, you can pay more money for power right now, or you can ramp down and pay less money because power prices are high. Then there are demand response programs, as you mentioned. A utility might say, you can make some money if you agree to curtail during this period. You might own an S thermostat and be enrolled in a smart thermostat program, and they will pay you if you are willing to reduce your consumption. There are even mandatory programs where a prerequisite of your enrollment is your promise to curtail and a hefty penalty if you do not curtail. But what's missing from all of these is the ability to offer this service of curtailment

• 12:50Speaker 03

  at the large scale that data centers could theoretically provide it and get a real benefit out of it. And that benefit is not just a cheaper cost of power or a flexibility payment. That benefit is a larger power connection or faster access to the power grid, whether you're in an existing data center seeking to increase your capacity or a brand-new data center seeking to connect. You should be allowed to harvest the existing stranded capacity on the grid that can be served to you if you are willing to curtail every so often. And that product doesn't exist today, and with good reason. You know, the electric utility industry for over a century has wanted to promise firm service to its customers. And so there really isn't this non-firm service tier that allows you to skip the line.

• 13:33Speaker 03

  And there are all kinds of legal considerations that come into play, but that's absolutely where we have to go.

• 13:39Shayle Kann?

  You know, the interesting thing about that, I think my guess is that most people would say, if you ask most folks who are kind of like in and around this market, like what is the, what is the limiter on data centers becoming flexible grid assets, particularly leveraging flexibility and compute as opposed to leveraging onsite behind the meter resources, which we will talk about as well. I would guess that most people would say the main limiter is actually on the compute side. It's because in, you know, in the legacy cloud world and then AI as it has emerged since then, there was an expectation of extraordinarily high reliability and low latency. And so, you know, your, your expectation of your workload

• 14:21Shayle Kann?

  getting curtailed is very low. And so that would have been the limiter. You know, it's interesting that you're saying it's actually on the other side because on that side, the compute side, it seems to be emerging. I saw that Gemini announcement as well. And that's cool to see Google doing that. And that that makes the new limiter on the other side of the equation, which again is, is, as you said, the problem is not offering differential pricing or savings based on curtailment. It is actually saying, look, if you agree to curtail a certain amount for certain times, we will interconnect you faster or we will give you a larger interconnection. That's the thing that's missing.

• 14:58Speaker 03

  Yeah, exactly. And let me first just preface by saying, it's not the case that faster and larger connections, because you're willing to be flexible, is not happening anywhere in the world. In fact, Google now has reached a gigawatt of contracted flexible capacity across, I think, five different utility territories, at least some of whom are willing to provide some of these benefits. So Google's really been a pioneer, I believe, you know, across the more than 3,000 American utilities. We have a long way to go to bring these differential service tiers onto the market. But still, we're making good progress. But the point you make, Shayle, I think is a really important one. The point you made, Shayle, is, look, everybody's sort of discounts data center flexibility because they're thinking about

• 15:42Speaker 03

  the compute side. They say these

• 15:46Speaker 03

  AI GPUs or accelerators are extremely valuable and produce wildly valuable tokens of artificial intelligence. If you watched Jensen's keynote at NVIDIA GTC, you saw some of the ridiculous economics of operating token factories, AI factories, right? It's a great idea to maximize the tokens you are generating per watt of power. And so the intuitive response is it is a terrible idea to ever curtail any GPU because the economics just absolutely don't make sense. That, by the way, is one of the reasons why I feel fortunate that basically no one else

• 16:28Speaker 03

  is doing what Emerald does, because that in itself is an intuitive blocker to founding a company like this. But I believe it's actually on the other side, as you said, Shale. I believe that if electric power utilities and grid operators offered these, a range of different service tiers, just like on the compute side, the cloud operators offer a range of different service tiers to their end AI customers, innovation would solve this problem. And you would absolutely have data centers taking advantage of the lower service tiers. And they're not that low, by the way. It's just a, you know, call it 50 or 100 or 200 hours a year that you'd have to curtail.

• 17:09Speaker 03

  Data centers would very happily take utilities up on these lower service tiers in order to accelerate their connection or get a larger connection.

• 17:17Shayle Kann?

  Yeah, I think there's another way to put it, which is that it is true economically that it's probably a dumb idea to curtail, to not maximize token generation if the benefit of doing so is purely a cost savings on your electricity bill, right? And so if it is traditional demand response or something like that, and the benefit that you get is just you save some money on your bill, those numbers don't pencil, largely for the reason of, you know, Brian Janis coined the bit-watt spread term. The bit-watt spread is so Big that it's just not that valuable to you to save some money on your electricity

• 18:00Shayle Kann?

  bill relative to the revenue that you're going to generate with your with your chips. So that is true. Generally, you could disagree with me if you want, but the economics of getting a data center connected larger or faster are orders of magnitude different. And so if that is a benefit that you can get, it actually does flip those economics.

• 18:22Speaker 03

  So I completely agree with your second point, and I sort of half agree and half disagree with the first point, right? On the second point, completely agree. If you're if you've got a 200 megawatt data center and you are able to increase its capacity to 230 megawatts just a year ahead of schedule, and you can swap out to liquid cooling and next generation Nvidia GPUs, you create billions of dollars of value, even netting out the cost of some of the downtime of curtailing during those rare peak load hours, you should absolutely take the deal about a new electric utility service tier. The earlier point you made, though, which is, does is there ever an economic incentive that makes it worthwhile on the fly to reduce your operational expense, your OpEx by reducing your power cost or getting a flexibility payment to curtail a little bit?

• 19:08Speaker 03

  Even if the answer isn't yes in all cases today, and I think there are some cases where it is yes, I think the answer will increasingly become yes in the future as the cost of inference, the cost of token generation asymptotically approaches the cost of power, which is the only real operational expense input into the into the cost of intelligence generation. And so and even today, there are lots of efficiencies we can harvest on a temporary basis to mean that I can reduce peak power by a larger amount than the token generation that I'm avoiding, simply because by operating, this is getting a little technical, by operating a little differently on the power performance curve, on a part of it where I'm not losing as much performance,

• 19:51Speaker 03

  but I am losing, reducing quite a bit of power, is a pretty good trade off to be made on a temporary basis. For example, for some inference workloads, Microsoft has done a great job quantifying this. So there is some low hanging fruit to harvest here, which means I believe even today, it makes sense to be responsive. And in the medium and longer run, it's going to make a ton of sense to be responsive, just in terms of reducing your power bill.

• 20:14Shayle Kann?

  It's a good point. Yeah, it's a good point, particularly about over time. We're in a moment right now that is not reflective of where we're going to be in five years or 10 years, or who knows how many years, two years maybe. But inference should and probably will get cheaper and cheaper. The market will be saturated with it. At that point, the cost of energy does matter. So that is a good point. You alluded to one thing I wanted to ask you about. As you think about workload flexibility, talk to me about the different workloads and what is more and less suited. Obviously, there's the training versus inference distinction, and I'm interested in your perspective on that. But even within a category, even within inference, for example, what have you learned, having run all these demos now,

• 20:56Shayle Kann?

  about what types of workloads seem to be the ones where there is enough volume, they are a big enough portion of the overall workloads to matter, and where they have the most flexibility?

• 21:08Speaker 03

  Yeah, absolutely. There are many different AI workloads. It's more than just a simple dichotomy of training and inference. Each of these categories has lots and lots of different subtypes. I will say, a good reference, there's a March 2026 paper that was published actually by Emerald's chief scientist, Professor Aisha Khoskun at Boston University, with two others, both at BU and at Emerald AI, that shows an 18 to 55% power flexibility opportunity across a range of different representative AI workloads, spanning training, inference, fine tuning, and all of their subtypes. So there's a lot of inherent flexibility is kind of my overarching point. And then I can go into the various kinds, as you suggested.

• 21:53Speaker 03

  As you mentioned, we've now done these five demonstrations at data centers with Nvidia, with EPRI's DC Flex Initiative, and with many other partners from Oracle to Nebius to National Grid. And in each of these, we've tried to reenact real production-grade actual workloads. So, for example, in London, we ran workloads from real models, whether they're OpenAI's models, Meta's open source model, even an Alibaba model from China, to showcase that we could achieve. ...performance levels that real customers are find acceptable. Making sure not to throttle workloads that are the customer labels as mission critical

• 22:36Speaker 03

  or that should not be throttled, while at the same time precisely meeting grid objectives, whether that is responding within seconds to a scenario of a lightning strike or reducing power by thirty or forty percent during the halftime of a soccer game where in England everybody turns on their tea kettles. So we believe that many AI workloads can be throttled in a way that's acceptable to customers, and many of these will be fine tuning, post-training, training-type workloads. There are other workloads, and by the way, some inference workloads as well, like batch inference. There are other workloads where these workloads, even if they can't be throttled, they might be batched differently.

• 23:20Speaker 03

  So again, you're still basically reducing the power consumption in one data center, or they can be migrated. So with Oracle, we showcased migrating AI workloads from one location, Virginia, to another, Chicago. And this was during the data winter, the Dominion winter peak period, the inference queries got rerouted in such a way that you were able to precisely meet the Dominion Grid's power constraint while utilizing capacity far away, while the queries moved within milliseconds halfway across the country. So the user experience really wasn't changed. And so if you're chatting with a chatbot, which by the way is just one of like a million different AI use cases, that that isn't an experience that's going to change very

• 24:04Speaker 03

  much if what's happening is this geo-shifting under the surface. So my only point here is there's so many different use cases. You know, Google, when they announced their flex and priority inference tiers yesterday, they cited cases like background CRM updates, large-scale research simulations, agentic workflows where a model is browsing or thinking in the background, as cases of workloads that are inherently flexible, that you probably don't need an answer from right this second. And of course, that helps Google to better optimize its own AI infrastructure, right? You might be able to use your AI servers for queries that are more urgent, but it also helps us to throttle power use by tapping into the inherent flexibility of computational workloads.

• 24:48Speaker 03

  And so the last thing I'd close on this is

• 24:52Speaker 03

  Historically, data centers have been optimized as a closed system. There are computers, right? CPUs, GPUs, memory, storage. There are fiber optic networks. And so there are multiple data centers across the country. And you optimize this closed system. Nobody's ever considered adding within this closed system. If you weren't listening to this podcast and you were looking at my hands, one circle is around the data center system. And a bigger circle is around the data center plus the grid system. No one's ever added the grid to the closed system. And once we add the grid, then we are optimizing not just for where there are servers available or where there are fiber optic congestion constraints, but also where there are transmission line congestion constraints or where there is inadequate generation.

• 25:36Speaker 03

  And that overall optimization problem causes you to harvest computational flexibility in a different way and often in a way that utilizes this massive electric grid fixed asset and save everybody money.

• 25:52Speaker 00

  For data centers, connecting to the grid quickly means two things: building distributed energy and having a plan for demand flexibility. GridBeyond helps with both. GridBeyond's Terms and VPP platform unlocks the potential of distributed assets and dispatches flexibility into the right market at the right time. And this is more than software. GridBeyond supports developers every step of the way. From modeling your highest ROI energy mix to orchestrating the full set of assets around a data center. The track record speaks for itself. GridBeyond manages over 1,400 sites and more than 3.7 gigawatts of load across Europe, the UK, and the US. Learn more at gridbeyond.com or click the link in the show notes. If you work in energy or climate,

• 26:36Speaker 00

  you already know the company's Antenna Group has helped build. For three decades, they've been the communications and marketing partner behind the industry's breakout companies, category creators, and market leaders. Today, their team is working across the most consequential areas of the energy economy, from data centers and grid modernization to nuclear, geothermal, storage, critical materials, and next generation technologies. Antenna helps ambitious companies become the names everyone in the market knows, trusts, and wants to work with. They build reputation, elevate executives, drive demand, and turn momentum into market leadership. If your company is ready to lead its market, Antenna is ready to help you get there. Visit antennagroup.com.

• 27:18Speaker 02

  When you harness the power of millions of DERs in a VPP and put artificial intelligence behind the dispatch, the outcomes exceed conventional generation. Energy Hub's DERMs platform has been trained on years of real dispatch data from over 2.6 million DERs, so utilities can plan with confidence. That means consistent load reduction across a four-hour event window, even during the widest, most uncertain peak periods. Utilities target, shape, and verify capacity down to the meter. Unlock flexible capacity that costs 40% to 60% less to deploy than traditional infrastructure in a fraction of the time it takes you to break ground on a peaker plant. Learn more at energyhub.com.

• 28:02Shayle Kann?

  One thing that as I've spent more and more time with you and sort of learning about what Emerald is building and more broadly learning about the concept of compute flexibility with data centers, one of the challenges it seems to me is just it's a multi-party situation. There are a bunch of actors in any given situation. It's not as simple as you want it to be. It's not like there's data center and grid. Even within the data center, quote unquote, right, there, somebody is operating the data centers, somebody else might be the cloud provider to the data center, somebody else might be running the workloads or actually being the customer. So can you walk me through like how you think about the stack of who needs to do what? If we're going to deliver on this promise and we're going to take advantage of the

• 28:47Shayle Kann?

  100 gigawatts of latent capacity we've got on the grid by making data centers flexible, like who needs to sign off on what?

• 28:54Speaker 03

  Yeah, it is a wickedly complicated, multi-party problem. I'm delighted, Shayle, you got comfortable getting your hands around this and now we can work together. Look, I go back to an earlier question you asked, which is what's the most critical thing that has to happen? The most critical thing that has to happen is Power utilities and system operators and regulators and governors saying, "If you are willing to be power flexible, oh, data center, we want you in our state. You get to skip the line, you get to connect faster as a flexible load fast track, you get a bigger data center, et cetera." If that happens, I believe everything else quickly falls in line. Now, you're right, the data center is not one monolithic entity. It comprises a lot of players.

• 29:35Speaker 03

  You might have, for example, a data center developer, owner and operator. I'll make one up, Digital Realty, terrific one that we partner with, that is operating a data center within which they have a tenant. That tenant might be one of the many folks we've partnered with, like Nebius, for example, or Oracle, or Lambda. And within that cloud provider, by the way, it could be a hyperscaler as well, within that cloud provider, you might then have a customer. And that customer, by the way, may not be the end customer. You might have together.ai or fireworks.ai, which is an inference serving service, which is then serving tokens and enabling an end customer to run models on them.

• 30:20Speaker 03

  And there may be N layers here. And ultimately, all of those layers have to work together so that the data center, at the point of common coupling, that interconnection point to the grid, has to adjust its net withdrawal from the system, consistent with the grid signals, right? This is complicated. Emerald seeks to be the easy button for data center flexibility. And in order to do that, we basically have to have modules at every layer of this stack, right? We have a module for utilities, we have a module for the data center operator to interact with the utility and communicate, we have modules for the cloud operator, for the end user to have Emerald agents to help them to most gracefully throttle the workloads that they may want to throttle.

• 31:03Speaker 03

  We have agents elsewhere that are working on the onsite energy resources to harness all of those energy resources as well. It is a complicated stack, but I will say, everybody becomes much more willing to work together when there's a real economic incentive, and it's the grid that sets that incentive, which is to say, you get connected faster, you get a bigger data center if you're willing to do this, everybody else will work together.

• 31:26Shayle Kann?

  Yeah, I agree with that, the prerequisite, if the grid says the right thing, everybody else falls into line. You just mentioned the onset resources. I want to talk about that for a second, too, because I think part of what's happened as the concept of data center flexibility has gained more prominence is that it has morphed somewhat. Sometimes people, when they say data center flexibility, they're talking about workload flex. Other times, they're talking about from the grid's perspective, what makes a flexible data center. And in many cases right now, what's happening is that data center developers and operators are putting a bunch of assets behind the meter. Usually what that means is gas turbines of one kind or another, maybe some bests, some battery storage, maybe there's some

• 32:11Shayle Kann?

  other generation, solar could be behind the meter as well. But like, it's behind the meter generation and storage. And so there's one version of data center flexibility, which is just, you know, grid says, or utility says, I need you to curtail now this amount, and you just fire up your behind the meter generator, and you don't do any workload flex at all. There's another version where these things all like play together. So walk me through how you see the landscape emerging with the relationship between behind the meter physical resources and workload flex.

• 32:45Speaker 03

  Totally. I'll say a preparatory point, which is, I believe AI factories belong on the grid. I think it's best for everybody. This is counterintuitive, by the way. A lot of folks might say, well, if the data centers just went off the grid, that would insulate the rate pairs from the peak load increase that the data centers would cause and the bill increases, et cetera. But I believe that's a little bit short sighted. The far sighted way of thinking about this is, as data centers become by the end of this decade, up to 17% of America's load, and, you know, in the decade beyond, a quarter, and a third, and half of America's load, it would be a catastrophe if data centers were Entirely decoupled from the electricity system because the system loses their biggest source of anchor tenant revenue and the most exciting engine of American economic growth.

• 33:29Speaker 03

  It's a terrible idea to be completely off-grid forever. But in order to achieve that, there may be a period of time in the near term where data centers say, I need to get online right the second. And so therefore, I'm going to build myself Bridge Power. It's highly rational. And the hope is, we will be able to quickly bring those resources behind the meter to bear to support the broader electrical system and connect those data centers. With Nvidia, we made a major announcement at CERA Week that Nvidia has a reference architecture. It's called D S X. It's how AI factories should be laid out and should operate. One element of it is D S X Flex, the capability to be flexible. And Emerald is a software partner that helps to operationalize that.

• 34:11Speaker 03

  And we joined six large, the largest American power companies to say, even if you are putting on Bridge Power, we're going to incorporate that into the D S X reference design. We're going to call them hybrid AI factories, and we're going to make sure that they can work together as a single unit to provide services back to the grid. In some sense, this is a super flexible AI factory facility. And the reason for this is, you can coordinate the onsite resources, the gas generators, the batteries, alongside the computational flex. Because AI factories, these token factories, are inherently flexible, as I mentioned, that 18 to 55% inherent flex built in to AI workloads. You can take all of this together, and when you do get a grid connection, and ideally

• 34:56Speaker 03

  it comes faster than it otherwise should because you're flexible, you're able to provide real services back to the grid. So, one of the things that at Emerald, we've been focused on is orchestrating not only the computational resources, slowing down workloads, moving workloads, but also doing that in tandem with the onsite energy resources, generators, cooling, batteries, fuel cells.

• 35:22Speaker 03

  The reason that's important is you might have a microgrid onsite. It may be operated through the software systems of Siemens or an Eaton or a GE Vernova, all of whom actually just entered this round in Emerald AI that you led, Shayle. And we will play very nicely with all of them. We'll integrate and we'll say Emerald will help to recruit the amount of generation and flexibility from these onsite energy resources and coordinate it with the computational flexibility from the GPUs onsite. And that entire unified amount of flexibility is what the grid sees in terms of a change in the net withdrawal of energy from the grid. So I look at Bridge Power Behind the Meter Resources as really a way to supercharge flexibility and not a way to remain as a permanent island.

• 36:07Shayle Kann?

  Yeah, I'll tell you the way that I think about it, and you can tell me if this resonates with you. You know, there's a dispatch curve in electricity in general. And when there's a certain amount of demand, you start at the bottom of the dispatch curve, which is basically the cheapest resource to generate, and you keep moving up the dispatch curve until you meet the demand, right? And so in the context of the broader electricity market, the low end of the dispatch curve is stuff with no marginal cost, which is solar and wind mostly, right? And then you get further and further up and other things get dispatched more and more. When there's a single asset, a single data center that has multiple resources that it can draw upon to meet a need, which in this case is going to be, you know, some amount

• 36:48Shayle Kann?

  of curtailment from the grid's perspective, it's kind of like a little mini dispatch curve, right? And they may have one thing that can go in that dispatch curve, or they may have six. It doesn't really matter. And if you think about it in that context, then it should be that workload flex is the bottom of that dispatch curve. In other words, the cheapest thing to deploy, assuming that you still, you know, to your point, you're taking advantage of the latent inherent flexibility. In other words, you're not sacrificing customer SLAs, you're not sacrificing performance to customers, things like that. If you take that to be true, then workload flex is the cheapest thing you can do. And you should do as much of it as you can, as long as you don't sacrifice customer performance.

• 37:33Shayle Kann?

  Then if you need more, which you may well, you should then dispatch things that cost more money and that may be firing up your generator that you have behind the meter. It may be firing up your battery or dispatching your battery or fuel cells or whatever it is. All those things come at a significantly higher cost to dispatch, but you might be able to get more out of them, right? You might have a generator, gas generator behind the meter that is rated to the same capacity as the entire data center. And so you can, you know, if you need to flex down to zero, that's the way to do it. But if you need to flex down 20%, it actually might make more sense in most cases just to do the workload flex. So I think of it as this like little mini dispatch curve that some data centers will ultimately have, but really only the ones that do have the behind the meter resources.

• 38:18Speaker 03

  I love the dispatch curve analogy. All I'll say is I don't think it's a static dispatch curve. So in electricity markets, it's always that gas peak here that's going to set that marginal price when you have sufficient demand, right? It's always that skinny pointy one at the right side of the dispatch curve. Whereas in the data center, you'll have a complicated, dynamic, constantly changing dispatch curve. I agree with you that there's always going to be a fat, short part of the, on the left hand side of the dispatch curve that's going to be some latent workload flexibility that we can just harvest. There will be customers who are, you know, willing to tolerate a little bit of flexibility

• 39:01Speaker 03

  and there will be workloads that are inherently tolerant to some flexibility. I'll just note here, by the way, there are so many reasons that AI users are tolerant to workload flexibility because all other kinds of things can happen in a data center that might require them to be flexible. So power is just yet the next thing that we ask them to be flexible about. But in addition, in addition, there will be workloads that are, you know, less inherently flexible or that are higher up on that dispatch curve. They might sandwich the battery. The battery, by the way, might have an operating constraint. It can provide you a certain amount for a certain amount of time. That sets the width of that bar, so to speak, but you might have some very interesting dispatch algorithms. One day, you might even have what I call energy token arbitrage,

• 39:46Speaker 03

  or what token arbitrage, where you might actually choose to throttle tokens even before the grid actually requires you to do so, because it's economically optimal in this particular case to charge your battery, let's say. And I believe that as we build in intelligence such as forecasting, which many of our five demonstrations now have done, we'll be able to forecast on both sides, both the grid side, when we expect an event to arrive, and on the AI side, when we expect a job that is more or less flexible to arrive on the scheduler. All of this means it's just a more complex dispatch curve, but I love the analogy. And for us, grid wonks, it's a useful organizing principle for us.

• 40:28Shayle Kann?

  Yeah, it's a good point on the charge of battery one. I think people haven't really thought this one through, right? We're going to put a lot of batteries behind the meter at data centers. Like, I'm pretty convinced that that's going to happen. But let's say that you're a data center that has 200 megawatt, you're a 200-megawatt data center, and you have a 200-megawatt interconnect, and you add a battery. How do you charge that battery? Right? Like, you kind of either need the data, either you need a bigger interconnect, your total load is actually 200 megawatts plus the size of the battery, which is going to be big, or you need to figure out how to be flexible on your power consumption from the data center, such that some of the time, you can be simultaneously charging the battery and pulling from the grid. And so that's like an inherent workload flex requirement that you're going to have to solve, unless you are going to get a much bigger interconnection, which nobody can get.

• 41:13Speaker 03

  Yeah, completely agree. And Shayle, I guess I just don't want to lose sight of the overall, the overarching story here, which 38 minutes in, I'm now going to share. That, what you just shared, Shayle, is an important functionality, and I'll call it the fourth bird that you can kill with a stone. But the first three birds are, first, let's get AI factories, data centers connected much more quickly and at larger capacities to grids, thanks to flexibility. Second, let's keep rates low and stable, thanks to flexibility, by avoiding unnecessary grid build outs. We've still got to build, but nevertheless, if we can harness flexibility, we can build less quickly to, less, less quickly. Rising peak demand while bringing on massive amounts of energy demand,

• 41:57Speaker 03

  megawatt hour demand from data centers that help to pay for the whole system. And third, let's keep the system reliable. The third bird here is if AI factories can respond to system needs, that lightning strike, that soccer game, tea kettle spike, a heat dome we demonstrated in Portland, Oregon with PGE, the utility and Nvidia and many other potential reliability issues. Well, then we'll be able to, with one solution, we'll be able to basically get the grid we want and the AI adoption that we want. It's that really rare holy grail solution. It's why there's so much chatter about it. But you've correctly laid out the reasons it's hard. There's a lot of actors that you have to coordinate.

• 42:37Speaker 03

  There's a lot of ongoing forces such as the push to just go entirely off grid. And of course, there's the lack of those differentiated service tiers from the electric power system. I think later this year, as you know, Emerald and Nvidia and some other partners, Digital Realty, Eprey, Dominion, and PJM, we will put together the world's first 100-megawatt commercial scale AI factory that is truly power flexible. It's custom designed from the ground up to be power flexible, and it's going to be able to respond precisely to all of these grid needs, but at a commercial scale. My hope is the community sees that in parallel, we're getting to the point where more electric utilities are understanding

• 43:22Speaker 03

  they have to offer these differentiated service tiers and give you accelerated interconnection and larger connection sizes. And that's when, you know, late 2026 and 2027, this really takes off and it kind of solves all three of those problems.

• 43:35Shayle Kann?

  All right, Varun, this was fun as always. Appreciate you coming back.

• 43:39Speaker 03

  Really appreciate it, Chael. Thanks for having me.

• 43:42Shayle Kann?

  This show is a production of Latitude Media. You can head over to latitudemedia.com for links to today's topics. Latitude is supported by Prelude Ventures. This episode was produced by Max Savage Levenson, Anne Bailey, and Sean Marquand. Mixing and theme song by Sean Marquand. Stephen Lacey is our executive editor. I'm Chael Khan, and this is Catalyst.