Pod Insights Big Ideas Lab El Capitan About this episode For decades, it was an ambitious dream: to create a supercomputer powerful enough to tackle humanity's most complex problems. Now, that dream is a reality. Welcome to the world, El Capitan.
Transcript 0:00 Speaker 00 Looking for a career that challenges and inspires? Lawrence Livermore National Laboratory is hiring for a power grid dynamics engineer and a transmission grid engineer, along with many other roles in science, technology, engineering, and beyond. At the lab, every role contributes to groundbreaking projects in national security, advanced computing, and scientific research, all within a collaborative, mission-driven environment. Discover open positions at llnl.gov/careers, where big ideas come to life.
0:46 Speaker 00 For decades, the U.S. Department of Energy has been pursuing a bold vision: a system powerful enough to tackle the greatest challenges facing humanity.
0:57 Speaker 01 Fears of a serious new threat to U.S. national
1:00 Speaker 02 Russia has begun major nuclear weapons exercises.
1:03 Speaker 03 The World Health Organization has declared a global public health emergency.
1:06 Speaker 04 The electricity system is undergoing a once-in-a-century transformation.
1:09 Speaker 05 What will the energy of the future look like?
1:12 Speaker 00 That vision: Exascale Computing.
1:15 Speaker 06 Exa is a Greek prefix, meaning "ten to the eighteenth," and "exascale system" nominally is about how many calculations can it perform per second.
1:26 Speaker 00 The U.S. government and the National Nuclear Security Administration's Trilabs, Lawrence Livermore, Los Alamos, and Sandia National Laboratories, needed a machine capable of operating on a scale that had never been done before.
1:41 Speaker 06 You can think of it as a billion billion, and so just the sheer number of calculations that you can perform in a fixed amount of time is beyond anything that we've been able to do in the past.
1:54 Speaker 00 The NNSA Labs needed a computer that could simulate nuclear reactions to the tiniest detail: discover new materials, boost energy, advance inertial confinement fusion, and meet the nation's evolving national security demands.
2:12 Speaker 00 But building a machine of this magnitude required vision and a willingness to gamble on the unknown. More than a decade of work went into building something that would push the boundaries of what was possible. Capable of performing more than two quintillion calculations per second at its peak. And now, that vision is a reality. This machine doesn't just turn on. It awakens. Piece by piece, system by system. Each one coming to life in perfect synchronization.
2:56 Speaker 00 And then, it happens. The future has arrived. Welcome to the world. El Capitan.
3:09 Speaker 07 We expect El Capitan to offer more total compute capability than any previously built system.
3:21 Speaker 00 Welcome to the Big Ideas Lab, your weekly exploration inside Lawrence Livermore National Laboratory. Hear untold stories, meet boundary pushing pioneers, and get unparalleled access inside the gates. From national security challenges to computing revolutions, discover the innovations that are shaping tomorrow, today. Looking for a career that challenges and inspires? Lawrence Livermore National Laboratory is hiring for a power grid dynamics engineer and a transmission grid engineer, along with many other roles in science, technology, engineering,
4:06 Speaker 00 and beyond. At the lab, every role contributes to groundbreaking projects in national security, advanced computing, and scientific research, all within a collaborative, mission-driven environment. Discover open positions at llnl.gov/careers, where big ideas come to life.
4:34 Speaker 00 On November 18, El Capitan was officially launched at supercomputing's biggest showcase, the SC conference, where it was announced as the world's fastest supercomputer. At a peak speed of more than two exaflops, El Capitan is not just a technological marvel, but a machine that holds the future of national security, scientific research, and breakthrough innovations in its hands.
5:00 Speaker 06 El Capitan is one of the first exascale systems deployed in the United States. It is the third in a series that the United States has been developing, and is the first of these exascale systems to be deployed for the national security mission.
5:17 Speaker 00 Rob Neely is the Associate Director for Weapons Simulation and Computing at Lawrence Livermore National Laboratory. The immense computational power of El Capitan, and its unclassified companion system, Tuolumne, holds the potential to solve some of humanity's biggest challenges. From fusion energy, to climate modeling, to renewable energy research, to breakthroughs in drug discovery and earthquake simulation. However, at its core, El Capitan was designed with a singular mission: to ensure the safety, security, and reliability of the U.S. nuclear stockpile.
5:55 Speaker 06 For the United States to maintain confidence in our nuclear stockpile, prior to 1992, if we wanted to understand if a change or a new design worked, we would go off to Nevada, drill a big hole in the ground, put the weapon down there, and set it off. And that's called underground testing. And that's how things worked for decades. We stopped doing that in 1992, under the Clinton administration, and that left us with the big question: "How are we going to retain confidence in our nuclear stockpile?" And so, that really spearheaded a big push in the United States to use supercomputing, and modeling and simulation,
6:39 Speaker 06 as one leg of a new program called "Science-Based Stockpile Stewardship", designed to make sure we could retain our confidence in these weapons.
6:49 Speaker 00 With new global threats emerging and a Cold War-era arsenal still in play, ensuring that the US maintains its nuclear deterrence and its competitive advantage over its adversaries have become some of the nation's most critical challenges.
7:03 Speaker 06 For the first time in decades, we're designing new weapons that are similar, but safer, higher performing. So that national security mission is core to a lot of what we do and what we plan to use El Capitan for.
7:20 Speaker 00 This mission is not new. It's one Lawrence Livermore National Laboratory has been working on since its founding in the 1950s.
7:28 Speaker 04 The nice thing about Dealey Labs is they do make these long-term investments in science and technology that we think we're going to need for the mission, so they can take 20 and 30 years to come to fruition, which is a really interesting work environment for us.
7:44 Speaker 00 Theresa Bailey is the Associate Program Director for the Weapons Simulation and Computing Computational Physics Program at Lawrence Livermore National Laboratory. Her job is to oversee the development of a wide range of modeling and simulation tools that can be run on Lawrence Livermore National Laboratory's high-performance computers. She points out that El Capitan, in many ways, represents the culmination of decades of research and development, bringing to life the vision of the Accelerated Strategic Computing Initiative, or ASKE, that was established over 25 years ago.
8:20 Speaker 04 The ASKE program was designed to deliver modeling and simulation tools aimed at stockpile stewardship using high-performance computers, so that we would never have to go back to nuclear testing. So El Capitan really represents that end product for the original vision of ASKE.
8:42 Speaker 07 Supercomputing is bringing to bear as much computational power as we can assemble to solve the hardest problems that are out there.
8:53 Speaker 00 Bronis D. Sapinski is the Chief Technology Officer for Livermore Computing.
8:58 Speaker 07 We do modeling and simulation of a variety of processes. Most of them are related to stockpile stewardship, but climate science, things like that. To do those kinds of simulations in ways that actually models things close to reality, it takes quite a lot of computation and so it takes much more computing capability than you have in, say, your laptop or your phone.
9:23 Speaker 00 Today, supercomputers far surpass the computational power of any device you have at home. What truly sets them apart is their precision and interconnectedness. Supercomputers are designed to have thousands of compute nodes work together to run simulations that mimic reality with incredible accuracy, which requires immense computational power to achieve the 64-bit double-precision calculations necessary for reliable scientific results.
9:52 Speaker 07 Mathematically, real numbers are infinite precision. In a computer, you have to choose some finite precision. The fidelity with which you're representing that infinitely precise number in the computer is limited by the number of bits you devote to it. And so getting an accurate answer depends on how many bits you use for it.
10:15 Speaker 00 Think about it this way: when you write down the number 3, you're not just writing "3." In precise terms, it's 3.000000, continuing infinitely. Computers, however, have finite precision, meaning they have to cut off those trailing zeros at some point. In scientific computation, every extra decimal place of precision can be the difference between a simulation that is reliable... And one that isn't.
10:49 Speaker 07 Doing large simulations requires fairly significant precision. So most of our computations require 64-bit computations.
10:59 Speaker 00 64-bit precision allows supercomputers to handle numbers with up to 64 binary digits, enabling the highly accurate calculations needed for complex simulations, such as those used in nuclear weapons research. In national security, where the smallest margin of error can have critical consequences, close enough simply isn't an option. This is why Lawrence Livermore National Laboratories and the NNSA have been relentlessly focused on hitting that exascale computing target. But achieving this level of technological advancement requires more than just improving current capabilities.
11:39 Speaker 00 It requires holding a vision so bold and far-reaching that the path forward may not always be immediately clear.
11:47 Speaker 06 Back in about 2008, there was a seminal paper that was released by DARPA, the Defense Advanced Research Projects Agency, foreshadowing the difficulties that the computing industry was going to have reaching this exascale target. So for decades, computers had been getting 1,000 times faster, approximately every decade or so, built on first just smaller transistors, the more things you could pack on a chip, then by parallel computing, putting more of these chips together into a single system. But getting to exascale very early on, almost 15 years ago, it was recognized this was going to be a challenge like we haven't addressed before.
12:29 Speaker 06 So we started thinking about these systems long before we decided what the systems would actually be, because we knew there was going to be a lot of research needed to be able to utilize these systems effectively.
12:42 Speaker 00 This DARPA report foreshadowed the immense challenges on the horizon. It highlighted key issues like power, memory, and system resiliency.
12:52 Speaker 06 Fast forward ahead to about 2015, 2016, the United States funded something called the Exascale Computing Project, which was really about the research needed to develop the software and the applications that would ultimately run on these machines. And it also funded some research for companies like AMD and Intel and Nvidia and HPE, big players in the supercomputing industry, to help them develop technology faster so that we could deploy those at the laboratory sooner for our mission. So all this was happening about six, seven years ago, and at that time is when we began thinking about what's our next
13:33 Speaker 06 system going to be, what's the NNSA's Exascale system going to be.
13:38 Speaker 00 As the Exascale Computing Project took shape, it became clear that the path forward would require new solutions for both software and hardware.
13:47 Speaker 06 One of the original challenges we had when thinking about Exascale Computing was really around the power requirements of these computers.
13:55 Speaker 07 Historically, the earliest supercomputers were just the earliest computers, right? Over time, though, they became dominated by something called vector systems. So that's a way of computing a bunch of things at the same time in parallel. There's kind of limitations on that. And so over time, we moved to networked systems of CPUs, which is the standard way of what people use in their laptops. And so for a long time, we were building systems with CPUs.
14:24 Speaker 06 That's how, for decades, we've been getting faster and faster performance on these supercomputers. But if you drew sort of a straight line on where we knew technology was going in the late 2000s, out to 10 years later or so, the amount of power it was going to require to field one of these systems, we were going to have to think about putting a nuclear reactor next to the building because it was in the hundreds of megawatts, which the operational costs for that were more than the Department of Energy even was willing to accept. And so a lot of the initial challenges and a lot of the initial research was, how can we continue to ride this wave of improved computer performance without expanding the
15:07 Speaker 06 amount of energy and power that's going to be required?
15:11 Speaker 00 The power challenge was immense. Exascale systems like El Capitan would require a completely new approach to energy efficiency, pushing computing experts to explore new ways to design and build these machines.
15:25 Speaker 07 In order to get more parallelism, we moved to processors that are used to drive the graphics on your screen, so GPUs.
15:33 Speaker 00 In 2018, Lawrence Livermore National Laboratory launched Sierra, a groundbreaking supercomputer that combined CPUs with GPUs, making it one of the first large-scale systems to use this integrated, heterogeneous approach. Sierra delivered 125 petaflops at its theoretical peak, roughly one-eighth of the computational performance of Exascale.
15:58 Speaker 06 Part of what we were able to do between the community and our vendor partners, like folks at Nvidia and AMD and Intel, were to make these graphics processing chips suitable for scientific computing. It was really scientific computing in partnership with companies that helped us recognize that, yes, we could do this. This could become the basis for the next generation of supercomputers, and it's going to be something like that technology that's going to be required to get us to Exascale computing in a power budget that we can manage.
16:32 Speaker 00 Sierra's design was a huge leap forward, but the shift to GPUs introduced a new challenge. Many of the existing codes weren't built to run on GPUs. These codes had been designed for CPU-based systems, and adapting them wasn't a simple task.
16:50 Speaker 04 These aren't just little codes that you can rewrite over and over again. They're big codes. There are sometimes millions of lines of codes coming together. So to make these big shifts in algorithmic type takes a lot of upfront thought and research to make sure it has the payoff that we need.
17:11 Speaker 00 Imagine being tasked with translating a complex manual into a different language. Except this manual isn't just a few pages. It's millions of lines long, and every detail is critical.
17:30 Speaker 00 Even the smallest error could derail the entire process. This was the challenge Lawrence Livermore National Laboratory's developers faced when adapting CPU-based codes to run efficiently on GPUs. To overcome this, the team implemented Raja and Umpire, coding tools that simplify and streamline the process of adapting and using the codes. These tools, first used for Sierra, sped up the work for El Capitan dramatically, reducing code implementation time and pushing the exascale transition forward. The next pivotal step toward a fully functional exascale machine came with the introduction
18:12 Speaker 00 of AMD's next-generation processors, known as APUs, or accelerated processing units. These chips combine both CPUs and GPUs into a single hardware package, making them more efficient and easier to program. This invention marked a major leap forward in computing technology, not just for the lab, but for the world.
18:36 Speaker 06 The APU was an innovation that AMD came up with, one of our partners in El Capitan, to basically integrate the idea of the CPU and the GPU all on a single package. Sierra had GPUs in it, but they were really completely separate from the CPUs. They were separate memory. And one of the complications of using those systems and using accelerated computing in general was that the programmer now had to make some explicit decisions about when to move data between the CPU and the GPU and when to transfer control of the program from one type of device to another. The APU now gets rid of one of those complications.
19:18 Speaker 07 That makes the system more efficient from an energy standpoint because you're not doing those useless movements of data. And it also makes it easier to program because you don't have to program that movement of data. That's technically a big advantage.
19:34 Speaker 00 El Capitan is made up of tens of thousands of these APUs, each one linked together to create a vast system capable of calculations on a scale never before seen.
19:45 Speaker 06 The way these large supercomputers are assembled is you have the basic unit of compute that's called a node, and a node, in our case, is actually already made up of multiple APUs. Then you take nodes and you assemble those into blades, and then blades get assembled into like a commercial-grade refrigerator-sized rack that sits on the floor and weighs a lot. And then we assemble those racks together on the order of about 100 of them for El Capitan to make the entire system.
20:27 Speaker 00 Looking for a career that challenges and inspires? Lawrence Livermore National Laboratory is hiring for a power grid dynamics engineer and a transmission grid engineer, along with many other roles in science, technology, engineering, and beyond. At the lab, every role contributes to groundbreaking projects in national security, advanced computing, and scientific research, all within a collaborative, mission-driven environment. Discover open positions at llnl.gov/careers, where big ideas come to life.
21:12 Speaker 00 One of the biggest challenges with exascale computing wasn't just designing the machine, but building the infrastructure to support it. At Lawrence Livermore National Laboratory, they had to overhaul the entire electrical and cooling infrastructure, doubling their capacity to handle the immense energy demands of El Capitan. A new utility yard was built, supplying enough energy to power tens of thousands of homes, just to ensure the supercomputer could run at full capacity without interruption.
21:44 Speaker 07 As part of something called the Exascale Computing Facility Modernization Project, we deployed significant increase in the electrical infrastructure to our main data center. And so that took us from 45 megawatts to 85 megawatts. So we're essentially 2X the...
22:07 Speaker 07 Energy that we can deliver to the computer and floor.
22:10 Speaker 06 Now, El Capitan is not going to use all 85 of those megawatts, but it's going to use somewhere around 30 of those at any given time.
22:20 Speaker 00 That power is enough to supply around 30,000 homes. The extra energy capacity of the Livermore Computing Facility ensures they can sustain existing supercomputers alongside El Capitan. Despite its substantial energy requirements, El Capitan is one of the most energy-efficient supercomputers ever built in terms of performance per watt. But all that power generates heat. A tremendous amount of it.
22:48 Speaker 06 Liquid cooling is required to keep these systems from literally melting, because they run at sometimes over 1,000 watts. So you think about how hot 100-watt light bulb can get. Magnify that now by 10, 20, 50 times. That's how much heat you're trying to dissipate in a very small package in one of these nodes of a supercomputer. And then multiply that by the tens of thousands of nodes that make up these systems. That's a lot of heat that you've got to try to make sure you can get rid of. And liquid cooling is the idea that you bring in cool water. You then run water across cold plates.
23:30 Speaker 06 It dissipates some of the heat away, goes out the other side of the rack, and then eventually, through heat exchangers, goes out to a cooling tower. And then that water is cooled and the cycle repeats.
23:42 Speaker 00 At full operation, El Capitan will cycle through 5 to 8 million gallons of water every 24 hours to keep its systems cool and running efficiently.
23:57 Speaker 00 Building El Capitan required more than just cutting-edge technology. It took a coordinated effort across multiple organizations. Years of collaboration between Lawrence Livermore National Laboratory, the Department of Energy and NNSA, and private industry were essential in overcoming the immense technical challenges of exascale computing.
24:18 Speaker 06 Back around the time where we were first starting to talk about exascale and recognizing the challenges, we created a term that stuck called co-design, which was really the idea that we're going to have to take this from a standard customer-client relationship with these companies to something much more collaborative. We need to understand more about the long-distance roadmaps of these companies so that we can begin to angle our research and our applications development toward what their roadmaps are. But probably more importantly, these companies really need to understand where the bottlenecks are in our applications so that they can think about how to design their hardware in
25:00 Speaker 06 ways that are going to best address our concerns and our needs.
25:04 Speaker 00 Co-design emerged as a way to blur the lines between hardware and software development, bringing together experts from both fields to work side by side. This deeper level of collaboration, often involving clearances for security-sensitive work, allowed teams to quickly identify and address the most critical challenges, speeding up progress in ways that wouldn't have been possible without a standard customer-supplier relationship.
25:29 Speaker 07 Being innovative is really critical to doing new things, taking new approaches. But if you have a completely new approach all on your own, you're not going to get much done because big things take lots of people.
25:43 Speaker 00 Together, they've built something truly extraordinary. El Capitan is not only faster and more powerful, but is also able to tackle problems that were once deemed intractable.
25:56 Speaker 04 So there's a class of problems that are big 3D problems that we want to run at high resolution. We've been studying this class of problem for years, since the beginning of ASCII. And the first time we took it out for a spin, it took like half of our biggest supercomputer and it took over a month to run it. And in 2015, we checked again and it took maybe 20% of our supercomputer and it took a little less than a month. Then we took that same calculation out for a spin on Sierra and all of a sudden it took 3.3 days. Whoa. Okay.
26:40 Speaker 04 That is like game changing, right? Think about it. Think about what you can turn around in 3.3 days as opposed to a month. 10 different types of those calculations. Think about if you're designing something, how that changes what you can do, right? It's just night and day. I get 10 shots as a designer to make a choice in a month. That's incredible. Oh, and by the way, that 3.3 days took less than 10% of Sierra. That was like, this is going to be tractable on El Capitan. We need to continue pushing. We need to get to higher mesh resolutions and do a better job with the physics and that is our goal.
27:23 Speaker 04 Our goal is a reasonable turnaround time for a medium to high resolution, full physics calculation in three dimensions that we have never been able to do before.
27:38 Speaker 06 It's an open question for whether or not El Cap will be the fastest computer in the world for one year, two years, maybe three years. We can't predict that right now just because everybody's working always to build faster and faster computers.
27:54 Speaker 00 El Capitan's achievement as the world's fastest supercomputer isn't just about speed, it's about what that speed can accomplish. It signals a new era of computational capability that will tackle some of the biggest challenges facing humanity, whether it's understanding complex physical phenomena or advancing national security.
28:15 Speaker 04 We have a series of problems that are just gonna challenge the entire scale of the machine. There are problems I can imagine. They're big problems, they're things that no one has ever dreamed really trying. We have laboratory-directed research and development projects that have put things in place where like, if we could do something massive, we could solve this problem. And there are a few of them that, over time, using El Capitan, we will get the codes aligned and arranged, and go after those problems as well. They're probably not gonna be the first thing we try, but over the life of the machine, we will take a shot. I'm very certain of that.
28:54 Speaker 00 El Capitan's journey did not begin yesterday, and it won't end tomorrow. Decades of planning, innovation, and collaboration have led to this moment. And now, even as it comes online, the lab is already looking to the future.
29:10 Speaker 06 We always are planning ahead as much as possible, and we're already starting to think about what the next system in the 2030 timeframe is gonna be. And we wanna make sure we can begin to stand it up, and we're anticipating it's also gonna be a very power-hungry system, while still keeping El Capitan running, because it will, of course, be being used for the mission during that time. So, we sized our facility to be able to support multiple exascale systems at one time during that overlap period, when we're at end-of-life for one system and beginning-of-life for the next system. So that was one of our big challenges, was making sure we have the infrastructure, the power, and the cooling required to field these systems.
29:55 Speaker 00 Building world-changing technology requires looking far ahead, anticipating the limits of today's capabilities, and constantly pushing the boundaries. The team at Livermore isn't just solving problems. They're planning for challenges that may not even exist yet.
30:13 Speaker 04 What's the next big thing? That is the billion-dollar question. I think taking a step back and looking at the numerical methods that we can apply on these machines and looking at different ways to run sensitivities or to understand how we not just get one solution, but a solution plus ensembles of answers or getting gradients of the solution is probably what we should be doing once we get through the El Capitan challenge. Hardware advances are uncertain.
30:53 Speaker 04 The machine learning market is driving hardware changes that are complex for our codes to deal with. They don't need the precision we need. And so the hardware that vendors are creating, take that into account to sell to that market. So that's going to be a challenge for us.
31:13 Speaker 07 We're looking at both technology slowing down and prices going up and very worried that for the same dollars, we're not going to get a lot more compute than we have in El Capitan. So we're thinking about how can we make the systems get more work done for the same compute capability.
31:34 Speaker 04 Because of that, the future of the architectures is unclear. So for the code teams, I think thinking about new types of calculations we can do, new types of numerical methods we can employ because we do have huge compute is what we'll do in the short term.
31:53 Speaker 00 The real power of El Capitan isn't just in the numbers it can crunch today, but in the new frontiers it opens for tomorrow.
32:02 Speaker 06 This is a signal of the United States continuing leadership in high-performance computing, that we can continue to do something that is the best in the world. And that alone makes El Capitan interesting. And that alone is one reason to be proud of what we're doing here at our national laboratories with US industry to do something that is the best in the world. But of course, a fast computer that doesn't actually solve any of humanity's problems, that's not terribly interesting. So it's not enough for us to just be the fastest in the world. It has to be for a purpose.
32:47 Speaker 00 As the team at Livermore has shown, reaching for the pinnacle is just the beginning. The pursuit of what comes next, anticipating future limits and pushing past them. That's the enduring mission.
33:17 Speaker 00 Thank you for tuning in to Big Ideas Lab. If you loved what you heard, please let us know by leaving a rating and review. And if you haven't already, don't forget to hit the follow or subscribe button in your podcast app to keep up with our latest episode. Thanks for listening.
Previous DYNA3D Next NARAC Page updated November 6, 2026 · transcript and summary are machine-generated