Pod Insights a16z Podcast a16z Podcast | Datacenter of the Future About this episode The datacenter has long been -- there's no nice way to put this -- a bit of a snoozer. Expensive boxes running expensive software. No more, says a16z General Partner Peter Levine. Along with Chris Dixon, Levine lays out a vision for the datacenter of the future. Building on the technology established by companies like Facebook and Google, Levine and Dixon describe a software-led transformation of the datacenter, one where the mobile supply chain and fast-moving companies are reimagining everything -- from the underlying architecture to new business models. Be prepared to get in the weeds, hear Levine talk about the next opportunity, “hosted instances,” Dixon describe the “the dream within the dream,” and discover why the datacenter is about to get exciting.
Transcript 0:00 Speaker 1 Hi, it's Chris Dixon. This is the A16Z Podcast. I'm here with uh my partner Peter Levine, who um so Peter, you focus a lot on um data center technology, uh sort of the when people talk about the cloud. Yeah, what is this cloud? Someone has to build it. Um it seems like it's an exciting time in that area. Like can you can you kind of explain why?
0:18 Speaker 0 Yeah, it uh it sure is. And I'm Peter. Hello, everyone. Um it really is an exciting time. You know, uh data center, which uh tends to be the plumbing of the internet, um, has been one of these uh pretty state areas for a long time. And all of a sudden there's been this unlocking of lots of innovation happening in the data center, largely on the back of, and not uncoincidentally, on the back of the whole mobile revolution. Like as every human on the planet starts to use a mobile device, you know, tweets and and emails and applications, all that information has to go somewhere. And it goes to back end data centers, it goes to the cloud. And the cloud is comprised of uh data centers and computers and that whole uh infrastructure is now transforming to support massive numbers of users that are um that are out there and eventually uh Internet of Things to support all the endpoint devices that are out there.
1:20 Speaker 1 Can you kind of explain just like so in the old days or whatever, five years ago, yeah. If you're you would go as a company and you would you would rent space from Rackspace or some or whatever, some physical data center, you would install your own servers, you would buy software, you'd install it there, like Oracle and all this kind of software, right? And now, and then what happened is people started to sort of use Salesforce and they manage their own data center because software is so software as a service is the first enabler, right? Yeah. Um then and then but you really had then these giant scale companies like Facebook and Google who who had such a new level of scale that no one had ever they had to actually design new infrastructure, right? And so can you kind of explain like how that has evolved?
1:59 Speaker 0 Yeah, um I think it's tremendously interesting what Facebook and Google and Twitter and other very large scale out companies are doing is really interesting because it's the consumer internet companies that are driving this back end infrastructure. Because they
2:14 Speaker 1 have they have to.
2:15 Speaker 0 They have to, right? I mean, they're supporting billions of users, this whole notion of multi-tenancy. You think about all these users, they're all kind of you know, independent. It's kind of
2:25 Speaker 1 crazy to think Facebook is more sophisticated on networking right now than Cisco, right? I mean, is that fair to say?
2:30 Speaker 0 Yeah. Um it's very fair to say. I think they they Facebook and Google have absolutely pushed the needle on backend data center infrastructure. And it's interesting. It's all about software. It's about commodity components kind of being put together in these data centers. So it's much less about thinking of a big vendor coming in with a refrigerator size switch or storage device. It's much more about aggregating very inexpensive components at massive scale using a layer of software on top that can unlock the value.
3:03 Speaker 1 So in the old days, you would go to EMC for your storage, and they make a custom piece of hardware and software. Yeah. You go to Cisco for your networking, you'd go to what HP Dell for your for your
3:13 Speaker 0 servers. You'd go to Oracle for your data. And all those
3:15 Speaker 1 custom hardware. Now people are saying, no, let's just take complete commodity Linux, and it's all software.
3:21 Speaker 0 Absolutely. We we like to say the mobile supply chain is eating the data center, right? And it's it's rather interesting that as you know, look, mobile, the innovation in mobile and the innovation in hardware on mobile devices has been phenomenal over the past several years. We will be able to take many of those in Facebook and Google are starting setting an example here to take many of those components, whether it's ARM chips or flash memory, and take those hardware components and aggregate those together with open source and proprietary software to create the next uh data center of the code. So
3:58 Speaker 1 my smartphone is connecting to the cloud, and the cloud, the data center is literally going to be a bunch of reconfigured smartphones.
4:04 Speaker 0 I I that's a great look. I have this visualization that the data center is a billion smartphones connected together through very sophisticated software. And it doesn't, you know, may not have a screen on it or whatever, but it's it's a lot of different things. Well, those particular things like, for
4:17 Speaker 1 example, ARM processors. ARM processors. It turns out that power is the most important, is the scarcest resource in data center the same way that it is on the on the handset.
4:25 Speaker 0 Power and cooling are critical elements in designing a data center these days. So to the extent that we can go design a data center that uses much less power, requires much less cooling, uh, is optimizing on floor space, those are the ingredients for massive scale out data centers, and those are the those are the drivers. So to the extent we can use um mobile components for that, it's definitely going to solve that problem.
4:51 Speaker 1 So what so how does this then relate to our investing? So, you know, I know probably what a quarter, maybe even a third of our investments are around data center technology. Um can you can you kind of walk through like different areas of the storage, networking, compute? Yeah,
5:07 Speaker 0 so on a on a on a on a broad level, if we take Facebook and Google, those companies are becoming the blueprint for data centers of the future. It used to be where companies would look at Wall Street, for example, at Fidelity and Morgan Stanley and say, hey, we want to copy, we're gonna build a data center like them, right? So
5:26 Speaker 1 Fidelity would build something and maybe some of it would be custom and then the companies would come along and say, you know, let's take that factor it out and sell it to other people.
5:34 Speaker 0 And right, companies would come exactly. So I was a startup. Startups would start up would go look at Fidelity or or Morgan Stanley and go build a stack of the code. So in the old days, if
5:45 Speaker 1 you're an entrepreneur looking to do a data center company, you'd go and learn what Fidelity is doing, package it up as as well. As merchant market, as
5:53 Speaker 0 merchant market products to make it available to the rest of the world. And now you go look at what Facebook's doing and Google's doing, and you say, okay, instead of me as a company having to need 10,000 engineers to keep this up and going, how can how can we create the merchant market products to make that type of data center available to uh data centers around the world to companies around the world who want to go build this next generation of of uh of system infrastructure? Yeah. And so a lot of the companies that we invest in, whether it's storage, networking, compute, databases, analytics, security, all follow the model of how do we unlock the value of commodity hardware components with sophisticated software to bring this next generation scale out data center to everyone who's who's building that.
6:43 Speaker 1 So maybe we can talk about a few of these companies. So like on the networking level, NYCERA was a company that we invested in. Can you explain what they do?
6:51 Speaker 0 Yeah, so NYSERA company that was uh acquired by VMware. Um they uh really pioneered this whole notion of software-defined networking and uh really unlocking this sort of hard coding of of uh of networking to something that's much more flexible. Anytime you build something in software, it becomes inherently more flexible. So they unlock that. Um
7:15 Speaker 1 what's the customer benefit?
7:16 Speaker 0 The customer benefit of that is that uh no longer am I locked into particular silos of networking or um having to lock down a st a server to a particular underlying piece of storage or a user to a particular server, it's very fungible. And so if I'm if I'm creating a service-oriented architecture, I need to be very flexible in terms of how my network connects to different parts of my physical infrastructure, and that the software layer actually enables us to go do that. We um so NYSERA is now part of VMware, um, and VMware is taking that that to market. We are on the networking side, one of our current investments is Cumulus Networks, which is building a very much along the theme of of replacing network switches.
8:07 Speaker 0 What they are doing is taking commodity hardware, putting a layer of open source and closed source software on top of commodity servers and turning that into a new switch that is uh as fast as is uh you know as capable as some of the uh most proprietary systems that are out there today from the likes of Cisco and Juniper.
8:30 Speaker 1 And then what about storage?
8:33 Speaker 0 So on the storage side, we see much of the same thing where again it's all about software being built on top of commodity components, whether it's uh flash or uh you know, flash has become a huge trend in storage. Well, unlocking that flash and using commodity flash as the basis of an enterprise storage array is quite compelling for the uh for the market to the extent that we can build, you know, take software and unlock the value of commodity flash. We can literally see in the not too distant future the the cost of flash storage devices being uh the same price as you know spinning media, and that's gonna be very compelling. It's fast, it's you know reliable.
9:19 Speaker 0 Um so I I think that the transformations on that side are are really interesting as we start to use again these commodity components for the basis of the city. Well, I weren't
9:31 Speaker 1 people using commodity components, let's say five or ten years ago. It wasn't the performance wasn't there. Just one of these sort of Moore's loss things where you
9:38 Speaker 0 so one could argue that we did use commodity components. You had mainframes, mainframes were replaced by PCs. So five, ten years ago, it was the PC revolution. So X86 chips and you know, um uh disk drives from a PC and Microsoft software and Oracle data. That was the that was quote unquote. Quote commodity. Commodity now is even way more commodity, and that in the same way that PCs replace mainframes, I see mobile mobile devices replacing PCs. So it's really, you know, in ten years ago, people were talking about commodity components in the data center, meaning X86 and PCs. Well, now we take that a step further, power cooling, the price of these components coming down that much further.
10:25 Speaker 0 It's just the further commoditization of enterprise hardware that um that that is continuing. Trevor Burrus, Jr.
10:33 Speaker 1 And so what and and so how you know how do you think the world can look in five to ten years in the sense of is every large company going to be building their own data center using the software? Are they going to be outsourcing it to AWS and Amazon and Google? Like the stuff that we're seeing now with start like every startup we meet, right?
10:50 Speaker 0 Yeah.
10:50 Speaker 1 It would be strange to not be running your stuff on AWS. Yeah, yeah. Is that how enterprises are going to look in five to ten years?
10:58 Speaker 0 Look, I think a lot moves to the cloud. I think there's the big debate of does everything move to one. But there's sort
11:04 Speaker 1 of private or public cloud, right? There's
11:05 Speaker 0 there's private, you know, there's a lot of things. Private cloud is
11:07 Speaker 1 Goldman Sachs's has their own quote cloud. Right,
11:10 Speaker 0 right. So I think certainly um the notion of private and public clouds will be the dominant compute sort of style in the future.
11:19 Speaker 1 Um there won't be a question as to whether you do a cloud, quote unquote cloud style infrastructure. The stuff we're talking about, it's so much better, but it'll be a question as to whether you own it and control it. Correct,
11:30 Speaker 0 correct. And that will be mostly around security. Security, data, you know, kind of regulatory stuff, like
11:35 Speaker 1 HIPAA and whatever. All
11:37 Speaker 0 of you know, and and so and you know, sort of DNA's of the company themselves on how they view this, but every data center of the future will be a scale-out data center, right? Applications are going to change. The user base is going to need that as you know, again, mobile, and then we start to think about Internet of Things as you know, collecting all this information and analytics that needs to be done on that, all point to this uh notion of the scale-out data center, whether it's public or or private.
12:05 Speaker 1 I see. So you think it'll be and the difference will just be, as you said, depending on the the DNA of the company or maybe some security issues or something, but there's not a whole lot of other there won't be other reasons why you would go private or
12:18 Speaker 0 mean on-prem, on-prem private. You know, this is uh it's uh it's certainly a a you know if you have a private data center right now on prem, I think it'll take a while. So a lot of people will say, well, of course I'm gonna continue to do that. I think that the economics and the way that data centers are going to be built are is going to drive everyone to private or public clouds, and the notion of the on-prem data center starts to disappear. But you know, uh I'll we'll see what happens.
12:48 Speaker 1 What um and you mentioned Facebook and Google leading the way, Amazon's not leading the way. I mean, that's the most people think of cloud, they think of Amazon.
12:55 Speaker 0 Uh I think I think that the Google and Facebook infrastructure is now uh in my opinion, more advanced than what Amazon is. Amazon was created uh several many uh sort of already generations ago, relative to this commoditization code. Can we give
13:14 Speaker 1 some examples of the kinds of things that you do that are old technologies?
13:17 Speaker 0 Um I think uh yeah, that's a good one. Um, Amazon at Amazon, from what I know is uh based on a virtual machine architecture, and virtual machines um are you know the way to encapsulate information and encapsulate sort of uh uh uh you know kind of uh uh data. Um I see that we've already moved to the next generation where you know virtual machines certainly within which is containers, which certainly in a Google or Facebook environment, it's more about containers and less about virtualization. Now, why is that? Well, containers use far less uh compute resources. There, you know, it used to be where I had to support Windows and Linux on a machine, therefore virtual machines are important.
14:04 Speaker 0 Now it's only Linux on both sides, Linux as the as the base operating system and running within these containers. So we can simplify the environment by as an example through containers, and that unlocks a lot of uh a lot of additional power for compute for applications as opposed to locking that power down for um for the virtual machine infrastructure. Trevor Burrus, Jr. So
14:30 Speaker 1 what are the areas in the data center that we're like that we're looking at for you know new investments? Like what do you consider the
14:36 Speaker 0 well one of the new investments that we recently made was a company is a company uh Mesosphere. And I'm particularly excited about that particular architecture, and that it literally is what I call the one over VMware technology company. And when I say one over VMware, this is not about carving up machines and carving up resources, it's about aggregating resources together. And I think that that um the notion of aggregation of processes, compute resources, storage, and bringing that all together against this this massive scale out kind of data center is going to be the way that that um that environments run in the future. So um that's one area. So
15:21 Speaker 1 I think of it as so tell me this is wrong, but I think of it as if so in the cloud architecture, the data center is is becomes a lot like a server used to be, and therefore uh a single server. So yeah, now the entire data center is one is in sense one server, and all the things you used to do at the server level in the operating system are now need to be done at the data center level. And I think of Mesos is sort of like maybe the scheduling aspect of the system. It is the schedule,
15:46 Speaker 0 but it is a platform for uh for the aggregation of these resources beyond just scheduling. So one could imagine applications actually being written to the Mesos API, and it will uh coordinate the right resources from the right places coming together, not unlike you know an operating system does on an individual server.
16:08 Speaker 1 So you can say I want, you know, to increase the capacity of web servers 50 percent and databases 10 percent, and it'll just sort of
16:16 Speaker 0 Mesos will go out and get that for you and make it available to the application without without the user doing it. In the
16:21 Speaker 1 old days you had to have like a team of sysadmins, you know, whatever spinning up servers and configuring and
16:27 Speaker 0 your analogy of like single server to data center being the server is exactly the analogy within a given server. I could always, you know, I could tune things up and move things around. But at the data center level, very, very difficult to do, and then things change, and it's you know, sort of a shit show of stuff that goes on and it's crazy, right? And so as you expand out to thousands or you know, we talk about a billion cell phones. Imagine trying to manage all that without something like a Mesos helping to uh coordinate it all. Aaron Ross Powell,
16:56 Speaker 1 Jr. So what other areas you think like are you know that we haven't made investments in yet that you think are interesting.
17:01 Speaker 0 Um I'm interested in uh I think the whole container uh world is uh is particularly interesting. Aaron Powell So
17:09 Speaker 1 containers, so I mean let me do my lay person's take on containers too. Uh so you know, virtual machines if in the data center world have probably been one of the biggest inventions of the last 10 to 20 years. It's that virtual VMware massively successful company that pioneered it. Um it basically allows you to run an operating system on top of an operating system, which is great for both running Windows on top of Linux, but also in in a way to partition resources effectively. So you can sort of say I right. I mean, it lets you it lets you mu change things in software that pass you to change in hardware, like you want to run more web servers or something. And but the problem was you're running an operating system on top of an operating system, which is a preposterous architecture, right? Like I mean, it's just I mean it works. It's a total hack. It's a phone it's a clue. Well, it's a
17:50 Speaker 0 complete replica, like that operating system, the base level operating system is a complete it's a complete reproduction of the server itself. It's inception-like in that everything is like happening. And it's just incredibly you
18:05 Speaker 1 know, resource intensive.
18:06 Speaker 0 It's very resource intensive. Now
18:08 Speaker 1 so containers are you get the benefits of that, but you're you're not doing a dream within a dream. You're doing one layer of operating.
18:16 Speaker 0 Um it's sort of one layer. The operating system effectively reproduces itself, right? So you have multiple instances of the same operating system running on a system. And uh look, I think the notion of the the notion of having a container and being able to move things, and this was the the best of the virtual machine world was that I had this entity that I could move around and then. This is like
18:45 Speaker 1 so a developer now. What happened also, right, is in the old days you wrote a program, you wrote a program, right? Now you write a program, you got 50 different libraries, you've got a database, you've got a web framework, and just getting the thing deployed. Like so you take your software and I want to put it on a new machine is like a day of work of like downloading and configuring, installing. Yeah, and so containers let you package it all up in one single file, and boom, you can shoot it out anywhere you want.
19:09 Speaker 0 So and that's been that was that is the employment is
19:12 Speaker 1 amazing with that.
19:12 Speaker 0 So for virtual machines, that was this, you know, had similar characteristics. One file I could go deploy in multiple places. Containers offer that without all the overhead of this virtualized infrastructure. And so I think that that's one of these
19:27 Speaker 1 it's a rare thing where it just seems like it's a no-brainer dramatic improvement over virtual machines, and they're they're just VMs are over. Um
19:34 Speaker 0 I mean it's gonna take a while. It'll take it certainly will take a while. Um But
19:38 Speaker 1 there's just there's not there's not really trade offs here, right?
19:40 Speaker 0 The the well, the trade-off in the past was, and I mentioned this before is that what virtual machines allow you to do is run different operating systems on top of the base operating. That was a big
19:51 Speaker 1 more.
19:51 Speaker 0 It doesn't matter anymore. So while it's a no, you know,
19:54 Speaker 1 Linux is so people don't understand. Some people don't it's so thoroughly one. It's
19:58 Speaker 0 pervasive, right? It's one. And so So if I happen to be running Linux on top of Linux, like, hey, that's just fine, right? In the in the quote unquote old days, I had to run versions of Windows, I had to run different instances of Linux. And so that mixed environment created the uh the the opportunity and rationale for uh for server virtualization. So I I look, I think the world is is shifting in this new direction, and um yeah, it's gonna unlock, I think, a lot of value out of you know these data center infrastructure components.
20:30 Speaker 1 So around containers, so we have Mesosphere, like what uh what are the other interesting kind of startup opportunities there?
20:36 Speaker 0 Uh around uh you mentioned containers as being an interesting thing. So one of the things that um I'm particularly interested in um is the hosting of a variety of infrastructure components. So we made an investment in a company DigitalOcean, right? And what they do is they take a variety of open source components and they you know they're a they're a cloud for developers. And um what I find really interesting about their uh environment is they are offering to developers the hosted instance of many open source projects. So um I I'm a big believer that we're moving from a world of sort of you know, this on-prem kind of uh you know, virtualization running on-prem to these hosted instances of let's say hosted instance of Docker, for example, or hosted instances of databases.
21:33 Speaker 0 And so I think uh in my mind, to the extent that we uh look to invest in the in in the not too distant future, it'll be about investing in hosted instances of particular open source technology. So a hosted Docker might be an interesting thing.
21:56 Speaker 0 Yes. Um it provide one, it provides great value to the end customer because I no longer have to deploy this stuff on prem, right? Um then the business of open source is completely uh rationalizes open source as a viable business model. In the past, open source was a questionable business model. Yes, Red Hat made a you know nice way at it. I wrote a blog on this. Like, you know, there are some companies who will make good money with the internet.
22:24 Speaker 1 There haven't significant acquisitions, but there haven't been standards. There haven't been
22:28 Speaker 0 standalone franchises other than Red Hat that have really been able to quote unquote. Given the scope of
22:35 Speaker 1 the importance of open source, given that it's as you know, if you compare it to its to its uh proprietary software analogs, it's you know, Microsoft. You just
22:45 Speaker 0 you you just made a couple of minutes ago, you made the point that Linux has taken over the world, right? There's no need for anything else. Well, if you think about the economic benefit that Red Hat has derived over the complete transformation of Linux, it pales in comparison to the impact that Linux has had in the world. And so look, open source has been fantastic. It's been a fantastic uh uh vehicle for innovation. But um in terms of economic value back to the developer of open source and back to the provider of open source, I believe that once it once open source can be provided as a service, it will have it is then able to unlock full market value and full potential. And to me, that's a really interesting sort of transformation.
23:33 Speaker 0 So
23:33 Speaker 1 does that mean the company like true historically with open source, the interesting company has been the company that had the core developers of the project. So for example, MySQL, the company had the MySQL developers, right? Yeah. And so like and so in the future, you think that there's a there's a cool new open source project X. The key developers for X will be in a company, and that company will provide a service-based version of that software. That's what you think will be the future of open source. Yes, I
24:01 Speaker 0 think that's that to me is the interesting part of the next gen open open source models um will be that particular uh that particular type of deployment. And uh, you know, GitHub is a good example of this. Like, you know, they're the they're the epicenter of all open source development of all development, right? So you can have
24:21 Speaker 1 taken Git and you could have sold it MySQL style, or you could do GitHub, which seems to be a much more much more interesting business. Duh, right?
24:29 Speaker 0 Like, yes. Okay. So that model is exactly what I believe is going to happen at every segment of the open source market will be around.
24:39 Speaker 1 You know, GitHub has that network effect. Yes. I mean, that that I think I wonder if it's if it's really the beginning of a pattern or if it's such an exception.
24:48 Speaker 0 Uh I think look, GitHub certainly has the the the network effect of developers, but I would argue that if um if they had just gone off and and supported Git and done it as an on-prem thing with some collaborative hoo-ha on top of it, it would never have been as successful as what it is now. So sure the collaboration adds to it, but look, I mean, I think uh, you know, there are a number of companies who I believe will have very great promise of offering sort of the sassafied versions of open source that will be the future um just because it's gonna be very compelling for them to continue to innovate and for users to actually use that in ways that we just haven't seen before.
25:34 Speaker 0 Okay.
25:34 Speaker 1 All right, great. We're out of time. Thanks.
25:36 Speaker 0 Okay,
25:37 Speaker 1 thanks.
Previous Company Building in Crypto: A Conversation between Brian Armstrong and Chris Dixon Next What's Next for Education Startups Page updated August 25, 2026 · transcript and summary are machine-generated