Aaron Levie, CEO of Box, on Box AI, Enterprise Enthusiasm, and the Evolution of SaaS

In this episode, Aaron Levie, Co-founder and CEO of Box, discusses the current landscape of AI and its rapid advancements. He compares the enthusiasm for AI in the enterprise to the initial reluctance faced during the early days of cloud adoption. Levie shares insights into how AI is integrated into both his personal and professional life, highlighting new apps, tools, and features driven by AI. He elaborates on Box's AI initiatives, including the creation of Box AI to manage enterprise content and the concept of AI agents and their impact on enterprise IT departments. Levie also addresses the obstacles and opportunities in deploying AI at scale, predicting significant changes and a new era of 'systems of intelligence' in enterprise software. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U. S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality. Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution CHAPTERS: (00:00) Teaser (00:50) About the Episode (03:49) Introduction and Warm-Up (04:08) Personal AI Use and Worldview (06:48) Enterprise AI Excitement (07:22) Comparing Cloud and AI Adoption (11:19) Transforming IT Departments (14:24) Box's New AI Features (18:08) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (20:48) Challenges in AI Implementation (22:25) Building the Right AI Architecture (27:41) The Future of AI Agents (29:04) Exploring Agent Capabilities (30:55) The Evolution of Enterprise Software (32:12) Sponsors: Shopify | Vanta (35:28) AI's Role in Non-Deterministic Workflows (37:07) Challenges in AI Deployment (40:27) AI's Impact on Enterprise Software (44:47) Debates on Enterprise Software's Future (52:33) AI-Driven Productivity in Enterprises (55:01) Conclusion and Future Outlook (55:44) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk PRODUCED BY: https://aipodcast.ing

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  The rate of change that we're seeing and the rate of just exponential improvement that we're seeing from AI models is incredible. And I would assume if we keep that pace up, I think these systems will increasingly be able to perform any kind of general task. Jensen at Nvidia kind of put it the best, which is, you know, effectively the IT department becomes the HR department of AI. And that just opens up so many new questions about what the future of IT looks like. But I think we're entering a new era with with systems of intelligence that let us combine data, AI, and underlying enterprise software to go and automate, you know, really anything about our business. There's going to be a tremendous amount of AI startup opportunity, but it will not come

• 0:41Speaker 00

  from just doing, you know, an AI-first CRM system, because you should anticipate that Salesforce is an AI-first CRM system.

• 0:52Nathan Labenz?

  Hello and welcome back to The Cognitive Revolution. Today, I'm excited to share my conversation with Aaron Levie, founder and CEO of Box, the intelligent content cloud. Box powers secure collaboration, manages over 100 billion documents, and is now introducing AI-powered workflow automation for more than 100,000 customers globally, including such diverse household names as pharmaceutical giant AstraZeneca, legendary nonprofit Teach for America, investment bank Morgan Stanley, peer-to-peer rental market Airbnb, the $1 trillion chipmaker Broadcom, and even the United States Air Force. As you'll hear, Aaron says that leadership at these organizations is now more energized about AI than they've ever been about any other technology in the history of his career,

• 1:36Nathan Labenz?

  including cloud computing, where Box was an early enterprise SaaS pioneer. While cloud adoption faced initial skepticism and resistance around security and compliance and just needing to do things differently, enterprises today are eagerly exploring use cases for AI. In many cases, Aaron says, perhaps more than is immediately practical. Box is, of course, racing to meet the moment by building new AI functionality into all aspects of their platform. And they recently launched Box AI to help enterprises get more value from their unstructured data in a secure, controlled way. We discuss several key capabilities, including natural language querying across enterprise content, automated metadata extraction, and their vision for AI agents that can autonomously perform workflows like contract review and routing.

• 2:22Nathan Labenz?

  Aaron shares a number of technical details on how Box is now layering foundation model capabilities onto their existing foundational features, like their Hubs product, which they originally developed before the current AI moment to allow users to curate canonical, authoritative versions of key documents, and which has proven to be the perfect base on which to build accurate, reliable, retrieval augmented generation experiences at scale. We also dig into key questions facing enterprises and the software companies that serve them, including how IT departments will need to evolve from supporting work to actually performing work with AI agents, the transition from per-seat to consumption-based and other pricing models, and whether startups can compete with incumbents who are racing to add AI capabilities.

• 3:04Nathan Labenz?

  Aaron makes the case that while incumbents will continue to dominate many established markets, there is still massive opportunity for AI-native startups to build fundamentally new products that work across platforms and address unmet needs. As always, if you're finding value in the show, we'd appreciate it if you'd take a moment to share it with friends, leave us a review on Apple or Spotify, or drop a comment on YouTube. And always feel free to share your feedback, either via our website, cognitiverevolution.ai, or by DMing me on your favorite social network. I got a lot of encouraging messages after the recent AMA and R1 episodes, and it was great to hear from so many listeners, so please do keep it coming. For now, I hope you enjoy this conversation about AI adoption in the enterprise and the ongoing transformation of enterprise SaaS,

• 3:47Nathan Labenz?

  with Aaron Levie, CEO of Box. Aaron Levie, founder and CEO of Box. Welcome to the Cognitive Revolution.

• 3:56Speaker 00

  Thank you. Yeah, good to be here. A lot of, lot of stuff going on in AI land right now. How are you doing?

• 4:00Nathan Labenz?

  Never a dull moment, that is for sure. Let's do a quick warm-up and then we'll get into what's going on with AI in the enterprise and then what you guys are bringing to the enterprise with your latest AI features. For starters, what are you doing with AI in your personal life? And what is your AI worldview, particularly as it relates to like, are we going to get AGI soon? Or what are you sort of expecting over the next couple of years?

• 4:23Speaker 00

  Yeah, well, I think, hard to obviously say based on the very amorphous definition of AGI. But so I'm kind of like everybody else downstream of whatever Ilya or Sam or Greg are talking about. So I have no better ability to predict. Where that's going than I think anybody else right now. But all I would say is the rate of change that we're seeing and the rate of just exponential improvement that we're seeing from AI models is incredible. And I would assume if we keep that pace up, I think these systems will increasingly be able to perform any kind of general task that you give it. And with these reasoning models, I think we're seeing incredible results in math and, you know, very complex logic and obviously coding. So, once you have those basic foundations, you know, if we could continue to improve more and more in the benchmarks, that gives

• 5:08Speaker 00

  you the building blocks for basically models that can continue to learn on their own and get, you know, as advanced as we need them for basically any task that you'd want to give them. So, it seems like within the few next few years, we could be getting some form of whatever we would have previously defined AGI as.

• 5:25Nathan Labenz?

  Yeah, not that much farther to go, I would say. And certainly, the checkpoints seem to be coming, if anything, more densely than they were not long ago.

• 5:33Speaker 00

  Yeah.

• 5:33Nathan Labenz?

  How about in just like your day to day use? Do you have kind of favorite use cases? Do you feel like you're properly challenging O1 Pro? Or are you doing more basic stuff? Where are you at?

• 5:45Speaker 00

  I think, you know, partly because I always get enamored with new technology. So, I try everything out. But I would say one thing I was actually reflecting on recently is I have more new apps on my home screen in the past, let's say, six months than probably any other time in the past decade, decade and a half. My home screen was like, okay, you added Uber, and then you added Spotify, and you added, you know, maybe one social app, and then WhatsApp. And like, only every one or two years did something get to the homepage. But recently, I have at least five new apps that I've added into the mix, which to me is a little bit of a proxy for just how much, how much infusion of AI has already occurred in our personal lives. I'm, you know, talking to Gemini Voice, or OpenAI,

• 6:27Speaker 00

  you know, with ChatGPT with video, pretty regularly, using Perplexity to get different kinds of answers, playing with XAI and Grok. And it's just incredibly exciting to see the range of what these AI models can do. Built a prototype with Artifact and Claude. You know, everywhere in my personal life and kind of professional life, AI is kind of getting added into the mix.

• 6:50Nathan Labenz?

  So, recently, you put out a LinkedIn post that I thought was pretty interesting, where you basically said that this is the most energized you've seen.

• 7:00Nathan Labenz?

  Enterprise companies about a new technology at any point in your career.

• 7:04Speaker 00

  Yeah.

• 7:04Nathan Labenz?

  Obviously, you made your company on the cloud wave. So this is, you know, that's another big wave that people are pretty enthused about. How would you, you know, for people that aren't in the room and aren't hearing these conversations with senior leadership at enterprise companies? What is the vibe like? What are they doing? Are they hands on? What are you seeing?

• 7:24Speaker 00

  Yeah, well, you know, you, given that you brought up cloud, it's actually really interesting comparison between the two. So in the early days of the cloud, I actually would not describe the energy as super excited, super animated and aggressively, you know, pursuing, moving to the cloud. I would say most of the conversations we had with enterprises were there was some degree of skepticism. There was resistance. There was a lot of friction. There wasn't a lot of just pure excitement with no friction around it. The reasons for that were this is a very big shift for enterprises. They had to move their infrastructure from the data centers that they managed to the cloud. They had to trust these new vendors that they hadn't worked with before. If you were an enterprise, you'd never worked with Amazon, you know, as an enterprise vendor.

• 8:09Speaker 00

  That was obviously very atypical. And then you had to sort of change your whole notion about data privacy and compliance from a world of a sort of physical management of hardware to a world of, I'm going to get a set of APIs and maybe some dashboards and some audit reports. And that's my only way of kind of controlling these systems. So enterprises were very reluctant early on to move to the cloud. If I compare that to today with AI, recently I was in New York, met a couple dozen CIOs and customers. And the reaction was if I snapped the line at like two or three years in the cloud versus two or three years into AI, you know, couldn't be more different in terms of the environment.

• 8:47Speaker 00

  Enterprises are looking for almost as many use cases as possible that they can deploy AI in, probably in many cases more than is actually practical. You have a sense of creativity and excitement and innovation that didn't necessarily exist in the cloud. You know, with the cloud, it was kind of like very pragmatic. It was like, you know, I could take this piece of infrastructure and move it into a virtualized environment. There's nothing like that exciting about that. It's kind of very utilitarian. You know, with AI, people are saying, well, what if we could actually solve this business problem that we've never been able to attack before? Or what if I could go and deploy human resources at much more interesting problems than where my talent is currently, you know, dedicated to?

• 9:28Speaker 00

  And all of a sudden, the creativity, the energy, the opportunity is totally different for these enterprises. So there's a lot of excitement. There's a big, there's a big kind of asterisk, which is we're still very early. The actual amount of at scale deployments in the enterprise are still very early innings in terms of where has this technology been deployed. But the excitement level is totally different. And so what this means to me in being an enterprise software is there's just going to be an insane amount of opportunity. We are going to see opportunity for, you know, bigger companies like the Microsoft or Oracles or Googles of the world. There's going to be opportunity for, you know, the software stack like Box or Salesforce or ServiceNow. There's going to be a lot of

• 10:12Speaker 00

  opportunity for brand new startups to go and build AI agents that solve a whole new set of problems for the enterprise. And I think there's a very, you know, it's probably a relatively narrow window, but there's a window right now of opportunity where you're going to see a tremendous amount of change, a tremendous amount of new startups that get to emerge. And enterprises are very much, you know, ready and excited for pursuing that.

• 10:35Nathan Labenz?

  What do you think that change looks like in practice? One of the comments that you made in that post was that you kind of expect IT departments, in a way, this could almost be sort of a reverse from the cloud because in the cloud, it was like, now you guys aren't going to manage this physical stuff anymore. And, you know, there's going to be more kind of put over on the vendor side in terms of making sure we have uptime and whatever, and we'll just kind of, you know, consume that and build apps on top of it. But if I understand you correctly, you're saying almost the opposite when you say IT departments are going to go from supporting the work to actually doing more of the work.

• 11:10Speaker 00

  Yeah.

• 11:11Nathan Labenz?

  And I wonder like, what does that mean? And how many enterprise IT departments are up to that challenge today? How much are they going to have to transform to take on that challenge?

• 11:21Speaker 00

  I think enterprise IT departments are going to have to transform pretty dramatically. I'd say that, you know, history of IT was, many times in partnership and even proactively with the business, the IT department would work with the business, the business would say, and by the business, I mean, the marketing team, the sales team, the finance team. You know, if somebody in the business would have a particular need, you know, I want to have a CRM tool so I can track all my leads. I want an HR system so as we hire more people globally, we can make sure that we're managing all the local laws from an HR standpoint. They go to the IT team, they review a set of vendors, and then basically it gets handed off to IT to go manage the system, deploy the technology, pick the vendor, and then enable the business.

• 12:06Speaker 00

  And what, you know, that relationship has always been, you know, has been well-defined and sort of codified for, you know, a few decades as we've had kind of modern IT environments. But it was still the responsibility of the business to make use of the technology and to be productive and to drive execution in the company. So, you know, the sales team still was owning all of the execution and they were using a CRM system from the IT team to be productive. AI kind of flips that on its head, which is now it's not just the people in the business that are using the technology as sort of using it to enable the business, but the business is going to go to the IT and say,

• 12:45Speaker 00

  I actually need you to go and deploy AI labor against different kinds of problems that I'm dealing with. And so now you might have a future where the head of sales will go to the IT team and say, I need to spin up a new sales campaign. Do you have AI agents effectively that can go and help me do that? Or a back office processing, you know, team might say, they might go to IT team and say, hey, do you have AI agents that can go review all my contracts? Or review all these invoices or help with all my client onboarding workflows? So this is a totally different era for IT to be in the position of now actually solving the business problem, not just deploying the software to help the business solve their problem.

• 13:28Speaker 00

  And this means you're going to have to understand the business way more if you're in IT. You're going to have to become even more strategic for the company. You're certainly going to have to understand all the trends happening in AI. You're going to have to sort of understand the ecosystem and all the surrounding, you know, companies that produce AI agents and all the software around that. You know, Jensen at Nvidia kind of put it the best, which is, you know, effectively the IT department becomes the HR department of AI. And that just opens up so many new questions about what the future of IT looks like, all of which are much more exciting, I think, than the past, but we are in for quite a bit of change in this space.

• 14:07Nathan Labenz?

  Yeah, gotcha. Okay, so if I torture a metaphor here, if the IT departments are the HR departments of AI, then Box is applying for or looking for promotion in a lot of these organizations and has just been through, you might call an upskilling with a bunch of new generative AI product and feature releases. So tell us what's new as we enter 2025 at Box.

• 14:31Speaker 00

  Yeah, so for us, what we do is we work with about 115,000 customer companies that are our customers. And what they use Box for is they use Box to secure, to collaborate, to automate workflows around their content. So that could be their contracts, their financial documents, their marketing assets. It could be their research data, their product plans, all of that, those documents, those media assets, the digital images, all that content we store, we help secure, and we automate the workflows around or allow, enable companies to collaborate on that data. AI is really the next frontier of now what we can do with all of this unstructured data in the enterprise.

• 15:13Speaker 00

  And so we built a layer called Box AI that connects AI models to enterprise content in a secure way that lets the enterprise continue to have their security, their privacy, their access controls, their permissions. So we handle all of that, and then we connect to AI models with this abstraction layer. So what we've been building out is a set of capabilities to let people really transform and unleash the power of their data. So the first big use case is, you know, being able to talk to your data for the first time. We store well over 100 billion files in Box, and you can imagine every single one of those has incredible insights and value inside of it. But most of the time, you don't know what's inside of your data,

• 15:54Speaker 00

  because until you search for it and look at it, you don't know what's actually out there. So now, for the first time, you can just talk to your data. I could take 100 sales presentations and say, I need, what's the best practice of me selling this product to a new customer? And it's going to read through, our system will read through all those documents, and then produce exactly the right answer for whatever you're doing with that customer. Or you could take a bunch of medical research or life sciences documents and research and be able to talk to all of that data to find interesting trends or patterns in that information. So that first use case is basically, you know, retrieval augmented generation on many documents with an AI later that that kind of powers that. The next big use case, which we've just been starting out with, is the ability to read

• 16:37Speaker 00

  through any kind of content and then extract the most important structured data from that content. So take a contract and you want to be able to pull out, you know, the renewal date of the contract or the party names from the contract. And then you want to store that in a structured database. So that way you can query it later, you can have dashboards, you can automate workflows. And so that's the next big use case that that we're working on, which was is sort of rolling out imminently. And then where this is all sort of going is eventually agentic workflows within our platform or connected up to other systems. So I think that, you know, the very big prize in this space is, is if you take all of the information in your enterprise and what if you had agents that could go off and operate on that data?

• 17:18Speaker 00

  And so I could have a contract agent or a marketing agent or a sales agent and it could perform tasks for me that that make me more productive. So go review the contract, pull out the riskiest clauses, go and route it to the right person. And I could basically design an agent to go and do those workflows for my entire data set and then connect it to another system. So I want to connect it to Salesforce, I want to connect it to ServiceNow, I want to connect it to Microsoft. And Box becomes really this layer for managing intelligent content management, but then we connect to other technologies that will handle the AI in their particular part of the workflow. So this is the the future that we're we're sort of building out and and I think it's the biggest set of change and the most amount that we've been building in the history of the company.

• 18:03Speaker 00

  And it's, you know, unbelievably exciting because you're you're on a daily basis seeing new things that were never possible before with our data.

• 18:10Speaker 02

  Hey, we'll continue our interview in a moment after a word from our sponsors.

• 18:16Nathan Labenz?

  Let me ask two kind of digging in questions on the retrieval and then the agents one by one. So retrieval, I think, obviously rag has been a huge trend and exactly what you described. You know, a lot of people and companies have rushed out and implemented a version of it. And then I've heard over and over again that it sort of hasn't worked super well for people. Usually when I get under the hood and kind of explore like, why isn't this giving people the answer that they want? It seems like the most common failure is that the usually vector embedding mediated search is not retrieving the right content in the first place.

• 18:59Nathan Labenz?

  And so you don't have the right sources, then you're not getting the right answers. What have you guys done to deal with that? Perhaps the like structuring of the unstructured is a part of it. But how do you address that problem, which seems to pop up?

• 19:12Speaker 00

  Yeah.

• 19:12Nathan Labenz?

  If it's kind of the first trough of disillusionment for so many.

• 19:15Speaker 00

  Yeah, 100%. Now, now let me ask a question. When you see that trough of disillusionment, is it often with data sets that are quite broad or heterogeneous? So we've seen this a lot with, you know, the use case of I have my email, I have my data, my calendar, and I want to do a search across all of it with some kind of AI system. Are you seeing those kinds of scenarios or other ones?

• 19:38Nathan Labenz?

  I feel like almost always, kind of honestly, even if it's not like a crazy, complicated situation, it still feels like it pops up.

• 19:48Speaker 00

  So I'd love to attribute this to pure genius. We got lucky. We were building a product about a year before chat GPT launched, which was, it's now called hubs. And what it was, was the ability to organize content on a topic by topic basis. So you could share that content or search that content on a per topic basis. And with this sort of novel idea, which was within your Box account, you manage files inside of folders. But you could create a hub that basically points to content within your Box account. And it was the whole power of it was to create a sort of a many to many relationship. So I could have the same documents show up in 20 different hubs without ever moving it, without ever changing the permissions on it.

• 20:33Speaker 00

  And so if I made one update to that document, it then propagates to all the hubs that it's accessed in. So we created this architecture because what we saw was a lot of people wanted to create a sales hub where it pointed to the sales data. But then they said, I want a sales hub for the Japan region and I want to create a sales hub for a particular product line. And I don't want to go and change the documents and sort of have to fork them and keep track of why is the one in the Japan hub updated? But the one in the other, the product hub is not. So the whole idea was create kind of virtual pointers back into the same source of truth of data. But then you have all these virtual hubs that you can create. So we were working on that about a year before ChatGPT, unrelated to AI, but with, with, with sort of search and discovery is one of the common use cases.

• 21:17Speaker 00

  And then as soon as, as ChatGPT launched, we were like, oh, like, obviously the next big thing that we should do is let you talk to all the data in a hub. And what we discovered was this was sort of the breakthrough architecture for a RAG use case. Because where, where RAG runs into problems is let's just pretend you had, you know, 100 million files inside your enterprise. And somebody went in and they said, I want to find what was the last, you know, what was the last revenue figure in our earnings, our last quarter earnings? And the challenge with RAG is that you might have a document called like earnings underscore final and earnings underscore draft one. And earnings underscore draft one, you know, underscore Sally edits.

• 22:01Speaker 00

  And the, the challenge is like the, the, the RAG, I mean, the vector embeddings on all of, of those documents look very, very relevant. You know, to being able to produce the answer. But the accuracy and authoritativeness of any one of those versions might be totally wrong based on, based on, you know, where it was in that, in that editing process of that document. Now multiply that by years of data and signal from other systems like email or other data sources. All of a sudden, it becomes very hard to then be able to go and ask any kind of generic question on your internal data in the enterprise. The reason why this is less of a problem for the public services like perplexity or other is because you get the benefit of almost like a page rank algorithm for public

• 22:46Speaker 00

  data where you can sort of look at a, you know, a sort of a curve and say, you know, this CNN article is more authoritative than this random blog or this blog is more authoritative than this very random website that was created two days ago. And so you get a little bit of an authoritative score in the public internet in a way that our corporate data doesn't really have. Our corporate data is much more messy. It tends to not have a kind of a page rank element to it. So it's very hard to know the ultimate source of truth. So hubs basically solve this problem because what happens with hubs is users are basically telling us what is the authoritative copy of the data that I'm putting into a hub. So if I created a sales hub that has the sales presentations and product information,

• 23:31Speaker 00

  I'm only going to put the ones that are the authoritative records into that hub. And then when you're going and doing a question in that hub, you're only going to really be asking it questions about sales. You're not going to ask the sales hub an HR question. You're going to go to the HR hub. And so we've been able to kind of get the user to ask the right types of questions for the, where the data set is. The data set is authoritative and it's not as messy as doing a broad based rag environment on all your data. So those are kind of like two or three different hacks that we've kind of lucked into and then kind of doubled down on that has made our particular rag service, I think, you know, at least 100 times better than just doing like broad based deployment across all your data.

• 24:11Nathan Labenz?

  Yeah, that's interesting. I've heard so many of these stories now about how somebody just happened to be sort of building the right thing that was perfectly complemented by AI. And then the whole business shifted as a result of those things coming together.

• 24:25Speaker 00

  We pinch ourselves because if we hadn't been building that, I do kind of like, I do get very scared because it was about a year, year and a half of just deep architecture work. Like, there was no way to build it any faster. Like, you had to create a file system that could have a virtual sort of sharing component. And for the complexity of our platform, that just took a year plus. If we had not already been a year into it, or a year and a half into it, I fear that we would have felt it would be too daunting, based on how fast AI was moving, that I'm not sure we would have landed on this exact architecture. We may have done, you know, kind of a less optimal version. So in this case, we got totally lucky, but ultimately built the exact right thing for the exact right moment.

• 25:07Nathan Labenz?

  Yeah, okay, that's cool. On the agents one, obviously, you know, 2025 is the year of agents. We thought it might be 2024. It turns out it's 2025. What does an agent mean to you? Like, I have my sort of sense of what the definition is, and it kind of, I contrast an agent with what I tend to call an intelligent workflow by how much autonomy or like decision-making discretion the AI ultimately has. How do you think about it? And how much autonomy or discretion are you giving to the agents in your platform?

• 25:43Speaker 00

  Yeah, yeah. So I like that definition, and I would fully subscribe to that. We have, in our platform, we've taken probably the broadest definition, only because what we didn't want was there to be, like, you know, you hate to use software where there's like 17 different versions of a thing, and then you're kind of like pushing all that complexity on the user to understand the differences. So what we've defined agent as basically a mix of an AI model or many AI models, a set of tool use within the platform, and then effectively underlying skills or capabilities that it has, which is some mix of like, you know, system prompts, but also some kind of proprietary architecture change, and then, of course, access to your data.

• 26:26Speaker 00

  So that, that whole collection of capabilities creates an agent. So then, within our platform, you can do very simple things with an agent. You can go and talk to a single document and you're talking to an agent, but it's not doing anything agentic. It's just you're talking to the agent that is either the core Box AI agent or you're talking to, you can create a custom agent. So you can create a sales agent that has a custom prompt and custom instructions that just have information about how your sales workflows work or the kind of language that you should use. And so you can create custom agents to let you talk to your data, to let you extract metadata from your documents, to let you talk to lots of files at once, to create content.

• 27:11Speaker 00

  So that's our first era of agents. I think many of these agents would be what we would have called assistants two years ago. But again, we've created just a universal language for this. Where it's really going is much closer to your definition, which would be agentic workflows, where the agent is performing many sequential tasks and there's some degree of probabilistic elements to those. So that would be, I want to review a document and then based on how I reviewed that document, I want to kick off another process to either another agent or a human. I want to be able to take a lot of data, collate it and produce something. These are much more multi-step flows that we expect you will make very agentic in the future.

• 27:53Speaker 00

  And so right now, the limitation of software is that software is very good at these deterministic workflows, but the vast majority of work is actually not deterministic. It's probabilistic. It does require judgment and you do change your answer based on other inputs or insights. And so the majority of work in the future will be non-deterministic, judgment-oriented, agentic work, which is incredible opportunity for enterprise software because that is what we can now finally go and digitize. So the way that I've been thinking about this recently is, if you think about the eras of enterprise software, 40 years ago, we had the initial wave of systems of record, which was CRM systems, ERP systems.

• 28:36Speaker 00

  This was the definition of the most deterministic technology possible. Like you're changing rows inside of databases effectively. So that and you know, based on that, it kicks off a thing. And that was like 100% deterministic. Then we moved to systems of engagement, which was this idea of like collaborative systems, Slack and Box and other tools where things are a lot less structured. They're a lot less deterministic. The workflows are a lot more fluid. They can adapt a bit more because it's kind of human to human and a little bit messy. And then with this new era that we're in, more of systems of intelligence. This is really the era of now the AIs are automating those workflows. And they have all of the properties and benefits of being structured like systems of record.

• 29:21Speaker 00

  But they have all of the flexibility of a system of engagement where it can adapt. It can change. And that and that's because that's what now AI can do. I think we're entering a new era with with systems of intelligence that let us combine data, AI and underlying enterprise software to go and automate, you know, really anything about our business.

• 29:39Speaker 02

  Hey, we'll continue our interview in a moment after a word from our sponsors.

• 29:45Nathan Labenz?

  Yeah, I often say intelligence, of course, this has been debated for a long time. And I don't pretend to be the final word, but my working definition of intelligence is the ability to do useful work when there is no explicit algorithm that tells you what every step ought to be.

• 30:00Speaker 00

  Yeah, I think that's great. Very, very practical definition, especially for the enterprise use cases where you just don't want to kind of have a predetermined or pre-wired workflow because it's going to change. You need it to adapt to new data. Maybe there's not even APIs available for that thing you're trying to do. And that's where even things like browser access gets very exciting. Because there's a lot of future workflows where I want to go and automate these five systems and how they talk to each other. But there's not clean APIs to have them all go talk to each other.

• 30:33Nathan Labenz?

  Yeah, I find myself in my AI assisted coding workflows. When it's working well, I'm basically copying and pasting stuff around most of the time. And when it's not working well, then I start to have to troubleshoot. But you know, the smooth thing is like, I'm just kind of the copy and paste monkey that's gluing these other things together. It's a weird experience when it's working well. So what would you say are the biggest?

• 30:58Nathan Labenz?

  Bottlenecks that enterprise companies face today in terms of realizing the value. I have a thesis that like the AIs are actually good enough to do a lot more than people are in fact deploying them to do. Tyler Cowen recently said, you know, in front of an audience, you, all of you, the humans, you are the bottlenecks. What do you see as being like the, the practical barriers that people are currently still struggling to get over?

• 31:23Speaker 00

  Yeah. So I a hundred percent agree with that AI can do vastly more than what most enterprises either think or have even the near term, you know, kind of appetite to go and deploy. So there's to some extent, you know, more technology available at the moment than most people realize. And even myself, I have to like, remember, hey, that task that I normally would have gone and pinged somebody, hey, can you go work on this thing for me? I'm reminding myself more and more, no, like go and try and, and create it in artifact or use AI to go and do this. And so even right in the center of AI, watching everything happen around the world, I have to trigger my brain to remember, you know, actually how much these things can do.

• 32:08Speaker 00

  So I can only imagine if you're not in it every single day, well, that gap is, is probably fairly massive. That being said, I don't want to let the AI model providers off the hook though, because one of the, the things that does prevent AI deployment is, you know, you can't have an enterprise workflow in a particularly a regulated industry that works 98% of the time. You would not find it acceptable if 98% of your flights that you scheduled were successful. And 2% of the time you show up at the airport and you don't actually have a ticket, right? And that's enterprises need 99.99999% reliability on almost anything that's really important.

• 32:47Speaker 00

  So if it's a creative task, you know, write a marketing campaign or review a blog, write a blog post, or send an email on this topic, you have some kind of room for a little bit of hallucination, or you can go and have the ability to go and edit it later. But if you're going to have a billion financial transactions get submitted every week or every month. And AI gets 0.01% of those wrong, then that's a nonstarter for deploying any of these kinds of systems. So I do think that what we need from the model providers is, and you can see it in the benchmarks, we're getting closer and closer, but we need to be getting to even higher degrees of accuracy. We need to get, until like all of the evals have to be completely reset, you know, so that way, because everything is hit 100%.

• 33:31Speaker 00

  I, I think we still are a little bit technology dependent, a little bit AI model dependent. We do need the costs to continue to come down in AI, because this is actually due to the excitement from customers, as, as customers will say, hey, I'd love to go deploy 10,000 AI agents at X problem. But then they look at the costs and they say, okay, you know, I still can't yet afford what that would look like in my business, or maybe we have to take it in a more stepwise fashion until costs come down. So I think we need AI to still be cheaper. We need to be able to get the performance of these models up even higher. And then from there, I think you're, you're running into, to Tyler's point, all of the classic human-based change management difficulties. And those range from still privacy concerns and security concerns in some cases.

• 34:16Speaker 00

  Those range on, you know, the very real issue of, hey, I still, I actually have humans doing that thing. And so until I can kind of transition them to a different role or teach them a new skill, you know, we're not going to be able to go and automate that particular workflow. And so all of that is, is still what we're in for in the enterprise, and that's going to take years and years. I mean, this is going to be at a minimum, a decade-long change for, for how enterprises go and become more AI-first. But I think we have a roadmap, because we did it in cloud, and I think we have an increasingly clear vision, because we sort of start to understand what this world could look like as, you know, what would an AI-first enterprise look like? How would agents be a part of the workforce? How do we now get better insights from all of our data?

• 35:01Speaker 00

  How do we automate almost any workflow in our enterprise? And I think that you see this increasing understanding of what an AI-first future could look like in most organizations.

• 35:12Nathan Labenz?

  Just to push a little bit harder on this, I feel like, you know, the sort of a corollary to my definition of intelligence. If intelligence is something that allows you to do work when there's no explicit algorithm, a corollary is you should only use intelligence where there is no explicit algorithm, right? Like if you have a way to do something with traditional code, you probably should. It'll be faster, cheaper, more reliable. So if we then bring the AI back into the domain of like all these fuzzy things that we don't have these algorithms for, and we ask, how good is AI at doing these things as compared to a human? My belief is that with some elbow grease of, you know, making sure you have the right context and putting a few examples together and whatever, applying all the best

• 35:55Nathan Labenz?

  practices, I would say you can most of the time get to the point where the AI can do as well as the human at, you know, much reduced cost and much faster. And we've seen that, you know, for no less than like medical diagnosis recently, right? So if you buy that, doesn't it sort of suggest there's still something else going on? Like, maybe it's a fallacy, or not necessarily a fallacy, but sort of an attitude of like, we need the AIs to be not just like on par, but actually, you know, have a 10x lower defect rate or something. I mean, that seems to be the case with self-driving.

• 36:28Speaker 00

  Well, I actually think you just nailed it. So you can't, you know, and this would be like advice to any software vendor, you can't go to a company and say, I can do exactly what you're doing today, and you're going to save 40%. You know, like, in like, and this is like, an economist would say, oh my God, everybody would do that deal all day long. But, but like, once, once that meets real life, that person has 17 other projects. There's an incredible amount of people and attention and priorities that are all competing for their time. So if you could wave a magic wand and make something 40% cheaper, like you'd totally do it. But like, of all of the things that I have to do, like, that just might be like number nine on my list. And to your point on, there's

• 37:12Speaker 00

  something else going on, like that person now has to go to the AI council and get approval. And they have to go and prove, they have to do a full six-month test to make sure that it actually is 40% cheaper. And all of that work, and then they have to weigh that against anything else that they're doing in their business. So to your point, I think we need AI to be producing multiples better improvement on the status quo. That's how you really compel motivation. You can't be incrementally better, incrementally cheaper, incrementally faster. You have to be in order magnitude better on one of those dimensions. So if you could go to a company and you could say, listen, I can be literally a tenth of the

• 37:51Speaker 00

  cost of what you do today to go review your contracts or review your invoices or automate this backend supply chain process, then you're talking. Then you're like, okay, I could save you millions of dollars. Or if you could say, I can actually do a 10x better job than your human based workflow today, we'll discover that cancer more effectively, or we will actually be able to target even more automation across your enterprise. This is often why, actually, I think AI is biggest opportunity. I think that's the flavor of what you're saying, is to actually go after the work today that is not automated. So you're not even replacing something that's existing. You're just layering on to an existing workflow and just making it better.

• 38:31Speaker 00

  I would say this largely explains the breakthrough in Copilot or Cursor is because I get to do exactly the same thing I'm doing now, but I'm seeing incremental productivity gains right away without changing really any behavior. The more that AI can solve those types of problems where it's all a net new use case that just adds incremental increased productivity, easier on the change management front. Anything where you're replacing an existing process and you're only saving a little bit of money, way harder problem to go after in the enterprise.

• 39:04Nathan Labenz?

  So what do you make of the debates around the future of enterprise software? I mean, we've heard, I feel like people are groping around, of course, because everything's happening fast and we're trying to make sense of it. But I feel like we've heard pretty clearly conflicting narratives. On the one hand, it was like, oh my God, now it's never been a better time to start a startup. And then it was like, well, actually, though, this technology is so easy to implement that probably like. Incumbents will capture most of the value because they'll be able to roll. You might have a little bit of a go to market lead, but they already have the customers. So they'll beat you, you know, if you're trying to start up versus have them just to, you know, figure it out and deploy to their current customer base.

• 39:46Nathan Labenz?

  But then we also have like the Klarna narrative where, you know, they've allegedly reportedly, you know, shut down a couple of systems of record. And then there's also the pricing debate too, as to like, you know, do we still charge by seats anymore? Or do we have to go to like per outcome based pricing? So there's a lot there that could probably consume the rest of our time. What do you make of all that?

• 40:07Speaker 00

  Exactly, man. If I had heard that when I was just starting Box, I would be way too stressed to start a company. So there's definitely a lot of variables that are in flux. I compare that to our early days, which was, it was, you know, lots of other problems, but not like the fundamental variables of the business model of the company. And I think you're right. I mean, you have a sort of which spaces are incumbents, the natural, you know, sort of have the natural advantage. The underlying billing model of this, is it seat based or is it outcome based? The idea of is there a future of some, you know, AGI light that makes some software just irrelevant? You don't even need the software in the first place. So all of those things I think will happen. I would say, you know, I would more lean toward timeless lessons of competitive strategy,

• 40:52Speaker 00

  which is, you know, if you're a brand new startup, you go after things that are not easy for the incumbent to go after. So if all you were doing was building a sort of a thin layer on top of OpenAI, bad idea. If you're building a thin layer on top of Salesforce with AI, bad idea. So, you know, Salesforce is very competent. They will build the CRM AI thing. Workday will build the HR AI thing. You know, ServiceNow will build the ServiceNow AI thing. And equally, if you're just finding a slight gap in what OpenAI does today, you'd have some risk of them moving up the stack or the model getting better and better. And kind of, you know, eventually bringing that into, into the model layer. That being said.

• 41:38Speaker 00

  I can think of a number of things that are would be unnatural for OpenAI to do. Because maybe you have a lot of non-AI interface and workflow work that has to happen to make X problem get solved, or you can be doing things inside of the sales world, HR world, or this ITSM world that the incumbents equally aren't going to do. Maybe it's cross-platform AI workflows that are not natural for, you know, any one of those players to sort of lean into. Maybe it's building AI agents that are so, so kind of like orthogonal to the normal strategy of Salesforce or Workday or ServiceNow that they that those companies wouldn't kind of think to pursue them.

• 42:21Speaker 00

  And you can get enough traction fast enough where you have some degree of a moat. So I think there's going to be a tremendous amount of AI startup opportunity, but it will not come from just doing an AI-first CRM system, because you should anticipate that Salesforce is an AI-first CRM system. And I think we're seeing startups all the time that are finding those windows of opportunity right now.

• 42:43Nathan Labenz?

  So what do you make of like a Karna? I mean, I've heard every take on that from like, it's all hype, but they're not even really doing it to, yeah, maybe, but that's the, you know, exception that proves the rule.

• 42:54Speaker 00

  I think right now it's the exception. I think I've sort of, as I've seen the reports, I'm more in the camp of maybe it's overplayed a little bit, but nothing about it is impossible. So given that it's not impossible to do what they've said, then maybe they have just chosen that this is gonna, this is, you know, something that will make them differentiated as a company. That's still different from every company on the planet, you know, doing it in a homegrown way. I mean, my understanding was they were going to build their own Workday system with AI. And that's just like not a priority. Again, back to that prior point of like, where are you in the prioritization stack? Most companies are just not focused on building their own HR system to save a couple hundred thousand dollars. So I think what they're doing is super provocative, super interesting, and yet not

• 43:39Speaker 00

  translatable to the broader economy. But it's super fun to watch. I invite as many companies to try that experience and share their lessons along the way. I think it makes the conversation in the ecosystem much more interesting, much more, much more dynamic. But I'm not convinced that 90% of corporations would ever do what they're doing.

• 43:58Nathan Labenz?

  Any pricing guidance?

• 44:01Speaker 00

  Yeah, this one's, I mean, I don't really have any guidance because we ourselves are going through the testing of all the business models. In general, I think one of the biggest benefits of AI is that you can get much closer to software solving an outcome. The conclusion of that theory would be that then you should have your pricing model be closer to that outcome. That could be either very literally the outcome, i.e. you pay an AI agent to generate leads and thus you pay by lead. Or it could be, you know, what is the consumption that goes into that outcome? I want the AI to generate 10,000 leads and so that takes a certain amount of compute capacity. And so I'm paying for the consumption of that compute capacity. And then there's just like, you know, traditional subscription models, which is, okay, I want an ongoing license.

• 44:45Speaker 00

  It'll roughly do this much volume for me. Sometimes it's a little bit more expensive. Sometimes it's a little bit more volume, sometimes it's a little bit less, but I pay the same fixed rate the entire time. I think we're going to see every version of these business models get pursued. And again, I kind of put it in the category of super intellectually interesting because we're in such a dynamic period. We have not had, you know, open questions about business models and software for, again, two decades, like, you know, CRM, Salesforce basically invented, you know, maybe with a couple of other companies, basically invented the idea that you pay per seat on a subscription basis. And that's been the business model of SaaS for 20 plus years. And now we have a chance to say, oh, there's other business models that will begin to emerge. I find that incredibly fascinating, but I think each company has to kind of pursue

• 45:30Speaker 00

  its own understanding of what is its customer looking to pay for. And so then thus which business model kind of makes most sense.

• 45:38Nathan Labenz?

  One niche one that's really interesting to me is in terms of things that people might want to buy separately, you know, if they're like going to continue to be a Salesforce customer and get all the agents or whatever. But maybe one thing they might want to buy separately would be sort of safety or compliance kind of stuff, somebody to like rent team, for example, the agents. Do you see that as viable?

• 46:01Speaker 00

  Yes, absolutely.

• 46:03Nathan Labenz?

  Okay, cool. That's interesting because the other option would be like Salesforce would just deliver that too as another feature, but.

• 46:09Speaker 00

  But like that. So it's really good to understand like IT stacks. And so if you just think about an IT stack of, okay, I've worked at Salesforce, I have HR, I have an ERP system, I have Box, you know, which things cut across all of those. And that's where you need a new vendor that is sort of independent of any one of those players. And so some things lean toward, well, actually, it really only makes sense to be in one of those systems. And then other things lean more toward, well, no, I want a technology that works across all of the apps in my enterprise. And then that kind of determines whether you could be a startup or whether it's really an incumbent game in that, in that, you know, market.

• 46:47Nathan Labenz?

  That's, that's good perspective. Last one, of course, it's been famously said that we see the impact of computers everywhere, but the productivity statistics, it seems like AI is maybe still in that zone, but I wonder what you are seeing internally at Box when it comes to AI enabled productivity boosts. And, you know, is that something you can measure? Is it something you're believing in and encouraging on faith right now? And what do you have for other leaders who want to make sure they're getting the productivity that's promised?

• 47:20Speaker 00

  Yeah. So we are 100% committed to being an AI first enterprise and company. And then, you know, that's fairly important for us because we sell AI technology to enterprises. So we need to be the first to understand where this is all going. But also, I just think it's going to be a way you run a better company in the future. And so that has a handful of ways it's showing up already. So one with Box AI, this is, you know, sort of how we work with any of our unstructured data. So if you're a new employee and you want to learn how to sell our product, you go to our sales hub and you can ask it any kind of question and then it'll give you an answer back. And it's basically like you're talking to a top expert in the company. So you are getting all of the value of talking to, you know, the smartest existing employee, but now you can do it 24/7.

• 48:05Speaker 00

  You don't have to wait for somebody to respond to your Slack message. That's on one hand. That's sort of the part that's probably less measurable because it's so, it permeates everything we do and just improves productivity. And then in other areas where, again, it's kind of anecdotal, but we've deployed AI coding tools and I get ranges of, you know, somebody will say, hey, it was five or 10% more productive. Maybe a new hire, it's 50% more productive because they can just ramp up so much faster. I think this will be, you know, most it will show up in the biggest way as we will just ship more software. That will be the measure of productivity that we care about internally. But I think AI will certainly be the first kind of discrete technology category that shows up as in that kind of long-term GDP graph that people tend to talk about as

• 48:49Speaker 00

  driving productivity gains due to technology.

• 48:53Nathan Labenz?

  So over half a percent a year, which is what Tyler Cowen recently said, you take the over, it sounds like.

• 48:59Speaker 00

  If you can let us start the clock in a few years, I think you still have a diffusion of the technology across the economy that takes way longer than I ever think it should. But that's just life in human-based, you know, human-mediated environments.

• 49:13Nathan Labenz?

  Yeah, I'm with you on that. I always underestimate the timelines.

• 49:17Speaker 00

  Yeah, exactly.

• 49:17Nathan Labenz?

  Anything else you want to touch on or leave with the audience before we break?

• 49:22Speaker 00

  Yeah, I mean, I think we're just in such an unbelievable time to be building technology, deploying technology, you know, that like the fact that anybody anywhere in the world could be getting like 90th, you know, percentile expertise on any topic, you know, instantly is just an unbelievable time to be alive. If you had even contemplated that three years ago, based on our understanding three years ago of where technology was, it would not have been conceivable. So I just think it's an incredibly exciting moment and we're super excited to bring it to the enterprise.

• 49:53Nathan Labenz?

  Yeah. Terrific stuff in both respects. Aaron Levie, founder and CEO at Box. Thank you for being part of the cognitive revolution. It is both energizing and enlightening to hear why people listen and learn what they value about the show. So please don't hesitate to reach out via email at [email protected] or you can DM me on the social media platform of your choice.