The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
Hosted by Harry Stebbings
Written by a model from the transcript; not yet reviewed.
In this episode of The Twenty Minute VC, Harry Stebbings is joined by Erik Bernhardsson, co-founder and CEO of Modal, to discuss the explosive growth of the inference market, compute economics, and why capital efficiency still matters. Modal recently hit $1 billion in ARR, raised a $750 million D round led by Accel at a $15.75 billion valuation, and continues to expand its platform footprint. Bernhardsson explains why infrastructure providers must offer more than raw tokens, detailing Modal's expansion into sandboxes, training, and reinforcement learning. They also debate the long-term viability of open-source models, the brutal reality of GPU procurement, and why building enduring software companies requires focusing on craftsmanship rather than just financial exits.
The host introduces the episode, welcomes Eric from Modal, and presents the episode sponsors Blitzy, Flex, and Vanta.
Eric shares his early coding experience, the delay in founding Modal, and the motivations behind starting the company.
Eric discusses his views on entrepreneurship, the importance of confidence, and why he prefers long-term building over quick exits.
The conversation turns to Modal’s fundraising tactics, valuation considerations, and the balance between raising enough capital and avoiding dilution.
Eric outlines the massive potential of the inference market, the need for a comprehensive product suite, and how Modal plans to differentiate beyond simple inference.
The discussion focuses on Modal’s GPU procurement strategy, the challenges of scaling, and the advantage of treating global compute as a unified pool.
Eric evaluates the role of Neo clouds, the difficulty of competing with them, and the enduring dominance of Nvidia’s ecosystem in the inference space.
The dialogue examines the value of open-source models, the rise of frontier models, and the implications for pricing and innovation in inference.
Eric reflects on Modal’s product evolution, the importance of timing, and future plans to expand into training, batch, and reinforcement learning services.
The episode concludes with predictions about the continued expansion of both open-source and frontier inference markets and the long-term potential for Modal and the broader industry.
Eric outlines Modal’s plans to enter data warehousing, vector databases, and workflow orchestration, highlighting the synergies with their core inference platform.
The conversation shifts to the industry’s shift from pre‑training to post‑training, evaluating the feasibility and limits of reinforcement learning for complex tasks.
Starting Modal at Thirty-Sevenstory
The guest explains that he did not start a company until his late thirties because he lacked self-confidence earlier in life. He reflects that 32 is an ideal founding age due to having better experience in managing and hiring people.
Rejecting the Eating Glass Narrativeinsight
The guest pushes back against the common Silicon Valley trope that founding companies is like eating glass and suffering for a reward. He emphasizes that he genuinely enjoys building technology and would immediately start a second company if Modal sold.
The Gingerbread Man Strategyinsight
Citing a Ben Thompson concept, the guest argues that early-stage startups do not have true moats and must simply outrun everyone else by moving faster, much like the gingerbread man.
The guest describes Nvidia's GTC conference as an open-air drug market where companies frantically hunt for GPU suppliers. Modal manages this complexity by partnering with 25 different neo-clouds to abstract supply constraints for customers.
Building Custom Infrastructure Stackstrategy
Modal bypassed standard tools like Kubernetes and Docker, choosing instead to build its own file system, container runtime, and scheduler to handle thousands of concurrent tasks and variable customer demand smoothly.
Extrapolating Growth for GPU Ordersdata
With GPU lead times sitting at three to four months, Modal relies on straight-line and exponential growth extrapolations across a diversified customer base to predict capacity needs and place advance orders.
Explosive Sandbox Revenue Growthdata
Modal launched its sandbox product in 2023 with minimal initial traction, but revenue exploded by mid-2025 as AI models improved at writing code. Sandboxes now represent a $300 million run-rate business.
“I think there is an opportunity to create a hundred billion dollar company with a lot of specialized models in inference.”
“The demand for inference, it's infinite.”
“I think inference is going to be an enormously large market. It's like the new cloud, basically.”
“One of the things that I feel very strongly about is like, it has to come with like a lot of other products.”
“I think there's a lot of gross margin opportunity and there's a lot of opportunity to make a lot of money.”
“I think there's so much upside. I think this is one of the largest markets opportunities that's ever existed.”
“I think post-training works because there is a lot of tasks that people do in real life that have fairly finite sort of feedback mechanisms.”
“I think the demand for compute, the demand for AI applications, it's just, it's going to be enormous.”
“I think the biggest misconception from the outside is that developer is about, like, translating from English to code.”
Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik built Spotify's original music recommendation system. AGENDA: 05:30 - Why wait until your mid-30s to start a company? 06:40 - Is founding a startup really like "eating glass"? 08:00 - How to Raise $1BN with No Pitch Deck 08:45 - The danger of raising too much venture capital 09:40 - How much cash is Modal burning on GPUs? 10:30 - Do early-stage startups actually have moats? 13:30 - Who wins the inference market in the next 5 years? 15:30 - Are 90% software gross margins dead in AI? 17:45 - The "open-air drug market" for GPUs 21:30 - Will GPU hardware prices ever collapse? 22:15 - Are we about to overbuild data centers? 23:45 - Can custom silicon dethrone NVIDIA's monopoly? 24:30 - Is CUDA really the moat everyone claims it is? 25:20 - Are Neo Cloud providers partners or mortal enemies? 26:35 - Nebius vs. CoreWeave: who built the better business? 27:25 - Open-source vs. frontier models: which takes the lead? 28:20 - Can Europe ever build a competitive frontier model? 30:20 - The bull case for a $100B verticalized model company 37:15 - Modal's biggest resource allocation mistake 38:00 - Has open-source LLM inference already peaked? 41:30 - The real limits of post-training and RL 44:20 - How much does Modal spend every month on coding agents? 45:50 - The massive gold rush in selling data environments to labs 47:20 - Should enterprises own their own intelligence? 49:50 - Is model routing a defensible standalone business? 53:20 - $20M+ compensation packages for exceptional new grads 54:20 - The #1 portfolio company Erik would bet on 55:10 - What Erik changed his mind on most this year
14,345 words · 3 speakers
Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.
Page updated · transcript and summary are machine-generated