
Written by a model from the transcript; not yet reviewed.
In this episode, Sarah Wang and Marc Andreessen sit down with Decagon co-founders Jesse Zhang and Ashwin Srinivas to discuss their playbook for building enterprise AI applications. The conversation explores why Decagon shifted 90 percent of their AI stack to open source models to optimize latency and performance for voice agents, how they think about deploying AI inside large enterprises, and why the future of software will be shaped by AI agents rather than just foundation models. The guests explain how fine-tuning smaller, task-specific models often outperforms larger general-purpose models while being faster and cheaper. They also unpack their views on forward-deployed engineering, go-to-market strategy, and why they believe software and careers will persist in an AGI world.
The discussion provides a look into how an AI-native application company navigates rapid technological shifts by building a research lab, creating internal tooling like the Duet agent for workflow automation, and maintaining a product-led approach to enterprise sales. Listeners will benefit from concrete examples of how Decagon handles enterprise deployment challenges, manages a high-intensity culture, and expands from customer support into broader operational and sales workflows.
The hosts introduce the episode and set the stage for the discussion.
The conversation shifts to the debate over open source versus closed source AI models and their relevance to enterprises.
Decagon’s founders discuss their initial use of frontier models, the need for low latency, and the decision to move to open source models.
The team explains how fine‑tuning small open source models can outperform larger frontier models on specific enterprise tasks.
Decagon Labs is introduced as a research hub that accelerates the deployment of fine‑tuned models and supports enterprise use cases.
The discussion turns to how enterprises deploy AI, the use of forward‑deployed engineers, and the balance between productization and custom engineering.
The hosts debate the distinction between AI application companies and AI labs, emphasizing the need for deep, integrated solutions in enterprises.
The episode concludes with reflections on career prospects post‑AGI and the evolving role of AI in the workforce.
Decagon’s Duet agent is described as an automated system that writes procedures, tests, and monitors conversations, reducing manual effort.
The conversation explores how AGI will change enterprise AI, the importance of infrastructure, and Decagon’s long‑term moat.
The hosts discuss how Decagon’s product‑driven, glass‑box approach accelerates adoption in large enterprises and shortens sales cycles.
Discussion on how Decagon supports large enterprises in deploying AI solutions and ensuring long-term reliability.
Open Source Performance Advantageinsight
The guest explains that 90 percent of their workflow runs on open-source models primarily for latency optimization in voice agents. They argue that fine-tuning smaller models for specific tasks outperforms large frontier models while delivering cost and speed benefits.
Enterprise Inference Sharedata
The guest notes that enterprise inference share for open-source models is currently slowing down because organizations are constantly spinning up new experimental use cases using easy-to-use frontier model APIs.
Building a Model Factorystrategy
The guest discusses how Decagon operates a research team to continuously fine-tune and train new open-source models as the model landscape evolves rapidly.
The Trap of Forward Deployed Engineersdebate
The guest argues that while forward-deployed engineers are necessary to learn new AI workflows early on, companies must productize those learnings or risk becoming glorified consulting firms.
Automating Agent Operations with Duetstory
The guest describes Duet, a secondary agent that automates the creation of agent operating procedures, tests, and conversational monitoring, significantly reducing manual engineering overhead.
Glass Box Versus Black Boxstory
The guest shares an example of a customer switching from a competitor to Decagon because Decagon provides a productized "glass box" approach that allows internal teams to rapidly iterate and spin up new journeys.
Following Business Processinsight
The guest explains that Decagon's core thesis from the start was building an agent that follows business processes well, enabling expansion from customer support into sales and operations.
“So today, 90% of our workflow is on open source.”
“We have a lot of respect for Sierra and also just, you know, other folks in the space.”
“This is how we should catch any issues that come up and how we're going to fix them and how we'll ensure that they don't happen again.”
“I probably spend most of my time, like 80% maybe.”
“Because model capabilities are changing all the time.”
“We are voracious consumers of tokens, but we would always love more great people.”
“I think it's like, AI will kill jobs, but not careers, in a way.”
Sarah Wang and Kimberly Tan are joined by Jesse Zhang and Ashwin Sreenivas, co-founders of Decagon, to discuss the evolution of enterprise AI agents, why the company increasingly relies on open-source models, and how it is helping some of the world’s largest companies deploy AI in production. Decagon has become one of the fastest-growing AI companies by building agents that automate customer support, sales, and operational workflows. Jesse, Decagon’s CEO, and Ashwin, its president, explain how the company is building enterprise AI at scale. They unpack why Decagon moved most of its inference to open-source models, how latency, evaluation, and fine-tuning shape production AI systems, and why enterprise AI requires far more than simply plugging into frontier models. The conversation also explores forward-deployed engineering, enterprise sales, AI’s impact on jobs, and why application companies will continue to thrive alongside the foundation model labs. Timestamps: 00:00 - Intro 01:07 - Decagon's Journey from Frontier APIs to 90% Open-Source 05:00 - The False Trade-off: Why Fine-Tuned Small Models Win 09:26 - Decagon Labs as a Model Factory 15:07 - Are Frontier AI Labs the Last Startups? 21:21 - The Forward Deployed Trap: Product vs Consulting Truck 28:36 - Duet Autopilot: The Agent That Builds the Agent 37:02 - Winning Enterprise: Glass Box vs Black Box (and Beating Sierra) 47:55 - From Customer Support to AI Concierge 01:14:45 - Will AI Kill Jobs? Jevons Paradox in Customer Support Resources: Follow Jesse Zhang on X: https://x.com/thejessezhang Follow Ashwin Sreenivas on X: https://x.com/AshwinSreenivas Follow Sarah Wang on X: https://x.com/sarahdingwang Follow Kimberly Tan on X: https://x.com/kimberlywtan Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.
16,068 words · 5 speakers
Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.
Page updated · transcript and summary are machine-generated