
Summary
Written by a model from the transcript; not yet reviewed.
In this episode, Sarah Wang and Marc Andreessen sit down with Decagon co-founders Jesse Zhang and Ashwin Srinivas to discuss their playbook for building enterprise AI applications. The conversation explores why Decagon shifted 90 percent of their AI stack to open source models to optimize latency and performance for voice agents, how they think about deploying AI inside large enterprises, and why the future of software will be shaped by AI agents rather than just foundation models. The guests explain how fine-tuning smaller, task-specific models often outperforms larger general-purpose models while being faster and cheaper. They also unpack their views on forward-deployed engineering, go-to-market strategy, and why they believe software and careers will persist in an AGI world.
The discussion provides a look into how an AI-native application company navigates rapid technological shifts by building a research lab, creating internal tooling like the Duet agent for workflow automation, and maintaining a product-led approach to enterprise sales. Listeners will benefit from concrete examples of how Decagon handles enterprise deployment challenges, manages a high-intensity culture, and expands from customer support into broader operational and sales workflows.
- Fine-tuning smaller open-source models for specific tasks can yield higher performance, lower cost, and better latency than relying solely on massive frontier models. 5:34
- Enterprises can successfully scale AI deployment by treating agents as business process executors rather than simple conversational wrappers. 49:06
- Forward-deployed engineering should be used to discover workflows and productize solutions rather than morphing into permanent, bespoke consulting services. 25:38
- Automation often reveals latent demand for services, leading companies to expand their offerings rather than simply cutting headcount. 1:16:44
Chapters
- 0:00Podcast Intro and Host Welcome
The hosts introduce the episode and set the stage for the discussion.
- 1:39Open Source vs. Frontier Models Debate
The conversation shifts to the debate over open source versus closed source AI models and their relevance to enterprises.
- 2:17Decagon’s Early Journey and Model Choice
Decagon’s founders discuss their initial use of frontier models, the need for low latency, and the decision to move to open source models.
- 3:01Fine‑Tuning Open Source for Enterprise Tasks
The team explains how fine‑tuning small open source models can outperform larger frontier models on specific enterprise tasks.
- 4:02The Role of Decagon Labs and Research
Decagon Labs is introduced as a research hub that accelerates the deployment of fine‑tuned models and supports enterprise use cases.
- 7:06Enterprise Deployment Strategy and FDEs
The discussion turns to how enterprises deploy AI, the use of forward‑deployed engineers, and the balance between productization and custom engineering.
- 15:03Product vs. Application Layer in AI Companies
The hosts debate the distinction between AI application companies and AI labs, emphasizing the need for deep, integrated solutions in enterprises.
- 28:50Closing Reflections on Careers and AGI
The episode concludes with reflections on career prospects post‑AGI and the evolving role of AI in the workforce.
- 30:13Duet Agent and Automation of Agent Development
Decagon’s Duet agent is described as an automated system that writes procedures, tests, and monitors conversations, reducing manual effort.
- 34:48Future of Enterprise AI and AGI Impact
The conversation explores how AGI will change enterprise AI, the importance of infrastructure, and Decagon’s long‑term moat.
- 37:04Sales Strategy and Enterprise Adoption
The hosts discuss how Decagon’s product‑driven, glass‑box approach accelerates adoption in large enterprises and shortens sales cycles.
- 43:25Deploying at Scale for Enterprise Clients
Discussion on how Decagon supports large enterprises in deploying AI solutions and ensuring long-term reliability.
Highlights
- 5:34
Open Source Performance Advantageinsight
The guest explains that 90 percent of their workflow runs on open-source models primarily for latency optimization in voice agents. They argue that fine-tuning smaller models for specific tasks outperforms large frontier models while delivering cost and speed benefits.
- 8:25
Enterprise Inference Sharedata
The guest notes that enterprise inference share for open-source models is currently slowing down because organizations are constantly spinning up new experimental use cases using easy-to-use frontier model APIs.
- 10:06
Building a Model Factorystrategy
The guest discusses how Decagon operates a research team to continuously fine-tune and train new open-source models as the model landscape evolves rapidly.
- 25:38
The Trap of Forward Deployed Engineersdebate
The guest argues that while forward-deployed engineers are necessary to learn new AI workflows early on, companies must productize those learnings or risk becoming glorified consulting firms.
- 31:10
Automating Agent Operations with Duetstory
The guest describes Duet, a secondary agent that automates the creation of agent operating procedures, tests, and conversational monitoring, significantly reducing manual engineering overhead.
- 38:12
Glass Box Versus Black Boxstory
The guest shares an example of a customer switching from a competitor to Decagon because Decagon provides a productized "glass box" approach that allows internal teams to rapidly iterate and spin up new journeys.
- 49:06
Following Business Processinsight
The guest explains that Decagon's core thesis from the start was building an agent that follows business processes well, enabling expansion from customer support into sales and operations.
Quotes
“So today, 90% of our workflow is on open source.”
Unnamed speaker · 0:32 “We have a lot of respect for Sierra and also just, you know, other folks in the space.”
Unnamed speaker · 37:57 “This is how we should catch any issues that come up and how we're going to fix them and how we'll ensure that they don't happen again.”
Unnamed speaker · 43:25 “I probably spend most of my time, like 80% maybe.”
Unnamed speaker · 44:42 “Because model capabilities are changing all the time.”
Unnamed speaker · 46:50 “We are voracious consumers of tokens, but we would always love more great people.”
Unnamed speaker · 52:08 “I think it's like, AI will kill jobs, but not careers, in a way.”
Unnamed speaker · 1:17:25
Sponsored segments
- A16Z 1:19:44–1:20:15
About this episode
Sarah Wang and Kimberly Tan are joined by Jesse Zhang and Ashwin Sreenivas, co-founders of Decagon, to discuss the evolution of enterprise AI agents, why the company increasingly relies on open-source models, and how it is helping some of the world’s largest companies deploy AI in production. Decagon has become one of the fastest-growing AI companies by building agents that automate customer support, sales, and operational workflows. Jesse, Decagon’s CEO, and Ashwin, its president, explain how the company is building enterprise AI at scale. They unpack why Decagon moved most of its inference to open-source models, how latency, evaluation, and fine-tuning shape production AI systems, and why enterprise AI requires far more than simply plugging into frontier models. The conversation also explores forward-deployed engineering, enterprise sales, AI’s impact on jobs, and why application companies will continue to thrive alongside the foundation model labs. Timestamps: 00:00 - Intro 01:07 - Decagon's Journey from Frontier APIs to 90% Open-Source 05:00 - The False Trade-off: Why Fine-Tuned Small Models Win 09:26 - Decagon Labs as a Model Factory 15:07 - Are Frontier AI Labs the Last Startups? 21:21 - The Forward Deployed Trap: Product vs Consulting Truck 28:36 - Duet Autopilot: The Agent That Builds the Agent 37:02 - Winning Enterprise: Glass Box vs Black Box (and Beating Sierra) 47:55 - From Customer Support to AI Concierge 01:14:45 - Will AI Kill Jobs? Jevons Paradox in Customer Support Resources: Follow Jesse Zhang on X: https://x.com/thejessezhang Follow Ashwin Sreenivas on X: https://x.com/AshwinSreenivas Follow Sarah Wang on X: https://x.com/sarahdingwang Follow Kimberly Tan on X: https://x.com/kimberlywtan Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.
Transcript
16,068 words · 5 speakers
Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.
Topics
- Decagon
- sales
- AGI
- customer support
- Duet
- frontier models
- open source models
- Anthropic
- OpenAI
Page updated · transcript and summary are machine-generated