Skip to content

Decagon’s Playbook for Building Enterprise AI Applications

a16z Podcast

Hosted by Erik Torenberg

1h 20m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

In this episode, Sarah Wang and Marc Andreessen sit down with Decagon co-founders Jesse Zhang and Ashwin Srinivas to discuss their playbook for building enterprise AI applications. The conversation explores why Decagon shifted 90 percent of their AI stack to open source models to optimize latency and performance for voice agents, how they think about deploying AI inside large enterprises, and why the future of software will be shaped by AI agents rather than just foundation models. The guests explain how fine-tuning smaller, task-specific models often outperforms larger general-purpose models while being faster and cheaper. They also unpack their views on forward-deployed engineering, go-to-market strategy, and why they believe software and careers will persist in an AGI world.

The discussion provides a look into how an AI-native application company navigates rapid technological shifts by building a research lab, creating internal tooling like the Duet agent for workflow automation, and maintaining a product-led approach to enterprise sales. Listeners will benefit from concrete examples of how Decagon handles enterprise deployment challenges, manages a high-intensity culture, and expands from customer support into broader operational and sales workflows.

  • Fine-tuning smaller open-source models for specific tasks can yield higher performance, lower cost, and better latency than relying solely on massive frontier models. 5:34
  • Enterprises can successfully scale AI deployment by treating agents as business process executors rather than simple conversational wrappers. 49:06
  • Forward-deployed engineering should be used to discover workflows and productize solutions rather than morphing into permanent, bespoke consulting services. 25:38
  • Automation often reveals latent demand for services, leading companies to expand their offerings rather than simply cutting headcount. 1:16:44

Chapters

  1. 0:00
    Podcast Intro and Host Welcome

    The hosts introduce the episode and set the stage for the discussion.

  2. 1:39
    Open Source vs. Frontier Models Debate

    The conversation shifts to the debate over open source versus closed source AI models and their relevance to enterprises.

  3. 2:17
    Decagon’s Early Journey and Model Choice

    Decagon’s founders discuss their initial use of frontier models, the need for low latency, and the decision to move to open source models.

  4. 3:01
    Fine‑Tuning Open Source for Enterprise Tasks

    The team explains how fine‑tuning small open source models can outperform larger frontier models on specific enterprise tasks.

  5. 4:02
    The Role of Decagon Labs and Research

    Decagon Labs is introduced as a research hub that accelerates the deployment of fine‑tuned models and supports enterprise use cases.

  6. 7:06
    Enterprise Deployment Strategy and FDEs

    The discussion turns to how enterprises deploy AI, the use of forward‑deployed engineers, and the balance between productization and custom engineering.

  7. 15:03
    Product vs. Application Layer in AI Companies

    The hosts debate the distinction between AI application companies and AI labs, emphasizing the need for deep, integrated solutions in enterprises.

  8. 28:50
    Closing Reflections on Careers and AGI

    The episode concludes with reflections on career prospects post‑AGI and the evolving role of AI in the workforce.

  9. 30:13
    Duet Agent and Automation of Agent Development

    Decagon’s Duet agent is described as an automated system that writes procedures, tests, and monitors conversations, reducing manual effort.

  10. 34:48
    Future of Enterprise AI and AGI Impact

    The conversation explores how AGI will change enterprise AI, the importance of infrastructure, and Decagon’s long‑term moat.

  11. 37:04
    Sales Strategy and Enterprise Adoption

    The hosts discuss how Decagon’s product‑driven, glass‑box approach accelerates adoption in large enterprises and shortens sales cycles.

  12. 43:25
    Deploying at Scale for Enterprise Clients

    Discussion on how Decagon supports large enterprises in deploying AI solutions and ensuring long-term reliability.

Highlights

  • 5:34

    Open Source Performance Advantageinsight

    The guest explains that 90 percent of their workflow runs on open-source models primarily for latency optimization in voice agents. They argue that fine-tuning smaller models for specific tasks outperforms large frontier models while delivering cost and speed benefits.

  • 8:25

    Enterprise Inference Sharedata

    The guest notes that enterprise inference share for open-source models is currently slowing down because organizations are constantly spinning up new experimental use cases using easy-to-use frontier model APIs.

  • 10:06

    Building a Model Factorystrategy

    The guest discusses how Decagon operates a research team to continuously fine-tune and train new open-source models as the model landscape evolves rapidly.

  • 25:38

    The Trap of Forward Deployed Engineersdebate

    The guest argues that while forward-deployed engineers are necessary to learn new AI workflows early on, companies must productize those learnings or risk becoming glorified consulting firms.

  • 31:10

    Automating Agent Operations with Duetstory

    The guest describes Duet, a secondary agent that automates the creation of agent operating procedures, tests, and conversational monitoring, significantly reducing manual engineering overhead.

  • 38:12

    Glass Box Versus Black Boxstory

    The guest shares an example of a customer switching from a competitor to Decagon because Decagon provides a productized "glass box" approach that allows internal teams to rapidly iterate and spin up new journeys.

  • 49:06

    Following Business Processinsight

    The guest explains that Decagon's core thesis from the start was building an agent that follows business processes well, enabling expansion from customer support into sales and operations.

Quotes

  • “So today, 90% of our workflow is on open source.”
    Unnamed speaker · 0:32
  • “We have a lot of respect for Sierra and also just, you know, other folks in the space.”
    Unnamed speaker · 37:57
  • “This is how we should catch any issues that come up and how we're going to fix them and how we'll ensure that they don't happen again.”
    Unnamed speaker · 43:25
  • “I probably spend most of my time, like 80% maybe.”
    Unnamed speaker · 44:42
  • “Because model capabilities are changing all the time.”
    Unnamed speaker · 46:50
  • “We are voracious consumers of tokens, but we would always love more great people.”
    Unnamed speaker · 52:08
  • “I think it's like, AI will kill jobs, but not careers, in a way.”
    Unnamed speaker · 1:17:25
  • A16Z 1:19:44–1:20:15

About this episode

Sarah Wang and Kimberly Tan are joined by Jesse Zhang and Ashwin Sreenivas, co-founders of Decagon, to discuss the evolution of enterprise AI agents, why the company increasingly relies on open-source models, and how it is helping some of the world’s largest companies deploy AI in production. Decagon has become one of the fastest-growing AI companies by building agents that automate customer support, sales, and operational workflows. Jesse, Decagon’s CEO, and Ashwin, its president, explain how the company is building enterprise AI at scale. They unpack why Decagon moved most of its inference to open-source models, how latency, evaluation, and fine-tuning shape production AI systems, and why enterprise AI requires far more than simply plugging into frontier models. The conversation also explores forward-deployed engineering, enterprise sales, AI’s impact on jobs, and why application companies will continue to thrive alongside the foundation model labs. Timestamps: 00:00 - Intro 01:07 - Decagon's Journey from Frontier APIs to 90% Open-Source 05:00 - The False Trade-off: Why Fine-Tuned Small Models Win 09:26 - Decagon Labs as a Model Factory 15:07 - Are Frontier AI Labs the Last Startups? 21:21 - The Forward Deployed Trap: Product vs Consulting Truck 28:36 - Duet Autopilot: The Agent That Builds the Agent 37:02 - Winning Enterprise: Glass Box vs Black Box (and Beating Sierra) 47:55 - From Customer Support to AI Concierge 01:14:45 - Will AI Kill Jobs? Jevons Paradox in Customer Support Resources: Follow Jesse Zhang on X: https://x.com/thejessezhang Follow Ashwin Sreenivas on X: https://x.com/AshwinSreenivas Follow Sarah Wang on X: https://x.com/sarahdingwang Follow Kimberly Tan on X: https://x.com/kimberlywtan Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.

Transcript

0:00
1:20:15

16,068 words · 5 speakers

Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.

Topics

  • Decagon
  • sales
  • AGI
  • customer support
  • Duet
  • frontier models
  • open source models
  • Anthropic
  • LinkedIn
  • OpenAI

Page updated · transcript and summary are machine-generated