Skip to content

20VC: How to Build Your Own Data Center & Why Every Startup Should Do It | How ElevenLabs Leapfrogged Us: What I Learned | The AI Talent War: How Your Hiring Process Needs to Change with Cliff Weitzman, Speechify

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

Hosted by Harry Stebbings

1h 5m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

This episode features a discussion with Cliff Weitzman, founder and CEO of Speechify, covering the strategic and financial mechanics of buying Nvidia GPUs versus renting them, the critical mistake of ignoring B2B markets while competitors like Eleven Labs scaled rapidly, and the evolving landscape of AI talent and hiring. The guest and host debate the viability of competing in crowded AI sectors like customer support agents and voice AI against industry heavyweights like Brett Taylor's Sierra and Eleven Labs. Weitzman explains why owning data center hardware provides an essential speed and cost advantage for heavy training workloads, how agentic workflows are fundamentally changing software engineering productivity, and shares a personal story of applying GPU clusters and genomic sequencing to tackle rare diseases.

  • Owning your own GPU hardware is often cheaper than renting over a multi-year horizon and removes engineering constraints caused by parsimonious usage. 4:01
  • Failing to build a B2B go-to-market motion early can allow competitors to leapfrog a dominant consumer business. 23:39
  • Modern engineering teams use AI agents to handle long-horizon tasks, shifting the primary developer role toward high-level architecture decisions and rigorous quality assurance. 38:59
  • When hiring technical talent, prioritize raw mathematical and cognitive aptitude over handcrafted coding experience because tools allow individuals to learn rapidly. 34:00

Chapters

  1. 0:57
    Podcast Intro and AI Law Firm Sponsorship

    The hosts introduce the episode and discuss how the first AI law firm helped secure a major sponsor for the show.

  2. 3:48
    Cliff Weitzman’s Nvidia GPU Strategy

    Cliff explains why Speechify invested heavily in Nvidia GPUs, detailing the cost-benefit analysis of owning versus renting hardware.

  3. 10:25
    Forecasting Chip Purchases and Supply Constraints

    The conversation turns to the challenges of predicting chip demand and supply, and how Speechify navigates vendor relationships and logistics.

  4. 15:38
    Strategic Mistake: Ignoring B2B Opportunities

    Cliff reflects on his biggest strategic error—failing to pursue B2B sales early—and how it allowed competitors like Eleven Labs to leapfrog him.

  5. 20:09
    Data, Compute, and Team: The Three Pillars of AI Success

    Cliff outlines the critical components—data, compute, and talent—that enable a company to innovate and stay ahead in the AI space.

  6. 30:41
    Future Outlook: B2C, B2B, and Market Dynamics

    Cliff concludes by weighing the prospects of staying strong in B2C while expanding into B2B, and reflects on the evolving AI market landscape.

  7. 31:59
    Hiring in the AI Talent War

    Cliff shares insights on hiring strategies, the competition for top talent, and how companies can attract and retain high-caliber engineers and leaders.

  8. 37:43
    Agent Orchestration and Internal Tooling

    The conversation explores how Speechify’s engineering teams use agent orchestration, internal tooling, and token allocation to accelerate product development.

  9. 40:15
    Rapid AI Iteration at Speechify

    The speaker explains how Speechify pushes AI features to production quickly, highlighting the importance of fast feedback loops.

  10. 1:03:18
    GTM Evolution and AI Superhumans

    Discussion of One Mind’s superhuman sales enablement and AlphaSense’s AI-driven market intelligence for modern GTM challenges.

Highlights

  • 4:01

    Why Buying GPUs Beats Rentingstrategy

    The guest explains the financial breakdown of owning Nvidia GPUs versus renting them from cloud providers, noting that owning hardware is roughly 1.5 times cheaper annually while enabling co-located memory access necessary for large-scale training.

  • 23:39

    Admitting a Major Strategic Mistakeinsight

    Reflecting on competition in the voice AI space, the guest admits that failing to prioritize B2B enterprise APIs earlier was the biggest strategic mistake in the company's history, allowing competitors to capture valuable market segments.

  • 34:00

    Shifting Hiring Criteria for Engineersstrategy

    In an era where coding can be heavily automated, hiring philosophy shifts toward looking for raw technical intelligence, math olympiads, and high work ethic rather than past syntax mastery.

  • 38:59

    Engineers as Quality Assurance Expertsinsight

    As AI agents generate more features and handle routine execution, the daily job of an elite software engineer transforms into orchestrating loops and acting as an exceptional quality assurance tester.

  • 58:46

    Applying GPU Clusters to Cure Diseasesstory

    Demonstrating the practical application of high-performance compute outside of software, the guest describes sequencing genomes, running RNA analysis, and utilizing GPU clusters to research and solve rare autoimmune neural inflammation.

Quotes

  • “You want to be the warrior who runs up with their sword and engages the enemy first.”
    Unnamed speaker · 0:11
  • “We have a bunch of models, the newest Speechify Simba 3.2 model is ranked number one in the world for quality.”
    Unnamed speaker · 4:09
  • “If I wanted to rent an H100 for one hour spot instance from GCP, it could cost me $5.”
    Unnamed speaker · 5:43
  • “We rent the data center and so the data center provides the networking capability.”
    Unnamed speaker · 9:56
  • “The best bond you can buy long tail will yield you like 5% or you can buy GPU.”
    Unnamed speaker · 9:22
  • “Speechify has served more than 770 billion words to users over the last few years, which in terms of times of listening, it's like 6,000 years of listening, right?”
    Unnamed speaker · 27:45
  • “If you didn't do that, you get no credit. If you carry the football all the way to the line, but you don't cross over to the end zone.”
    Unnamed speaker · 40:18
  • “And I think Anthropic published this paper when Fable 1 came out about long horizon tasks with Fable.”
    Unnamed speaker · 44:15
  • “The realization moment was when we realized that we had really talented engineers who were essentially moving at one-seventh of the speed they could have if they had the compute one-to-one with their creativity and ideas.”
    Unnamed speaker · 45:13
  • “I would never try to fight Brett Taylor.”
    Unnamed speaker · 52:38
  • Crosby 1:02:05–1:03:54

About this episode

Cliff Weitzman is the co-founder and CEO of Speechify, the world's leading AI voice and text-to-speech platform, used by more than 60 million people globally. Diagnosed with dyslexia as a child, Cliff first built Speechify at Brown University to help him consume written material through audio. AGENDA: 00:00 Cliff Weitzman Reveals His Biggest-Ever Strategic Mistake 03:08 Why Speechify Is Paying Millions to Build Their Own Data Centres 09:59 What No One Knows About Buying Chips That Everyone Should Know? 20:19 The AI Data Gold Rush Has a Brutal Business-Model Problem 23:42 How ElevenLabs Leapfrogged Speechify—and Why It Was Cliff's Fault 31:00 The $15M AI Talent War: Can Startups Still Compete for the Best Talent? 36:57 The New 10X Engineer: Ten Killer Decisions Every Day 46:12 The Voice-AI Bloodbath: Who Survives Commoditisation? 53:21 The Screen Is Dying—and Voice Will Replace It 57:58 How Cliff Plans to Use AI to Cure His Brother's Disease

Transcript

0:00
1:05:13

14,444 words · 2 speakers

Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.

Topics

  • Speechify
  • Meta
  • 11 Labs
  • Nvidia
  • Whisperflow
  • SpaceX
  • One Mind
  • Tesla
  • Willow
  • Gemini

Page updated · transcript and summary are machine-generated