Skip to content

20VC: Mercor CPO on Revenue Concentration from Frontier Labs | Why Large Enterprise is Scared to Partner with Frontier Labs | Why Small Specialised Models is the Future with Osvald Nitski

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

Hosted by Harry Stebbings

1h 0m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

This episode features a conversation with Oswald Nitski, Chief Product Officer at Mercor, discussing the economics of AI data providers, the demand for human annotation, and the impact of open-source models on frontier labs. The guest explains how synthetic data and specialized training sets are essential for pushing model capabilities, why large enterprises remain skeptical about sharing core workflow data with frontier providers, and how hyper-growth companies manage token spend and engineering velocity in a rapidly shifting technological landscape. The discussion also covers the evolution of product management in the age of AI coding agents, the challenges of scaling annotation platforms, and the future outlook for robotics and physical data markets.

  • Prioritize hiring senior candidates who have strong business judgment and ownership rather than focusing on tactical tool familiarity. 23:18
  • Never delegate core decision-making and judgment to AI models, as maintaining personal paranoia and critical oversight prevents skill degradation. 26:52
  • Build guardrails around supported services early to avoid operational chaos and eliminate low-end demand that lacks enduring value. 17:19
  • Secure real-world internships as early as possible during university studies because academic curricula become outdated rapidly. 51:12

Chapters

  1. 0:00
    Podcast Intro and Host Greeting

    The host introduces the show and welcomes the guest, Oswald Nitski.

  2. 0:52
    Impact of Open Models on McCollough’s Business

    Oswald explains how open-source models affect McCollough’s revenue and customer needs.

  3. 6:24
    Enterprise Skepticism Toward Frontier Model Providers

    The hosts discuss why large enterprises are wary of partnering with frontier model companies.

  4. 9:47
    ROI and Token Spend in AI Adoption

    They explore the current ROI landscape and how token spend is managed across teams.

  5. 30:26
    Hiring and Talent Strategy in a Hyper‑Growth AI Company

    Oswald describes how hiring priorities shift toward senior, business‑impact‑focused talent.

  6. 32:40
    Scaling the Marketplace and Expert Experience

    The discussion covers strategies for scaling the marketplace and ensuring a great expert experience.

  7. 38:57
    Future of Specialized Models and Data Types

    Oswald predicts the rise of specialized models and new data types like RL environments.

  8. 41:28
    Democratizing Human Data Projects and Revenue Concentration

    They talk about moving from high‑concentration clients to broader, self‑serve solutions.

  9. 46:44
    Security, Cyber, and AI‑Generated Code Challenges

    The conversation ends with a look at cybersecurity threats from AI‑generated code and future data needs.

  10. 48:28
    Talent War in San Francisco

    Discussion of the challenges of hiring, retaining, and paying talent in the San Francisco tech scene.

  11. 50:34
    Rapid Growth and Market Demand

    Merckor’s surprise success in scaling its environment delivery and the high demand for specialized AI services.

  12. 51:12
    Career Advice for Aspiring Engineers

    Practical guidance on internships, company size, and location for computer science students looking to break into AI.

Highlights

  • 4:21

    Open Source and Core Businessinsight

    The guest explains that open-source models do not cannibalize Mercor's core business because data is most valuable at the very frontier of model performance, where customers purchase evaluation and training data to fill capability gaps.

  • 7:45

    Benchmarking Long Horizon Workflowsdata

    Top models score around 50% on long-horizon workflows in Apex benchmarks, but many complex tasks require continuous, uncapped rewards rather than binary success metrics.

  • 13:27

    Insatiable Enterprise Demanddata

    The guest notes that the company cannot spend money fast enough to service all current demand, resulting in headcount scaling over 10x alongside commensurate revenue growth.

  • 26:52

    Avoiding AI-Induced Psychosisstrategy

    The guest advises teams never to delegate actual job judgment or decision-making to models, warning that over-reliance causes workers to lose critical thinking capabilities.

  • 36:29

    Revenue Concentration Strategystrategy

    Mercor's biggest product challenge is moving down market to allow every enterprise to run human data projects efficiently, which will diversify revenue away from frontier labs.

  • 41:58

    Competing with Founder Annotationdebate

    The company competes with a cottage industry of VC-subsidized startups where founders personally perform annotation, a model that ultimately fails to scale past initial throughput.

  • 54:14

    Robotics as the Next Frontierinsight

    The guest projects that real-world physical data and robotics will experience massive growth and represent a significant revenue line over the next three years.

Quotes

  • “I don't think there's an ROI problem right now.”
    Unnamed speaker · 9:50
  • “We see a lot of leaders moving there and seeing new capabilities that they never thought existed.”
    Harry Stebbings · 6:03
  • “The data type that's growing the fastest for us is environments.”
    Unnamed speaker · 39:04
  • “You just have to be able to use coding agents, like a couple of tools will do everything you need, you know?”
    Unnamed speaker · 15:02
  • “We’re in a period of exploration and experimentation where there’s more tolerance, more patience to get that ROI calculation right now.”
    Unnamed speaker · 9:54
  • “Which, you know, to our point earlier about like the 90% of enterprise workflows that can already be completed.”
    Unnamed speaker · 48:05
  • “We had a great offsite just recently, actually with our annotation team. We went to Tofino in Canada. It's on the west coast of Canada. It's the only place you can surf.”
    Unnamed speaker · 50:08
  • “I got a lot of advice to join small companies, join startups, move to San Francisco. I grew up in Canada. I went to school in Toronto. I followed that advice.”
    Unnamed speaker · 55:01
  • “Eval's and training data are the primary bottleneck to model performance right now.”
    Unnamed speaker · 53:29
  • “I think that real world, like physical data is going to grow significantly over the next three years. Robotics is, robotics is an interesting area for us.”
    Unnamed speaker · 54:14
  • Asana 1:09–1:43
  • Zero Hash 1:48–2:32
  • Framer 2:36–3:47
  • Asana 57:44–58:18
  • ZeroHash 58:27–58:40
  • ZeroHash 58:48–59:00
  • Framer 59:10–1:00:34

About this episode

Osvald Nitski is the Chief Product Officer at Mercor, the AI-training and expert-data marketplace powering frontier-model development. Mercor last raised a $350 million Series C at a $10 billion valuation, and is reportedly in discussions for a new round at a $20 billion valuation. Mercor crossed $2BN in ARR in June; doubling from $1 billion in only four months. AGENDA: 00:04:00 Will open-source models kill the data-provider business? 00:07:00 Are enterprises still terrified of working with frontier model companies? 00:09:00 Does every company end up with its own specialised AI model? 00:10:00 Do enterprises actually have an AI ROI problem? 00:11:00 How should founders balance AI performance against exploding token bills? 00:14:00 Does AI mean product teams build 10x more—or ruthlessly simplify? 00:15:00 What does it now take to be a great product manager in an AI-native world? 00:20:00 Is the boom in AI services and forward-deployed engineers here to stay? 00:37:00 Can Mercor escape its dependence on a handful of frontier-model customers? 00:47:00 Are AI-generated code and agents creating a cybersecurity arms race? 00:56:00 When will robotics have its real "ChatGPT moment"?

Transcript

0:00
1:00:37

11,333 words · 2 speakers

Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.

Topics

  • AI
  • Robotics
  • Merckor
  • San Francisco
  • Canada
  • Chat GPT
  • Waymo
  • Uber
  • Austin
  • Phoenix

Page updated · transcript and summary are machine-generated