Skip to content

Databricks CEO on AI Pacing, Cyber Risk, and the Enterprise

a16z Podcast

Hosted by Erik Torenberg

1h 8m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

In this episode, the guest discusses the current pacing of artificial intelligence, enterprise AI adoption, cybersecurity risks, and how companies can derive actual business value from large language models. The conversation addresses public anxiety over existential risks, the reality of cyber threats as autonomous agents accelerate exploits, and why organizational context and data integration matter more for enterprises than chasing superintelligence. The discussion also covers internal use cases at Databricks, managing token costs with multi-model gateways, and the growing importance of building agent-friendly infrastructure.

  • Leaders should avoid discussing existential scenarios that cause unnecessary public panic when the actual risk is low. 2:22
  • Cybersecurity is an immediate priority as autonomous agents reduce the time to weaponize vulnerabilities down to hours. 25:48
  • Enterprises often struggle with AI adoption not because models lack intelligence, but because they lack internal organizational context. 41:08
  • Managing token costs and multiplexing across different models and harnesses is essential for sustainable enterprise AI operations. 56:05

Chapters

  1. 0:00
    Podcast Introduction and Host Greeting

    The hosts introduce the episode and set the stage for a discussion on AI pacing, cyber risk, and enterprise concerns.

  2. 0:57
    Superintelligence vs. Cybersecurity Focus

    Ali Ghodsi explains that while superintelligence remains distant, cybersecurity is an immediate and pressing issue.

  3. 1:29
    Internal AI Practices at Databricks

    Ali discusses how Databricks uses AI internally, from building ontologies to managing token costs and selecting models.

  4. 9:00
    Pacing vs. Safety and PR Missteps

    The hosts critique the pacing narrative, arguing that safety and security should be prioritized over slowing progress.

  5. 18:00
    Future of AI Governance and Ethics

    The episode concludes with reflections on how AI governance might evolve, balancing innovation with safety and ethical considerations.

  6. 22:10
    Cyber Risk and Automated Defense

    Ali outlines the growing cyber threat landscape and the need for automated AI-driven security solutions.

  7. 31:02
    Regulation, Inspection, and Industry Self‑Policing

    The discussion turns to potential regulatory frameworks, inspectors, and the feasibility of industry self‑policing versus federal involvement.

  8. 39:20
    AI Self‑Training and Auto‑Research

    Discussion of emerging self‑training models and the shift toward autonomous research.

  9. 40:32
    Enterprise AI Adoption Gap

    Exploration of why most enterprises rely on simple chatbots instead of agentic AI.

  10. 41:08
    Contextual Knowledge as the Key to Productivity

    Emphasis on the importance of embedding organizational context into AI models for real gains.

  11. 45:46
    Ontology Construction for Enterprise AI

    Detailed explanation of building an ontology graph to feed AI with internal knowledge.

  12. 55:41
    Databricks’ Unity Gateway and Cost Management

    Overview of the Unity Gateway, token budgeting, and harness optimization to control AI spend.

Highlights

  • 2:22

    Existential Risk Is Lowinsight

    The guest argues that talking about existential scenarios where all of humanity is wiped out is irresponsible and causes unnecessary public mental health issues.

  • 7:15

    Tragedy of the Commonsdebate

    A business leader explains the competitive pressure in AI development, noting that companies will not stop racing unilaterally because of market equilibrium and IPO stakes.

  • 25:48

    Rapid Vulnerability Weaponizationdata

    The time required for a software vulnerability to be weaponized in the industry has dropped from years down to mere hours.

  • 41:02

    Context Over Smarter Modelsinsight

    Most enterprises do not need models that can solve advanced math or physics, but rather models equipped with the specific context of their organization.

  • 44:21

    Drug Discovery With AIstory

    A transformer-based model built with Merck predicts gene regulatory network responses to significantly reduce costs in targeted drug discovery.

  • 52:39

    Internal AI Adoption at Scalestory

    The CFO and employees across Databricks rely on an internal ontology and query tool called Genie to find operational data rather than asking colleagues.

  • 1:04:45

    Database Optimization for Agentsstrategy

    A database provider focused on agent workflows built a highly elastic, sub-second cloning system where over 90 percent of new databases are created by agents.

Quotes

  • “The problem is that it doesn't understand your company.”
    Erik Torenberg · 0:53
  • “So we just have to race very, very fast to do all of those things.”
    Ali Ghodsi · 23:01
  • “The time from CVE to actually weaponize exploit has like been going down from years down to like minutes now, just in like three, four years.”
    Ali Ghodsi · 33:29
  • “We have a product in the market, in in the detection market, Lake Watch, that helps you do detections.”
    Ali Ghodsi · 22:10
  • “The next model, first of all, there's only one or two such runs a year that each of these labs do.”
    Ali Ghodsi · 15:49
  • “We are rushing, the industry is rushing to do that super, super fast.”
    Ali Ghodsi · 22:40
  • “We have a lot of use cases that are, I mean, just fascinating.”
    Ali Ghodsi · 43:00
  • “If you actually look at it, is the models are smart enough. But they just don't have the context that exists inside of any organization.”
    Ali Ghodsi · 41:02
  • “We started noticing that, okay, it's actually starting to give much better productivity.”
    Ali Ghodsi · 54:26
  • “Even exactly same model. You know, same version, but different harness, you get 2X difference in actual cost.”
    Ali Ghodsi · 56:19
  • A16Z.substack.com 1:07:49–1:07:55

About this episode

Databricks co-founder and CEO Ali Ghodsi joins a16z General Partners Martin Casado and Sarah Wang for a conversation about AI risk, recursive self-improvement, cybersecurity, and what’s actually holding back enterprise adoption. Ali argues that today’s models are already capable enough to automate far more work than most companies are using them for. The bigger problem is context: models haven’t been in every meeting, don’t understand how decisions actually get made, and lack the institutional knowledge that experienced employees accumulate over years. He explains why building an organizational “ontology” could help close that gap and what Databricks has learned from doing it internally. They also debate the current conversation around pacing frontier AI, what would constitute meaningful recursive self-improvement, and why Ali distinguishes speculative superintelligence risk from the much more immediate challenge of AI-powered cyberattacks. They close with how enterprises are managing exploding AI usage and costs, the shift toward multiple models and harnesses, and why agents are beginning to reshape infrastructure itself.

Transcript

0:00
1:08:34

15,273 words · 4 speakers

Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.

Topics

  • AI
  • Databricks
  • Genie
  • Neon
  • OpenAI
  • recursive self-improvement
  • Anthropic
  • Lakebase
  • Postgres
  • CVE

Page updated · transcript and summary are machine-generated