Skip to content

Claude Code for Finance + The Global Memory Shortage: Doug O'Laughlin, SemiAnalysis

Latent Space: The AI Engineer Podcast

2h 4m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

Doug O'Laughlin of SemiAnalysis discusses how Claude Code 4.5 transformed his financial research workflow, describing it as a "junior analyst" that amplifies experts but lacks meta-level learning. He details his "awakening" moment around December 27 when the model started one-shotting complex tasks, and how he now uses it for everything from tracking GitHub commits to fine-tuning time series models for memory prices. He argues the tool is a "skill issue" and that all information work is being automated, not just coding.

The second half covers the global memory shortage: HBM's 3-to-4x multiplier on DRAM demand, combined with two-year clean room lead times and the aftermath of the worst NAND/DRAM shortage in history, creates a supply gap he expects to persist for two years. He predicts DRAM prices could rise another 100%, and notes that even dead technologies like CXL are being revived to pool old DDR4 chips. He also argues Microsoft has the most to lose in the AI era, comparing Azure's relationship with OpenAI to "renting barbarians at the gate," and draws parallels between current AI capex and the railroad buildout that consumed 4.8% of GNP for a decade.

  • Claude Code 4.5's ability to one-shot complex multi-step tasks represents a capability threshold that makes it viable for financial research, not just coding. 15:39
  • HBM's 3-to-4x multiplier on DRAM demand, combined with two-year clean room lead times, creates a memory shortage that won't resolve for approximately two years. 1:40:43
  • Current AI infrastructure capex is already on track to match or exceed the railroad buildout, which consumed 4.8% of GNP and 25% of total gross fixed capital investment for a decade. 1:05:26
  • Microsoft's Azure-OpenAI relationship is structurally broken because each year the AI partner becomes more powerful while Microsoft's core software moat dilutes. 1:22:18
  • A CPU shortage is emerging from the convergence of the five-year post-COVID refresh cycle and increased demand from AI agents and RL workloads. 1:53:03

Highlights

  • 15:39

    Claude Code 4.5 Awakeningstory

    Doug describes his December 27 moment when Claude Code 4.5 started one-shotting complex projects that previously required extensive iteration. He calls it a capability threshold that changed how he does all information work.

  • 23:02

    Tracking Claude Code GitHub Adoptiondata

    Doug built a cron job tracking Claude Code's share of GitHub commits daily, showing it reached 4% in two weeks. He describes it as the fastest exponential trend he has ever seen.

  • 45:14

    PhD Project in Two Daysstory

    Doug used Claude Code to compile all memory price data, macro covariates, and regime summaries that he previously described as a lifetime of work or PhD project, completing it in one to two days.

  • 1:05:26

    Railroad Capex Comparisondata

    Doug compares current AI infrastructure spending to the railroad buildout, which consumed 4.8% of GNP and 25% of total gross fixed capital investment sustained for ten years, noting current AI capex is already on track to match it.

  • 1:11:30

    Excel Is Dead for Analystsinsight

    Doug declares he will never make a chart in Excel again, arguing that all human IDEs including Excel, Bloomberg, and PowerPoint are being replaced by AI agents that can retrieve, analyze, and present information without legacy interfaces.

  • 1:22:18

    Microsoft's Barbarian Probleminsight

    Doug argues Microsoft's Azure-OpenAI relationship is structurally broken, comparing it to ancient Rome renting the Golden Army. Each year the barbarians become more powerful while Microsoft's moat dilutes, and the company is stuck between defending its core software and investing in AI.

  • 1:40:43

    HBM Multiplier Creates Memory Crisisinsight

    Doug explains how HBM's 3-to-4x multiplier on DRAM demand, combined with the industry's failure to invest in new capacity after the worst shortage in history, creates a supply gap that won't close for two years.

  • 1:59:58

    Continental Divide Trail Sabbaticalstory

    Doug describes his six-month, 2,800-mile through-hike of the Continental Divide Trail in 2021, calling it the most personally meaningful experience of his life and a way to understand his own limits and self-mastery.

About this episode

This is a free preview of a paid episode. To hear more, visit www.latent.space https://www.latent.space?utm_medium=podcast&utm_campaign=CTA_7 First speakers for AIE Europe https://www.ai.engineer/europe and AIEi Miami https://www.ai.engineer/miami have been announced. If you’re in Asia/Aus, come by Singapore https://www.ai.engineer/singapore and Melbourne https://webdirections.org/ai-engineer/. AI Engineering is going global! One year ago today, Anthropic launched Claude Code https://www.anthropic.com/news/claude-3-7-sonnet, to not much fanfare https://news.smol.ai/issues/25-02-24-ainews-claude-37-sonnet: The word of mouth was incredibly strong however, and so we were glad to be one of the first podcasts to invite Boris and Cat on in early May: As we discussed on the pod, all CC usage was API-based and therefore it was ridiculously expensive to do anything. This was then fixed by the team including Claude Code in the Claude Pro plan https://www.reddit.com/r/ClaudeAI/comments/1l3bwmm/claude_code_is_available_on_pro_plan/ in early June, and then the virality caused us to make a rare trend call in late June https://news.smol.ai/issues/25-06-20-claude-code: Now, 6 months on, Doug has just calculated that around 4% of GitHub is written by Claude Code https://newsletter.semianalysis.com/p/claude-code-is-the-inflection-point: We talk about how Doug uses Claude Code to do SemiAnalysis work. Memory Mania In the second part of this episode, we also check in on Memory Mania https://newsletter.semianalysis.com/p/memory-mania-how-a-once-in-four-decades?utm_source=publication-search, which is going to affect you (yes, you) at home if it hasn’t already: Full Episode on YouTube Timestamps 00:00 AI as Junior Analyst00:59 Meet Swyx and Doug03:30 From Value Mule to Semis06:28 Moore’s Law Ends Thesis12:02 Claude Code Awakening32:02 Agent Swarms Reality Check32:53 Kimi Swarm Benchmarks37:31 Bots vs Zapier Automation39:44 Claude Code Workflow Setup57:54 AGI Metrics and GDP01:04:48 Railroad CapEx Analogy01:06:00 Funding Bubbles and Demand01:08:11 Agents Replace Work Tools01:13:56 Codex vs Claude Race01:21:15 Microsoft and TPU Strategy01:34:13 TPU Window vs Nvidia01:36:30 HBM Supply Chain Squeeze01:39:41 Memory Shock and CXL01:45:20 Context Rationing Future01:54:37 Writing and Trail Lessons Transcript [00:00:00] AI as Junior Analyst [00:00:00] Doug: This crap makes mistakes all the time. All the time. It is still just like a, like I think of it once again as like a junior analyst, right? The analyst goes and does all this like really pain in the ass information and you bring it all together to make a good decision at the top. Historically what happens is that junior analyst, who I once was, went and gathered all that information, and after doing this enough times, there’s a meta level thinking that’s happening where it’s like, okay, here’s what I really understand and how this type of analysis, I’m an expert in, actually I’m very good at, I consistently have a hit rate. [00:00:28] Now I’m the expert, right? I don’t think that meta level learning is there yet. We’ll see if l ones do it, right? Everyone who’s spending one quadrillion dollars in the world thinks it will, it better, it better happen by if you’re spending, you know, a trillion dollars and there’s not meta level learning. [00:00:44] But for me, in our firm, that massively amplifies everyone who is an expert. ‘cause like you have to still do something that you can just like lop it up. It’s very obvious to me. What It’s slop. [00:00:59] Meet Swyx and Doug

Transcript

0:00
2:04:13

28,379 words · 2 speakers

Topics

  • Claude Code
  • AI Agents
  • Memory Market
  • Semiconductor Supply Chain
  • Microsoft Strategy
  • AI Capex
  • Financial Research
  • Context Windows

Page updated · transcript and summary are machine-generated