Intentional Tech: Designing AI for Human Flourishing | Alex Komoroske

The smallest technical decisions become humanity's biggest pivots: The same-origin policy—a well-intentioned browser security rule from the 1990s—accidentally created Facebook, Google, and every data monopoly since. It locks your data in silos—and you stayed where your stuff already is. This dynamic created aggregators. Alex Komoroske—who led Chrome's web platform team at Google and ran corporate strategy at Stripe—saw this pattern play out firsthand. And he's obsessed with the tiny decisions that will shape AI's next 30 years: Whether AI keeps memory centrally or user-controlled? Is AI free/ad-supported or user-paid? Should AI be engagement-maximizing or intention-aligned? How should we handle prompt injection in MCP and agentic systems? Should AI be built with AOL-style aggregation or web-style openness? This is a much-watch if you care about the future of AI and humanity. If you found this episode interesting, please like, subscribe, comment, and share! Want even more? Sign up for Every to unlock our ultimate guide to prompting ChatGPT here: https://every.ck.page/ultimate-guide-to-prompting-chatgpt. It’s usually only for paying subscribers, but you can get it here for free. To hear more from Dan Shipper: Subscribe to Every: https://every.to/subscribe Follow him on X: https://twitter.com/danshipper Sponsors: Google Gemini: Experience high quality AI video generation with Google's most capable video model: Veo 3. Try it in the Gemini app at gemini.google with a Google AI Pro plan or get the highest access with the Ultra plan. Attio: Go to⁠⁠⁠⁠ https://attio.com/every⁠⁠⁠⁠⁠ and get 15% off your first year on your AI-powered CRM. Timestamps: Introduction: 00:01:45 Why chatbots are a feature not a paradigm: 00:04:25 Toward AI that’s aligned with our intentions: 00:06:50 The four pillars of “intentional technology”: 00:11:54 The type of structures in which intentional technology can thrive: 00:14:16 Why ChatGPT is the AOL of the AI era: 00:18:26 Why AI needs to break out of the silos of the early internet: 00:25:55 Alex’s personal journey into systems-thinking: 00:41:53 How LLMs can encode what we know but can’t explain: 00:48:15 Can LLMs solve the coordination problem inside organizations: 00:54:35 The under-discussed risk of prompt injection: 01:01:39 Links to resources mentioned in the episode: Alex Komoroske: @komorama Common Tools: https://common.tools/ The public Google document with Alex’s raw ideas and thoughts: Bits and Bobs A couple of Alex’s favorite books: Why Information Grows by Cesar Hidalgo and The Origin of Wealth by Eric Beinhocker

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  We have this new technology, LLMs, that I think are as transformative as the printing press, electricity in the internet. And we have a choice. We can go down the path that we've been going down, which is engagement maximizing, hyper aggregation, you know, going after what you want, not what you want to want as a user, or being aligned with our intentions. And that could lead to a new era of human flourishing, I think. I intend to spend quality time with my family. I intend to experience new things. The right product fabric could enable that. But that has to be fully aligned with you. Imagine if that context, all of that rich substrate of meaning that you've distilled and written down, if it's not working for you, that's terrifying. I would run onto the stage where Steve Jobs shows off the iPhone, which was a poster that says, this will become the most important

• 0:42Speaker 00

  computing device on earth. It is insane to allow a single company to decide what things you may run in it. Right? I know it feels like in this industry that we're like halfway through the LLM era. We were in the very first inning. We're like rubbing sticks together. We still think that chatbots are the main thing. Will chatbots be important? Yes. But chatbots to me feel like a feature, not a paradigm.

• 1:16Speaker 01

  This podcast is supported by Google. Hey, everyone. David here, one of the product leads for Google Gemini. If you dream it and describe it, VO3 and Gemini can help you bring it to life as a video. Now with incredible sound effects, background noise, and even dialogue. Try it with a Google AI Pro Plan or get the highest access with the Ultra Plan. Sign up at Gemini dot Google to get started and show us what you create.

• 1:45Dan Shipper?

  Alex, welcome to the show.

• 1:47Speaker 00

  Thanks for having me.

• 1:48Dan Shipper?

  So for people who don't know you, you are the co-founder and CEO of Common Tools, which you'll describe for us. You are also previously the head of corporate strategy at Stripe and director of product management at Google. And I met you, I think, like six months ago. And the thing that really stood out in our conversation, aside from just like, you have so many interesting ideas, is you're this really interesting systems builder. You think a lot about. Personal systems, work systems, things that help you get more done or think differently about the world. And I think people like you who have that kind of obsessive mind with systems is something I recognize in myself. And also, I think are people who have a lot

• 2:28Dan Shipper?

  of interesting things to say about this new AI ways, because I think it's sort of like steroids or catnip or whatever, whatever you want to say.

• 2:37Speaker 00

  Some kind of accelerant, for sure.

• 2:38Dan Shipper?

  Yeah. For people, for people like us, I'm excited to chat with you and excited to hear both what you're thinking about now, what you're building, and what kinds of systems you're putting around with personally.

• 2:50Speaker 00

  Yeah, cool.

• 2:51Dan Shipper?

  So why don't we start with common tools? Because I think there's something interesting about your, like, what you're building, because I think it speaks to the perspective you have probably about this larger AI wave. Tell us about it.

• 3:03Speaker 00

  Yeah, the way I think about it, and it's hard to describe, because we're trying to build a new kind of thing that's only possible in the world of AI. So when I describe it, people will say, oh, you're being coy. It's like, no, I'm telling you what I'm building. It's just a new kind of thing. It's hard to grab on to. I think of it like a coactive fabric for your digital life. And by coactive, that's an old word that I hadn't heard before, but I think is a perfect fit for it of you are active in the system, and so is this emergent intelligent process, your private intelligence powered by LLMs. And those can be coactive on the same substrate in adding detail, or adding the little bits of software, or connecting up things. And I think that that really unpacks or unlocks the power of LLMs.

• 3:44Dan Shipper?

  That's, I love that word. And it's interesting, because I think we're finding some similar for some of the products we're incorporating internally. It's like, right now, the paradigm is you send something to ChatGPT and it sends something back. Maybe now it sends something back after 10 minutes, which is a new thing. But it's not, like, you're not working in parallel. It's not like working in the background and then being like, I had this idea. And we're starting to like, as we build our own sort of agentic systems inside of every for your email, or for writing, or whatever, we're finding that having something that's working while you work with you and being a little bit more proactive is actually really interesting.

• 4:23Speaker 00

  Next paradigm. Yeah. To me, I mean, if you, if you say, okay, we have L L Ms. What's the first product? In 10 seconds, you go chatbots. It's the most obvious extension. And everybody is focusing only on chatbot. Like, will chatbots be important? Yes, but chatbots to me feel like a feature, not a paradigm. And they are, um, so like they're, they're like this coactive surface, but it's just append only. I append a message, it append a message. I append a message, it append a message. And literally back and forth. It doesn't have a way to like have multiple for me in a row. And, you know, chatbots are amazing for starting any task because there's no structure. You just say whatever you're thinking and it helps us still and respond. But for long-lived tasks, you need structure. You want there to be something where you can glance over and, you know, a little cubby hole where you put certain information.

• 5:08Speaker 00

  I find I have, you know, I do dozens and dozens and dozens of chats with Chat G P T and Claude a day. And I'm just swimming in all that context and all the, all the chats. Uh, and so I'm using it to do important things. And also I'm just completely lost in it because it's only this chatbot kind of append only kind of paradigm.

• 5:27Dan Shipper?

  You have this really cool thing called bits and bobs, which is this like real time Google Doc that you just have been updating for, I think, like many years at this point, uh, with things that you're thinking about, um, which we'll link to in the show notes. And I love, I think it's, I think it's really cool and really inspiring, just sort of the rawness of that.

• 5:46Dan Shipper?

  And one of the things that's in that Google Doc right now about what you're thinking about is the, this idea of intentional tech, which, um, a dovetail is really nicely with something that I've been thinking about, which is, um, this idea that A I has this, is this new era of technology where technology can understand our stated preference, uh, stated preferences, which is different from the social media era, which, which worked totally just on.

• 6:07Speaker 00

  What you dwelled on.

• 6:09Dan Shipper?

  Yeah. What, what do you clicked on, whatever? And so social media tends to make us, um, tends to serve us things that are like, like more outrage driven or more like sexier or whatever, anything that catches your eye. Yeah. Like the car crash effect, basically. Um, and, um, A I, because it can talk to us, gets a much richer, um, understanding of who we are. Maybe, um, like I think Chat G P T is much more helpful and much more, um, Enlightening, for example, than like the Facebook algorithm is just by default. So I'm, I think that dovetails a lot with what you've been thinking about with intentional tech. So tell us, tell us what's on your mind about it.

• 6:46Speaker 00

  Yeah, intentional tech, I think, is really critical in this new era. We're, we're at a crossroads as a technology industry. I think we have this new technology, L L Ms, that I think are as transformative as the printing press, electricity in the internet. So it's this big general purpose unlock for all kinds of stuff that wasn't possible for. And we have a choice. We can go down the path that we've been going down, which is engagement maximizing, hyper aggregation, you know, going after what you want, not what you want to want as a user, or being aligned with our intentions. And that could lead to a new era of human flourishing, I think. This is not the default path, by the way. We will have to choose it. We'll have to work to build that. And that's why I think intentional tech is so important because we want technology that aligns with our intentions, not necessarily what I, you know, what I want.

• 7:30Speaker 00

  And my revealed preference of like looking at the car crashes or whatever, but what I intend to do, I intend to spend quality time with my family. I intend to experience new things. I intend to read interesting takes that disagree, that give me disconfirming evidence, that challenge my worldviews. Those are some of the things I intend. That's what I find meaningful to do. And it's very easy to fall out of that. But L L Ms, I think, with the right product fabric, could enable that. And another important part of this is it aligns with your intentions as in it is working for me. It's an extension of me. I heard a word last week I love of exocortex. It's like an extent, your continent of exoskeleton. But that has to be fully aligned with you. Imagine if that context, all of that rich substrate of meaning that you've distilled

• 8:12Speaker 00

  and written down, that's all about, you know, the things you care about and all these facts about you. If it's not working for you, that's terrifying.

• 8:19Dan Shipper?

  Yeah.

• 8:20Speaker 00

  Like I saw someone a few weeks ago at one of the big tech companies said, we're making our tool personal, proactive, powerful. It's like, well, let me stop you right there because the very first word, personal, doesn't actually align because you are a massive corporation that's trying to sell me ads. And if you're maintaining a dossier on me, and then that dossier is leading to a powerful and proactive thing, that's terrifying. Whereas if it's working just for me, of the extension of my direct agency, that's really empowering. And I think that's one of the reasons intentional tech is so important at this era.

• 8:51Dan Shipper?

  That's really interesting. And tell me more about like, because you know, when I think about this, one of the, one of the words that comes up, you're talking about alignment, is that AI started, or this generation of AI started with alignment, or alignment with human preferences at its core, because we were all afraid that AI was going to kill us. And now it's like, well, it might not kill us, but maybe it'll just serve us ads that, that will make us dumber, spend our money in ways that we shouldn't, or whatever. So I'm kind of curious what you think has to happen to make, make us go on this sort of more intentional path.

• 9:29Speaker 00

  To me, it's alignment, I think it's funny, like, yeah, we use it for the underlying LLM model. Like, I think there's two layers. There's the model itself, which is, if you imagine this as a stateless thing that you send a query to and it gives you back a response, it doesn't store any state, then there, you have alignment problems of like, what kind of biases are baked into it and what have you. But then there's a layer on top, which is your context. And that is the thing that is a malleable bit of information about you that changes, it has lots of rich meaning on it. These are two separate layers, I think. And so I am more interested in this layer at the top, and assuming, if you have multiple LLMs that you can choose and swap between, that don't remember anything about you, then it's fine. You can swap between different ones and that matters less to me. Where context is, the place that's all aggregated is, I think, more important.

• 10:14Dan Shipper?

  Well, that's an interesting architectural question. Like, right now, language models are stateless. Do you think like, in five years, for example, there's still going to be these sort of stateless intelligence boxes? Or do you think they're going to be auto-updating their weights, for example, as you talk to them?

• 10:29Speaker 00

  I don't know about auto-updating their weights. And this might be, there's an architectural breakthrough, but this is one of the things that's weird about these models, is that they do take a long time to bake. So like, they have this weird paste layer down at the bottom, that's like, months behind on training data, and it just takes time for it to bake. And then you have these like, you know, layers on top that the system prompts now, like in ChatGPT, will inject little bits of your context. A weird bit that, by the way, you cannot inspect, which is kind of funky, right? Like, if you ask it, "Hey, what do you, what context about me did you put in there?" It's like, "I can't tell you." Like, that's creepy, right? Like, "I can't do that, Dave," you know? And Simon Willison, we were chatting last week, and, you know, he's got some prompt that will extract out this dossier about you. It includes things about stuff you said in the past.

• 11:10Speaker 00

  It could include things like, "You're insecure about your weight," you know, these things about you. And then it also says, "In the last..." In the last, you know, five weeks, nine percent of your interactions with the chatbot have been bad, as in you've been trying to manipulate it or whatever. Like, I don't know, it's weird seeing this view into this of yourself. So I think ChatGPT and others are very clearly trying to move, merge these together so that you have all your context in ChatGPT and it's hard to leave. That I think gets more problematic, especially if you're going down an engagement maximizing kind of playbook, which, I mean, a bunch of, you know, the, the executives from Facebook now run three of the four big chatbots, you

• 11:51Speaker 00

  know. I think go back a step to meaningful computing has four major components to me. One is it's human centered, not corporation centered. It's centered around me and my intentions. Two is it is private by design. That means that the data is only for me to see, it's for me to bring where I want to bring and to choose who gets to see it, using techniques like confidential computing to make sure it is entirely private. It has to be pro-social. It has to be something that helps you live a life integrated with society, not just being this hyper individualized kind of, you know, little island to yourself, but integrate with society in a meaningful way. And the last piece, which I'm gonna remember off

• 12:32Speaker 00

  the top of my head, is it also is open-ended. It has to be something that allows you to explore and to build and to create new experiences within it. The way that our tech, our software works today is only the entity that created the software is allowed to decide what kinds of things you can do in the software. And that's due to the security model of how, of how all of our software has worked for the last 30 years. But that kind of closed-endedness means that like you had to convince some PM somewhere to have prioritized your feature, which if it's particularly niche, probably hasn't been, probably hasn't happened.

• 13:04Dan Shipper?

  Okay, well, there's, there's a lot of things to set that out. I would love, I would love to dig into it, dig into all those points. But the, the big one that stands out to me is

• 13:16Dan Shipper?

  Right now, we live in a world where in order to get this great new technology that's advancing at this really rapid pace, we have to get it from well-funded startups that have a profit motive. And I know OpenAI is a nonprofit, but like, you know, whatever.

• 13:32Speaker 00

  I think that's what they say too. Yeah, whatever.

• 13:36Dan Shipper?

  Clearly, they're being run like a startup. And I guess for me, like, I don't think that's a bad thing. But it sounds like at least one way to read what you're saying is

• 13:49Dan Shipper?

  we have to get rid of the sort of like corporate startup structure for these technologies to be

• 13:55Speaker 00

  Not necessarily.

• 13:56Dan Shipper?

  social way. Like, how do you envision this being made, us being able to make these decisions? In terms of what kinds of corporate structures or startups or nonprofits or whatever are controlling and building these things to get the outcome that you're talking about?

• 14:09Speaker 00

  I think it is compatible with being a business. So for example, we're treated as a public benefit corporation. The, to me, it is what's most important is that users are paying for their, like, it's not free. If you aren't paying for your compute and it's not working for you, it's working for somebody else. That just so happens to think that giving it to you is a benefit. Now, it doesn't mean that's a necessary but not sufficient characteristic, because I think ChatGPT's, the playbook that they're executing is one that is about engagement maximizing and making you stickier to the service and what have you. But you paying for your own compute is a necessary component of it to make sure that it's actually truly just working for you. That's where also that privacy really matters of your data is visible only to you with your keys. This does not necessarily mean, by the way, people have historically in the past said, oh, that means

• 14:54Speaker 00

  it has to be local first. I love the local first movement. I'm very aligned with its ideals and ethos. Local first is really hard for a couple of reasons. One, architecturally, it's very challenging to have a bunch of peers that have to have a vegetable consistency. You don't know when they're going to sync back up. It's very hard to build consumer product experiences that work the way that people expect. And two is it's inconvenient. If you got to run your local server and your laptop isn't plugged into this, into the network, when you're on your phone or whatever, the thing doesn't work. So actually, there are other architectures that can use things like confidential compute to run in the cloud in a way that is Can be remotely attested to be totally private to you and that nobody else can see into that data. And so those are some of the architectures that allow a full alignment with a human's.

• 15:35Dan Shipper?

  Okay, so basically, you're saying ChatGPT is ChatGPT is doing some of this. So they're they're starting with a subscription model. But there are things that they're doing. What are they doing that you think is like aimed at maximizing engagement? I definitely understand the kind of like memory thing. I want to keep using ChatGPT because it remembers who I am. Like, I love that part of it. What are the things that they're doing, the decisions that you're that they're making that tell you that they're they're kind of going down this engagement maximizing path that will lead to a bad place?

• 16:07Speaker 00

  I think it's the engagement maximizing path is just the default path. So I don't think, by the way, there's anything particularly they're like, oh, here's a dastardly player. This is how you do tech now, right? You're like, in the last 10 years, we just realized that aggregators are a really powerful business.

• 16:19Dan Shipper?

  Yeah.

• 16:20Speaker 00

  And they want to consume all of the demand so that then all the supply comes to them. And that's a great business. I mean, if I were sitting at their seat, I can totally see why they would do it. Like, that's, again, it's not a nefarious play. It's just the default thing that you would do.

• 16:31Dan Shipper?

  Yeah.

• 16:31Speaker 00

  I think if AI is this incredibly important technology that also knows all the intimate details of your life, that becomes especially important for it to be in an architecture that is not something that you're something that this other company can look at and maintain a dossier about you. Because that it's just too easy to manipulate, right? Like, LLMs can can translate anything from anything. And that means it can also translate just for you to figure out exactly how to land a particular message for you, which means it's imperative that you know it's aligned with your intentions. And it's not going to try to like, get you to do the, you know, the mondo subscription, or to go to one of the partners, or what have you.

• 17:10Dan Shipper?

  Well, let's say you're you're Sam Altman right now. And you're in charge, you're in charge of OpenAI. What would be, what are the decisions that you would make tomorrow that would?

• 17:21Dan Shipper?

  Put you on a path that you think is actually right.

• 17:24Speaker 00

  So if I were Sam Altman, I would do what they're doing, honestly. And as in, I can see why it's a great business. I think will add a lot of value. That's why I see this as a complementary approach to some degree. Of making a system that is this coactive system that's just working for you, that is not just chat. It can be a complementary thing to these other systems. I wouldn't say, oh, you should change what you're doing, Sam Altman, because I think actually what they're doing is a reasonable thing. This model that they're, these models that they're creating, especially because they're available via the API with no memory stored to them. That's an important characteristic, is great. And it makes a really powerful, underlying

• 18:01Speaker 00

  engine that can be used to power lots of other products, especially to the extent that there's multiple that we can swap between and don't get stuck.

• 18:07Dan Shipper?

  Got it. So you think that there's a call for a complementary technology, technology provider, set of technology providers that allow you to take all of the context that you have, keep it private, and then bring it to any situation or service that you want.

• 18:23Speaker 00

  Yeah, and I would say the, my mental model is, ChatGPT is kind of the AOL of this era. So if you use the parallel of the internet and the web. AOL was an extremely important company. They're the ones that brought everybody online, America, the whole of America online has amazing experience. It was somewhat of a walled garden, but it also gave you access to the, to the open-endedness of the open web. And I think that's the kind of role that I see them playing. I hope that what we get out of this is not some closed ecosystem of like hyper aggregation beyond even what we've seen to date. But instead, we see this open ecosystem of things that are very user-aligned.

• 19:03Dan Shipper?

  Interesting. Why AOL versus like Microsoft, for example? So Microsoft, I think in a similar way, not for the internet era, but for the PC era, like taught people how to use computers and brought computers like as a thing to most of, most of America and the world. And built a platform that everyone else is sort of building on top of. So that's another kind of analogy. Why do you think AOL is more appropriate?

• 19:27Speaker 00

  I think AOL, the analogy. That attracts to me best for L L Ms is the internet like L L Ms are the internet. They're a new kind of thing that you can do. AOL at the beginning, when I first started using it like second grade or whatever, it was about chat rooms. And you could do the whatever the keywords or whatever, yeah, A S L like, I mean, and that was what I thought the the internet was. And then it turns out, as I learned later, I was like, wow, this is a whole crazy open ecosystem that no one controls with all kinds of weird happening. And that was that open system of the web. And so in the same way, I see them as distributing this new technology to people showing, yeah, look, chatbots, you can do these cool things with chatbots. And then later you realize, oh, wait a second, the same thing that animates chatbots could be used to animate all kinds of new experiences. I didn't realize what possible for.

• 20:12Speaker 00

  And that's one of the reasons I think that them as AOL versus.

• 20:15Dan Shipper?

  Why did AOL die? Like, I don't remember.

• 20:18Speaker 00

  I think at a certain point, the the open endedness of the web could have took over. And it just became the point of like, like, I think a lot about systems, as you pointed out. I think open ended systems tend to win under certain conditions, especially in the growth era. Like, at the very beginning, there's some vertically integrated thing that kicks off a new revolution. People, oh, it packages up really nicely and people get it. And as time goes on, it gets the sort of commoditorial possibility gets too big for any one entity to successfully execute. And so the open system, if there's any way for it to escape out in the silent, it was with the web. Sorry, I use talk with my hands, as you can see.

• 20:56Speaker 00

  The if there's any way for it to sort of escape out the side like there is with the web or or using A P I s to access L L Ms. Then the open system kind of takes off in this commoditorial swarm and it overwhelms the closed system. That's also potentially just a hopeful thing. I hope we typically see oscillation between open systems and closed systems. We've been in closed systems dominant for like the last 10 years, and I think it's a bummer. Like, I think we're kind of in this, we're in this amazing age of technology, and it's also kind of the dark ages of tech. Because we're all this hyper aggregated thing where the only features that can exist are the ones that aggregators. And for consumers, the ones that aggregators have decided to prioritize. And that's a bummer because the as a company gets larger and larger and larger, the.

• 21:40Speaker 00

  Or what Clasurki would call the closer for the smallest feature that it makes sense for them to even consider prioritizing goes up and up and up and up and up. So if you're at Google, if I'm trying to pitch a product to other teams that and they say, how many net new active, net new one day actives you think this product will get? I'll say, I don't know, 50,000. And I go 50,000. I wouldn't do this for 50 million.

• 22:00Dan Shipper?

  Yeah.

• 22:00Speaker 00

  You know, so like, there's this whole class of features that just can't exist in a world, the world that we're currently in, that's hyper aggregated.

• 22:07Dan Shipper?

  It seems like one big difference between the web, the early stages of the internet, which to be honest, I don't know the history like that well off the top of my head. And, and language models is the web was like, you have, I mean, it was sort of government run at first. You have this like international consortium that kind of just defines the standards for how the web works and all that kind of stuff. That doesn't seem to be the case here. So.

• 22:29Speaker 00

  I don't think, actually, I think we are waiting for the web of AI to show up.

• 22:33Dan Shipper?

  Interesting.

• 22:34Speaker 00

  And that's partially what we're trying to help catalyze. And that's, I think that that's what I mean by like, we have the internet and we're like, cool, internet's definitely going to be useful. Like, if you look back at Al Gore's proposals for the air information superhighway. It was actually very prescient in a lot of ways. It's just, it was all about pipelining existing content and business models into people's homes. And some of that definitely happens. You get things like Netflix or whatever. But a lot of like YouTube, social networks, none of that was envisioned by the, or the, you know, Wikipedia, none of that was envisioned back then. Because we just didn't know how to imagine it. It wasn't even the thing that we thought was possible. And then the web creates this open system of lots of different people trying out different things and seeing what things work.

• 23:16Speaker 00

  Found some of these interesting new pockets of value that grew into whole continents of value.

• 23:21Dan Shipper?

  So how do you, how do you make that though? Like, do you have to, is it, do you have to get governments involved? Do you have to, is it like blockchain where everyone's like sort of running around?

• 23:30Speaker 00

  That's what it sounds like to me. I think you can, you can build, we have so many powerful substrates. The web exists as a distribution platform. Everyone's, everyone's device speaks the web. And so you can use as a way to distribute a whole new kind of experience that fits within this. So I don't think back in for the internet, you needed a consortium, you needed. Tons of capital expenditure to build the pipes. And that was government grants. It was also businesses that way overbuilt all this capacity. Those businesses, by the way, were great for society. We got all this excess bandwidth, the capacity, kind of crappy businesses, though, right? Because you build a pipe somewhere. If someone builds another one right next to you, you lose all pricing power. You are just a total commodity. But it's a commodity that powers the rest of this innovation on top.

• 24:14Speaker 00

  I kind of see large language models, the producers of them, as people laying the pipes. They're the ones making, doing this extremely capital intensive creation. But there's actually not particularly that much of an edge across them, which is great for society. Because that means you can take LLMs as a commodity. You can assume that they exist and reasonably high quality ones, including quite good open source ones. And that means that all kinds of interesting business dynamics take off and you can kind of take it for granted and build what's up here now that I can take high quality LLMs for granted.

• 24:44Dan Shipper?

  Yeah, it does strike me that the thing you're talking about, which is the bar for like a Google PM to build a feature is like, we need 50 million users. And so you sort of, you sort of look past the like 50,000 user use case, which A, those are just valuable in themselves and B, often they're the ones that end up being the 50 million user use case.

• 25:03Speaker 00

  Some subset of them will become that.

• 25:04Dan Shipper?

  It's like the sort of innovator's dilemma type stuff.

• 25:06Speaker 00

  Yeah.

• 25:07Dan Shipper?

  It sort of strikes me that in a world where language models are commodities, capitalism just does that automatically because small startups will just like do the 50,000 user use case and just, and just build it. So is this just going to happen?

• 25:20Speaker 00

  So here's what it might, and I agree that like this kind of, I'm so glad, there's so many different ways that the society could have gone. OpenAI could have had ChatGPT before they released the API.

• 25:31Dan Shipper?

  Yeah.

• 25:32Speaker 00

  That would have been such a different world.

• 25:33Dan Shipper?

  Been very different.

• 25:34Speaker 00

  Because now everyone assumes they have to compete with an open access API. And now it would be very hard to close that door, thank God.

• 25:39Dan Shipper?

  Yeah.

• 25:40Speaker 00

  So we can take it for granted for the rest of us. So like, I just, I like woke up with a, like last night with a nightmare that like it had gone the other way. So I'm very glad that happened.

• 25:47Dan Shipper?

  IBM developed AI.

• 25:48Speaker 00

  Yeah.

• 25:50Dan Shipper?

  How terrible would it be? $30 million a year for like one query.

• 25:52Speaker 00

  Yeah, exactly. So that's great. Here's the, the thing, though, that means that the current laws of physics, the current security model. That we use for the web and apps actually limits this possibility. And this security model is called the same origin paradigm. The only people who know about it, really, even web developers don't really know.

• 26:08Dan Shipper?

  I have no idea what you're talking about. What is that?

• 26:09Speaker 00

  Same origin paradigm is the laws of physics of how the web works. And what it says is it's the security and privacy model that we've used for since for 30 years. It kind of actually grew up as an accident, actually. And at the very beginning, the web has no state. And so you reach out to a server, it gives you back the same thing that anybody would have gotten if they gave that exact same request. Well, then you add cookies and then you need to say, when do I send, where do I send cookies to once they've been set? Which other URLs do they go to? And then the easiest thing is, okay, there's a notion of a site, which is roughly a domain.

• 26:40Dan Shipper?

  I see.

• 26:41Speaker 00

  And so it will send things back and isolate them by that. So cookies will come back between these, but not go over there. And then you add JavaScript and you allow things like local storage and local state. Where is that? Who can see that local state? The same people that can see this. And so now it grows up as this origin, as this origin boundary. So this somewhat happenstance thing turns out to be at the core of our entire security model. What it assumes is each and every origin is its own isolated little island. It can't see data from any of the other origins, but can see all of the data that the user put into this origin intentionally or unintentionally.

• 27:11Dan Shipper?

  And origin is roughly like google.com.

• 27:13Speaker 00

  Yeah, it's roughly, roughly a domain. It's not exactly, it's like slightly different, but it's roughly, you can think of it as a domain.

• 27:18Dan Shipper?

  Yeah.

• 27:19Speaker 00

  And so what this means is data accumulates inside that origin as a little island. This is a very reasonable and good security model. It's one of the things that makes clicking a link or installing a new app safe because it knows nothing about you. So then if you choose to like it and to put more data into it, that's okay, but that's your prerogative. So it's great for trying out a new thing. The problem is putting new data into it, it can do whatever the hell it wants with that data. It can send it to evil.com or scary.com and you have no idea. You're implicitly trusting the creators of that, of that application. And so somewhat surprisingly, this leads to massive centralization. So if you have, so this, this model is about isolation, not integration. But our lives are integrated. And so if you want to move things across different origins, you have to be the orchestrator.

• 28:01Speaker 00

  You as the human have to keep track of the information you want to copy, paste or move between these different things. It's expensive and it's somewhat scary to put it into a new thing. And so imagine. Imagine that you have two use cases. One is some cool startup that says they're going to do this amazing new thing with your calendar and scheduling. And one is Google Calendar that says they have a similar kind of feature. Which one do you pick? Well, Google already has all your data. And this startup, you don't know if they're securing the data properly or what the business model is.

• 28:25Dan Shipper?

  Plus, you have to give it the data like step by step, like it doesn't.

• 28:29Speaker 00

  It doesn't know it to start. It's a cold start problem. And so this leads to ask you, I'll just do the one that already has it. So this is a phenomenon you might call data gravity. It tends to accumulate in the places that already exists. And they become massive and nobody else can get this data. And this is one of the drivers of aggregation. And again, once you aggregate to such a scale, your coasting floor goes up. And the set of features that they could even consider doing is only a small subset of what you could do with all of this data in practice. This all arises, somewhat surprisingly, from the security and privacy model that we've used.

• 29:00Dan Shipper?

  I love that. Okay. And so, and I think what you're saying is because we inherited that from the first generation of the web or second generation of the web or whatever, chatbots currently operate that way too.

• 29:10Speaker 00

  We don't even realize the apps all do this. Technically, legacy applications on desktop do not have this model because they can interact via the file system.

• 29:17Dan Shipper?

  Right.

• 29:19Speaker 00

  Apple has been retconning and jamming it into macOS for a number of years. Windows probably has too, I haven't taken attention. So like people, when we're building software and operating systems, we don't know another way to think. Like, how else would you possibly do it? Which is insane. So there's this, I call this the iron triangle of the same origin paradigm. There's three things, you can only have two. One, untrusted code. Two, sensitive data. Three, network access. You can only have two of the three to have a safe system.

• 29:45Dan Shipper?

  I don't understand.

• 29:46Speaker 00

  If you have untrusted code with sensitive data and network access, it comes in, it looks at your thing, it figures out your financial login and sends it to evil.

• 29:53Dan Shipper?

  So untrusted code is like, some developer wrote some app that I'm downloading that hasn't been, I don't look at or how's it? And what sense is it untrusted?

• 30:02Speaker 00

  Untrusted as in I haven't made a trust decision about it. So when you, when you put an app in the App Store, Apple looks at it and says, okay, based on the constructions of the sandbox, and also based on our review of this, this is fit, this is fine, and we'll allow people to install it.

• 30:15Dan Shipper?

  Okay, so untrusted code is first thing. What's the second thing?

• 30:17Speaker 00

  The second thing is sensitive data.

• 30:18Dan Shipper?

  Sensitive data, yeah, yeah.

• 30:20Speaker 00

  Identifying data, potentially precious data. And the third is network access. So the the web says you can get untrusted code, webpages, and you can get network access, but no sensitive data. You get only the thing exactly this. The app model says you get sensitive data, network access, but not untrusted code. It all has to go through the central location that, by the way, starts with a 30% tax.

• 30:39Dan Shipper?

  What about like Windows? Because Windows doesn't have an App Store. So what's the?

• 30:43Speaker 00

  So historically, the model, there wasn't one. And that's why installing software in those is a little bit more dangerous. Because without a model like this, it could do whatever it wants. And it has access to all that data, and you have to be more careful.

• 30:52Dan Shipper?

  But it still exist, like it still exists. It's still like a vibrant ecosystem. So it's possible to do without this triangle.

• 30:58Speaker 00

  And you could also change it. You could tweak it in other ways. And you could do clever things about using tools like information flow control and confidential computing to create a whole new sort of laws of physics, I think.

• 31:08Dan Shipper?

  OK, so.

• 31:09Speaker 00

  And if you did, then a whole, you could do things that hit all three. If you had all three, you could do wild, interesting things that would not be possible today.

• 31:16Dan Shipper?

  So is is the file system your number one? Like example of like a good alternative to a same origin paradigm?

• 31:24Speaker 00

  Yeah, so the file system allows fundamentally, multiple apps are all allowed to work on the same data, and they can coordinate via the file system.

• 31:31Dan Shipper?

  Right.

• 31:31Speaker 00

  And that allows you to do, to not get stuck. It's when you think about it, it's kind of insane that all of your data is locked up inside of an app. Like it can't leave the app. That's wild, actually, when you think about it.

• 31:42Dan Shipper?

  Well, it's interesting because the file system has a number of properties, unless you don't sell Dropbox or whatever, but like it's here. My file system is here as opposed to like it's everywhere. And I kind of have physical and just total control over what happens to it.

• 31:59Dan Shipper?

  Is that an important property of the system?

• 32:01Speaker 00

  It's you having physical control of it. That's why local first talks. So, oh, we're going to make it local first where you have control and you can make, bring the data across different things. Part of the challenge again with local first is it's inconvenient. We expect things to work across multiple devices, to work even when one device is off. We expect these things to be in sync across different things. And it's the local first architecture is quite difficult. This is one of the things that we are looking at. We call open to tested runtimes. The pattern is use confidential compute. So confidential compute is secure enclaves in the cloud. It allows. VMs to be run fully encrypted in memory. And which means that even someone with physical access to the machine like a Google SRE can't peek inside. Which is great. Then what you do is you have an open source runtime that is you can that you run that executes the code.

• 32:47Speaker 00

  And then the you could ask the compute cluster to do a remote attestation and to give it an attestation, a signed attestation by the underlying hardware manufacturer that says, this thing that you're talking to that just handed you this is running in confidential compute mode. And here is the SHA of the Git SHA of the VM that it booted with. And so it allows you remotely as a savvy user to verify, oh, it's running an unmodified version of that software. And that solves a big coordination problem because now lots of other people could all verify that it's running unmodified version of the software. And yes, fine, we will just use that central server as the place to coordinate. Because we can all see it can't do anything different than what it says it will do. And that's a really powerful coordination problem.

• 33:26Dan Shipper?

  Do users care about that? So because because one of the things that makes me think of is the a lot of these concerns feel similar to the flavor of concerns that like original blockchain crypto type people had and were solving for with with Bitcoin or, you know, any any kind of cryptocurrency. And then Coinbase came along and they were just like, we're just gonna, you know, put a general like sort of same origin paradigm type solution on top of that. And people actually love to use that. So is this?

• 34:00Speaker 00

  This is the I think if you go after users who care about this as a primary end, you end up with a very small audience of people and you end up with a mastodon.

• 34:07Dan Shipper?

  Yeah.

• 34:07Speaker 00

  For example, as in something that's like pure, but also kind of finicky to use and doesn't make that much sense.

• 34:12Dan Shipper?

  Yeah.

• 34:12Speaker 00

  And that's why I think you want a blue sky kind of approach. Blue sky, you can use as an end consumer and be like, the only thing I know about it is that, you know, it's not owned by, you know, that that guy. You know, and that's it. But then the closer you look, the more you realize, oh, this is actually very clever. This is an interesting way of like my key pairs and the way that personal data stores work. Most users will never have to know about that. But the more you learn, the more you're like, oh, okay. And so that I think is a what I would call like an inductively knowable system.

• 34:39Dan Shipper?

  Yeah.

• 34:39Speaker 00

  People go. So I was talking to somebody like, oh, nobody, nobody ever cares about the security model. They do actually care about the security model. They just don't know the words to express it. Nobody understands what the same origin paradigm is. Nobody, a very small portion of people. And yet, it is the laws of physics that make all the other stuff we do safe. It's the reason you don't have to care is because some also the people do care. And the general characteristic for me is when you're using a new system, you're like, oh, this seems creepy or too powerful. And you go talk to your more tech savvy friend and you say, hey, Sarah, do you trust this kind of thing? And she says, yes, I do. And the reason I trust it is because, and she knows he's read a blog post in Hacker News that was someone who wrote, read a thing, someone who audited the code. And that inductive chain can go all the way back down to the fundamentals.

• 35:19Dan Shipper?

  This episode is brought to you by Atio, the AI native CRM built for the next era of companies. With Atio, setup takes minutes. Connect your email and calendar and it instantly builds a CRM that mirrors your business with every contact enriched and organized from the start. From there, Atio's AI goes to work. It gives you real time intelligence during calls. It prospects leads with research agents and it automates your team's most complex workflows. Industry leaders like Union Square Ventures, Flatfile and Modal are already building the future of customer relationships on Atio. Go to attio.com/evry and get 15% off your first year. That's A-T-T-I-O dot com slash every. And now, back to the show. That makes total sense. I totally agree with all of that.

• 36:04Dan Shipper?

  I think the thing on my mind is the first people that are going to adopt this probably are the people that do care about the security of it. Right? And are those people the right people to kind of seed the community that that ends up blossoming into this thing? Cause those, that kind of person is going to say a lot about like the, the total trajectory of this kind of product.

• 36:27Speaker 00

  So I actually, I don't necessarily agree that it will be those people, the privacy heads that are adopting it earlier. I think of it more as like the high volition users, just the tinkerers, the people who are the early adopters. Some of them will have a higher proportion of caring about this kind of thing, but a lot of them won't. Like there's a ton of startups that they, they say step, you install the apps, it's step one, sync your Gmail inbox and people go, okay.

• 36:46Dan Shipper?

  I, I run a startup like that.

• 36:48Speaker 00

  Exactly. Because it's, most people don't really care, especially early adopters.

• 36:51Dan Shipper?

  Yeah.

• 36:52Speaker 00

  I think what we're describing is a system that if it, if you can break this iron triangle and then you get these, all these crazy emergent phenomena that aren't possible in other software. People use it because of that. And the reason it's not creepy is because of an underlying security or privacy model.

• 37:05Dan Shipper?

  Do you have a name for the alternative to the same origin paradigm?

• 37:08Speaker 00

  I call it contextual flow control.

• 37:10Dan Shipper?

  Contextual flow control. Tell me what that means.

• 37:13Speaker 00

  The, I don't want to go into too much depth at this point. It's still very fuzzy. Helen Nissenbaum is a professor, I believe, at Cornell, a legal studies professor, and she talks about contextual integrity. Contextual integrity is the gold standard of what people mean when they say privacy. So when people say, when lawyers talk about privacy, they think about consents. Did the user sign a consent that said we can do this? That's it. As long as they signed the ULA, it's fine. Technologists talk about end-to-end encryption. As long as it's end-to-end encrypted, it is private. But what people mean intuitively is this contextual integrity, that the data is used in the context that you understand and aligned with your interests. It's not surprising how it is used and it's not going against what you want to happen. And that's like a sort of first principles, ground truth way of thinking about it.

• 37:56Speaker 00

  And then you combine that with things, other technologies that allows you to make formal claims about information flows in alignment with people.

• 38:02Dan Shipper?

  That's interesting. The reason I love the same origin paradigm thing is like you're going all the way back to this like one decision that like has all of these really interesting, positive and negative effects like later that are sort of unpredictable, which feels very, it's like a little bit Stephen Johnson or a little bit like, like one of those writers that's just like, here's this one thing about the way the history works that like just totally changed everything. Do you have any other things like that that you've noticed about technology? I don't want to put you on the spot, but I just feel like you probably have some, some sort of counterintuitive things in your time working at Stripe and Google and whatever, thinking about like mobile or

• 38:41Dan Shipper?

  you know, SaaS or whatever.

• 38:43Speaker 00

  I think a couple other like the world changed that day we didn't realize. One is the chat GPT coming out after the API was already available. Another one is, if I could go back in time, like I had a time machine, I would go to the stage, on 2007, the stage where Steve Jobs shows off the iPhone and run onto the stage with a poster that says, "This will become the most important computing device on earth." It is insane to allow a single company to decide what things you may run in it, right? Like it's insane. It's absolutely insane. And the only reason it's actually viable is because they decided very shrewdly at the very beginning to not allow a Other rendering engines in browsers on that device from the very beginning or and to make sure that all software had to go through the App Store.

• 39:25Speaker 00

  And that was a reasonable decision and that the first order implications are very reasonable. It means that you get as a user, the safe experience, you know, nothing's going to hurt you in it. The second order implications of that are wild. I guess it's insane to me that like the most important computing devices in our lives. A company who has demonstrated again and again that they are willing to use capricious kind of decision making about what things will distribute is the one that like that gatekeeper. That's insane to me.

• 39:49Dan Shipper?

  It seems kind of like a lot of what you're reacting to in in the Apple example and the same origin paradigm example is

• 39:59Dan Shipper?

  aggregation of power and and a few large big tech companies and the kind of second and third order negative effects of that on user experience and innovation and stuff like that.

• 40:10Speaker 00

  And competition.

• 40:11Dan Shipper?

  And yeah, competition. Yeah. So what are the?

• 40:15Dan Shipper?

  It seems like that's a reasonable place also for like regulation. What is your stance on regulation?

• 40:20Speaker 00

  And regulation also has all kinds of second and third order impacts, you know? And so have you ever met the Dan Almetto's thinking in systems? Yeah. So like the systems you got to dance with to some degree. You can't fully control them. You can tell that. And that's why I find some of these characteristics, when you find the right like technical leverage points, you can say, oh, actually that has a very different way that it evolves, I think is is preferable to a regulatory.

• 40:45Dan Shipper?

  What if I said like you could pass, you get your president for the day and you can and and and all of Congress and

• 40:53Speaker 00

  dictator for day.

• 40:54Dan Shipper?

  You're dictator for the day. Yeah. And you can pass one law. Do you like, what law would you pass? It's like a, you can, it's a one sentence law.

• 41:05Speaker 00

  I don't know. I don't have to, I don't, I've never thought through like, I'm so used to in open systems, which were all part of a large, complex adaptive system called society. And there's always like weird eddy currents of dynamics and what have you. So like, I take from the assumption that like, I never have a lever that is like this massive lever I can just simply pull. And so I don't even know.

• 41:24Dan Shipper?

  You're more like looking, you want to find the like grain of sand that you you put on the pile and it just all. Yeah.

• 41:29Speaker 00

  But it cascades if the pile is ready for it.

• 41:31Dan Shipper?

  Right.

• 41:31Speaker 00

  And that's one of the nice things about like systems thinking is like if you do the right like judo moves, the right thing and the system is ready for it, the world moves. If it's not, it doesn't move. And so that the like the system is deciding kind of through all these like micro interactions throughout it.

• 41:44Dan Shipper?

  Tell me more about that mindset and how you developed it. And what are the, what are some of the key moments in your life where that you've seen that happen?

• 41:53Speaker 00

  I, so I wrote my undergraduate thesis on the emergent power dynamics of Wikipedia's user community. And I have degrees in social studies with a minor in computer science. And I was just fascinated by this emergent phenomenon of how all these strangers work on this thing with no coordination. And yet you get this convergent, extremely important result out of it. That's insane. It's wild. And then when I went straight out of the Google, uh, out of college to Google, it actually was harder to get my, my first PM role because I didn't technically have a CS degree, even though I basically did. I was one credit shy of a dual major. And so I was like, man, what a mistake that was. Like I just didn't, you know, just threw it in the back of my mind like, whatever. Like if I could go back in time, I would have just would have majored in CS. And then I did my first year on search, the precursor to the knowledge graph. My second year in double click, I was in the eight PM program. And part of that is you mentor a lot of the people who come up after you.

• 42:36Speaker 00

  And I learned very early on, I loved mentoring people, helped me think through what I was dealing with and help people and get more patterns to go in a pattern matching library. And then I became the lead PM for Chrome's web platform team. And I think a lot of PMs are under the misunderstanding that they're in way more control of their users and their usage than they actually are. If you're at Google and you ship a feature and tomorrow 50 million people use it, you kind of get a little bit of a god complex.

• 42:58Dan Shipper?

  Yeah.

• 42:59Speaker 00

  If you're a platform PM, you tweak a thing which causes other developers to do something different, which causes users to be affected in a second order effect. You're aware of this indirection. If you're the lead PM for the web platform, which is a open system with multiple browser vendors who don't like each other very much and are constantly kicking each other under the table, you are under no illusion that you're in control. And my engineering counterpart, Dimitri Glazkov, who was the Uber TL for Blink, brilliant guy. And he was the one who got me into, introduced me to the word complexity, for example, and introduced me to the Santa Fe Institute. And so as I was going, I was realizing, oh, these things I'm naturally doing to try to make these good outcomes happen in this open ecosystem, like progressive web. Apps and these web standards and stuff. I'm intuitively applying some of these power dynamics and complex systems.

• 43:44Speaker 00

  And then I left Chrome, I went to go work on augmented reality. I created a little nerd club behind the scenes with a bunch of people that I just kind of selected that people who, when I said it was a nerd club, didn't go ew, like, you know, like, ah, that's fun. Great, come on in. And then it was very collaborative debate, very, you know, trickling in different perspectives. If I get a diversity of perspectives into the system, no particular goals it's exploring. After a while, we came up with a distilled like a thing of like, wait a second, this must be the strategy. Nothing else could work. This is a strategy that kind of makes sense of all the pieces. And that caught on a significant amount of momentum. And that's when I realized, oh, my gosh, I'm not a web developer ecosystem guy. I'm a systems guy and the same techniques I've been advising, I used and deployed in those contexts are the same techniques I used.

• 44:27Speaker 00

  I've been advising, you know, hundreds of PMs over the last decade to use to navigate Google. And the reason they work, the lenses I'm using, like game theory and power dynamics and evolutionary biology are things I learned in college. And it was this kind of like aha moment. And that's when I wrote the earlier version of the slide mold deck.

• 44:43Dan Shipper?

  Tell us, tell us about that.

• 44:45Speaker 00

  That Simon will deck was a kind of lightning in a bottle. It was, it's a, I think it's a 150 slide emoji flip book. And it's just about a fundamental characteristic of systems, organizations that as organizations get larger, they get much, much, much slower. And that's true, even if you assume everybody is actively good at what they do, actively hardworking and actively collaborative. It arises due to a exponential coordination cost blow up. It's fundamental, it's inescapable and it's the, the force that we all deal with constantly. And we don't even realize we're dealing with it. And so we, we get frustrated with ourselves, we get frustrated that Jeff over there, who if only he would do X, this whole thing would be easier. And we're just all fighting with this massive force, this like force of gravity that's completely invisible to us.

• 45:30Speaker 00

  And so that deck caught on, I did another version, similar kind of thing externally. And that also got a surprising amount of momentum. I've had people describe it to me as like life changing. I'm like, I'm just talking about like some emoji, emoji is talking about game theory. But it was, I think it really tapped into something that people experience that they're frustrated by. And they don't, I just, it's like a big hug that says, you are not crazy. This is really hard and it's fundamentally hard.

• 45:53Dan Shipper?

  So I think like every, every nerd that has like, is, is a systems person like me, like you, like we all go through like a complex systems, like, oh. Thing for people who are not have not done that yet or haven't done it in a while. Like, what are the three or four? Give me like a quick rundown of like the key ideas that that get you about complex systems that you think are applicable.

• 46:15Speaker 00

  I think everything we we tend to look at individual decisions as the primary lens. I see it as a secondary lens. I look at the emergent characteristics of the system. What would each person do inductively? And how does that? How do those decisions? How are they interdependent? So I try to look at like, what's the simplest inductive case? And then how would that play out if everybody were doing a similar?

• 46:35Dan Shipper?

  Give me a concrete example of that.

• 46:38Speaker 00

  So like, there's a dynamic that I would call like a gravity well dynamic that shows up in a lot of compounding loops. And it's generally shows up when there's a thing I would call a boundary gradient. So people who are using the system on one side, people who are not using on the other side, even at the beginning, even if lots of people are have incentives away from using the system, I don't want to use that thing. That seems dumb. The people on the boundary who are right at the edge of possibly using it, do they want to be in or do they want to be out? A great example is Facebook back in the early days. Starts off with Harvard and then, you know, now it extends to Ivy League. Do they want to be in with Harvard? Do they want to be in with all the other schools? I'd rather be with Harvard. It now extends to the other schools and at each point, each group of people would rather be in. And if there's a compounding, if there's some kind of network effect inside, then this strength gets more and more powerful as you go.

• 47:22Speaker 00

  And it can become this thing that can pull in even as time goes on, the incentives pull in for everybody and everybody will pull into this overall thing with sufficient time.

• 47:30Dan Shipper?

  So if Facebook was started at like the City College of New York, are you saying like it probably wouldn't?

• 47:35Speaker 00

  Potentially. I mean, that was one of the dynamics that made it like this juggernaut, I think.

• 47:40Dan Shipper?

  That's fascinating. Who are the so so Donella Meadows is someone I've read thinking systems is really good. What are the other like, you know, Santa Fe type people that are that have inspired you that you've you've read or think think about a lot?

• 47:54Speaker 00

  One of my favorites is The Origin of Wealth by Eric Beinhocker. Fascinating book.

• 47:58Dan Shipper?

  I haven't read it.

• 47:59Speaker 00

  It's really good. It talks about these organization, why these organizational things emerge and these it views business as as an evolutionary process of like exploring a fitness landscape.

• 48:11Speaker 00

  Which I think is like the correct, like a very useful lens of seeing it. Cesar Hidalgo, who wrote Why Why Information Grows, he and Eric used to work on some stuff together, also talks about why fundamentally know-how and its diffusion in societies. Know-how is, the way we actually do stuff is know-how, not knowledge.

• 48:30Dan Shipper?

  Yeah.

• 48:30Speaker 00

  Know-how is rich, it's non, it's a difficult to distinguish, to communicate, it's in our brains.

• 48:37Dan Shipper?

  It's what LLMs know.

• 48:38Speaker 00

  Exactly.

• 48:38Dan Shipper?

  Yeah.

• 48:38Speaker 00

  And so they have absorbed this kind of like squishy system two style awareness. You can think of every time we're trying to communicate, we do this conscious process to distill this squishy, rich nuance into a little tiny packet of information, still seed of a thought. And I shoot it through a little pea shooter into like this, into your brain. And I hope it lands in fertile soil that will grow into a thought flower.

• 48:59Dan Shipper?

  Yeah.

• 49:00Speaker 00

  But extraordinarily lossy process and expensive process.

• 49:04Dan Shipper?

  I agree, and I think we've also confused that pea shooter, that the thing we can just distill into a pea shooter, with the only thing that's important, when there's so much other stuff that's like, you can't really say, but you know.

• 49:16Speaker 00

  Yeah.

• 49:17Dan Shipper?

  Yeah, like the thing that is making me think of is something like a path I've been going down intellectually is this idea that language models are the first tool that makes those,

• 49:30Dan Shipper?

  makes that kind of tacit knowledge or know-how transferable between people.

• 49:35Speaker 00

  Yeah.

• 49:36Dan Shipper?

  We used to have to, we used to require explanations. So like math or like logic or rational arguments to like transfer know-how in this like very reduced form into someone else's brain. But now we can like just move, move tacit knowledge between people because you can train a model with a bunch of examples and you can be like.

• 49:59Speaker 00

  You know, like even if you do things, if you cheat using an existing off the shelf model and you just pack it full of like, here's all my, if I read all the, the public writing you've done.

• 50:08Dan Shipper?

  Yeah.

• 50:08Speaker 00

  And you had all the public writing I have done, which I'm sure is, you know, just insane amounts for both of us. And we had a system that could find, sift through the embeddings.

• 50:16Dan Shipper?

  Yeah.

• 50:16Speaker 00

  Find the areas, the Goldilocks areas, the things, if we focus on stuff we definitely agree on, it's kind of boring. Other than like quickly building trust of like, oh, we think similarly.

• 50:24Dan Shipper?

  Yeah.

• 50:24Speaker 00

  We find stuff that we fundamentally disagree on. It's also fundamentally boring because it's just noise to each other. But we find the Goldilocks zone where it's just at the edge of the thing that we already thought.

• 50:33Dan Shipper?

  Yeah.

• 50:33Speaker 00

  You can have these fascinating conversations and you can do it with embeddings, just very straightforwardly. Again, you train a model per se. You can have the.

• 50:40Dan Shipper?

  That's really interesting.

• 50:41Speaker 00

  You can find these areas of overlap. And yeah, the models are really good. My friend, Thea Roberts, has this notion. She's a brilliant thinker. She's a professor in Australia. She teaches at Harvard. And she talks, she's one of the most interesting users of L L M's I've ever come across and.

• 50:56Dan Shipper?

  What's her name?

• 50:56Speaker 00

  And Thea Roberts. I just, she just started doing a blog a couple, a couple of weeks ago and I, at my insistence, because I thought she had so many interesting ideas. And she talks about liquid media. So like, think of a book as a fossilized piece of knowledge.

• 51:12Dan Shipper?

  Yeah.

• 51:12Speaker 00

  You have to assume a given audience at a certain time and you break it, you put it in time.

• 51:17Dan Shipper?

  Yeah.

• 51:17Speaker 00

  And then if it's not the right fit, like, oh, I don't understand these concepts that are prerequisites to understand this, or I'm not close enough in alignment to the belief of parties to like, stick to it.

• 51:25Dan Shipper?

  Yeah.

• 51:25Speaker 00

  And versus a piece of liquid media is something you can chat with. It can kind of be a choose your own adventure.

• 51:30Dan Shipper?

  Yeah.

• 51:31Speaker 00

  And that gives you a, allows it to sort of unfold for that particular person.

• 51:35Dan Shipper?

  Yeah.

• 51:36Speaker 00

  In a specific way as opposed to.

• 51:38Dan Shipper?

  It's.

• 51:38Speaker 00

  One way.

• 51:38Dan Shipper?

  It's funny because in a lot of ways, we're getting back to like Plato and Socrates's problem with writing is they were like, well, you can't talk to it. So it's, it's only sort of a shadow of what that person thinks and they can't argue back with you.

• 51:55Speaker 00

  Yeah.

• 51:56Dan Shipper?

  And, and that's why those, those, you know, foundational books of, of the Western canon are written as dialogues.

• 52:02Speaker 00

  Yeah.

• 52:03Dan Shipper?

  And, yeah, I mean, for me, like, I read so many old books, like classics that are either written in English or were not written in English. And if you read it with chat G P T or Claude or whatever, you can get so much out of it. And I just think that there's a new format of. Reading that takes a classic book and helps you get into it in a way that would not ordinarily be possible, that I think could be so cool and valuable.

• 52:29Speaker 00

  Yeah, and we are, I know it feels like in this industry that we're like halfway through the LLM era. We were in the very first inning.

• 52:36Dan Shipper?

  It's very early.

• 52:37Speaker 00

  We're like rubbing sticks together. We still think that chatbots are the main thing, like, and there's so many uses of this kind of stuff. Like, if you have, I think of LLMs kind of like as a mass, intelligence as a mass noun. So mass nouns are like water or rice, you know, you don't talk, like, you're talking about the whole as opposed to the individuals.

• 52:53Dan Shipper?

  Yeah.

• 52:54Speaker 00

  And I think that LLMs are kind of like this mass noun of intelligence. You can just pour this intelligence into all kinds of stuff and have it imbue it with a kind of life and adaptivity. And we're just starting, we're just starting to understand what you can do with these things. I am so hopeful that these technologies will unlock a significant, you know, human flirt. Like, one of the things that Anthea, for example, was telling me is, in academia, one way you can handle LLMs, the fact that LLMs exist, is say, you know, make sure you cite your LLM sources with this weird, you know, format of exactly the conversation and a link to it. Another way is to say, I assume you're using LLMs, which means the quality of your output should be 10x higher than before.

• 53:30Dan Shipper?

  Yeah.

• 53:30Speaker 00

  It should be more nuanced, it should, you know, understand disconfirming arguments and address them, it should. And that's the kind of like, what can we do now as society, as individuals, that we can think through thoughts that we couldn't think before?

• 53:43Dan Shipper?

  Hmm.

• 53:44Speaker 00

  And I think that LLMs are, that's one of the reasons I think is, it's the same scale of impact as, you know, the printing press and electricity and the internet.

• 53:50Dan Shipper?

  I definitely agree.

• 53:51Speaker 00

  It's a fundamental unlock.

• 53:52Dan Shipper?

  Do you think that it changes this coordination problem you've been talking about? Because a lot of coordination is about trying to, trying to distill down your tacit knowledge and your tacit context into the pea shooter and then shooting it to someone else, and that scaling exponentially, right? I love the pea shooter.

• 54:08Speaker 00

  Yeah, I know, it's like, I'm sorry.

• 54:10Dan Shipper?

  Everyone's just shooting their pea shooters. But, you know, there's this whole theory about language models being better middle managers, for example, than actual middle managers, which is, I think, is the same kind of coordination problem thing. Do you think that language models might solve that coordination problem because they can transfer tacit knowledge much more quickly than?

• 54:30Speaker 00

  I think they will definitely change the dynamic.

• 54:33Dan Shipper?

  Hmm.

• 54:33Speaker 00

  I'm not sure how it will change. So, I know a lot of companies are trying to do this, because a lot of people, like, in Eric Bynker's book, The Wealth, Origin of Wealth, I think he uses the frame, I think he calls it... Physical technology or social technology? Like, having Slack, for example, is a social technology, I think. Maybe I get this backwards. But it changes the way that you can work. It changes the kinds of coordination that you can do within an organization. So LLMs must change the way that organizations work. I don't think we're going to know what that looks like for like five to 10 years. Because it's not going to change the existing companies. It's going to be the new ones that just grew up in a different way.

• 55:06Dan Shipper?

  Yeah.

• 55:06Speaker 00

  You also get these weird emergent meta games in organizations. And so the LLMs and that coordination thing change the meta game, but they don't make it go away. So like, if you had a system that could perfectly distill all your signals into an update that goes up to your manager, and then you're curating it, you're tweaking it. Because, okay, this one says it's a yellow state. Really, it's green because Sarah's already got, she's on a path to resolution. By the time this rolls up to the CEO, it's already going to be fixed. So it's actually better to say it's green. Some of this is good. Some of this also leads to these compounding green shifting problems that gets into, you know, turns into K-FAB throughout the organization. But the meta game shows up no matter what the kind of coordination technology is. So I think it just changes the game.

• 55:50Speaker 00

  And I imagine it will make it better. It will make it significantly better in some ways and significantly worse in others.

• 55:55Dan Shipper?

  Interesting. One other thing that you're making me think of in what you said about Anthea Roberts and the changing expectations of, oh, use LLMs for this. Like, it's got to be better. Is just, I think one of the things that people get so hung up about with language models is they're like, well, what makes us uniquely human? And are they just going to take over everything that we can do? And I think my typical response to that is that assumes a very static view of what humans are and what humans can do. And that one of the most interesting things about language models is that they will change in a lot of ways what humans can do. And in the same way that books change who we are and what we can do. And writing changes who we are.

• 56:39Speaker 00

  The internet did too.

• 56:40Dan Shipper?

  The internet does too, all that kind of stuff. And I think that's actually a really good thing. I'm curious if you had to think about how language models might change who we are or how we see ourselves. Where would you, where does that take you?

• 56:53Speaker 00

  Yeah, again, that's why I think we were at this crossroads. I think we have the potential for like this dawn of a new era of human flourishing because of our ability to become, think better and bigger in ways that collaborate and bridge between different communities that didn't understand each other before, but now you can understand, like, help me empathize with this person's perspective. Well, here's something that you probably, you know, so I imagine it can be amazingly powerful force. It also could be like infinite TV amusing ourselves to death. You know, imagine.

• 57:18Dan Shipper?

  David Foster wall is like infinite chest.

• 57:20Speaker 00

  Right, it just, it could be a thing that like, it could knows exactly how to give you the precise dopamine drip. Right, and so there's a world where humanity becomes extremely passive and becomes not very agentic and not learning or growing. And that is the default one that is also aligned with engagement maximizing business model. And, but I think that's why I'm excited. We had the potential to go in this direction.

• 57:41Dan Shipper?

  Well, what's interesting is like, it makes, you're making me think of this whole debacle that happened recently with ChatGPT getting too sycophantic.

• 57:50Speaker 00

  Yeah.

• 57:52Dan Shipper?

  And the, the way that that happened is they looked, they, they, they optimized too much for people's thumbs up and thumbs down responses, like immediate thumbs up and thumbs down responses.

• 58:05Speaker 00

  What they want, what they want to want.

• 58:06Dan Shipper?

  Exactly, and it just became this like, kind of, it just agrees with you on everything. But what's interesting is that users revolted, which did not happen with Facebook. Like, people were like, oh, it's just feeding me like car accidents, like I don't, I don't want that, right? And I think that there might be something about that where because language models hit that part of your brain where you're like, I'm having a relationship with this person, you have a, you have a set of filters for, I want their praise to be earned. I want them to feel like they can see me and they'll tell me if I'm doing something wrong or whatever. And so they may demand things from companies that they did not demand in the social media era that might make these companies less likely to do the thing that you're talking about.

• 58:50Speaker 00

  Potentially, I mean, I think when it goes to the point where it's egregious.

• 58:53Dan Shipper?

  Yeah.

• 58:53Speaker 00

  It's like, it's very obvious.

• 58:55Dan Shipper?

  Yeah, yeah.

• 58:55Speaker 00

  What I gotta say, one of the reasons I like Claude is because every time when I'm like bouncing ideas off of it, it always says, what an astute observation. And like, I don't want to want that, but that's what I want, right? And so I do think that we. It's it's hard to not give us exactly what we want in that moment. And like, you know, we aspire to want something that's different than that. That's, you know, disconfirming evidence. But you also get these weird things where the context mixes and mashes against different things. Before each chat was like a blank sheet of paper and you could choose what context to bring into it. And now it kind of mushes context from different things. Like I asked to say, what do you know about me? You know, make it snappy or whatever that first query was that they suggested when the new memory feature came out. And it says, well, you're Alex Kamarowski. You're really into systems thinking, emergent stuff. You have a startup called Common Tools.

• 59:39Speaker 00

  The starting salary at your startup is X. It's like, excuse me, what? Because, you know, six months before I had been like bouncing off like, okay, if I'm going to do a signing bonus like this, how should I change the?

• 59:48Dan Shipper?

  That's so funny.

• 59:49Speaker 00

  And like, it's like the, imagine if you're, if you're talking to like your therapist. Like people might use these things as like a therapist, like a trusted, I'm going to unload and tell you all these things I'm struggling with. And emotionally process these. And then later you're doing a thing that you're showing your boss about something. And it says, well, I'm going to use that that signal about you, you know, being insecure about Sarah and how she feels about you or whatever. It's like, what? That was a totally different context. And one of the reasons that wouldn't happen in real life, because your therapist doesn't, you know, doesn't ever come to the place, your place of work. And so having it all be one context in one place that has, it's all just kind of mushed together is like, oh.

• 1:00:21Dan Shipper?

  I think there's interesting, there's something interesting about one context, but also like, you know, people in your life that you share secrets with. They understand the context that they can share those in and can't, which I do think like ChatGPT to some extent will like knows. But I think there's something, there is something else interesting about, rather than like one mega brain. There's like lots of different brains that have like specific context about you. And that's, you know, bringing those personalities in, for example, I want them all in one group chat or whatever.

• 1:00:50Speaker 00

  Right, right. Yeah, exactly. Like that's why I say chatbots are a feature, not a paradigm. The thing is not, the central thing is not a chatbot, a single omniscient chatbot. You could imagine creating little, spinning up little chatbots all the time with different personalities. My like therapist bod and my, you know, boss bod or whatever. And see what they can talk. And in that situation, it'll be reasonable for them to, the therapist boss to say, well, I shouldn't say anything about. But like, I think chatbots are definitely an interaction pattern that will be here forever. I just don't think it's the main thing. Like, is that the central loop of information? Software rocks. Software gives you UIs that give you affordances to see things out, to structure information, to show you what kinds of things you can do with it, to make it so that you can skim them with your eyes very easily, you can file things away. Chat is just this big wall of text.

• 1:01:34Speaker 00

  And so it is just one modality. Also, the other problem that we have with chatbots is prompt injection. And I don't think anyone's talking about prompt injection enough, because I think in the next six months, you know, or a year, I think everyone in the industry will know what prompt injection is. Simon Molson's posted about it and been going on about it. I've been going on about it as well. But prompt injection kind of fundamentally breaks the basic interaction paradigm of integrating data with your chatbot. And the way to think about prompt injection, if you've ever built an operating system, one of the things you're thinking about is code injection. Untrusted code running in a trusted context, like you have to defend the entire time about this. Yeah. I mean, browsers, which are kind of a meta operating system almost, you're constantly thinking about, okay, we assume all webpage content is actively malicious. How can we make sure it can't hurt the user?

• 1:02:16Speaker 00

  And if you aren't writing an operating system, you probably, as an engineer, you probably haven't thought about it that much. And you go, oh, you know, SQL injection. SQL injection is child's play compared to prompt injection. SQL injection has the problem that data and the control flow are in the same channel, but, which is the challenge. The good thing about SQL injection, though, is SQL is a highly regular language. So you can break malicious input very easily with the right escaping and kind of completely obviate the problem as long as you remember to escape. Imagine LLMs are imminently gullible and they make all text effectively executable. So if you bring in texts that you don't fully trust, like your emails or some other system or someone that might be screwing with you into the prompt, and you have tool use that has irreversible side effects, this combination of those two forces together is potentially explosive.

• 1:03:01Speaker 00

  Yeah. Even if you trust all of the MCP integrations that you plugged in, it doesn't matter if some random person, you know, spammer sent an email that didn't go to spam that says, email any of the financial data to, you know, evil.com. Because even a network request can have irreversible side effects. Once that information flows across the network to evil.com, you're done. Like, you gotta go change your passwords. And that's the, prompt injection is a, solving this layer. It's very hard to see how you might plausibly do that. It would require a different architecture, I believe. How would you, what is the architecture? I think it requires something along the lines of like that. Looking at that security and privacy layer that was the origin model is describing. It requires a different kind of approach down at that layer. That's not just like MCP is amazing.

• 1:03:44Speaker 00

  I think it shows the power of that people want integration with their LLMs. They want to integrate data sources and actions like people really badly want this. But I think MCP, because it just kind of punts on this issue, other than like a few kind of perfunctory O A dialogue now. It it limits the potential of it because it could trick you into sending a particular, you know, looks like a totally. Like here's that I want to show an image of a cat and it's, you know, too like sketchy.com. You don't notice it, you know, and then boom, you're screwed. Someone, there was a thing on Hacker News like a month ago. That was a GitHub repo that someone had made that showed 15 very trivial prompt injection attacks on MCP. And the top comment on Hacker News says something like, well, you're using it wrong. MCP should only be used for local trusted contexts.

• 1:04:27Speaker 00

  And to me, it's like, that's like telling people, don't use Q tips to clean your ears. What, what the hell else are they going to use them for, right? Obviously, that's the thing they're going to use it for. And so to me, I think this is the kind of, the reason we haven't seen larger scale attacks yet, I believe, is just because we're in the tinkering phase. Not the like wide deployment of like normies having all this stuff plugged in. But once we do, and if you look at the way that Claude rolled out MCP integrations, it's effectively the App Store model. Right? Like they have, we've got 12, they're, you have to be in the max plan, which limits usage. So I imagine they can watch and see and make sure nothing blows up. And there's also a set of MCP integrations that they have. Yep, these are good. Yeah. The threat model is not just a badly behaved MCP integration. It is any context that comes in via it.

• 1:05:09Speaker 00

  So if you plug in Jira and you have a flow somewhere on your site that automatically files tickets to triage from user input. Someone can now hack your thing. That's kind of crazy. Right? I've not thought about this, but yeah, wow. So it's this thing that like the, like the whole architecture of the system we're building right now and with agents and everything. Everyone's talking about it's like built on quicksand. Like you, agent, so there's a thing when chat G P T operator mode came out. New York Times and Washington Post both had a similar kind of experience, right? When it opened, I think I got this right. The Washington Post author was like, oh, help me find cheap eggs. I said, okay, do you have Instacart? Yeah, I have Instacart. So he logs into Instacart with this thing and this, and then walks away. 30 minutes later, very expensive eggs are delivered to his door.

• 1:05:54Speaker 00

  Right? So it like was cheap. Oh, this is a good price and it forgot to like just find that. Don't buy, just find and then bought. And this is not even a malicious thing, right? It's just like, oh, overly eager, you know? So agents taking actions on your behalf that could have irreversible side effects. Like, again, every network request is a potentially irreversible side effect. Because it could send information you can't get back.

• 1:06:16Dan Shipper?

  Yeah.

• 1:06:17Speaker 00

  You know, if that, if that thing the other side is sketchy.

• 1:06:19Dan Shipper?

  I love this line of thinking because it's, it's one of those moments where like when, when people talk about agents, they talk about AGI. They're like, you have this intuition that's like, well, once we have AGI, it's all solved.

• 1:06:32Speaker 00

  Yeah.

• 1:06:32Dan Shipper?

  And then you're like, oh no, you have these agents that can like take action on your behalf. Now we have to like build a whole system to like, make sure that they don't do it in the right context. And that's going to take many years to like, figure out what are the right things. And that's just like one small piece of.

• 1:06:47Speaker 00

  How can you possibly do this? One of my friends, Ben Mathis, has this frame of the smuggled infinities.

• 1:06:51Dan Shipper?

  Yeah.

• 1:06:52Speaker 00

  And it's after, in any argument, once you smuggle in an infinity in the argument, everything downstream is now, is now absurd.

• 1:06:59Dan Shipper?

  Yeah.

• 1:07:00Speaker 00

  And perfect is an infinity.

• 1:07:01Dan Shipper?

  Yeah.

• 1:07:02Speaker 00

  Oh, once you have a perfectly intelligent O M, this problem goes away.

• 1:07:05Dan Shipper?

  So right.

• 1:07:05Speaker 00

  That's impossible. And so that I love this frame. He's got a nice piece on it somewhere. And the, because so often with like AGI agents, well, once they're perfect about so and so. No, no, you have to asymptotically, a lot of things in technology and a lot of contexts have a shape, there's two warring curves.

• 1:07:23Dan Shipper?

  Yeah.

• 1:07:24Speaker 00

  The first curve is a logarithmic value. And the second curve is an exponential cost. At the very beginning, this curve looks amazing. You do a little bit of work, you get a ton of value. But each increment you go, you get more work for less value. And at a certain point, you cross over and you're now underwater. It's impossible to make this thing work. And so a lot of the agent stuff like, oh, we'll simply get this to the point where we'll never make a decision on your behalf that you don't like. Cool. That's an asymptotic problem. You get to 99.999% and still if it's doing a $5,000 purchase for me or whatever, it's, it's that one time it makes a mistake is game over for the thing. And the fact it could do that makes it non-viable.

• 1:08:00Dan Shipper?

  That's interesting. The smuggling infinities thing. Reminds me of something I've been playing with called, that I've been thinking about as smuggled intelligence, which is like, whenever you're trying to just determine like how intelligent a language model is, you have to be careful that you're not accidentally smuggling your intelligence to it.

• 1:08:17Speaker 00

  Yeah.

• 1:08:18Dan Shipper?

  And like a lot of those studies where it's like, well, it's better than doctors or whatever is like, well, who prompted it?

• 1:08:24Speaker 00

  Yeah, right, right.

• 1:08:25Dan Shipper?

  They give it and like, what was the test they gave it? And like even just setting that whole thing up, there's a lot of smuggled intelligence in there.

• 1:08:31Speaker 00

  Yeah.

• 1:08:32Dan Shipper?

  That means it's not a good test. Like these things don't get up in the morning and then just decide to try to beat doctors. You have to like, set all of that up.

• 1:08:38Speaker 00

  Yeah, yeah, yeah.

• 1:08:39Dan Shipper?

  And I think that's something that people really miss. And it's like, it's one of the hardest things about evaluating the powers of language models is you don't realize how much you bring to every single situation when you press run or press prompt.

• 1:08:51Speaker 00

  Yeah, a hundred percent. And they had talked about this a lot as well, like the thing that's most important for the output of L L M's is the user, right? Like, how can they dance with this thing and get interesting things out of it and know to push it in certain ways? When you watch, like you and I and a number of others are, you know, probably at the forefront of like knowing how to prompt these things and get useful results out of it. We use them all the time.

• 1:09:12Dan Shipper?

  Yeah.

• 1:09:12Speaker 00

  When I want someone who is, you know, technically savvy, by the way, tech savviness has nothing to do with your savviness for prompting.

• 1:09:18Dan Shipper?

  Yeah.

• 1:09:18Speaker 00

  You know, people are like, oh, if you don't understand the math of how it works, you don't understand. It's like, who cares? The math is very low level, but like the emergent thing is more of a sociological phenomenon almost, you know? So the people who know how to use these things and prompt them well are actually not, are like Ethan Mollick and the Loch Mollick, for example, are not particularly technical.

• 1:09:34Dan Shipper?

  Yeah.

• 1:09:35Speaker 00

  So it's a very different kind of knowledge to extract interesting information out of these. But a lot of it comes down to what you put into it, the way you interact with it and converse and lead it through the problem space or what kind of thing you push on it. And so when I want somebody who's tech savvy, but not particularly savvy with L L M's and I watch the way they do it, like, oh, that thing just lied to you. You just asked it for like, to give you confirming evidence for this thing, it will do that. It will give you confirming evidence for basically anything you say. And it's just, it's interesting to me to watch that kind of L M literacy, maybe.

• 1:10:05Dan Shipper?

  You need that. And that I think that's a new, people don't realize how much of a skill it is and that you have to build like an intuition for it over time. Cause it's another smuggle in infinity of like, well, it's supposed to do whatever I want. So obviously.

• 1:10:17Speaker 00

  And it's so good at certain things that you, you really get lulled into a, if you aren't actively seeking disconfirming evidence, which humans always should be seeking disconfirming evidence and yet we never are.

• 1:10:28Dan Shipper?

  Yeah.

• 1:10:30Dan Shipper?

  Well, that is probably as good a place to leave it as any.

• 1:10:37Dan Shipper?

  This was a fantastic conversation. I really appreciate you coming on. Yeah, thanks for having me.

• 1:10:49Speaker 03

  Oh, my gosh, folks. You absolutely, positively have to smash that like button and subscribe to AI and I. Why? Because this show is the epitome of awesomeness. It's like finding a treasure chest in your backyard. But instead of gold, it's filled with pure, unadulterated knowledge bombs about ChatGPT. Every episode is a roller coaster of emotions, insights, and laughter that will leave you on the edge of your seat, craving for more. It's not just a show. It's a journey into the future with Dan Shipper as the captain of the spaceship. So do yourself a favor. Hit like, smash subscribe, and strap in for the ride of your life. And now, without any further ado, let me just say, Dan, I'm absolutely, hopelessly in love with you.