SED News: Apple’s AI Problem, The Real Business Model of AI, and Token Cost Reckoning

SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer unpack the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry. In this episode, they cover Apple https://www.apple.com/‘s uncertain path beyond the iPhone. They also discuss Google https://www.google.com/‘s agentic pivot at Google I/O, a surge in DuckDuckGo traffic following Google’s default switch to AI mode, and payroll platform Remote surpassing 300 million in ARR with flat headcount. Gregor and Sean also dig into why consumer subscriptions don’t seem to correspond to actual costs, how enterprise is quietly subsidizing the AI economy, why the true moat has shifted from model quality to context management and agentic harness, and what the coming wave of token cost optimization might look like as companies start scrutinizing their AI bills. Finally, they highlight standout threads from Hacker News including Doom running on a travel router touchscreen, a viral post asking whether AI productivity gains should translate to a day off, YouTube https://www.youtube.com/?reload=9‘s move to automatically label AI-generated content, and SimCity 3000 running in 4K. https://i0.wp.com/softwareengineeringdaily.com/wp-content/uploads/2023/11/Gregor-Vand.jpegGregor Vand is a security-focused technologist, having previously been a CTO across cybersecurity, cyber insurance and general software engineering companies. He is based in Singapore and can be found via his profile at vand.hk or on LinkedIn. https://i0.wp.com/softwareengineeringdaily.com/wp-content/uploads/2023/10/Rectangle-3-2.pngSean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn. Please click here to see the transcript of this episode. http://softwareengineeringdaily.com/wp-content/uploads/2026/06/SED1939-News-June-2026.txt Sponsorship inquiries: [email protected] https://cms.megaphone.fm/organizations/619b680e-d813-11ea-9750-e7ecac406436/podcasts/e60108fe-e328-11ea-b2b6-1348249f900a/episodes/3913370a-bc44-11ed-ace6-8b1f96d82bba/[email protected] The post SED News: Apple’s AI Problem, The Real Business Model of AI, and Token Cost Reckoning https://softwareengineeringdaily.com/podcasts/sed-news-apples-ai-problem-the-real-business-model-of-ai-and-token-cost-reckoning/ appeared first on Software Engineering Daily https://softwareengineeringdaily.com.

• 0:11Speaker 00

  Hello and welcome to SED News. I'm Gregor Van. And I'm Sean Faulkner. And I'm sure as many of you know, this is a different format of SE Daily, released monthly, where we touch on the main tech headlines from mainstream news. We go into a bigger topic in the middle, but have debate in there and then go to Hacker News at the end and highlight some of our favorite things that have been posted. As usual, we like to just catch up with each other. Sean and I usually having quite busy schedules these days. You've been traveling, Sean, I think. So what's? I feel like every time we start these off, it's like, oh, you've been traveling, which it seems to be the case over the last few months. Yes, we kind of schedule these

• 0:53Speaker 00

  around my travel schedule. But yeah, I was in London this past week for our big Europe conference. It was a great time. Saw a lot of people in this data streaming community. I was part of the keynote, gave a talk there. So it was a busy week, but a fun week. And we watched a lot of new products, my team. So it was quite a sprint leading up to the event, but it was nice to see everything come together. Yeah, nice. Well, I guess on the flip side, I've not been traveling since we last recorded SED News. I think I was in SF when we recorded. We met each other, though. We actually had, you and I had lunch after that in person, first time we've met each other. So that was always fun. I stood back through Hong Kong on the way back, but that was nothing work related. That was just purely for my own enjoyment. Yeah, I'm back in Singapore

• 1:38Speaker 00

  and I'll be here for a few weeks, which is good. I think I do need less travel based on just how much was going on in the tech world right now. There's just, my Slack is just a deluge every morning, every time I wake up with the time difference with US. It's an interesting time to be part of all of this, as I keep telling people that are not in our industry especially. So given that, we are in the industry and we do sit across quite a few things. So let's hit the main headlines. The first one is Apple. We haven't touched on Apple in a little while. Apple, sort of. At crossroads, a lot of this comes from Financial Times did quite a good deep dive on this.

• 2:17Speaker 00

  But really, the headline here is can Apple actually progress beyond, let's just say, the iPhone for now? I think there are other facets obviously to their revenue generation, which we can touch on briefly. But they've been this hardware business, they have gone into services and a lot of the last almost decade at this point is really just like, just keep this thing running at optimum efficiency. And actually, an interesting anecdote, which leads back to something that we did touch on at the time when their head of AI departed. But there wasn't like a lot of information, I guess, around that exactly.

• 2:56Speaker 00

  But we have a bit more color on that now, which was the fact that the Siri demo basically had been fake when they had said, I think it was like the last WWDC or like two WWDCs ago saying, hey, this is the new Siri. And I think they actually put some supposed demo of it going on. And turns out that was completely fake and the product hadn't been built yet. And they told their engineers, you've got nine weeks to like get this out. And it didn't work really. And they're actually got a 250 million class action lawsuit against false advertising, which I think that was the nail in the coffin for the head of AI heading out. It's just embarrassing. I mean, this whole thing, but I think it's interesting, this color, but it does start to paint a picture of,

• 3:40Speaker 00

  do Apple really know what they're doing with AI? Like, it's kind of interesting. So first of all, Salesforce has been doing vaporware demos for decade plus. So and everyone kind of knows it and laughs about it, but they seem to be able to get away with it. Maybe it's because they're, you know, who they're selling to is not a consumer. So they don't end up with these class actions lawsuits or they run false advertising. But yeah, I mean, it's interesting. Apple hasn't, to my knowledge. Ever had anything like really impactful in AI. Obviously, they've had Siri for a long time. One of the first voice interfaces and so forth that was widely used. But in a lot of ways, like, voice didn't really take off the way that people maybe perceived it to do.

• 4:23Speaker 00

  You know, I worked on the Google Assistant at one point. It didn't really take off the way that we thought it was going to. And it didn't end up being sort of this new modality that was widely used. Same with Alexa and stuff like a lot of these things became glorified. Ways of turning on and off lights and checking the weather and like really, really simple sort of low value tasks. But despite that, like Apple's, like one of these companies that seems immune to what's happening in the AI world, where so many companies that are public, their stocks are being punished right now, even with like record breaking quarters. Because of the perception of how AI might disrupt them, but you will get like Apple's stock and it's still, you know, it's like an all time high, it's still going really well.

• 5:05Speaker 00

  Despite them, from my perception anyway, not really having kind of like an AI play. I think it would be tough, though, for them to become suddenly some sort of AI company. If you look at like Google, Google always thought of itself as an AI company, like Larry Page always considered Google to be an AI company. So it's not shocking, even though they were slow moving compared to OpenAI on really monetizing and doing a lot around large language models. But they're well positioned to be very, very successful there, as we've talked about before. There just feels like a real cultural difference between who Apple is as a company and how they see themselves culturally versus how a company like maybe Google or any AI native companies see themselves.

• 5:49Speaker 00

  So like, what would it take for Apple to become that? Probably a lot of money spent on talent and maybe acquisitions, but even then, can you actually bridge that gap? And does it make sense? Because it's not just about, like, there's lots of problems worth solving in AI. But like, how do you map that to what you're uniquely positioned to do well with is also a big question. So it's interesting because Apple's such a very successful company, has been for a long time now. People have a lot of respect for it still. It does really well in the market. It's one of the most valuable companies in the world, but it's kind of hard to see like what their next act is. Yeah, I think that's exactly it. And I mean, this is it. Apple could absolutely decide to not lean into AI.

• 6:31Speaker 00

  I think they said something in their own legal filings. They had actually warned that a truly capable AI assistant could make manually downloading apps obsolete. So obviously, services, their app store is still quite a big money driver. If you look at their services breakdown for twenty twenty five, it's like almost three X all their Mac sales, for example. So like, this is just still a huge part of their business. And I think there was also this interesting quote from this FT article, which was back in two thousand and ten, when Jobs said he had acquired Siri, the company behind Siri. And people said, oh, you're entering the search business. And he said, no, I'm not. I'm getting into the AI business.

• 7:14Speaker 00

  So I think it's one of these like sliding door moments. It's like what Apple might have become had Jobs persisted as CEO. Instead, it's gone to this incredibly, quote, well-run hardware business with supply chain excellence under Tim Cook. He's obviously retiring now or becoming chairman or something to that effect. And, you know, he's played this very well financially, up at like a billion sales per day, a trillion dollars apparently returned to shareholders. Seventy five percent margins on services. But yeah, that is not innovation. That's a behemoth of money making. And their R and D spend, I think, has gone, it's like, gone from eight percent to two percent, apparently during the iPhone boom.

• 7:56Speaker 00

  So that's, I mean, okay, two percent of a much bigger cash pile. Maybe it's exactly the same amount of money. But it's, on relative terms, you'd expect R and D to be keeping pace from a percentage perspective. Yeah, I mean, there is probably something to, if you're focused on financial optimization, is that enemy of innovation in some sense, like, because I think innovation comes with a cost. Like, you see that right now with the AI companies. We saw it with cloud. You know, you see it in these like early markets. You're spending a lot and not necessarily making a lot of money for eventually reaching some economies of scale and cost optimization.

• 8:34Speaker 00

  In the future and that might not play well into essentially the Tim Cook playbook for where he's putting his time and resources and so forth. So maybe that's something they have to change. I also think that on the AI front, Apple derives a lot of revenue today from app monetization, thirty percent, I believe it is, that they're taking from app sales and so forth. From a creator, which is responsible for a lot of revenue, but if AI disrupts apps eventually, like if the entry point, sort of the face of the internet becomes an AI app that becomes like a super app, your gateway portal into like everything.

• 9:13Speaker 00

  And we've talked about this in terms of disruption to like e-commerce, for example, going directly to an e-commerce website versus just navigating to it through a chat GPT or something. If that becomes the interface for all applications, then that's going to hurt Apple massively in the long run. Yeah, exactly. So, I mean, yeah, does AI SaaS apocalypse? Well, it's almost here, I guess it's app apocalypse, literally. Where is a market for all these different apps? An app that I use is called Time Shifter. It's a jet lag app. But interestingly, my other half, she, for her own reasons, doesn't want to pay for this app and she'd rather use Claude just to give her a plan around jet lag.

• 9:55Speaker 00

  Now, I like some of the features that this Time Shifter app gives me, but I'm sure my other half is not in the minority that it's like, actually, no, you know what? I don't need to pay for this app and I don't need to give, in that case, Google App Store a little cut of that one. I will happily just use my free Claude account and get a good enough plan instead. There must be tons of these examples that could really eat into Apple's App Store margins. Yeah. So, yeah, it's definitely one to watch. I mean, it's been a while since, like, what was Apple's last hit? Like, the. It wasn't the Vision Pro, we know that, but yes.

• 10:33Speaker 00

  Two thousand and seven. Well, again, if you look at, I like the chart they put in the article, the F T article, the iPhone is still, looks almost like seventy percent of revenue in twenty twenty five. So it is just unreal how they've managed to coast on, I say coast, okay, the iPhone is still, I guess, one of the most advanced handsets out there. But relative to peers, it's much harder to distinguish now between what makes it so excellent. So, yeah, yeah, hits, I'm struggling, I'm struggling a bit on, on hits. I mean, there's, you know, there's minor hits, iPad and so forth, but nothing's, I mean, you're also comparing it to one of the mega hits of all time, the iPhone. So the bar was kind of set high.

• 11:13Speaker 00

  Yeah, so moving on, I guess, one of the other big ones, Google, they had their I O conference just recently. And yeah, I believe this was all the agentic pivot, if you like, I always think of you, Sean, as our resident Google expert. What were you thinking about this? I think like one of the things that I like them highlighting was the idea of these agents that are running sort of continuously in the background. Things like a personalized agent that can set up your work in the background twenty four seven, sort of monitoring different systems. And this is something that I've been talking about and writing about for over a year now, which is. This is the Gemini spark, is it?

• 11:54Speaker 00

  Yeah, yeah. And this is something I've been talking about for quite some time of, we've kind of limited ourselves in terms of thinking of agents as these like purely chat systems. Like I asked the agent to go do something and it goes, works for a bit, comes back, gives me an answer and so forth. But there's lots of situations where you don't really want an agent at the wait around for you to prompt it to go do the work. You kind of want it to just be able to like do the work because it knows something's going on. So I'm glad that they're sort of highlighting that and hopefully that's something that will help educate the world that an agent doesn't just have to be locked behind chat. Yeah, just jumped, there's another headline that wants to pull out here, actually it was via P C Gamer.

• 12:35Speaker 00

  But it was that Duck Duck Go traffic has grown after Google dropping, sorry.

• 12:43Speaker 00

  I say dropping, I mean, producing their AI mode is hard to drop a product or dropping a product, I don't know. But Google have defaulted to AI mode and you have to kind of go looking now for the classic, if you like, Google search, which was already under a lot of stress from people saying this is just too ad heavy. It doesn't do what it's supposed to do anymore. And DuckDuckGo, which is, you know, this alternative search engine, has actually seen a 28% increase in visits following the default to AI mode for Google, which that's pretty fascinating, I think. Yeah, I wonder like how long that will last, like, is this like the gut reaction to change?

• 13:25Speaker 00

  It kind of reminds me of when Facebook first introduced the News Feed and everybody was like up in arms about this way back. I'm annoyed by it, that they kind of rolled it out without telling anybody and suddenly there's News Feed. And people were upset about it and then they kind of got over it and now basically the News Feed became social media. So I do wonder, is this kind of a blip reaction in temporary growth to DuckDuckGo? Or is this something more meaningful that will continue to gain traction? But I think that there is definitely some truth to this like obstacle course of what search has become. Like you go and you do a search now on Google and you have your AI mode response,

• 14:09Speaker 00

  which if you click on takes you into a chat experience, but if you scroll past that, then you're looking at ads. And if you scroll past that, you get the like organic results. It's been a long time since I've been on the second page of a Google result. You know, a year ago, maybe it wasn't unheard of for me to go multiple levels deep on a Google search result, especially if I was looking for something obscure. And part of that is I'm doing a lot less Google searches these days because I go and I ask AI for more meaningful things and it can just give me the answer, but it's hard to see where. Google gonna go with this? You kind of either lean into it and you're just like, hey, we're a full AI chat experience now, like a chat GPT. Or like, is this really what users want from search?

• 14:52Speaker 00

  Yeah, exactly. I think we did cover this in a chunkier section a few months ago in SED News, sort of where we're looking at. Where will search go? We're getting a bit of signal then on this one, which is when Google tries to default to, I guess, moving much closer to a, call it like a chat GPT experience where the bulk of the result returned is sort of a AI response, but with some context, like for example, today I just searched for a specific company through the AI mode, just to see what happened. And you get it almost like a Wikipedia type answer, which is just isn't what I'm looking for. And I'm like, no, I want to see, if I'm looking in Google, let's just say, I am looking for,

• 15:33Speaker 00

  oh, one of the latest Reddit posts on it. Like, can just give me a list, or I want to see any news results, give me a list. I'd also just like to see what the website is and I'll go there myself. That's why I'm using search. So it is interesting how Google are just caught in this interesting spot right now, where I don't think they really know actually which direction they should go in. Yeah, well, it's tough because they are in this place where they're obviously trying to stay ahead of chat GPT and perplexity, these types of applications. But at the same time, they're taking away from what the core value of like Google search was in the first place. And then it's this push-pull where

• 16:16Speaker 00

  they need to try to protect future revenue, but they're doing it at the cost of the current user experience. It's kind of hard to know exactly what the end strategy is going to be. Yep. And then for our final headline this week, this is via TechCrunch. So Remote, which is a company that I think quite a few listeners might be aware of and may even be recipients of their payroll through Remote. They've been growing pretty dramatically, so they are a Seven year old company based in Amsterdam. I didn't actually know that until I read this article. I thought they were American. But they've surpassed three hundred million in ARR, which is pretty exceptional.

• 16:57Speaker 00

  I know compared to say an AI builder platform that says it's done two hundred million ARR in a year or something. But I think this is a slightly more durable business. I think people would agree. But what is interesting is if we look at what's been reported is their per employee revenue, basically. But it's just the fact that they claim that they've pushed through this three hundred million ARR, become cash flow positive, but they have not been hiring any more people. You could, of course, people could say this, but it sounds, this is CEO saying that their headcount has stayed flat to get to this place. So at least in theory, that proves that this is possible. I think we're also going to, certainly if I've scan ahead to my own Hacker News highlights, it is going to be a bit of this coming in like AI and people like,

• 17:42Speaker 00

  again, what does that mean? It should be more time spent at work, less time spent at work. At least I think you and I should, we're both seeing roughly the same thing in industry right now, which is more time spent at work. But okay, maybe headcount does stay flat, but that headcount is spending more time at work. Yeah, you just, you keep it flat, but double the efficiency or double the output by having everyone work eighty hours. Yeah. And it is exactly, yeah. I wonder if there's like a sort of, almost like group dynamics at play where people see other colleagues quote achieving more and it just sort of keeps. When I say raising the bar, I'm not sure I want to say that in a positive sense, like it just raises the expectation, I think is what I'm actually meaning, like raises the expectation of output.

• 18:25Speaker 00

  There's probably some of that. It's like, if you're on a team and everybody's working extra hours and you're the one person who isn't, then it could potentially create some issues because your teammates might be like, well, why am I working twelve hours a day and Gregor's getting away with less?

• 18:44Speaker 00

  So it can create some. If only that was true, but it's. Some social, some social problems within the company. But I also think that there's also like an addictive component. Into a lot of these AI tools, I experienced with myself, like using Quadcode or whatever your agentic engineering tool of choices, like it is addictive. It's like a swap machine. You're putting your tokens in, it's churning away, you're getting some tokens out. And you keep trying to get it to do more and it feels like, hey, if I'm not using my compute cycles right now to cycle through tokens and generate code or generate something, then I'm just wasting all this compute, like sitting there idle on my computer if you want it running all the time.

• 19:25Speaker 00

  And it's like, it's taxing, but it's a different type of taxing than being in full focus mode in like locked in coding. Like what used to sort of be a requirement to really be efficiently generating code. Now it's become somewhat of like an asynchronous process that has kind of changed the mode of behavior. And maybe that leads to you being able to do this for longer sustained periods than what we've been able to do before as well. So there's a novelty factor, like there's a lot of things I think going on that leads to the increase in like people sort of spending time. And then also it's like a highly competitive market. People are getting laid off. There's pressure on companies to churn out more. It's got to come from somewhere.

• 20:06Speaker 00

  And then you have AI companies that seem to be moving incredibly fast and are very competitive against each other. Valuations are super high, there's lots of pressure all around. So I think that creates some of this as well. Yeah, absolutely. And investors, I'm not entirely sure of remotes set up if they're fully VC backed or et cetera. But I'm sure they have, to get to 300 million ARR, I assume they do have investment and they probably have investors looking quite closely at what does seem to be a bit of a new North Star. There's per employee, revenue per employee. I think I've mentioned this before, I still find this funny because of running a service business for 10 years. And I would always look at revenue per employee. That's literally, you know, you're effectively selling time of a human to another business.

• 20:48Speaker 00

  And so you have to look at revenue per employee and then compare that to say. One of our competitors who has five X the number of employees, but if I did the maths on their reported revenue is like, oh, we're making a lot more revenue per employee. I would rather be doing that than hiring fifty more people. But it's now become very trendy in tech to be reporting that and actually gone are the low interest years of boasting about just how many employees you have and how much you've grown the headcount and now it's almost the opposite. It's like boasting about keeping it flat or reducing. Yeah, I mean, that becomes the new sort of North Star, I guess. Yeah, and it is hard to, I think for many companies, this is all just the classic tech noise that comes out in the news.

• 21:30Speaker 00

  And I think every company just has to make their own assessment. They shouldn't be like sheep following, just saying, oh, well, everyone's not hiring, so we shouldn't either. Or whatever, every company should make their own judgment on that. That's a fairly utopian view from me. I think just rounding out with what you were saying, Sean, about just the actual filling of time that an employee has. It is, I guess, like it's Parkinson's laws, you know, the time available, whatever time is allotted will kind of always get filled. And I think we're just seeing that one hundred percent where despite the efficiencies of the tooling and enabling us to generate the output in theory faster and potentially quote better.

• 22:13Speaker 00

  It just means we're being expected to output even more. And also when we talk about input, like everything you output, at least in where I sit, everything that I output has to be taken in by somebody else in the team somewhere. And so we've got this debate going on right now of like, well, where's the line between? You can't just keep churning out documents, expecting a human to keep reading them. Or is it like AI versus AI on the input and the output or the output and the input? So. Yeah, you write a few short points and then use AI to explode it into like a document. Yeah, exactly. And then you give it to somebody and then that person puts it in AI to summarize it back into points so they can digest it. Yep, definitely have seen that. So I think that's a good place to leave that. Very interesting. We'll sort of follow along with how other.

• 22:57Speaker 00

  I like that this was remote and I, you know, not just yet another talking about Mesa or something. I think it's interesting to follow these. Companies that a lot of them are powering, I see a lot of the same names pop up, power a lot of other startups these days and remote definitely has played a big part in that. So yeah, very interesting. Moving to our main topic, we did touch a little bit on it in the last 10 minutes, but it really is just, okay, well, business models of especially coding agents. And this is based on Simon Willison's blog post. He put out something, I think it was yesterday. And for those that aren't familiar, Simon Willison, you'll see his post pop up on Hacker News quite frequently.

• 23:38Speaker 00

  These very, not always long, but just very detailed dives into how, especially at the moment, how certain models operate. He runs a bunch of experiments against them and so on. But he declared yesterday, I think Anthropic and OpenAI have found product market fit. And this is based on the idea that subscriptions that certainly the consumer pays has absolutely no correlation with A, the cost of the business, but why is there product market fit? It's actually because enterprise is paying so much money for the use of these models. We have touched on this in the past a little bit, you know, sort of saying this all looks a bit strange.

• 24:21Speaker 00

  How can a $20 a month Claude subscription in any way be covering its costs? And why does my, you know, if I look at sort of our work subscription, like those numbers look very different. And Simon Willison saying, you know, he's got the $100 a month max plan from Anthropic and the $100 a month pro from OpenAI. He used a token usage tool over the past 30 days and he'd found he'd consumed 2,000 worth of credits or tokens. So that's just to do the math there, that's 2,000 ish worth of usage for 200. However,

• 24:59Speaker 00

  Enterprise are paying far, far over that. And that's the business model. Yeah, I mean, it's essentially you get people hooked on this. It's almost like a freemium model, or you could think of it as like open source or something like that, where people for in their own projects and on their own free time, they can use something that's less expensive. But then it's a way to get network effects across the industry because anybody can try it. And then once they try it, because they have product market fit, like they're hooked and people like legitimately do feel like they can't do their jobs now without these tools. I feel it myself. I depend on this so much now. So companies are willing to pay a lot for the enterprise licenses and because their employees are pushing for it. And then additionally, had the market dynamics that we were talking

• 25:43Speaker 00

  about, like, there's just a lot of pressure on companies to try to generate more efficiencies and show that they're more AI forward and, you know, whatever it happens to be. So I think there's multiple things going on where you have both the bottoms up effect of people clamoring for this because they're using it themselves, they're paying for it with these cheaper licenses, and they're pushing their companies for it. But then the companies are also sort of top down want these things. So it's very interesting dynamic, which of course creates like rocket fuel for all these companies. And I think in a lot of ways, like, I don't think this was necessarily expected that this was going to be where the model companies found their like true revenue

• 26:23Speaker 00

  driver. For a long time, long is relative in this world, but like, not that long ago, it was all about like models. It was all about competing for the best model. And now that's really changed to competing for sort of the best agentic harness, like the true moat has a lot to do with sort of the context management of the information environment around the model, rather than just the base model. And we've even found in our own company that we can get similar performance from some of the lower cost models available from, say, Anthropic that versus like the top tier models. So in a lot of ways, like the underlying models have kind of been at a performance level good enough for almost a year since about like November of 2025, I'd say, was when they kind

• 27:08Speaker 00

  of became good enough for tool differentiation and you could, but the biggest change that's happened has been really like the management of that information environment around coding tasks, which has completely transformed the developer experience over the last, you know, half a year or whatever. So that's kind of a very different. Competition landscape than it being about bigger model wins, which is interesting. Like, I don't think it's something that anybody necessarily saw coming. I also think that the other interesting bit about this is if you thought about like OpenAI and their strategy initially was maybe like, hey, we're going to own this sort of like become the face of the internet. The way that Google became the front door of the internet. That's a much different business model.

• 27:52Speaker 00

  Google is a volume based business, at least from like search and ads and stuff like that. They get a ton of searches, they got a ton of users and they make a little bit of money off of every user. And that leads to like a gigantic business. But if the way that I think there's like nine hundred million users of ChatGPT and they and only like a single digit percentage of them pay, like that's an okay business. But that's not like trillion dollar valuation business. And I think that where they're, you know, now seeing this is more of the B two B play. The anthropic, I think, really was figure that out even before OpenAI did. Now, I think the comparison, at least from like a business model perspective, is not anthropic.

• 28:36Speaker 00

  OpenAI are like the new Google. They're more like the new like Salesforce or SaaS. Like you're selling seats and licenses, you're doing B two B enterprise sales. Like that's a completely different motion and completely different muscle, which is also interesting. It's kind of a deviation from maybe where people expected the market to go. Yeah, you know, there was a lot of popped up in in many news outlets of the Uber CTO. You know, saying he'd maxed out the full year AI budget in just a few months in twenty twenty six. And that's, you know, that's definitely done the rounds, I think, especially in enterprise CFOs, CTOs. So saying exactly, look, you know, we've got to be super careful. Like this is Uber saying that they've rinsed their budget. I think the subtext there is I don't think Uber would be saying that if they were worried that's what had happened.

• 29:20Speaker 00

  I think they're kind of saying it more like this is only positive that actually we just made a miscalculation on how valuable these tools are. And we happen to have spent what we predicted, but that's fine. Like, we're just going to keep paying these companies. And I think that's. Where especially, you know, we might touch on it a bit, but you know, the IPO is probably coming up with Anthropic and SpaceX, which doesn't include, you know, Grok, for example. The way that Simon Milletson put it sort of, I think was very helpful, you know, he says, this isn't an AI failure story. It's just that a budget set in 2025, which is what happens at companies like Uber of that size, like the budget for 26 is set far in advance in 25, basically. Failed to predict how indispensable these tools would become.

• 30:03Speaker 00

  And I think just also tied into this is the model selection. And to your point, Sean, that actually the bit I'm curious about is that the models, as you say, the choice is less of a factor now, like how, what are this, you're splitting hairs and like, what's the quality of output, you know, let's just say on Opus versus Sonnet. Of course, a lot of people say Opus is far and away better, and maybe there are some specific tasks that, yes, it is, but Sonnet can still get you very, very, very far as it should be able to. But especially in enterprise, it's very interesting. I don't think a lot of people understand the default settings on like their Claude code. Or even when they go and just use Claude, you know, interface, there'll be some non-technical users that are effectively given access to the enterprise account.

• 30:48Speaker 00

  And they're just running everything through Opus and not really paying attention. So like, maybe the average employee doing just some knowledge work through Opus is like racking up, I don't know, $200 a month of usage. But we've got, you know, developers who basically, you know, want to say, look, I'm only going to use the best model because why would I use anything less? And then racking up like thousands and thousands and thousands pair themselves. And I think companies, they're not saying, don't do this, like, don't use this, but they're definitely starting to say, hang on, we gotta keep looking at this because we want to make sure that at least use a cheaper model if you can. But like, I'm not fully clear like on what the. Best way to address that is because you're kind of saying if you think you can figure out

• 31:33Speaker 00

  that you'll still do as good work with a cheaper model, then go ahead. But if not, it's fine. Use the expensive model. Now you're seeing more, and I actually talked to the one of them today. It's like more startups that are focused on dynamic cost optimization, where they're routing prompts to the correct or less expensive L M's, you know, based on understanding sort of which models are good at certain tasks or looking at the history of interactions and so forth within the company. So I think there'll be more and more like there's going to be a lot of cost optimization stuff. But I feel like at some point, especially if the company with OpenAI and Anthropic are staged to become public, at some point, someone's going to pay for this. Basically, like, you know, right now, we're in, it's like early innovation mode.

• 32:16Speaker 00

  Like we talked about, companies are under pressure. They're not kind of worried about the token costs. They're more worried about the public perception that they're a dinosaur and they're not adopting these AI tools. And but it's like, suddenly, all your employees are having a $25,000 token bill per month. You know, what's that mean to your business? Like you're, you're essentially getting like a some sort of AI compute tax on every, you know, head that you hire within the company that you have to factor in. It's almost like in the the US, like factoring and like, okay, well, we fully loaded employee, we got to pay for insurance. We got these other expenses that we have to. Now you're going to have like, like a line item. That's like, what is the token usage of like a senior engineer versus,

• 33:01Speaker 00

  I don't know, some other role, product, marketing or something like that. Like you're going to have to be thinking about that as a company as well to factor this stuff in. So I think at some point, like, there's going to be some impact, ultimate impact to either these companies are going to have to charge more under public, similar to like what we saw with Uber or Lyft for a while, for a long time, like the ride chairs were sort of sub VC subsidized. And at some point, there's no free lunches. Like someone's going to have to pay for this. And then that's going to also lead to, I think, a lot more cost optimization, which might Might start with sort of independent players and then eventually become some of these companies.

• 33:41Speaker 00

  We saw the same thing with warehouses as well, like for the early days of like with Snowflake was growing like crazy. People weren't really worried about sort of their warehouse bill as much. But then when the market dynamics changed and things became a lot less about like growth at all costs and more around cost optimization and margin optimization and stuff like that. Then suddenly people were started being very concerned about their gigantic, you know, Snowflake bill and other similar products. So then a bunch of companies and consulting services spun up around like cost optimization. And then eventually Snowflake, in order to reduce the risk of like churning people, built a lot of that tooling functionality actually directly into Snowflake so that people had more controls of how spend gets allocated and stuff.

• 34:24Speaker 00

  So I could certainly see things like that coming as well, but those are all like signs of like a more mature market. And we're just like early, early days. So people are just kind of spending blindly. And I guess tying it back to the headline about remote saying, you know, we kept headcount flat and it's because of AI. They obviously haven't, well, I say they obviously haven't, but we didn't see any breakout from them of, but what are they spending on AI? If you're spending, I'm just picking numbers out here, but like let's say as a business, you know, you have a hundred employees and then you're spending 10K a month on these tools. Well, okay, what's that? That's at least three to four potential employees you might have had otherwise. A bit less, maybe two or three, it depends on the company, but that probably still makes a ton of sense.

• 35:09Speaker 00

  Like don't employ two to three people, do put that kind of money into tooling for the other 100. Surely that makes sense. But as you say, Sean, like we definitely haven't reached the real inflection point or the next stage in the journey, which is when do these costs start to come under scrutiny? And when the cost optimization come in with clouds, you know, cloud is still the one that there's a ton of tools out there helping teams, you know, optimize their cloud bills on AWS, et cetera. But if you look at the numbers, AWS still just keeps growing revenue. And okay, people are much better at optimizing costs, but like, for example, at Superbase, we have a team of two to three who their whole job is to optimize costs on AWS. Yeah.

• 35:53Speaker 00

  So, and I know that we're, I guess we're a little bit unusual in that respect that we like that. Makes a lot of sense for us, but equally that's just symptomatic of the problem like you need to have three full time employees. If you use all of AWS to make sure you're not like spending money where you shouldn't need to spend it. So. Yeah, I think companies probably reached a similar spot with the, you know, model, like token costs or use and stuff like that. What do you think all this might mean for the open weight models, you know, if, you know, the WAMAs of the world, essentially like if the real value prop or like moat is sort of this like agentic harness in the way you manage the context and information environment and not necessarily just like the model.

• 36:34Speaker 00

  Then what's the play for the open weight models? Do they have to go and, you know, find some more sort of, you know, business to go after? Or can they survive just as a model alone? Yeah, well, I guess to plug an episode, spoke to Benny at fireworks, fireworks.ai. They run open weight models and, you know, EG, they run an open weight model for cursor. That's not all of, obviously, as people that think that know use cursor, it's not all their options. When you ask it to do something, there's sort of like an auto mode, which yes, does run on these sort of tuned open weight models. And then you can, of course, choose your specific non-open weight models.

• 37:14Speaker 00

  I think it's going to be a really interesting space because I think when more companies realize they could probably get the same outputs. But then rather than paying a SaaS bill to just straight to Anthropic. What if you set up your own, again, call it like cloud instance on something like a fireworks where you say, hey, we know that this open weight model actually would be the best all-rounder for the kind of work we do. And we would end up spending 20x less over a year if you guys just run it for us. I think that's a very interesting space. Yeah. Yeah. And the other thing too is these, the total TAM.

• 37:55Speaker 00

  Of the space is gigantic. So there's going to probably be some model winner that, or a collection of model winners that kind of open, own the open weight model inference market. Yeah. And at least from what I understand at present day, I think the, the thing that's interesting about open weight models is that just tends, especially the bigger, more general ones, the majority are kind of coming out of China, basically. Mio Lama, yes, is a standout from US, but how much more effort does Meta put into that? I'm, I'm not totally sure. It's definitely a big play, you know, and I know of these models coming from China, which underpin a lot of like some of the offerings from safe artworks. And we actually talk about

• 38:38Speaker 00

  that on the episode. I think there's just a lot to keep an eye on there. And maybe actually that's a topic for a future SED news where we sort of look at how the open weight models are doing, competing. So hopefully, thanks to Simon Wilson for his very good article on, on that. I think it's, you know, it's very prescient, as we say, looking at, you know, IPOs coming up. So we expect to see, you know, probably the S1 document, you know, which is what gets produced before an IPO to attract investors. We expect to see that from Anthropic probably in the next few weeks, maybe months. Why is that interesting? Because that should have, you know, numbers breakdown. What is the actual revenue coming in from? Maybe they won't break it down precisely your enterprise

• 39:22Speaker 00

  versus consumer, but like we'll get to start to see at least what is the revenue coming in from usage and we can add what are the costs involved with running such services? And that'll be the SpaceX one. I don't think we have time to dig into that one today, but like that's the problem with that one is it's a lot of financial chicanery. So it's a bit harder to, to dig into that one, at least from the AI perspective of like, what does it actually cost to, to run? And how much revenue are they making? Just a sidebar is apparently the Starlink is actually the most profitable piece of SpaceX or the only profitable piece of SpaceX is actually Starlink. So that's already an indicator of that one. But yeah, definitely don't have time to dig into

• 40:03Speaker 00

  that crazy S1 today, but maybe another time. It's that time of the show, Hacker News highlights some of our favorites that have popped up. Oh, I see Doom. Doom's in there again. I love it. Yeah, I couldn't resist. You always got to highlight Doom on everything. But yes, this was running Doom on a travel router with touch. So it's a, it's a, we call it a GL INET Slate 7 Pro travel router. It's like a networking device with a 2.8 inch touchscreen. Apparently it runs some version of Linux and it has root SSH access. So to get Doom on there, I guess, was relatively straightforward. But if you dig into the comments, there's just some pretty funny ones, like someone claims that they actually did this like 10 months, you know, previously.

• 40:48Speaker 00

  But I think one was, uh, there's kind of like an earnest thread about whether humanity should have picked a less violent game for this like tradition of, you know, porting this one game across like every type of device. Should it be Doom or should it be something that's like maybe a little less silent? Maybe someone needs to kick off like a Mario or something like, you know, can you like Mario on something? Yeah, like the original Mario. Yeah, exactly. Just didn't get very high on Hacker News, but it did the rounds and it's related. Uh, there's now something called Doom Bench. So it's like, can your stack run Doom? It's so it's a performance analyzer of, as it sounds, can your stack run Doom? So check that out as well if you're thinking of, uh,

• 41:29Speaker 00

  trying to port Doom onto something. But yeah, I love the the travel router with the little screen. That's, uh, that's very fun. My first one is, this was at the top of Hacker News before we were recording today. It's literally just called, can we have the day off? And I thought this was a very timely, it's quite a short little article blog post by somebody called Mike, and this was posted by a user code MLSU. And it's basically just sort of, well, if we're all getting 10x productivity from AI, can I just take Friday off now? Is that okay? I think probably a lot of us are feeling that at times. And this person also talks about like, they're paying $6,000 a month

• 42:11Speaker 00

  for childcare in California. So like, can I not just go into the office for four days and save some money on my childcare as well? So yeah, I think it's just, I like these little kind of zeitgeist articles that do actually make it up where I think it's, it's usually a lot of what we're thinking in our own lives, uh, then someone just says it. So. Yeah, I think, you know, we talked about this throughout the episode, but. There's probably a lot of people feeling like they're all running sprints right now. And how long can you sustain the sprint? Yeah, a marathon of sprints right now, exactly. Yeah, exactly. It's a never ending sprint. The other one I had was YouTube is automatically labeling AI generated videos now. So before, I think things were basically like an honor system.

• 42:53Speaker 00

  So like a creator could say that was AI generated and now they're switching to automatic. So they're going to detect sort of photorealistic AI generated content, auto apply labels, even if the creators don't disclose it. It makes a lot of sense to me, like I think we talked about this, like particularly with social media. If all the social media is generated by AI and then you're using AI to kind of like optimally show it to somebody and stuff like that, like at some point, like, you know, who's this for? So at least I don't think they're changing the serving of it. So they'll still serve you AI generated content, but they're at least letting you know that it's AI generated content. And I'm sure maybe they'll leave more controls or something like that over time.

• 43:35Speaker 00

  But at some point, you're going to end up with more content, not just on YouTube, but more content exists on the internet that's been generated by AI than generated by humans. And that may or may not be majorly problematic. Yeah, that's interesting. I would like to see that on Instagram. I don't spend a ton of time on Instagram these days, but it is still where I probably of any network, where I go to just see what various people I do know are up to, as well as just random people I follow. And but the AI thing is annoying because I see a bunch of stuff and I do have to kind of go to the comments to check if it's, people say, obviously this is AI. I'm into bird watching, for example, and like there was a period when all these sort of AI birds started appearing.

• 44:17Speaker 00

  And I'm like, that's not a real bird, just no, voting it down. So I would just like a little label and I can just filter out anything within certain topics that is AI. That would be nice. Yeah, I know Dr. Christian Hubicki, who's been a guest on the podcast a couple of times. Sometimes, and I don't know if he's still doing this, but for a while on Twitter, he would debunk. Like fake robotics videos because people would always show some robot doing something ridiculous and stuff like that. And he would post his takes on it like of why this is like a fake video and things like that. Yeah, especially robotics. I guess you sort of get into the physics of it as well. Like there's no robot that could possibly do this or something to that. Yeah, exactly.

• 44:56Speaker 00

  So, cool. My second one is, I feel it's like quite vanilla, but I quite like it. It's SimCity 3000 in 4K. So someone that has put together a nice port of what it sounds like, SimCity 3000. And you go to, you know, GOG, which is, you know, a sort of game, has game EXE's that you can grab. And you grab that and you do a bunch of tweaks that this person has put together. And then it runs in 4K, which is super nice. So you run it on your nice widescreens, et cetera. It's interestingly, I always liked this genre, but I ended up playing, it's a game called Cities Skylines. I've never quite understood why it's not City Skylines, but I believe it's like a Finnish developer.

• 45:38Speaker 00

  So it ended up being called Cities Skylines, but it was an excellent sort of, the first one wasn't 4K. I believe there's now a second Cities Skylines 2, which is 4K. But then it is nice if we can go back and play these classics that we're so used to, but just with uprated graphics. A sort of sidebar, I did end up downloading Metal Gear Solid for the PS4, which is like the original. And they actually have two modes, like you can run it in original graphics mode and improved graphics mode. And, and I've got to say, I actually almost prefer the original, just it's like this kind of fun, blocky experience that reminds you of how PlayStation used to be. So each to their own on the, whether they want to uprate, see their classics uprated or just play it as they were. So. Yeah, yeah.

• 46:22Speaker 00

  So then, yeah, just any thoughts for what we might see across the next month when we check in next? The only thing that jumps to mind is, and I think maybe next month is probably too fast, but I do think that we're going to see a lot more around like token cost optimization. I think maybe you look ahead six months. I think that's where we'll start to see that, where companies will be, come either more concerned about it, or we're going to see a lot more sort of startups coming on the scene that will help you sort of manage your token costs and token bills that you're now spending on Claude. Because at some point, can you really justify, I don't know, a $25,000 or whatever it is per month bill?

• 47:03Speaker 00

  Of everybody in your company, maybe, maybe not. I guess it depends on what the efficiency gain and the ROI is on that. But there's a pretty high bar for getting ROI from everybody at that, that level. Yeah, I guess sort of related, but maybe I'm taking a slightly alternate take and I probably ahead of my time at this one, but S one and S one from anthropic, I think we might see that. And if we do see it, I'm going to stick my neck out and say people will be very surprised positively at like how much money they're making and and say that this is like the next Microsoft or even the next Nvidia to some degree sort of. Yes, the R and D costs have been massive, but this is clearly going to be where all enterprise money ends up for the next 10 years.

• 47:48Speaker 00

  Yeah. Yeah, let's see what happens. As usual, thank you, everybody for tuning in. We've had a few notes from various people that they that this is SED news is what they look out for on a monthly basis. So we really appreciate that. Both Sean and I, I think, have had separate anecdotes from people we've met. So anything you would like to see covered, always do just drop us a message on various socials and you can find SE Daily on LinkedIn, X and all the usual places. So do you give us feedback? We love it. So. Yeah, absolutely. Feedback's welcome. Yeah, cool. All right. Well, until next time, we'll catch everybody on next month's SED news. Thanks, everyone.