Google’s Potential, AI Money Spigot Shutting?, PHP Bug & Cybersecurity’s “Black October”

Ranjan Roy from Margins and Alex Stamos from Cognition are back for our weekly discussion of the latest tech news. We cover: 1) Is Sundar Pichai team product or team model? 2) Google's attempt to build a unified assistant 3) Which Google teams get priority? 4) Sundar's cloud allocation between Google Cloud and AI Research 5) Will Google Cloud Platform overtake Azure? 6) Meta Stock falls on worries about its fundraising and debt 7) OpenAI valuation takes a hit after investors feel "indigestion" given how much money they've poured into it 8) Is there any money left to fund AI? 9) Cognition CISO Alex Stamos joins to talk about the PHP bug is going to cause long term damage 10) How to protect yourself and your company from the ongoing cybersecurity risks 11) It's not just PHP, it's Black October for cybersecurity. --- Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice. Want a discount for Big Technology on Substack + Discord? Here’s 25% off for the first year: https://www.bigtechnology.com/subscribe?coupon=0843016b Learn more about your ad choices. Visit megaphone.fm/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Alex Kantrowitz?

  What is Google's potential? We'll get into it after my conversation with Google CEO Sundar Pichai. Is AI's money spigot finally turning off? And it's Black October for cybersecurity as a PHP bug and plenty more end up opening the doors to bad guys in technology. We'll cover it all on a big technology podcast Friday edition, right after this. This episode is brought to you by Cribble. Quick question. Is your IT budget growing 30% a year because your data is? And now AI agents are piling on, running investigations around the clock and running up three meters at once. Storage, queries and tokens. Cribble, the AI platform for telemetry was built for exactly this.

• 0:42Alex Kantrowitz?

  Own all your data, query it wherever it lives and let Cribble route every AI request to the right model at the right price. The best part, AI inference for workloads on Cribble is included. Models will change, agents will change. Your data is the asset that lasts. Own it with Cribble. Visit C R I B L dot I O. It's never been more challenging to get frontier compute. How do you know where to look, who to trust, or how much to pay? Akash is an open cloud that provides easy access, flexibility and peace of mind. That's how companies like Razor were able to cut their inference cost by 15 times. Visit akash.network slash Alex for a free consultation.

• 1:25Alex Kantrowitz?

  That's akash.network slash Alex for a free consultation.

• 1:30Alex Kantrowitz?

  Welcome to Big Technology Podcast Friday Edition, where we break down the news in our traditional cool-headed and nuanced format. We have a great show for you today. We're going to talk about Google's potential and cover a little bit of my interview with Google CEO Sundar Pichai, which was conducted earlier this week. We're also going to talk about whether the money spigot for AI is closing as companies like Meta say that the demand for money is starting to outpace the supply. And then finally, Alex Stamos is going to join us and talk about the PHP vulnerability that's turning the tech world on its head. Joining us as always on Friday to do it is Ranjan Roy of Margins. Ranjan, great to see you. Welcome back.

• 2:08Speaker 01

  Wednesdays with Sundar, Fridays with Ranjan, just another week at the Big Technology Podcast.

• 2:14Alex Kantrowitz?

  As it should be, as it should be. And you know, it was really interesting for me to put some of our long-running questions to Sundar, including what matters more, the product or the model? You know, I did tell him, I said, hey, listen, people are arguing that you just need standard models and you can put that into action in your products and that is a good strategy for Google. Sundar wasn't having that at all. He said, Google's committed to the frontier, that it's always been about the frontier, it won't have it any other way. And you can make good products with standard models. But the frontier is basically frontier or bust for Google because the frontier gives you visibility into what's coming. It also helps you improve your models faster.

• 2:55Alex Kantrowitz?

  You know, as you develop more models, you can rely on the frontier to help you make them better quicker.

• 3:00Speaker 01

  All right, we know what team you're on, Sundar. We know what team you're on, Sundar.

• 3:04Alex Kantrowitz?

  He's on team model. What do you think about that statement from him? Does it make sense? Does it make your thinking about how the model is more important? I'm sorry, how the product is more important than the model in today's age of AI? Does it, does it shift that thinking at all?

• 3:19Speaker 01

  Okay, it does not, at least the first part. The second part I do think is interesting around like the more at the frontier you are, the better you can actually train future models and it starts to give an edge overall. I think there is something to that. I think in terms of like overall progress for a company that being at the frontier does mean it can move faster. And I think anyone, I mean, the speed and velocity with which Anthropic and OpenAI actually just launched. Everyone feels it, everyone sees it, and I think that is kind of validation of that part of it. But in terms of, I still more firmly than ever, and I think anyone who uses, and I will say this,

• 4:01Speaker 01

  Google's suite of AI products and how disjointed they are, and we've talked about this a lot around like Gemini and Workspace versus Gemini standalone. Like you can feel that lack of cohesion in the product within the entire Google ecosystem. And yes, I know it is a big, large, sprawling, massive company. But I think actually a little more focus on the core product itself, Sundar, I'm going to say it. I think would be valuable for Google.

• 4:29Alex Kantrowitz?

  Okay, so that is another interesting point that we can bring up about the interview. And by the way, if you're new to the show, if you came in after seeing the conversation, just a bit of housekeeping, we do these news breakdowns, Ranjan and I, every Friday. And then we'll have a flagship interview like the interview with Sundar typically every Wednesday. So next week, for instance, we're going to have Wharton Professor Ethan Malik talking all about the productivity gains or the invisible or non-existent productivity gains. We get into a bit of a debate that we've seen after the AI era has kicked off. So this is kind of how the show works. Really happy to have so many new viewers and we appreciate you being here and listeners. All right, so, so Google's product priority.

• 5:11Alex Kantrowitz?

  This to me was actually one of the more interesting and subtle takeaways from the conversation with Sundar. And we're going to, of course, get into the company's potential very quickly, but I think it's important to go over some of the highlights. So I asked him, I was basically like, when, I mean, not even basically, this was the question straight up is when is search within Gmail going to work as good as Gmail being plugged in to ChatGPT? Right? Very interesting answer from Sundar. As opposed to saying, yeah, we're working on getting AI into all of our products. You know how he answered? He said this, he says, we're trying to bring this all together in a unified agent. First for enterprise and then coming for consumer. He says, you can address this agent, whether you're in Workspace, Search and Gemini.

• 5:55Alex Kantrowitz?

  We're putting a lot of time and effort into making sure as we build out our agentic experience that unification and that capability works well across all these services. You know, and then I said, well, that's a good answer to the interface question because I asked him what the interface of the future looks like. And he goes, it is. So I think I, and you tell me if you're reading this in a different way, but I thought this was very telling. I almost read this as, you know, in a way, Google's going headless where it's instead of having separate product areas, which is kind of the way that it operates now. Everything is going to be unified through the agent and the priority is building those integrations within the agent as opposed to building the integrations within the product themselves. That sounds smart to me. Let me turn to you. What do you think about that strategy?

• 6:39Speaker 01

  I think that's absolutely what they need to do. Again, the idea of having Gemini as like this little button at the top right of your Gmail and your Google Sheets and going and staying in that kind of being constrained to that traditional product layer. And AI becomes an add-on to AI is the core UI. And you're chatting with it, you're asking it to go through your email. It's the way so much of AI has already moved and I think it's the right choice. I will say, knowing how siloed a lot of different parts within Google are, and even I think that reflects in the product. It's interesting to me and actually we've joked in the past that Google's McKinsey background makes them uniquely suited to recognize.

• 7:24Alex Kantrowitz?

  Sundar's.

• 7:24Speaker 01

  Sorry, sorry, yeah, Sundar's makes them uniquely suited to actually pursue this organizational change that is required at a company like Google. But who would own that product? Is it Google Cloud, which owns Google Workspace? Is it, DeepMind is no longer DeepMind, right?

• 7:45Alex Kantrowitz?

  No, it is. Google DeepMind.

• 7:46Speaker 01

  Google DeepMind. Is it the Google search? Like who actually owns that at a company like Google? To me, that would require some massive internal transformation to actually make that successful.

• 7:59Alex Kantrowitz?

  But isn't it pretty simple? Like, don't you just create a new team to own it? And you then change the way that you evaluate the other products, right? So let's say you have the Gmail product group. You're going to say you still work on Gmail. But as opposed to, let's say, engagement or user numbers being your North Star. Your North Star is now going to be, you know, how many times people, you know, repeatedly query Gmail through the agent.

• 8:29Speaker 01

  That actually sounds perfect. And I think that's exactly how it should be now. Now, come on.

• 8:35Alex Kantrowitz?

  It's a hard, it could be tough to swallow because it's a lot of centers of powers within a big company.

• 8:39Speaker 01

  Centers of massive amounts of powers and hundreds of billions of dollars of revenue and like.

• 8:45Alex Kantrowitz?

  Right.

• 8:45Speaker 01

  I mean, this is, to just say, oh, by the way, your worth is now number of queries rather than you have been evaluated forever and your entire department's worth is based on daily active users and total like utilization to. Oh yeah, you're just an API call now, or not necessarily an API call, but you're just some queries to this other new shiny product. Again, it's interesting to me because a company like Google, I think more so than, I mean, actually Microsoft, it's the same thing. And I think we see that disjointed nature across a lot of their product offering. So that for, for the giant hyperscalers, that is the bigger challenge to me.

• 9:29Speaker 01

  And actually, as we're saying this even more now, Sundar, team product, I'm going to double down on because I think if you can solve that, you have the, every user in the world sitting and using your product or vast majority of them, like make that work well and just being around the frontier should be good enough.

• 9:50Alex Kantrowitz?

  And, and you know, you're hitting on an interesting point here, which is that Google really is this company with so much going on and yet many dilemmas, right? Another dilemma is where to allocate the compute. And you mentioned Google Cloud and I think there is, there is a well documented and obvious, clear conflict of interest between AI research and cloud compute within and cloud, yeah, cloud services within Google.

• 10:20Alex Kantrowitz?

  Let's say you have a bucket of compute. You could give all that compute to cloud services and because of the demand for AI compute, chips, et cetera. You could make massive profits. We'll talk about this in a minute, but Google Cloud platform grew 82% this past quarter. And that's with a lot of the compute capacity going to AI research, right? So if you were to put even more capacity to cloud, I wouldn't be stunned if they took, if they overtook Azure and maybe even AWS at some point in cloud computing. But basically, you know, I spoke with Sundar about this and what he said was, everybody is short compute. He said, today, when you look at everything, everyone is short, not just us, other companies.

• 11:05Alex Kantrowitz?

  And everyone wishes you had two times what you planned for because these decisions that you have today in 2026 were made in 2024.

• 11:14Alex Kantrowitz?

  And this is probably the toughest part of his job is allocating the compute between cloud profits and research, which is a cost, but can put it in in place to be able to lead the AI game. And of course, like, you know, as much as we might clamor for the product, it's always like, well, where's Google's latest model? And they finally have one with Argon that's performing quite well on the benchmarks.

• 11:35Speaker 01

  I I love this because actually that decision, where do I allocate the compute is the ultimate expression of team product versus team model. It's where are you going to push it to the research side and the actual like frontier training side? Are you going to push it to Google Cloud, which is going to be the much more application and product heavy side of things? Again, it's not pure product, but it's still in the much more kind of like general utilization of that compute. So, so I like it, Sundar, and he's going to show us which team he's on based on where that compute gets allocated. And it sounded like from the interview that it's still going to be leaning towards the research side. Is that, is that a fair understanding?

• 12:19Alex Kantrowitz?

  I think basically what he was trying to say was research is going to eat. Here's the quote, "Our cloud business is at any given moment in time foregoing short-term revenues because we are making compute trade-offs to support frontier AI development." So very clearly, cloud is sacrificing money. And then he said something else, which I thought was interesting, and I don't think the world has picked up on. So what he talked about was that some constraints are good. Even our AI researchers have some constraints which are also good. That's what inspires creativity. That's what helps you come up with a more efficient algorithmic breakthrough. If you were to run that logic by, let's say, the,

• 13:01Alex Kantrowitz?

  you know, the AI researchers at Anthropic or OpenAI, I think they'd have a heart attack. So I think it is very interesting to hear his perspective that like, yeah, I'm going to give you the amount of compute I think is necessary to advance the frontier, and we're committed to the frontier, but some constraints might be good for you. But that was interesting. That is a very different philosophical shift that no one's picked up on yet.

• 13:24Speaker 01

  No, that's, it's great to call that out because I actually think that is very relevant. Again, to go back and forth, though, if he's saying on one side, the entire industry is short compute, and my biggest challenge is allocating that compute. But I do like this idea because, again, there's a lot of kind of talk around how it was actually a lack of access to abundant compute that actually pushed Chinese innovation on more on the algorithmic side. We've seen innovations with decision models in Jev recently and like, like actually doing more with less. Certainly, that kind of constraint forces innovation versus like, you have infinite access to compute, and that's going to be

• 14:05Speaker 01

  where you kind of how you approach all these problems. I think that is interesting that he's saying that. Again, what does that actually mean for his, what do you think those meetings look like? Do you think they have like a meeting where all the most powerful people at Google sit and then wait to be told what which pile of compute they're going to get access to? It's like, one chart goes up and it's like, all right, sorry, cloud, research is, research gets this many.

• 14:39Alex Kantrowitz?

  I do think that there's a version of that. I mean, I'm not privy to the details of the meetings.

• 14:43Speaker 01

  We're just hypothesizing. This is fanfic, Google fanfic.

• 14:47Alex Kantrowitz?

  But I mean, it would not be stunning for me to, you know, think that there are people with projects within the company who are like, I'm going to need this much compute or I'm leaving. And that, those are the decisions that he's faced with. I'm sure that happens. I mean, Noam Shazer, for instance, who's been in and out of Google and founded Character AI in the middle, he left. He went to OpenAI. Why do you think that happened? I mean, I could just imagine the conversation, and they spent a lot of money bringing him back.

• 15:17Speaker 01

  Yeah, yeah. Could have just invested in some, well, I guess, they couldn't have just invested in some more GPUs, hence the short compute, but.

• 15:26Alex Kantrowitz?

  But they're making TPUs. The problem is that the decisions, it takes two years in terms of build out, probably even longer, honestly. But yeah, and then on the cloud side, it's probably just like, you know, I could see the cloud. I could see Thomas Kurian making the argument, listen, we are in a rare position where after lagging as the number three cloud computing company, cloud computing service, we can make a legitimate push for, you know, at least number two and potentially number one. And I mentioned this before. Google Cloud Platform, eighty, almost an eighty-two percent growth rate this past quarter, year over year. Their revenue last quarter was 24 billion, 24.8 billion. Azure's revenue

• 16:11Alex Kantrowitz?

  last quarter was 29.4 billion. AWS is, revenue was 42.2 billion. AWS, 37% growth, Azure, 42% growth, cloud, Google Cloud, 82%, sorry, Azure, 42% and Cloud, 82%. They have a meaningful shot here at at at least passing Azure. I don't think people are recognizing this. You know, if these numbers continue a pace for maybe another year or two, they're the solid number two. And if you're running the cloud business, man, it's like, you make that, you make that pitch, and it's hard. I mean, it's a company that's been struggling to build a cloud business for a long time, or really, you know, clawing at it. This is the moment to capitalize. But of course, it comes at the expense of research.

• 16:55Speaker 01

  What is your decision as a hypothetical Sundar?

• 17:01Alex Kantrowitz?

  Flood the cloud, man.

• 17:02Speaker 01

  Flood the cloud.

• 17:03Alex Kantrowitz?

  Cloud's got to eat. No, I don't know. I don't know. I wouldn't want to be in that job because it's so hard. How about you?

• 17:10Speaker 01

  I think it, again, I love it. It comes back to, do you believe the product or the model is going to be the?

• 17:17Alex Kantrowitz?

  You're giving the cloud the money.

• 17:19Speaker 01

  I'm giving the cloud the money. I'm giving the cloud the money. I'm telling my researchers, do more with less. Come up with innovations that actually make this more compute efficient. And again, they have the distribution base. They have the, like, every, whatever billions of people will be interacting with their products that, to me, I just, more so than ever, most people don't need to be at the frontier. Most people do not need to be on the frontier model for most tasks. Not all of us are doing, not everyone needs to be doing 3D modeling and whatever else. Like, it should be fine for

• 18:01Speaker 01

  them to focus on creating the most, again, like the instincts of the world. We've talked about this with Muse. No one even cares what model it's actually running on at any given time for a given task. All everyone cares about is that they are magical product experiences. And to me, of Google, where's your agent? Where's a personal agent?

• 18:22Alex Kantrowitz?

  No, I highly disagree with you on this one. I think that if the unified agent is going to be the product experience that people are going to be competing about, having the smartest and most capable one is going to matter. Because right now, what you've seen is Muse. I mean, just imagine you built Muse, but the model underneath it was 10 times smarter. You would obviously use that one. So if you hit.

• 18:43Speaker 01

  But what, what does that actually mean? Because Opus 5.5, a lot of the times, does not give me what I need it to give me. It like overthinks, it overdoes things. It, for simple things, it's not necessarily the right answer.

• 18:58Alex Kantrowitz?

  Well, I'm going to, so this is what I'm saying, like, I'm trying to say is like, with model innovation, you know, you won't be saying it doesn't give me what it needs to give me. You'll be saying, remember, we talked a lot about how important it is that a model understands the intent of the query and routes it the right way. And so if you have one that's incredible at that, that thinks just the right amount for when you have a sort of low intensity task and a lot when you have a high intensity task, and you can trust that it gets it right, that's, and it has the EQ to know when it should interrupt you or not, that I believe will be the winning product. I mean, otherwise, what are you competing on? Your mascot.

• 19:34Speaker 01

  Your computer. Certainly the mascot. And what would Google's be? Let's start naming Google's personal agent. Or is it just Gemini?

• 19:43Alex Kantrowitz?

  Don't let Alexander Wang anywhere near the brand.

• 19:45Speaker 01

  Leave Gemini alone. Leave Gemini alone. Do not sexualize Gemini. That's my platform.

• 19:54Alex Kantrowitz?

  I'm voting for that.

• 19:55Speaker 01

  Yeah, I still disagree. Again, I think like, the majority of use cases and ideas that like, people will be interacting with, to constantly get that product layer better and better and better in answering it, even again, right now with Muse, like, when should it respond quickly? When should it wait? Even tiny little things. I think Instinct, one of the things I love it does, is a little emoji reaction, just to show you like, it registered your query, even if it might take a little longer to actually come back to you. Like, there's so many ways people can actually, these products can try to help guide people along the way versus just sheer model intelligence. Are you still using dots?

• 20:37Alex Kantrowitz?

  I am using dots. I'm liking it. I think that like, we should, we should definitely make time to talk about just the potential of Google because every time I speak with Google, it's just, it's clear to me that, that, you know, if they're able to get all their ducks in a row, so to speak, they are, you know, so well positioned, probably better than anybody else. So think about, I wrote a little list about, you know, Google's, Google's potential if it hits everything right. So it could have an agent.

• 21:06Speaker 01

  Give me the list.

• 21:07Alex Kantrowitz?

  The list is this. It could have an agent that works seamlessly with its services, right? Which, by the way, since so many people, a billion, 13 products with a billion users, that agent can be extremely valuable if it's working across your Gmail and calendar natively. It can have an AI for information retrieval, right, which is search. It can license out its models via the API, so make a licensing fee there. It can resell or sell compute and potentially even chips via Google Cloud Platform. It has Waymo. And then, of course, it has tens of billion dollars either invested or committed to be invested in Anthropic. So it'll have a huge chunk of that company.

• 21:51Alex Kantrowitz?

  Name me a company outside of Google that has the ability to hit on all of these fronts, from unified agents to model licensing, autonomous driving, and then of course, the investment. I can't think of one.

• 22:04Speaker 01

  No, I completely agree. And I kind of love this list. And but again, to me, this is like, what we have seen to date is all of those potential channels also present potential complexity, or not existing complexity, that actually make things difficult for them to execute. Again, why, when I ask Maps in Google Maps, do I get a completely different answer that's worse than when I ask Gemini the same question? Why did Google Maps integration? Again, I'm asking like very pedestrian things that should be solved. And that's where each one of those, I mean, when you said it, 13 products, each with a billion users, they

• 22:45Speaker 01

  know everything about all of us. They should be able to serve us all better, the entire search, like better search experience they should own. Shopping, actually, you didn't even have shopping here. I actually think they're incredibly well positioned in agentic commerce to actually make a dent on Amazon. But that presents the challenges too. Who owns what? Who, what power centers are you kind of fighting? And so to me, and again, if Sundar, if he can figure this one out, the organizational structure and that gets

• 23:25Speaker 01

  them to the greatest potential on this, if anyone can do it, he can. So I don't disagree.

• 23:31Alex Kantrowitz?

  Okay, that's a good way to wrap the segment. We have 10 minutes before Stamos comes. And I want to talk to you about this concept that the AI money spigot may be running out. Remember that these companies have been funding AI infrastructure through VC, through their own free cash flows. I'm talking about OpenAI and Anthropic, but also the public companies like Google and Amazon and Meta. And then the free cash flow ran out. And so now what do they have to do? They have to like get creative. They're using debt. We've talked in the past about off balance sheet debt. They're doing equity sales to be able to to fund this, including Meta, which just split its stock and, you know, took away even

• 24:13Alex Kantrowitz?

  more voting rights. So it's able to sell that stock, I think, and invest it in building compute. The market's had it. Meta reported these earnings, and it's down 9% on the week. And this is from the Wall Street Journal, "A regulatory filing from Meta noted that recent significant capital raises from peers like Alphabet and SpaceX alongside anticipated fundraising from Anthropic and OpenAI have created an increasingly challenging fundraising environment. Oh, as a result, the company would more proactively raise funds before competitors absorb the market's available capital." This is the first time we're hearing,

• 24:55Alex Kantrowitz?

  honestly, of the capital potential running, potentially running out for companies like Meta, Google, OpenAI, and Anthropic. So there is a limit here to the amount of money that can be raised. And so Ranjana, my question to you is, compute has been the constraint all along. Basically, it's been as quickly as compute can come along, can come online. It will be bought and used, but the bottleneck has been the amount of compute that you can build. Is the new bottleneck the money? Because if Meta is running into these problems, you know, what, what, what is the potential for this entire AI build out can to get stopped

• 25:37Alex Kantrowitz?

  in its tracks by the simplest thing of all, the amount of cash you can have to build it up?

• 25:43Speaker 01

  Well, I think we talked about this last week. And one thing that I'm actually kind of happy about is, we're actually entering a period where there's rationality being applied to any kind of capital request, capital raise, like when there is SpaceX this week trying to raise $40 billion of debt and actually seeing that the actual yields they would need to pay were much higher than expected. Even in Meta, that was, I think they're supposed to raise, the capital commitments now yet have raised, risen to $825 billion, up from $700 billion in July. Like, the market is saying, okay, it's going to cost you more

• 26:25Speaker 01

  to get that money, which is good. It should, just from like, capital is finite anyways. And I do think there's, but, but it's gonna, we're gonna see more of that. Then you have the whole NeoCloud story with CoreWeave and others. And then, I mean, obviously, there's like, a great deal of potential turmoil there. But I think, to me, is the, is the reason capital is becoming more constrained because people don't buy the compute story? Or that they don't, they've seen that it's actually very difficult to build these data centers? And that it's not going to happen as quickly as possible? Do you think, and going back to Sundar's point as well, like, do you think the market as a whole has said, actually,

• 27:08Speaker 01

  this idea that the entire world will be short of compute is actually validated? Or do you think people are just like, actually, I'm not going to give you money to fund data centers because they're hard to build?

• 27:19Alex Kantrowitz?

  I believe it's, it's neither of these things. So I have two other reasons. One is, the investors are starting to do the math on what it's going to take to make these, these products profitable. This is a little item from a Wall Street Journal story that I read, which actually did the math on what Muse would need to generate to pay back some of these investments that Facebook is making. Remember, Facebook raised its guidance from 700 billion that it's going to spend on AI infrastructure to 825 billion. This is the amount of money they anticipate Muse building in one of the good scenarios. If Muse skyrockets to 100 million users next year, paying $20 a month, it would only add 24 billion to Meta's

• 28:03Alex Kantrowitz?

  annual revenue, about 12% of next year's anticipated capital spending. Associated advertising fees could add more to the pop, but probably not a ton. Meta, Meta made about $67 of revenue per daily active user from at mostly from ads, from in the year end, year to end of the third quarter, for 100 million users, that would add another 6.7 billion. Again, this is a company that's spending 100 billion, no, sorry, 825 billion on, on AI, on the AI build out. So basically, in order to make this work, company needs to get Muse to a billion users. And even then, we have questions.

• 28:44Speaker 01

  I think trying to come up with what is the scaled business model of personal agents like Muse. And normally, I'm like, very skeptical when people try to avoid that question. For a company like Meta, I still think it's still a bit early. Again, trying to apply the would you pay $20 a month? Are you trying to, trying to extrapolate out the existing ad revenue per daily active user? I still think like, we don't know what the business model around personal agents is going to be, or will there be a sustainable one? But, I mean, agreed, like, if the market starts asking those questions, it's a huge problem for a lot of companies, especially startups. Because I think, like, to date, especially on personal

• 29:29Speaker 01

  agents, the assumption is whoever just starts getting people draining tokens and using it nonstop, and getting completely habitual to it, the money will come. So if people start asking that, that is a problem.

• 29:43Alex Kantrowitz?

  So that's, that's one for me, is people are actually doing the math here. And they're like, how does this work? And the other side of it is, I think they're fatigued. They put the, the system itself has put so much money into these companies, and it's still experimental. And the belief was there, but eventually that hits the wall. That's from the Financial Times. "OpenAI has cut its valuation target for its latest funding round after facing resistance to a 1.4 trillion price tag from some investors." It's going to be 1.25 trillion now. "Deeper in the story, this was the rationale. Multiple people with knowledge of the Morgan Stanley-led process said demand from clients was weaker than in the past.

• 30:23Alex Kantrowitz?

  There has been zero clamoring, said one of the people. All the prior times OpenAI have been on, there's been a frenzy. This time, it's a bit of a thud. Some investors were also suffering from fatigue or indigestion after having invested heavily in prior rounds." OpenAI raised 40 billion in March 2025, 122 billion in March this year, and Anthropic has raised close to 100 billion this year. And that might be the most simple and obvious explanation here, it's fatigue.

• 30:52Speaker 01

  And I am happy if this is the case. You know what, everybody? I hope you all have a little bit of indigestion. Let's all just take a moment. Even the fact that, that there was zero clamoring, that in the past, there was much clamoring, is a reminder that everyone has been way too kind of intense about it. Because again, the fact that we're calling it a thud, when the jump in valuation is going to be almost 50% higher than its last funding round, is crazy. Like, the extrapolation, the expectations is still, I mean, just maniacal. So the idea that like, that is a thud, I think is, it's healthy for the markets overall.

• 31:35Speaker 01

  So if everyone can take a breath, pause to start moving forward again, I am happy.

• 31:41Alex Kantrowitz?

  So do you think that this means OpenAI, briefly, do you think this means OpenAI is no longer on track to a successful IPO? Or is it just sort of, I mean, usually these things, once these things stop going up, they start going down in a real way?

• 31:57Speaker 01

  I think it all depends on Anthropic and what happens. I mean, it is kind of crazy to think about, like, you're sitting at, you're invested in OpenAI heavily, heavily. All that matters is how the market receives Anthropic. Any kind of like, let's like, try to evaluate the financials on a comparable basis, none of that is going to matter. If Anthropic gets hit, there's no way OpenAI is going out.

• 32:23Alex Kantrowitz?

  Ranjana, before we move over to Alex, I just got to ask you one more question. Like you know, the financial markets, you know, the systems where, you know, people raise money and people invest it. Having worked again on trading floors in the past. Is it possible money just ran out like it? Did they just take all the available money?

• 32:44Speaker 01

  Well, I mean, if you look, it is UAE investors and co to that were coming in on this. So it's still, we've talked about when is the, where do the deepest pockets live? I mean, but, but there is like the sovereign wealth funds are the, the final boss.

• 32:59Alex Kantrowitz?

  Final boss.

• 33:00Speaker 01

  Yeah, and we've reached him short of, you know what? Where's the next government treasuries? That's your next, your last bastion.

• 33:10Alex Kantrowitz?

  Yeah, no, I've been saying for a long time that the Gulf states are the final boss of fundraising before IPO and. Opening up that stage of the game.

• 33:19Speaker 01

  Yeah.

• 33:20Alex Kantrowitz?

  All right. Look, when, when we come back, we're going to have a great discussion. I think people are largely under appreciating how intense the PHP vulnerability has been. And along with a number of other security vulnerabilities that have emerged this month. People are calling it black October for cybersecurity. And if that doesn't make sense, and there are still things that I am trying to learn about it. Good news is we are going to unpack it with someone who really does understand this world and is able to do it in a way that's accessible. And, and hopefully help us wrap our heads around how big of these vulnerabilities,

• 34:00Alex Kantrowitz?

  how big these vulnerabilities are that AI is finding in systems like, like PHP and what it means. Because we talked with Alex, basically as the hugging face hack happened. He said it was a big deal then it obviously proved to be a huge deal. He and I just texted this morning and I was like, I want to talk to you about PHP. And he goes, not just PHP, it's been an absolutely insane couple of weeks. So we'll speak with Alex about the implications of the insane couple of weeks and what the ripple effects are going to be when we come back right after this. This episode is brought to you by App Point. Everyone's racing to roll out AI right now. Co-pilots, chatbots, agents doing real work. But here's the part nobody loves talking about.

• 34:43Alex Kantrowitz?

  All that AI runs on your data and most teams have no single way to see it, secure it and prove it's under control. That's exactly what App Point does. For 25 years, they've been the trusted layer beneath the world's most demanding data, now extended across your entire AI estate. Your data, your cloud, and the agents acting on your behalf. It's how more than 28,000 organizations deploy AI with confidence. So innovation scales without scaling risk. App Point, the unifying trust layer for AI. Head to avpoint.com to see how enterprises deploy AI with confidence. Learn more at avpt.co slash big technology podcast.

• 35:27Alex Kantrowitz?

  That's avpt.co slash big technology podcast.

• 35:33Speaker 02

  This episode is brought to you by Google Chrome. You think you know a browser, but Gemini and Chrome, that's new. It can help you with practically anything on the web, like restoring a vintage motorcycle from a 50 page restoration block, or finally break down that long article you've had open for weeks. Gemini and Chrome is here for it. Ready to make anything online make sense? There's no place like Chrome. Check responses setup required compatibility and availability varies 18 plus.

• 35:58Speaker 03

  Stonefire naan is made with real buttermilk and ghee. It's the perfect flatbread for any occasion.

• 36:04Speaker 04

  I put out Stonefire naan with dips at every dinner party. I make naan grilled cheese when my daughter has friends over. I use Stonefire naan to reward the humans who do my bidding. Right. It's perfect for camping trips.

• 36:17Speaker 05

  Dance for it, feeble mortal.

• 36:19Speaker 04

  Sorry, is he talking to me or?

• 36:21Speaker 05

  Dance. Ha, ha, ha, ha, ha.

• 36:24Speaker 03

  From our tradition to yours, Stonefire.

• 36:27Speaker 04

  Together, we naan.

• 36:28Alex Kantrowitz?

  And we're back here on Big Technology Podcast Friday edition. We have, of course, Ron Jon Roy of Margins with us as always on Friday. And today we bring in our guest for when the proverbial excrement hits the fan. Alex Stamos is here. He is the Chief Information Security Officer at Cognition. New job, same Alex. Alex, great to see you. Welcome back to the show.

• 36:53Speaker 06

  Yeah, thanks for having me. I'm glad that I am the grim reaper of this podcast.

• 36:58Alex Kantrowitz?

  Well, the last time you were here on the Friday show, we were talking about the hugging face attack. Basically, as soon as right after it happened before the, the report was released. And you're like, guys, this is, you don't realize how bad this is. We certainly didn't. Ranjan was still calling it marketing. Then it turns out that, and he thinks he still is. Then it turned out that hundreds of bots had autonomously decided to hack this hugging face company in a fairly unprecedented attack that has basically, you know, driven the AI anxieties through the roof. Ron, and I'll give you a second to defend yourself here.

• 37:33Speaker 01

  No, no, I, I, the severity of the situation, I will recognize. I definitely have some questions on like the actual, how this vulnerability was found exploited? And what's that mean? Cause I'm still going to push back that, that they autonomously went out on their own and started doing nefarious things, like definitely trying to understand, is this kind of like targeted cybersecurity hacking? Is this people who know they want to exploit things and are doing that? And then we'll get into it, but.

• 38:02Alex Kantrowitz?

  We'll get into it.

• 38:03Speaker 01

  I was wrong that it was just marketing. I throw my hands up.

• 38:06Alex Kantrowitz?

  This is Alex, you're here for a seminal moment here on the show. So Alex was spot on last time. And now, you know, as we're talking, you know, Alex's belief is that this, what we're about to talk to you about is the next big thing. And as I mentioned before the break, I was like, I gotta, we gotta talk to you about PHP. And he said, it's not just PHP. This past few weeks have been insane. So I'll, I'll just read the story and then, and then Alex, you could take it away. This is the headline from the Wall Street Journal. AI just found a bug that puts up to 70% of the world's websites at risk. The creators of PHP, a technology that powers as much as 70% of the world's websites, disclosed a critical security issue that could be leveraged by hackers to take control of any system running its software

• 38:48Alex Kantrowitz?

  that would allow an attacker to steal information or launch a cyber attack on anyone visiting a hacked website. Good times, 70% of the web, not a big deal. So Alex, just talk to us a little bit about how this was found. It was found with AI and what this has led to and what it presages for what comes next.

• 39:08Speaker 06

  Yeah. First to set the stage, we'll talk about PHP first, but this has been about the craziest 30 days or so in the history of our industry of cybersecurity. And so PHP is what's catching the headlines. But for people to do this professionally, there's actually lots of stuff that's happened just the last couple of weeks. So the PHP bugs specifically, like you said, PHP is a very popular language for writing websites easily. So very few kind of enterprise quality websites are written in PHP. The interesting counter example is Facebook, although Facebook doesn't actually use real PHP. They use a typed version of PHP called Hack.

• 39:50Speaker 06

  But other than that, it is very hard to think of like a big company that uses PHP for a banking website or a big application or something. That being said, it's extremely popular for companies to make side projects, right? Here's my marketing site. Here's a, a smaller application. It's extremely popular in a number of frameworks and hosters like WordPress that host lots of sites. And so it is still very widespread. The bug was found by a, in a, a project that was being run by OpenAI called Hack the Planet, in which they have been providing.

• 40:28Alex Kantrowitz?

  Great name.

• 40:30Speaker 06

  Yeah, exactly. Right. That is marketing. I'll agree with Ron John on that one. But there's been, as we talked about actually on stage at your conference, there's a lot of controversy about the access to the best cyber capabilities from the two big L labs, OpenAI and Anthropic, who at differing levels restrict the ability for people to use their software to do vulnerability research. And so to, as a response to that, they, both companies run these programs where approved people have access to use their models to go find bugs. This was part of this where they were actually giving this away to free to bug finders, a company called Calliph, which is a kind of excellent security consultancy that does a lot of AI enabled vulnerability research.

• 41:14Speaker 06

  They used it to find the PHP bug. And then that was actually several months ago. And there's been a coordinated effort by a bunch of companies to try to get ahead of this issue of what's called coordinated disclosure. What kind of off the rails in the last couple of days, however, before the release? In that whenever you do these coordinated disclosures, you start obviously with a small circle and it gets bigger and bigger and bigger. And it started to leak out and we now have evidence that bad guys started exploiting this well before the public release. There was a controversial dump by the CEO of Chain Guard, which is a company that will make their own patches and push them to customers. But looking back, he might've been in the right. It's, it's, it's a little bit controversial. There's a big discussion.

• 41:58Speaker 06

  Anyway, the bug is a big deal because it is a pre-auth authentication remote code execution. So means you do not have to be part of the web app, right? So there's, you know, there's been a bunch of web app vulnerabilities where you need to be logged in or you need to be accessing some kind of functionality. This just works on the front end and it's remote code execution. It is not an incredibly easy exploit to write. It turns out to be quite a complicated issue, but people have figured it out probably with AI. And so.

• 42:23Alex Kantrowitz?

  So that, that just means that I just visit the site and my stuff could be, could be jacked.

• 42:28Speaker 06

  What it means is as a bad guy, you could just connect up and attack the system without having a login and without having special access. So even if the PHP site, the front page says login here, you can't access anything else. You're still vulnerable and you can't fix the bug without patching PHP, which is under your web code. They only released a patch for the latest family of PHP. And there's a lot of PHP sites on older versions. And so upgrading that breaks your site. So it's not just as easy as going in and saying, you know, run, run your update program, whatever your operating system is. For a lot of companies, they have to actually refactor their code

• 43:11Speaker 06

  to be compatible with the latest version of PHP8, because it was not backported. There, there turns out to be some like unofficial backports in patches that you can get. But those are not as widely available.

• 43:23Speaker 01

  So what does that, what does that mean in terms of the vulnerability of every website that has been built with PHP? In terms of the hacker can just take it down? They can access actual underlying databases? They have like full access to whatever is in terms of the, in their whole stack? Or what does it look like?

• 43:42Speaker 06

  They can take over the computer at the same level as the web server is running, which by definition has access to all of your data. Right? So what has been happening since just a little bit before the announcement is when you have a bug like this, you have a bunch of different bad guys go out and try to break into as much stuff as possible. And then they'll figure out later what they actually care about. And so what we've been seeing is automated exploitation of hundreds of millions of attempts to break into millions and millions of websites that are going on continuously. So these will be Russian ransomware actors who will like to take these things over, install malware, and then figure out who they want to actually ransom. It is probably what is called the Chinese cottage access industry.

• 44:24Speaker 06

  So there are, within China, there's effectively like an eBay for hacking. And so there's, there's providers in China that will break into a huge number of sites. We've seen this with other bugs. And then they will later sort through and then figure out who they want to sell access to inside of the PRC. There is probably the Iranians who have done this.

• 44:42Alex Kantrowitz?

  Our eBay is, is vintage sweaters and their eBay is ransomware on your computers.

• 44:47Speaker 06

  Yeah. It's not quite like a, a full eBay site from my, my understanding. But like, there's basically an ecosystem here. And it's quite smart, because in other countries like Russia, you have this problem where if there's a desire to hack something, everybody rushes in and they all step on each other's toes. So the PRC has the ability to kind of de-dupes taskings for their private access industry. So anyway, I expect that those people, we have seen this in the history. Like, there was a very famous SharePoint bug in Microsoft where these Chinese access vendors broke into something like 80,000 SharePoint sites that are on the internet and then sold them later to Chinese companies. So, and then these guys break in, they plant malware. And then sometimes what they do is they actually fix the bug so nobody else can do it. What we have seen in the past is you'll have them fighting

• 45:32Speaker 06

  over control of these systems. So whoever gets there first, part of one of the things they have to do is close the door behind them. Otherwise, other people will break in, remove the malware from the first hacker and then patch it themselves. And so that is effectively what's going on right now. Is you've got dozens or hundreds of hackers of hacking groups attacking tens of millions of websites and trying for control. And then in the long term, what you'll see is they'll then have their list of, this is what I control. And they'll search through it of like, oh, there's a government websites. This is a hospital. Like, what is the interesting stuff that now that I have control of it and I have malware there, I'm going to actually steal data or do a ransom?

• 46:10Speaker 01

  So, so by control, just so I understand it correctly, it's you control as users are entering information into the website. You're receiving all of that. But does it, but does it also mean you then have access to anything else, like in the backend? Or it's, it's both?

• 46:29Speaker 06

  You, you will have access to what is happening live, but also probably everything in the database.

• 46:33Speaker 01

  Yeah.

• 46:34Speaker 06

  And so, and then it also gives you a foothold inside the organization. So you're now behind the firewall. You're in their production network. And so you can, you've got your first foothold inside of their network. You can use that to maybe break in deeper. So that, that will, this is just the start for the PHP bug. This is the initial access vector. There will be, some of these attackers are probably breaking in and then just dumping the entire database out so that they can ransom, they can just use the data. Probably like the Chinese actors, what they're doing. Yeah, yeah. It's just like, you just copy it all. And then you figure out later what was interesting. 95% of it's going to be useless. 5% of it will be gold. And then some of them will say, okay, great. Now that I have a foothold inside this company, I can use this to scan the rest of their systems, find other vulnerabilities and go out and back.

• 47:19Speaker 06

  The other thing that I, I don't know, I don't have any good statistics on where we are, but in some cases, they're also using AI to do the attack, which means the traditional, I have to wait, doesn't really exist, because you can just have your AI agent go do the rest of those steps automatically. That, from what I've heard, is not as widespread. But that is going on in other situations that we can talk about. For example, a Chinese group broke into a bunch of South Korean bakes with completely automated AI attack chains. And so in this case, if you have that, that attack system set up, you could use this to pivot inside of the network to go to different systems.

• 47:59Alex Kantrowitz?

  So just going to give some stats that Matthew Prince from Cloudflare gave. In the 10 hours before it was publicly announced, this PHP vulnerability across the Cloudflare network, we saw thousands of attempts to exploit it. That jumps to tens of thousands in the 45 minutes post-announcement, hundreds of thousands within two hours and millions now. So this is certainly leading to, you know, a ton of hacking attempts. Just, just explain it for us. Like, if you're not like cybersecurity brained, what do you think the next couple of months are going to look like? You know, once, you know, obviously the damage is being done as we speak, but this is one of those things that it'll be latent until it starts to emerge. So what do you think the next month, two months, three months, six months are going to look like as a result of what we just saw?

• 48:42Speaker 06

  So first off, it is now basically impossible to get a instant response company to respond to you. So anybody qualified was already booked before this. So you'll have a bunch of companies.

• 48:51Speaker 01

  Yeah, what's instant response?

• 48:53Speaker 06

  Like, instant response. So like, like a forensics firm to help you do this work, they were already basically completely booked because of everything else going on before this. So if you are a big company and, but you don't have a team that can do your own instant response, you're in real trouble here, because it will be very hard to get a Mandiant or CrowdStrike or Sentinel One or any of the other companies that do this work to respond quickly. So first off, you're going to have lots of people trying to either do their own forensics or to recover by themselves. We will see, the breach notifications are going to start happening for the companies that actually have good security teams, because they will hopefully have detected that this happened. And then they will be able to do their own forensics.

• 49:37Speaker 06

  But that is going to be spread over a significant amount of time, because there's going to be a lot of people who patch it and don't realize that within the 48 hours it took them to patch, somebody got a foothold. And so then we'll see the secondary breaches over the next months as attackers now use that foothold to go deeper and deeper inside these companies. For, you know, ransomware actors, they want to get paid. So in those cases, they will contact those companies and ask for money. For the government actors, we won't hear anything unless there is some kind of interesting research that finds their attack servers or something like that. And so what you'll see is a huge amount of data is leaving these companies, a huge amount of customer data. We're also going to see a huge problem if everybody's passwords just got stolen. Right?

• 50:18Speaker 06

  So the, the number one way any individual human is hacked is that they use the same password on multiple websites. And what we're about to see is in the dark webs where these are sold, you're going to see these dumps of tens of millions of passwords being sold over and over and over again. And for a disturbingly large number of people, that is going to, that password's going to work on their email.

• 50:40Speaker 01

  Their bank.

• 50:41Speaker 06

  Their, their bank. Yeah. Especially, especially if you get access to somebody's email, their life is over, because then you can use that to reset almost all their other passwords. And so we're going to see a ton of kind of individualized fraud, spam. That kind of stuff is all going to hit a new high over the next six months.

• 50:57Speaker 01

  What do we do as everyday, simple folks who are just logging into our bank accounts and emails? And what do we do? I mean, use one password? What, what, what do you recommend?

• 51:11Speaker 06

  Yeah, so for, for normal folks, there's nothing you can do to actually stop the breaches. So what you need to do is you need to make sure you're using a different password on every single website. The easiest way to do that is a password manager. One password is one I like. There are other ones as well. So you, you need to install a password manager. And now if you've got that, you know, the name of your cat, 123 was your password, then every site that you're using that on, you need to now change it and, and use a randomized one.

• 51:41Alex Kantrowitz?

  My Pebbles 123 password is now exposed. Goodness gracious.

• 51:45Speaker 06

  So you've got to do that. You should just be very, I think what's starting is we've lived through this era where people just kind of assumed things were secure. That was never true, but it kind of works, because the number of attackers that were active was, right, was finite. And so if you just kind of blissfully walk down the street through a bad neighborhood, you just got lucky over and over again. Well, the neighborhood's gone really bad. We've gone from like, you know,

• 52:18Speaker 06

  A bad neighborhood in LA to like Somalia 1990s, right? Like it, we, it is completely, the threat profile is completely changed of what is the likelihood something bad is going to happen to you if you are walking down the street? And so I think people are just going to be much more paranoid. Obviously, there's a password thing. They're going to be much more paranoid about what websites they use. Like people just throw their personal information everywhere, login everywhere, and you're just gonna have to, you can't really do what we call vendor risk management as a normal person of asking them lots of questions, but you can get a feel of like, is this fly-by-night forum the kind of thing I want to put my personal information in? And I think what even normal people will start using sock puppets, right? So people will start creating secondary Gmail accounts for all the crap stuff they

• 53:02Speaker 06

  do, and then they'll have their important account for their bank and all that. And you're gonna want that secondary thing to be as disconnected from your real identity as possible. And I'd be looking out for frauds and scams, right? The number of spam is gonna go way up. You're gonna get way more texts and emails from people you know, asking you to click something. People are beginning phone calls because all this directed graph information about who knows whom and their phone numbers have all been leaked. And so you're gonna get a lot more of the bad texts and the phone calls of like, that are all AI-driven now of, you know, your grandchild's been kidnapped and all that. So like, people are just gonna have to just be much more paranoid going forward. And I think we talked about this, but I think unfortunately, this is probably the new normal

• 53:45Speaker 06

  for several years, where the pace of crazy things that have happened in the last 30 days might be, this might be up here, but we're not going back to the baseline. It might drop a little bit, but it is possible we are now at a heightened level of kind of operational tempo for bad guys and for defenders for at least several years.

• 54:07Alex Kantrowitz?

  And briefly, what's it gonna mean for corporations and governments? So the consumer level, we got down for the, for the big guys, what's gonna happen to them?

• 54:15Speaker 06

  Yeah, so on this, I'd like to expand it a little bit, because the PHP bug's a big deal. But just to make it clear, on the same, basically within 24 hours of the PHP bug, there was a large number of node flaws. So Node.js is also a popular web application server framework and is much more likely to be used by enterprises. Now, fortunately, the bugs there are more complicated and to exploit, but they are significant. We've had a bunch of breaches over the last couple of weeks. There was a certificate authority that had their certificate stolen, so kind of a not-so-great certificate authority. These are the people who, the little lock icon in your browser, they're the ones that make that work. And if somebody steals those certificates, they can create certificates, they can create

• 54:59Speaker 06

  an Amazon certificate or Google certificate that is also trusted.

• 55:02Alex Kantrowitz?

  I'm seeing this list, it's, yeah, it's PHP, Node.js, this is from X, so you can tell us if one of these are wrong, Java, GitLab, Railway, Signal, WordPress, LightLM, they're calling it Black October.

• 55:14Speaker 06

  Black October, yes. It is, it is, it is spicy. I mean, this is what we talked about on stage, like, this is, this is the start of the takeoff of what the new normal's gonna be, based upon just the number of vulnerabilities that are being found, but then also the operational tempo that attackers are able to stay at going forward. Those, all those breaches you're talking about, so like Railway, fireworks, those are almost certainly not PHP. So that is just attackers being good at their jobs and that being enhanced by AI.

• 55:46Speaker 01

  And finding API keys for everything you built on Railway, which I did insecurely myself on some side projects in the past, so I went back.

• 55:54Speaker 06

  Yes.

• 55:55Speaker 01

  Yeah, yeah.

• 55:56Speaker 06

  Same with fireworks. So there's a lot of attacks against infrastructure ingredient companies, where you see, and that is why I expect those attacks are professionals, that is not like a 19-year-old, that is probably somebody working for a commercial, like a, a commercial vendor who's doing state-level work, because folks are breaking into people who are important in the AI ecosystem, Neo Clouds, you know, hosting providers, and then once you have those API keys, you can turn around, go back to the cloud. So US enterprises, so enterprises are dealing with PHP right now, they're dealing with Node. They are asking all of their vendors what they're doing, right? So I have to, I keep on having to fill out these, send these emails saying, we do not have PHP at this company.

• 56:40Speaker 06

  But we did have Node, everybody does, but we fixed it as quickly as possible. What, you know, companies are like, kind of panicking for their vendors, for themselves, what this is reminding them is they probably have a lot of stuff they didn't know about. Like, a bunch of these PHP sites are like, somebody set up a website for a conference they held two years ago and it's still up.

• 57:05Speaker 01

  Yeah, yeah.

• 57:06Speaker 06

  Yeah, exactly. And, and if you architect the things correctly, then if you pop that, nothing bad happens. For too many organizations, once you're there, you're in a DMZ with a bunch of other servers that you can now compromise. Or, there was a bunch of data there that now you have to do forensics because you had the registration lists for everybody who went to your conference, that just got downloaded, you're gonna be ransomed for that, or it was downloaded for a state actor who's gonna use it for, you know, future whatever use, and now you're gonna have to do a breach notification. So there's a bunch of companies that are realizing that their attack surface is actually much larger than they expected because of all of this random crap, a lot of which is actually in the cloud, that makes it hard for them to pull together and say...

• 57:48Alex Kantrowitz?

  And governments, like I saw the NSA? The NSA was talking about this?

• 57:53Speaker 06

  Yeah, I mean NSA published, CISA published something, so yes, it is a big enough bug that you have the US government, unfortunately, the, the number of people who do defensive cyber in the US government has gone significantly down in the last couple of years, because CISA was kind of decimated by political, you know, political appointees who don't like the idea of CISA doing election security stuff, and this is showing now the outcome of that, which is, we really need competent people in the government to help coordinate response to things like this.

• 58:29Speaker 01

  Okay. Even though I am absolutely terrified right now, I'm still gonna ask one level above that I'm, I'm wondering about. So everything we've described so far is still, again, purposeful coordinated attacks to exploit leveraging AI to increase the velocity of these attacks. I still, then there's still the entire world of, and then there's reports on banking, like unsupervised agents potentially acting autonomously, obviously the Hugging Face thing, the scandal seemed to be more around agents going rogue as opposed to people controlling them in nefarious ways. Like, is that yet another layer we need to worry about? Or do we got enough to worry about? Yeah.

• 59:10Speaker 06

  Yeah, that's just, I mean, so those are two totally valid but completely separate issues. You've got the agents escaping during evals and training. That is going to be, I'm not gonna say solved, but the industry's done a lot to reduce that. A lot of things you've been hearing announcements are stuff that happened in the same air, same time as Hugging, timeframe as Hugging Face. It's just, it's all coming out now. Still, it's all kind of leaking out. You know, maybe that will happen every once in a while, but there's been a lot of changes in the way people do these evals and training. That is not like an actual, I think that is not really an actual, like, OpenAI's models going crazy and hacking you is not actually the threat that people should worry about.

• 59:52Speaker 06

  The other side is, yes, we are, people using agents and then being like, hey, you're giving Instinct or Muse, here's my entire one password, go like, handle my finances for me, go file my taxes, is totally insane.

• 1:00:06Speaker 01

  I'm hanging my head in shame.

• 1:00:09Speaker 06

  Where this technology is.

• 1:00:10Speaker 01

  I did it.

• 1:00:11Speaker 06

  But people are doing that, right? People are absolutely doing that.

• 1:00:13Speaker 01

  Yeah.

• 1:00:14Speaker 06

  And so that's what the banks are talking about, is that they now see all of these, these interactions with them that are, are authenticated correctly, so they're not stolen credentials, but are clearly bots doing interaction. And one of the reasons Instinct has a ridiculous valuation, from my perspective, but one of the things they did that, that made them popular, is they actually figured out ways to defeat all, a bunch of the automated bot detection mechanisms from these companies. And that's why Instinct is useful, because it will effectively bypass the safety protections that are in place at these companies to keep you from doing exactly what you're doing, which is to have your bot interact with the most important parts of your life.

• 1:00:55Speaker 06

  So that is, you have this, you have this crazy tension, where you have like, the banks and big tech companies and, you know, financial institutions and folks who are like, I am gonna do everything I can to prevent automated access to my systems on behalf of customers. And then you have this big demand from customers of, I want my life to be easy, so I'm just gonna turn over all my, my logins and personal data to a company that's existed for six months.

• 1:01:20Alex Kantrowitz?

  I just wanna end with this. There was a Nikita Beard tweet, who, he said, former head of product at X, I said, "There's nothing to worry about, nothing important is run on PHP or old software except the water and electrical grid, a few government services like our missile defense systems and a handful of electrified fences at the zoo specifically for the lions, tigers, and the cobras." So folks, if you do see a lion walking in your neighborhood this weekend, just understand that the origin was OpenAI's Hack the World program.

• 1:01:47Speaker 06

  Yeah, hack the planet.

• 1:01:49Speaker 01

  Hack the planet.

• 1:01:50Speaker 06

  The planet.

• 1:01:53Speaker 06

  Which is a reference to the hackers movie from the 90s. I don't know. This is another reference. I can't make these references at work anymore because now I work with a bunch of 25 to 30 year olds and I can't make any 90s references. Literally, I had, I mean, there's like multiple employees at Cognition who were students of mine at Stanford and one of them called me professor. And it was like the scene from Indiana Jones where, you know, he becomes a crypt keeper immediately. Yeah. But I can make it with you guys. You guys are closer in age to me.

• 1:02:22Speaker 01

  I remember Angelina Jolie was in that. Yeah, I remember. That was like what computers were supposed to be in the, when hackers were, yeah.

• 1:02:32Speaker 06

  Yeah. And they're hacking the mainframe. It's pretty, yeah. There's a lot of neon. It's pretty fun. It's a fun movie. A lot of people watch it like in parties at Black Hat Defcon. But okay, to OpenAI's credit, like the, the truth is, is this bug has existed for a decade.

• 1:02:47Alex Kantrowitz?

  They found it.

• 1:02:47Speaker 06

  A bunch of the bugs that Anthropic and OpenAI are either fixing themselves directly or are facilitating the fixes of are issues that have existed for decades that have always been waiting there. And so there are people, I just want to push back on this because there's people on X who are like blaming Anthropic and OpenAI. And the truth is, is these bugs were there and it is very hard to fix a open source product like this that is so widely discredited. This was handled as well as it possibly could be and was always going to be bad. And if OpenAI and Anthropic were not doing this work, these bugs will be discovered. So I've got my M5 Studio Max finally came. I'm running a obliterated quantized version of GLM 5.3 and wow, like the stuff, I feel

• 1:03:30Speaker 06

  like a much younger man with the reverse engineering I can do, the exploits I can write, the things I can do now on a Mac Studio that leaves absolutely no logs. And so these bugs were going to be found by the open weight models, the Chinese models. Somebody was going to find them. We have to fix them. And the only way through this of the two years or, or three years or five years of dark ages we're going to go through is to find bugs and fix them. And then also we're just going to have to rewrite a huge amount of software. That is, we can't have these applications written in like type and memory safe on languages, languages by humans. We're going to have to refactor the whole thing. And the good thing here is that would have been absolutely impossible five years ago. Now it is totally pluggable, right?

• 1:04:12Speaker 06

  Like that's actually a big part of our business at Cognition is helping big companies refactor stuff. You know, and there's all these examples of like some old SAP based software that was rewritten in eight days and such. And so you could do that, but it takes money. It takes time. It takes access to the best models and it takes kind of a willingness on behalf of the entire open source community to throw away the old stuff and to replace it with something new. And so I think that is one of the things that might come out finally. This is something I've been calling for actually for a while is like, we just need to rewrite a huge amount of the software that underlies the internet. Maybe finally there will be the billions of dollars necessary in both money and tokens thrown into a pool here so that that can get done.

• 1:04:55Alex Kantrowitz?

  Right. Last week, my biggest worry was the honey pot. So it turns out I was not anywhere prepared for where we would be this week.

• 1:05:01Speaker 01

  The good old fashioned human honeypots, actually. We're going to look back nostalgically.

• 1:05:06Alex Kantrowitz?

  Exactly. Exactly.

• 1:05:08Speaker 06

  Yeah. Yeah. Well, those are hard to copy with AI.

• 1:05:13Alex Kantrowitz?

  For now. Alex, it's always great to speak with you. You know, you've been here with us through thick and thin through the year. And as the, the stuff keeps hitting the fan, we'd love to keep speaking with you. So thanks again for coming on.

• 1:05:25Speaker 06

  Yeah. I feel like this won't be the last time we chat. Unfortunately, we'll be back.

• 1:05:31Alex Kantrowitz?

  Oh God. All right, everybody. Well, have a very comforting weekend. Thank you, Alex, and thank you, Ranjan. We'll see you next time on Big Technology Podcast. Stay safe.

• 1:05:42Speaker 07

  The wheel had roads. Electricity had the grid. Innovation needs infrastructure. Plaid makes AI work in finance. Visit plaid.com/ai to learn more.

• 1:05:57Speaker 03

  Stonefire Naan is made with real buttermilk and ghee. It's the perfect flatbread for any occasion.

• 1:06:03Speaker 04

  I put out Stonefire Naan with dips at every dinner party.

• 1:06:06Speaker 03

  I make naan grilled cheese when my daughter has friends over.

• 1:06:09Speaker 05

  I use Stonefire Naan to reward the humans who do my bidding.

• 1:06:13Speaker 04

  Right. It's perfect for camping trips.

• 1:06:16Speaker 05

  Dance for it, feeble mortal.

• 1:06:18Speaker 04

  Sorry, is he talking to me or?

• 1:06:20Speaker 05

  Dance. Ha, ha, ha, ha, ha.

• 1:06:23Speaker 03

  From our tradition to yours. Stonefire.

• 1:06:26Speaker 04

  Together we Naan.