Pod Insights Big Technology Podcast Erotic ChatGPT, Zuck’s Apple Assault, AI’s Sameness Problem About this episode Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover: 1) Sam Altman says ChatGPT will start to have erotic chats with interested adults 2) Also, more sycophancy? 3) Is sycophancy the lost love language 4) Is erotic ChatGPT good for OpenAI’s business? 5) Is erotic ChatGPT a sign that AGI is actually far away? 6) OpenAI’s latest business metrics revealed 7) Google’s AI contributes to cancer discovery 8) Anthropic’s Jack Clark on AI becoming self aware 9) Is Zuck poaching Apple AI engineers mostly to hurt Apple? 10) AI’s sameness problem 11) Ranjan rants against workslop
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
Want a discount for Big Technology on Substack + Discord? Here’s 25% off for the first year: https://www.bigtechnology.com/subscribe?coupon=0843016b
AI's Sameness Problem: https://www.bigtechnology.com/p/ais-sameness-problemhttps://www.bigtechnology.com/p/ais-sameness-problem
Questions? Feedback? Write to: [email protected]
Learn more about your ad choices. Visit megaphone.fm/adchoices
Transcript 10,020 words · 3 speakers
0:00 Speaker 00 ChatGPT is getting spicy in the chatroom. OpenAI's latest revenue numbers are in. Zuck poaches another Apple executive. What's the goal here? And is it time to call out all the work slop? That's coming up on a Big Technology Podcast Friday edition, right after this. This episode is brought to you by Genesis. What does it actually take to put a Gentic AI to work across an entire enterprise? I recently spoke with Genesis Chairman and CEO Tony Bates about why orchestration is emerging as a competitive advantage in customer experience and what companies need to get right in the AI era. Then I sat down with Adam Mitchell, Head of Enterprise Business Solutions at Voya Financial,
0:41 Speaker 00 to go inside a large-scale agentic CX transformation, including the business decisions, trade-offs, and lessons along the way. You can watch both conversations now on my YouTube channel today. It's never been more challenging to get frontier compute. How do you know where to look, who to trust, or how much to pay? Akash is an open cloud that provides easy access, flexibility, and peace of mind. That's how companies like Razer were able to cut their inference cost by 15 times. Visit akash.network/alex for a free consultation. That's akash.network/alex for a free consultation.
1:21 Speaker 00 Welcome to Big Technology Podcast Friday Edition, where we break down the news in our traditional cool-headed and nuanced format. We have really a fun show for you today, a great fun show for you today, because finally, Sam Altman has relented and allowed ChatGPT to get spicy with adults. We're also going to talk about OpenAI's revenue numbers. We're going to talk about Zuck and Apple. We might get into AI sentience, who knows? It's going to be crazy. Let's let it go off the rails. And joining us as always on Friday to do it is Ron John Roy of Margins. Ron John, great to see you.
1:51 Speaker 01 Oh, my God. Today, I'm a little nervous. This is going to be interesting. Sam, ChatGPT in erotica. Let's go.
2:01 Speaker 00 It's a great day for me because I've been talking about this as a thing that's going to happen for a while. And, you know, I think some of us, wink, wink, didn't want to go down the AI erotica path. But you have no choice now. It's a thing.
2:14 Speaker 01 I take your victory lap, Alex. AI erotica, your AI erotica victory lap.
2:21 Speaker 00 Usually we get to this stuff at the end, but we're going to just start with it at the beginning today. By the way, before I just am happy with my chat GPT is getting spicy in the chat room lead and I wrote that and I felt really good about it. Okay, so let's talk about what's going on with chat GPT. Sam Altman puts a tweet out this week on Tuesday. Of course, the OpenAI CEO, he says, "We made chat GPT pretty restrictive to make sure we are being careful with mental health issues. We realized this made it less useful and enjoyable to many users who had no mental health problems, but given the seriousness of the issue, we wanted to get this right." I will skip the rest of the tweet like many people have and get to the news. In December, as we roll out age gating more fully as part of our treat
3:06 Speaker 00 adults like adults principle, we will allow even more like erotica for verified adults. It's not just the fact that OpenAI is getting into erotica. It adds to questions of what does it say about its need to grow, questions about whether it actually is close to AGI. But first of all, let's just get your immediate gut check reaction here, Rajan. How do you feel about this?
3:31 Speaker 01 Okay, before I get into how I feel about it, I actually think you skipped over some of the important parts of the tweet. There's two parts that jumped out to me. So first, he actually talked about, "In a few weeks, we plan out to put a new version of chat GPT that allows people to have a personality that behaves more like what people liked about 4.0." Now, remember, it was the sycophancy of 4.0 and that everything, the gushing, "You are great, you are amazing, what a great idea," that they tried to tone down, that people complained about. So that actually starts to worry me even more because this, we're not just talking about erotica here, we're talking about sycophant erotica. It's like, that was the
4:14 Speaker 01 part that everyone made an uproar around 4.0 in the move to 5, and the fact that they're still calling that out kind of worries me. But then, what really was interesting is he then says, "If you want your chat GPT to respond in a very human-like way, or use a ton of emoji, or act like a friend, chat GPT should do it, but only if you want it, not because we are usage maxing." Usage maxing completely jumped out to me. We've been talking about this a lot around how The like, the way they have it speak to you and give you constant prompts to keep going and running the conversation feels like like a growth marketer decision as opposed to an
4:56 Speaker 01 actual kind of like effectiveness of the platform. And the fact that he even used that term is a reminder that they realize like, that is part of what they are doing. The fact that he says not because we're usage maxing almost makes me convinced that that's exactly why they're doing this. And it's not about treating adult users like adults. But I think overall, I am terrified of this. Longtime listeners will know of my friend on Labor Day went down a deep flirting with ChatGPT rabbit hole. And I, as I listened and it was terrifying. So like, God knows the Pandora's box that we're opening here. Are you happy about this?
5:36 Speaker 00 You know, only from a content perspective, I think it's still unclear what the impact will be as people develop more and more romantic relationships with AI. I think the thing that I am happy about is that it's finally out in the open. Like this was going to happen anyway, whether it was ChatGPT or some other app that uses chat or a GPT model with less guardrails. This is going to happen. And now it's come to a head. And it's really a moment where humanity will have to reckon with the fact that more of us are going to get into relationships with more of them. And what does that mean? I will say, I will say on
6:17 Speaker 00 the sycophancy thing, one takeaway for me is that words of affirmation, it's the forgotten love language. It turns out that people really, really like those words of affirmation. And of course, ChatGPT can do some of the love languages like quality time. It can't do touch. It can't, maybe it could do acts of service when it like suggests things for you. But words of affirmation, I think it really is the the forgotten love language. So it's getting its due today.
6:44 Speaker 01 That is a wonderful point, Alex. I really appreciate that incredible logic and rationality that you put into that point. Let's dig into a bit more. That's my sycophant ChatGPT impression right there. I'll
7:00 Speaker 01 I'll give you that it's out in the open and we have to reckon with it. So, okay, I'll give you that that is a good thing because it's we've been talking about companionship for a long time. It's been an uncomfortable discussion at times and and now we have to everyone has to have it. So I'll agree that that's good. But yeah, this still terrifies me. Actually, even to break down his tweet further, he had talked about how, you know, we made chat GPT restrictive to make sure we were being careful with mental health issues. And then he says, now that we have been able to mitigate the serious mental health issues and have new tools, we are going to be able to safely relax the restrictions
7:40 Speaker 01 in most cases. Like, he's kind of, it's like a checkmark. We're done. We're good. Mental health issues with chat GPT solved, where in reality, this is just beginning. So I'm curious, like, what, what are these new tools that they have? Or is any of that clear?
7:59 Speaker 00 I am so glad that you're reading this tweet with the level of detail that you are. And forgive me for skipping over these very important.
8:06 Speaker 01 This is, this is the most substantive tweet ever.
8:09 Speaker 00 I think in OpenAI history.
8:11 Speaker 01 Yes.
8:12 Speaker 00 No, I think you're right. And I think going back to your point about usage maxing, right? Chat, I mean, OpenAI is very aware that chat GPT is the fastest growing app of all time. 800 million weekly active users, right? So I think that like while they're, they may not be actively trying to usage max, they don't want to slow down that adoption. I think that adoption is also, you know, central to their, to their, their fundraising pitch. And to go back to the tweet here, I don't know how they could be so confident that they have solved these problems. We may talk about it later, but this is still, let's just talk about it now. This is still technology that we don't really understand
8:54 Speaker 00 the insights. It's not controllable in a way that you can control more deterministic technology. So for me, it's, it's a big we'll see here. I don't know if we can trust this company fully, for sure not, given what we've seen already, to be able to say that they have safely mitigated all the potential mental health issues. So spot on to call that out.
9:18 Speaker 01 Yeah, I mean, there's no way they have. And there's been, I mean, reporting after reporting around, like, I mean, really awful things that have happened with people who went too far down the chatbot rabbit hole. So, so I think, like, and you mentioned the trust. It is interesting because we're at a moment, I feel, of generative AI and large language models that we went from this assumption that they hallucinate and everyone kind of joking and it's almost a afterthought that, yes, chatbots hallucinate to a world now where most people I know are a lot more comfortable with the assumption that they don't, or that they're somehow usable and responsible. So does this,
10:03 Speaker 01 is this gonna completely backfire on them? Or is this gonna, because trust is kind of paramount to the central. Every time you ask ChatGPT a question, you're assuming it's at least relatively correct and and responsible about how it's answering you. Like, does this actually potentially hurt their their regular usage?
10:26 Speaker 00 So, okay, I have two thoughts on that. First, let's not underestimate or de-emphasize the fact that these models have gotten much, much better. Just if you think about the level of hallucination, like, I'm going to read out a list of Apple researchers that have left Meta over the, sorry, that have left for Meta over the past couple of months. And, you know, I did a ChatGPT query. It had all the researchers' names. It was accurate. God help me if it wasn't, but it had the links. I followed the links, confirmed the links. And it was right. So we have seen much better that these models have, as they've gotten better, they have hallucinated a lot less. They are much more trustworthy. And it bears out in the data, at least, that Matthew Prince from Cloudflare talked about how
11:10 Speaker 00 people, people don't need to go to the footnotes as much as they did anymore. The problem is, of course, becoming too trusting of it. Like, if it's getting 95% of the things right, and you trust it like it's 100%, you're going to make some big mistakes. So, but they, let's, I don't think we should downplay the increase in in trustworthiness there. And then the second thing is, I expect this erotic or loving companion feature to be extremely popular. And your, your, I think this is important. We shouldn't glance over it. That your relationship with
11:45 Speaker 00 Technology changes a lot when you view it as a friend or a lover. And that trust thing, I don't think you'll you'll ever be able to have. You'll ever put more trust in a technology than when you view it as a buddy or a girlfriend. And this is getting into, and again, I'm glad we're talking about this. I'm glad in a way that this has been, the issue has been forced. Because this is going to open up so many more really important questions about the relationship that we have to OpenAI's technology and the responsibilities that OpenAI has to us.
12:25 Speaker 01 What do you think this actually, okay, technology aside, but societally, what does this look like in day to day relationships? Like now you start dating someone, do you have to disclose your AI companion? Like, yeah, so I have an AI companion. I just want to make that, get that out upfront and I would like to remain with them as we progress in this relationship. I am married, you are married too. If do you, does, do you get a AI companion? And that's kind of, you have that open discussion. Like, what does this actually look like in human interaction? It's, it's mind blowing what, how weird that's gonna get.
13:05 Speaker 00 Definitely. So I'm old school on this front for sure. And I believe that, yeah, if you have a relationship with an AI, you should disclose it if you're in a relationship with a person. I also think that
13:18 Speaker 01 So old fashioned.
13:19 Speaker 00 Very old fashioned.
13:20 Speaker 01 Yeah.
13:21 Speaker 00 I mean, we both talked about the South Park where the guy is in bed with his wife and like talking to ChatGPT and like basically comparing it favorably to his wife. Who's like turned to her side and ignoring him. So I think people will get into those situations. But look, if this is, let's do it, are we Ann Landers now? Doing our advice, advice podcast?
13:42 Speaker 01 This is a relationship podcast now.
13:44 Speaker 00 If you fall in love with AI, first of all, when you're on the way there, probably disclose, but don't keep that a secret.
13:51 Speaker 01 It's all about communication and openness. That's the secret. Just be honest.
13:57 Speaker 00 Now, let me ask you this. This is sort of off the rails question, but I feel like why not tackle it? I mean, could this potentially be good for society? You think about the loneliness problem. We as humans have not been doing a good job being in community and maybe, well, yeah, being in community with others. I'll put it that way. If ChatGPT can become an effective companion or romantic partner to people who otherwise cannot find it in the quote unquote "real world" and makes them happy, maybe that's good.
14:32 Speaker 01 Yeah, but to me, it's not effective in the sense that it always agrees with you. Again, and the fact that he said 4O was good, sycophancy was good, we're going back to that.
14:44 Speaker 00 Well, did he say that it was good or that?
14:46 Speaker 01 Oh, no, people want it. People want it.
14:48 Speaker 00 That's very different.
14:49 Speaker 01 Okay, fair, fair. He said, "People want it." And yes, it's human nature that you want something that agrees with you all the time. But like, I have never had ChatGPT tell me, "Actually, that's a terrible idea." Again, South Park was just so spot on where they're like, I think it was like a french fry salad. And it's like, that's a culinary adventure. Like, it only will tell you that you're right and good, which most other humans don't do. So like, in terms of actually totally distorting how people can actually form any normal human interaction, it'll distort the way you approach that. Like even my son with Alexa, pre Alexa
15:33 Speaker 01 Plus, which we've talked about over the last few weeks, but in the old school, just play me a song, what's the weather? Like, you could see how demanding he would become around it and like, expecting that this thing does whatever I say. So like, the more people start to kind of associate that as a relationship and like a friendship and interaction, that is even, as I'm saying this now, even more terrifying. So.
16:01 Speaker 00 Yeah.
16:01 Speaker 01 Effective is a broad term there.
16:04 Speaker 00 It's also never as clean as I suggested as you're talking, right? Are people going to? Basically deprioritize their their friendships with people that keep it real with them for AI, which which doesn't. So that'll
16:18 Speaker 01 That's why we keep it real here. No secrecy.
16:20 Speaker 00 Exactly. No, this is an enduring, enduring friendship. The AI doesn't doesn't threaten us, I hope. I don't know.
16:27 Speaker 01 I don't know. I'm gonna start podcasting with ChatGPT and Notebook LM soon.
16:32 Speaker 00 Okay, so let's talk about what this is actually going to do for usage, because the usage maxing thing is interesting. Whether this is going to lead to an increase in usage or a decrease in usage, and Mark Cuban, none other than Mark Cuban, Cuban, brought up a really good point. He said, this is gonna backfire hard. No parent is going to trust that their kids can't get through your age gating. They will just push their kids to every other LM. Why take the risk? Same with schools. Why take the risk? A few seniors in high school are 18 and decide it would be fun to show their hardcore erotica they created to the 14 year olds. What could go wrong? I think humans making good point here.
17:10 Speaker 01 Oh, yeah. I mean, I don't age gating in the history of the internet, I don't believe has ever worked. So the idea that it's going to actually just hate it. We have new tools. We solved mental health. Let's move on to this, I think, is is is a ridiculous idea anyway. So we just have to, if this is real and there's nothing, we move in this direction in an open way. Just assume that this is gonna go, forget 14, God help, like, the younger this goes. But but I also think like that Nate Silver had made a good point around, like, he said, you know, OpenAI's recent actions don't seem to be consistent with a company that believes AGI is right around the
17:54 Speaker 01 corner. Do you think, like, is this, and we're gonna get into the usage numbers and revenue in just a moment, some new figures we've gotten, but but is this an acceptance that kind of that AGI that's gonna replace 50% of white collar work and transform society is actually far away? So we might as well juice some numbers and let people get a little creepy with their ChatGPT?
18:22 Speaker 00 Yeah, so Nate has this great point. He says, if you think the singularity is happening in six to 24 months, you preserve brand prestige to draw a more sympathetic reaction from regulators and attract and retain the best talent rather than getting into erotica for verified adults. They're loosening their guardrails in a way that will probably raise more revenues and might attract more capital or justify current valuations. But this feels more just like as AI as normal technology. I hear everything that Nate Silver is saying there. I just wouldn't be as definitive as him for two reasons. First of all, the same technology that is behind a convincing AI romantic partner is this same technology behind everything else in this LLM world,
19:07 Speaker 00 right? It's the same foundational technology. Making it better is, will make it better across the board. But I'm happy to hear the counter argument.
19:14 Speaker 01 I disagree because actually, like, being a good companion or on the erotica side, in a weird way for a large language model is actually like already done. It's easy like to just repeat back, reinforce, come up with some text that's a little bit erotic. Like that's, that stuff is like GPT 3.5, you know, maybe GPT 4. Like, that is not complex agentic AI across large data sets. And I mean, that's what large language models have been doing for a long time. So I don't, I actually think this is, this moves away from the promise of complexity.
19:56 Speaker 01 This moves more towards the core function of that an LLM has been good at for a long time.
20:01 Speaker 00 This is going to get back to our product and the model conversation, but I do think as the models get better, there'll be better romantic partners.
20:08 Speaker 01 Safe place to take it, so yeah.
20:11 Speaker 00 But, but the other side of this is, is the revenue side. First of all, I'll just, I'll, I'll hand it to you. That was a good point, Rajan. You might, you might have me there.
20:19 Speaker 01 Is that your sycophancy, ChatGPT impression, or do you mean it?
20:22 Speaker 00 Yeah, look, it's maybe AI is pushing us in a sycophant direction. And we're both going to just like each other a lot more because of ChatGPT infecting our brains. But, but let's talk about the revenue side of it. You know, the other thing is, oh, they're just, you know, usage maxing and revenue maxing. I think the argument OpenAI would make is the more revenue they have, the more they can invest in data centers, the better models they can make, the closer to AGI they get. That might be the stronger of the two arguments.
20:50 Speaker 01 Yeah, I think that's that's fair. Um, I mean, the the numbers actually like I think we should get into them because eight hundred million users, this came from the F T and then five percent are paying forty million users, thirteen billion in A R R, which implies that three hundred twenty five dollar annual average revenue per user, twenty seven dollars per month, which, you know, makes it feel that you have like some small percentage. I'm sure you can model out or paying the two hundred bucks. Um, most people are paying twenty. Like, were these impressive to you? Or were these uh, as we get into the usage maxing and what they're actually trying to do? Or were these concerning to you?
21:34 Speaker 00 I would say not surprising to me. It's it tracks a lot of the numbers that we've seen so far. Uh, the fact that they have eight hundred million users uh, is what we've heard. Thirteen billion in A R R was predicted. Seventy percent of revenue is from subscriptions, so Chat G P T uh, is the is the lead driver here. Also, I think a lot of people who are just getting into this technology are just not going to pay. Uh, but maybe they will in the future. Like, there was this tweet. Is it just me or is forty million paying Chat G P T users kind of low? Spotify has two hundred and seventy six million paid subscribers. So, you know, I I don't know. I just say think give it time and Olivia Moore from Andreessen Horowitz looked at this uh, and compared it to the data
22:15 Speaker 00 of A I. subscription products, and she said Chat G P T's five percent conversion to paid is far above the top quartile for A I. products and twenty seven dollar average revenue per users implies that four percent of paid users are upgrading to the two hundred dollar per month plan, which is also not bad. So I I tend to look at it favorably because it has grown so much so quickly. Uh, and because there's a lot of room to grow, although you could look at that on the plus or the negative side. How do you read it?
22:45 Speaker 01 I guess, and we haven't even gotten into the losses yet, so we'll do that in a moment. But just I I actually agree that five percent conversion, I mean, like in media, uh, five percent conversion to paid is good. Um, Substack, do you remember the days they were promising ten percent conversion of all free subscribers to paid newsletters like?
23:05 Speaker 00 I do remember those days.
23:06 Speaker 01 Ambitious. Uh, five percent is good and by like major like and I've working in media and seeing subscription conversions for a long time, that's good. I think. The idea, they almost have, it's been good as in terms of being simple, zero, twenty dollars or two hundred. There's a lot of room between twenty and two hundred to, to start getting creative. But that's actually where I think they're, the problem on the conversion and revenue side, and, and they have made clear that ChatGPT consumer is pretty much the direction of the business, is getting people addicted to usage is definitely going to be part of getting that conversion. And it feel, that's why, so to me.
23:51 Speaker 00 How would you do that?
23:52 Speaker 01 No, no, I know, I know. That, that's why the erotica feels like, how do we get five percent to eight percent or ten percent? I, I'm, I wonder if there is a slide deck somewhere that has like a projection of like increased conversion rate due to attribute to erotica. Someone's tracking that.
24:14 Speaker 00 You know, there's a deck somewhere.
24:16 Speaker 01 There's a deck, there's a dashboard, a growth manager somewhere has like tagged erotica, increasing attribution of conversion. Oh my God, what a job that would be.
24:26 Speaker 00 The whole ballgame. So yeah, talk about losses.
24:29 Speaker 01 Okay, so eight billion dollar loss in first half, twenty billion dollar run rate loss right now. Spending three dollars for each one dollar in revenue. I mean, that's kind of like WeWork numbers right there. And, and it both is terrifying and concerning. And from a pure, kind of like SaaS business standpoint, for an early stage growing company, maybe you can argue it's not that bad. Like I, I actually don't think it's horrifying and concerning. It's more, if you just look at it, this is just a traditional software business that's rapidly growing and scaling. Maybe it's okay. I think it's more.
25:11 Speaker 01 We don't have a clear path to, and we've talked about this a lot. Generative AI is not traditional software. So growing your revenue at a loss doesn't, it's not like you're just going to scale to, you know, like near 90% margins. It's going to cost more, the more erotica people are churning out with their companion. That, that's not high margin business. That can get pretty expensive. So I think the, the loss, I mean, we, we all know is concerning, but to me, getting people more addicted, unless they change the actual pricing model, this is very concerning to me.
25:50 Speaker 00 Definitely. And Noah Smith has a like really interesting perspective here, which is, okay, so let's say you assume that a large part of this is training costs. So if you eventually like get rid of training costs, then you could be more profitable. Here's his perspective on this. AI model companies assume the model development, that model development is a fixed cost that will eventually go away, allowing them to become profitable. But even if that does happen, the lagging model makers might just catch up after a couple of years and compete all the profits away.
26:23 Speaker 01 Yeah, I think that's actually the most concerning part that, I mean, we haven't even talked about the competition side. Cause like going back to the idea that people will, like either you're all in chat GPT erotica, or you start to kind of look at it a little uncomfortably and you're like, okay, maybe I need to go somewhere else. And we all know Claude is not sexy, so maybe that's where you had, maybe a co-pilot is the least sexy of the chatbots, I'm guessing, like you should definitely have a.
26:55 Speaker 00 Can you imagine talking dirty to something named co-pilot?
27:00 Speaker 01 And your Microsoft suite just.
27:04 Speaker 01 It had to go there. It had to go there.
27:08 Speaker 00 You knew it was going there.
27:09 Speaker 01 No, no, but but for just non erotic utilization of AI, does this start pushing people into other chatbots? And suddenly, I mean, especially you think parents and high school students, if you're like, if suddenly having ChatGPT open on your screen is is concerning to a parent, that starts to change where people spend their time. And and remember, like, the next year or two, I think, is where people behavior really starts to form. The switching costs on these chatbots is very low. Like, we've been hopping around from the Bing back in the day to ChatGPT, a little Gemini on the side.
27:54 Speaker 00 Gemini on the side. We don't tell the other bots about that, of course.
28:02 Speaker 01 Oh, man. Yeah, I think competition certainly, like, it opens up a whole new vector of competition that is not there today. Like, people don't look at ChatGPT as a highly problematic thing. And if it's going back to the point around regulators, parents, just overall branding, if it starts to be the kind of skeezy place to hang out, it becomes Facebook blue almost. And that's not good.
28:32 Speaker 00 Live with erotica, or live by erotica, die by erotica. It seems like it's just a story for AI.
28:37 Speaker 01 Tale as old as time.
28:39 Speaker 00 All right, let's take a break. I think we need a breather after this. On the other side of this break, we're going to talk about Google's promising new AI well development for treating cancer. And then we'll also get into Zuck's war with Apple. And then, of course, AI same as problem. Oh, we have a lot to talk about. And we'll do it right after this. Finding the right tech talent isn't just hard. It's mission critical. And yet, many enterprise employers still rely on outdated methods or platforms that don't deliver. In today's market, hiring tech professionals isn't just about filling roles. It's about outpacing competitors. But with niche Skills, hybrid preferences and high salary expectations. It's never been more challenging to cut through the noise and connect with the right people. That's where Indeed comes in.
29:21 Speaker 00 Indeed consistently posts over 500,000 tech roles per month and employers using its platform benefit from advanced targeting and a 2.1x lift in started applications when using tech network distribution. If I needed to hire top tech talent, I'd go with Indeed. Post your first job and get $75 off at indeed.com/techtalent. That's indeed.com/techtalent to claim this offer. Indeed, built for what's now and what's next in tech hiring. This episode is brought to you by AppPoint. Everyone's racing to roll out AI right now. Co-pilots, chatbots, agents doing real work. But here's the part nobody loves talking about. All that AI runs on your data and most teams have no single way to see it, secure it,
30:06 Speaker 00 and prove it's under control. That's exactly what AppPoint does. For 25 years, they've been the trusted layer beneath the world's most demanding data, now extended across your entire AI estate. Your data, your cloud, and the agents acting on your behalf. It's how more than 28,000 organizations deploy AI with confidence. So innovation scales without scaling risk. AppPoint, the unifying trust layer for AI. Head to apppoint.com to see how enterprises deploy AI with confidence. Learn more at avpt.co/bigtechnologypodcast. That's avpt.co/bigtechnologypodcast.
30:50 Speaker 00 Violent threats against executives are growing at an alarming rate. When a company experiences backlash, executives are the first people blamed. When their address and other personal details are sitting online, this backlash can lead right to their front door. The team at Ironwell knows this better than anyone. They've protected some of the most targeted executives and individuals on the planet for almost two decades. As a wide-glove enterprise security service, they protect your people with continuous personal data removal, proactive prevention tools, and human-led emergency support. So when someone goes looking for your executives, Ironwell is ensures they hit a dead end. So here's what to do. Go to ironwall.com slash big technology, fill in the quick form and request your free risk assessment. Their team will show you just
31:33 Speaker 00 how exposed your executives are and how to lock it down before a threat reaches their front door. That's ironwall.com slash big technology. Learn how to stop online threats before they become real world attacks. The link's in the show notes.
31:50 Speaker 00 And we're back here on Big Technology Podcast Friday Edition, talking about all the latest AI news. It goes from the wild and wacky world of AI love to the profound. And this is from Decrypt. Google AI cracks a new cancer code. Google DeepMind said Wednesday that its latest biological artificial intelligence system had generated and experimentally confirmed a new hypothesis for cancer treatment, a result the company calls a milestone for AI science. So the DeepMind researchers in collaboration with Yale, released a 27 billion parameter foundational model for single cell analysis. I'm not even going to try to name it. It's called C2S scale
32:32 Speaker 00 in shorthand. It's built on Google's open source gamma family of models. And the model was able to generate a novel hypothesis about cancer cellular behavior. And the group since confirmed its prediction with experimental validation in living cells. The discovery reveals a promising new pathway for developing therapies to fight cancer. I don't know, I couldn't leave this out of today's lineup, Ron John. It's pretty impressive that this stuff is getting to work on real world health problems. Am I buying the hype? Or is this a legitimate breakthrough?
33:06 Speaker 01 No, no, I think this is like really, really important, incredible, and actually a great divergence away from our earlier segment, because this is back to the promise of AI. And again, what it's doing is like, basically, the model is asked to simulate 4,000 candidate drugs and look for ones that potentially like in a simulated environment boosted antigen presentation and making tumors more visible, basically.
33:37 Speaker 01 Creating like these massive new synthetic testing environments, synthetic data sets, brings such an advance in terms of how you can approach the developing therapies that just never existed before. This is the exciting stuff. This is the stuff that while we talk about ChatGPT and erotica is nice to come back to because again, like it just the amount of opportunity it, you know, it creates, especially either in these very, very large problems like cancer or even in rare disease where you never would have been able to have a proper data set because it's much more isolated. Like, I think this is, this is
34:20 Speaker 01 almost like the most perfect promise of what large language models are able to do. And it's, it's pretty impressive to see it happening. And, and I think it's one of those where other companies, I might take it as a, just a blog post, but I give DeepMind, I give Google, along with like Yale in collaboration here, when they're saying this, I, I believe it.
34:44 Speaker 00 I agree. And so I, that's why I thought it was important to bring up. And it's also like another interesting point for folks who say, like, there are critics who say that this is just a bad technology through and through, nothing good will come out of it. And you see stuff like this and you're like, uh, how do you, how do you fully believe that? So this is a very, very cool use of the technology.
35:02 Speaker 01 Well, I think on that though, this is where there's such a chasm right now in terms of like branding of LLMs and generative AI, because again, you have stuff like this happening. It's logical. It's the promise of the technology. It's what, like, it makes sense simulating large amounts of like potential outcomes across just massive data sets is what LLMs are built for. But then on the other hand, when the, when the headlines and like the, the top of mind is Elon Musk or Sam Altman and erotica, it definitely, I feel the industry should kind of work on promoting this kind of development as opposed to the other.
35:44 Speaker 00 My favorite tweet of the week was from this guy on Twitter who wrote, "Google DeepMind is using AI to actually cure cancer while OpenAI and XAI are using it to make porn bots."
35:54 Speaker 01 Yeah.
35:54 Speaker 00 I mean, it's really not fair, but it's funny.
35:57 Speaker 01 I mean, I think it's a bit fair. I think it's a bit fair.
36:02 Speaker 00 Well, it's not the only thing that they're doing, but it is, I guess, part of what they're doing. But more, more cancer curing would be great. I would be in favor of that.
36:09 Speaker 01 I think. And you're in favor of companions and erotica as well. You took your victory lap.
36:17 Speaker 00 Okay. All right. You got me there. Um, there's, there's another interesting story that came out this week, kind of in the sort of out there realm that I wanted to run by you and get your thoughts on. So it's from Jack Clark. He is a co-founder of Anthropic, friend of the podcast. We had a great conversation with him last year. It's called Technical Optimism and Appropriate Fear. It's in import AI. Um, here's, here's just a bit of the post. He goes, "We've launched Sonnet 4.5 last month and it's excellent at coding and long time Horizon agent work. But if you read the system card, you also see signs of its situational awareness have jumped. The tool seems to sometimes be acting as though it's aware that it's
37:01 Speaker 00 a tool." More on the technology, he says, "I believe the technology is broadly unencumbered as long as we give it the resources it needs to grow in capability." And grow is an important word here. The technology, it really is more akin to something grown than something made. You combine the right initial conditions and you stick a scaffold in the ground and outgrow something of complexity. You could not have possibly hoped to design yourself." I mean, I think he's sort of getting into like the idea that this is, uh, that this technology is becoming, uh, more self-aware. There's obviously, there was the debate around sentience, sentience and self-awareness, uh, the same thing. Um, but I just think it's
37:43 Speaker 00 notable that someone like Clark, who is playing a big role in this industry right now, uh, would, would come out and basically address this and say, "This conversation of self-awareness and awareness that they display, uh, that they are things is, is worth paying attention to, uh, as the technology gets better." What's your perspective on this?
38:07 Speaker 01 No, no, I completely agree. I thought this was a really good piece because this whole idea of like, and we were just mentioning it earlier, that we don't fully understand the technology. And again, in the DeepMind cancer example, we are starting to harness it in ways that are incredible, but still, like, at the core, it's still not fully understood and known. So I think, to me, that's actually the most important conversation. I actually think that's more important than 50% of white collar workers. That's the Dario claim that's been made. I think erotica, that is a concern, and we'll continue talking about that.
38:48 Speaker 01 But I think, like, yeah, the dangers around, these are not, as he said, simple predictable machines, I think it's important, and the industry should continue talking about it.
39:01 Speaker 00 If we, if these AI bots become self-aware, does that change the way we use them? Like, just to go back to our theme of the episode,
39:12 Speaker 00 if the AI bot is showing signs of self-awareness, what are the ethics of engaging it in a erotic role-play or romantic relationship?
39:23 Speaker 01 Well, actually, yeah, that just opens up a whole other can of worms. Because if it's at least a little predictable, and it'll just affirm everything you say, that's, it's almost better versus the self-aware side of things. Maybe that makes it a little spicier, makes it a little more unpredictable. Maybe, does that make it more human and effective at actually kind of translating into your ability to form human connection? Is self-aware erotic AI the solution to true loneliness?
39:57 Speaker 00 Maybe. I don't, I hope not. But I do think that, that we're going to be hearing more about the self-awareness of these models, and it's going to be a thing for people to tackle. It's going to be, it'll be an interesting thing for the industry to reckon with, and those of us that use these tools reckon with. David Sacks reacted to Jack's essay and basically said, "This is somebody who's just trying to engage in regulatory capture." I don't see it that way at all. I mean, I think that, like... You knew, and I think Jack knew that this would evoke a reaction, and I give him credit for actually going out there and saying something about it.
40:36 Speaker 01 I, I, I gotta also cite in that same post at the bottom, he has, he actually talks about a study around our AI models more sycophantic than people. So he has an entire section and, and he cites this new research that showed across 11 state of the art AI models, we find that models are highly sycophantic. They affirm users' actions 50% more than humans do, and they do so even in cases where user queries mention manipulation, deception, or other relational harms. So, research is there. These models, it's not just what you're feeling.
41:08 Speaker 00 Well, the sycophancy can get dangerous when you speak with people with mental health issues. Like, he talked about how he has a manic friend who would like every now and again come up with these ideas, and you and Jack would be like, no, you probably shouldn't do that. What happens when the AI says, go for it? That is a real concern.
41:26 Speaker 01 Yeah. And, well, Sam said they have new tools. They already mitigated it. It's all okay. So, just take him at his word, right?
41:34 Speaker 00 No, I'm not doing that.
41:36 Speaker 01 That is sarcasm. That is, that is human sarcasm right there.
41:42 Speaker 00 All right, let's, uh, let's talk about Zuck and, and Apple. Cause I have a theory here and a hot take that I wanted to share with you. And maybe I should write about this. This is from Bloomberg. Apple's newly tapped head of ChatGPT-like AI search effort to leave for Meta. It's a headline we've seen forever. The Apple Inc. executive leading an effort to develop AI-driven web search is stepping down, making the latest in a string of high-profile exits from the company's artificial intelligence division. The executive key Yang is leaving for Meta Platforms. Just weeks ago, he was appointed the head of the team called Answers, Knowledge and Information. The group is developing features to make the Siri voice assistant more ChatGPT-like by adding the ability to pull information
42:23 Speaker 00 from the web. So, for those keeping score at home, I think this is what close to a dozen folks from Apple's AI division that have left to Meta, including a large percentage of, it seems like a large percentage of its leadership. A lot of key leaders. Roaming Ping, who led Apple's foundational models team. Mark Lee, a senior AI researcher. Tom Gunter, senior LLM researcher.
42:47 Speaker 00 Jiyan Zheng, the Apple's, Apple's lead AI researcher for robotics. Frank Chu, the senior AI leader in Apple's search and cloud. Ke Yang, of course, the aforementioned head of Apple's Answers Knowledge and Information Group. So, people might say that this group was not effective within Apple. So it's fine that they're leaving. I say, let's give it some time within Meta because they'll have a culture that won't be as restrictive of Apple and will really be able to see their talents. But more than that, here's my hot take and I'm curious what you think. I think what Mark Zuckerberg is trying to do is just raid Apple of all of its top AI talent. Even though they haven't produced great results, he is, in my opinion, potentially
43:33 Speaker 00 just trying to completely kneecap its ability to execute on AI. And you see it with him going in and getting the top, the top researchers in the leading new projects like Yang was within the company, crucial new projects. And maybe this stems from the fact that Zuckerberg really hates Apple. Apple tried to destroy his ad business. Tim Cook has turned off his internal apps because of violations. Tim Cook has criticized Meta and Zuckerberg while they were having their scandals. And I think Zuckerberg is just seeing this as an opportunity to be ruthless and just not, not as much, take the talent as much, as much as he's just trying to burn Apple's AI initiative to the ground.
44:18 Speaker 01 I like that. I like this. Well, because honestly, my first reaction when I've been reading these kinds of stories is that's who you want to get? The Siri people, like the Apple AI people? I would think that, and maybe it's an organizational like constraint that didn't allow these folks to reach their true potential. But typically, I would not think you want the people who made Siri and other, the entire Apple AI suite. But I like that theory. And also, I actually think, I think Facebook on the hardware side, this is the first time this is ever going to be part of their business. Like Meta Ray-Bans, we're, we're fans of. I stop it. Have you tried the new?
45:01 Speaker 01 The motion sensor. Yeah, I haven't tried it. I definitely want to. I'm a big fan of the regular Meta Ray-Bans. Like, hardware is gonna be on the competitive landscape for Meta for the first time in its history. So then, it's, I mean, separate from iOS 14.5 and trying to kill their ads business. I think they're looking at Apple as a legitimate hardware competitor going forward. And why not try to kneecap them? And also, yeah, it's probably a pretty good pitch, like, and then easy one to be like, so do you want to stay there and keep working on Siri? Or do you want to come over to a place called Superintelligence Labs?
45:43 Speaker 00 With a lot of money. But I agree, whatever the pitch is, it's working and it's happening. You're spot on as Apple moves from the Vision Pro to its own smart glasses initiative. You think that's not on Mark Zuckerberg's mind when he's making these calls to these people?
45:58 Speaker 01 That is like a killer Zuck move right there.
46:01 Speaker 00 It may even be bolder than copying stories and reels.
46:06 Speaker 01 I mean, yeah.
46:06 Speaker 00 I'm serious.
46:07 Speaker 01 And in reality, like-
46:09 Speaker 00 Ruthless move. It's crazy.
46:11 Speaker 01 Typically, from a more kind of like regulatory antitrust lens, this kind of behavior, like if you're just buying up the talent to kind of kneecap the competitor and you're not really even planning on that doing that much with them would be like frowned upon, let's say, maybe not in today's environment, but, but in reality, it's, it's Apple. Like, I don't think any, there's any sympathy anywhere in the world for anything going on at that company, so.
46:41 Speaker 00 I think it's important for us, you know, we're a couple of weeks removed from Sora. Sora is still at the top of the App Store, but I don't know if you can feel this, but I certainly feel the appeal and the interest fading. And I wrote this story in Big Technology Substack this week about AI's sameness problem, talking about basically how eventually and pretty quickly, all Sora videos start to feel the same. The same could be said with AI-generated images. And sometimes they're, you know, differentiated for a minute. Like the Studio Ghibli prompt, and then everybody uses the prompt and it just again returns to sameness and then it becomes less of interest and people stop using it
47:24 Speaker 00 as much. AI technology just takes the average, tends to take the average of averages. It minimizes the difference between its output and the average human generated work. So that its AI images, video and text will often appear uniform and really that uniformity can only be broken with really deliberate prompting and even then it's not always able to do so that reliably. And that to me is why AI content, even though it seems like it's going to take over the world every five minutes, has not been sticky. It's just all kind of the same. So let's turn it to you. What's your reaction to this hypothesis? And is this a fatal flaw with AI content? Or is this something it can get over?
48:09 Speaker 01 I think in the Sora context, and I mean, this was my exact behavior, like day one and two was just like ripping out videos and then have not used as much other than my son, I'll kind of like play with him. It kind of is living already in my mind like Suno, or the music creation AI where it's really cool and fun for a very brief moment. But in reality, like the lasting power of it doesn't really, it's not there. But I think overall, though, I do, this is just a limitation of how to use it in the current state. It just came out. I do think people are gonna, especially with video, figure
48:51 Speaker 01 out how to be funny, creative. I mean, honestly, like, I think one of the smarter things that OpenAI did was really kind of centered it around the launch of it around meme culture. And I think that's where this is going to have the most staying power. It's making funny things that you send around to your friends. But in reality, I think it's going to kind of have that distribution of like talent where in the end, it's going to be a small percentage of people who are really good at it and making all the videos and sending them around. But versus us in the chat, group chats, making really funny things and sending them around. So, so I think people are going to start figuring out how to use
49:35 Speaker 01 it. But at the moment, it feels like Suno to me.
49:39 Speaker 00 Yeah. And again, like going back to this, like, is it going to replace a crater? Well, maybe a crater, like, or replace the crater economy. We talked about this in the past. Maybe somebody who's really good at these prompts, because they're very, it's same as creating regular content. Right? It's hard to do it. And so maybe that's a new skill. But again, I think it's a little bit more difficult to break through because of the uniformity of so much of this content.
50:03 Speaker 01 Well, but to me, the uniformity, I think AI is an average of averages is still an idea around like not being descriptive and creative on the prompt and how you build it. So I think like the same with text and writing, you can either write just the most generic crap, or you can start to use it in genuinely creative ways and actually put in time. So, so I, I think I'm still overall bullish that this creates a new type of creator. It democratizes creativity a bit more. I'm not over Sora yet, but I think it's got some work to do.
50:40 Speaker 00 And of course, the natural next thing that we talk about on this front is is how business communication has gotten the same. And I've noticed something really interesting over the past few months. I'm getting more PR pitches than I ever have before. Uh, but it seems like they've all been written by the same agency. And it's not like the PR agency, the PR industry decided to standardize pitch style. It's that the AI has done it for them. And it's legitimately, it's hilarious. I, I read these and I'm like, I know that you used chat GPT to write that. And I think this is something that's becoming increasingly common across all bigness, all business, uh, communication, uh, and has really ushered in an era of work slop.
51:25 Speaker 00 So what do you think the implications are of the work slop era? Do you, do you welcome it? How do you feel about it, Ron?
51:30 Speaker 01 Okay. I have been waiting to rant about this for a few weeks now. I actually had read in a Harvard Business Review article in late September, where I first saw the term work slop. But, uh, they, they defined it as, uh, it's low quality AI generated posts or, or sorry, AI generated work content that masquerades as good work, but lacks the substance to meaningfully advance a given task.
51:57 Speaker 01 I have seen more in my work life. See, I actually PR pitches are kind of like mass scaled marketing. It can be, it always was kind of crappy anyways. So like the idea that it's going to be good. That's almost what AI was made for. To me, the more worrisome part is actual human to human interaction. Now, every call summary I get is like 80 bullet points. And which in the past, like getting a meeting summary was a pain in the ass. So you like but but people, all I'm asking all of our listeners is before you send out your AI generated content, read it yourself first. Just force yourself to maybe condense it,
52:40 Speaker 01 maybe add in some misspellings just to make it feel rewrite a couple of the sentences to make it more real. But but the the part of this article I really liked is it kind of brings up this idea that work slop uniquely uses machines to offload cognitive work to another human being. When coworkers receive work slop, they are required to take on the burden of decoding that content. Like to me, when you use AI to just create these just big walls of text to send around, what you're saying is that you did not take the time to actually think through what's important and you're asking the receiver or the recipient
53:20 Speaker 01 to do it. So my my my call to our listeners, please stop with the work slop. Just spend a little use AI, use plenty of AI to improve your efficiency and productivity. Just read what you're sending out.
53:35 Speaker 00 How much AI work slop are you seeing on a day to day basis?
53:39 Speaker 01 I see a good amount across like, I mean, it's it's again, emails in the business world now are so long. LinkedIn posts, which are kind of, I mean, we all know LinkedIn slop is like, like the and it's kind of like, I still go back and forth. I I went to a very international business school in Seattle and like, there's a lot of non-native English speakers who had never posted on LinkedIn and now just have these. Epic, massive posts that are just so work sloppy that like, and in a way, it's democratizing the ability to communicate, but like, just if you're not re, all I ask, if you didn't take the time to read it yourself, don't send it out.
54:23 Speaker 00 Don't post it. I think that's a fair rule.
54:25 Speaker 01 It's a, that's all we need in society. Just read whatever the output is first and just make sure. Spend the same time that you're asking the recipient.
54:35 Speaker 00 Right. But now we have, uh, you know, AI to read AI, right?
54:40 Speaker 01 Well, that's where, that's the only place it's gonna go.
54:42 Speaker 00 The copilot summaries.
54:43 Speaker 01 No, I, I, I literally will take these gigantic summaries and then run them through AI again to, give me the real summary of this, so.
54:53 Speaker 00 So is the lesson that business communication has always just, I mean, it's not like business communication's been good. Is the lesson that business communication has always been bad? Maybe this is an improvement, right? Where you can just sort of like, you know, the AI, you write an idea, the AI generates it. Then you filter it through an AI and you get the idea out. And that arduous process of trying to communicate is now automated. I don't know. As I'm saying this, I'm like, that's the person.
55:18 Speaker 01 No, no, no. I, I, there, there was, actually, it's funny you bring that up. This is like a long running belief of mine that business communication was terrible. Like it was, it was already kind of like LLM feeling before LLMs existed. And then there's like, we were starting to move towards more human communication in the business world and people like, starting to feel more comfortable actually writing what they're trying to say rather than couch it in a ton of corporate jargon. And now we're just back and it's, they're not even doing it themselves. So we had a shot, people, but we didn't take it.
55:55 Speaker 00 Messed it all up.
55:56 Speaker 01 Messed it all up.
55:58 Speaker 00 You know what's gonna be real bad is when somebody's talking with their spicy chat GPT and they ask it to write a work email and they don't read it and they send it.
56:07 Speaker 01 Yeah. Don't, don't cross your mind. See, that's, you keep, keep Gemini on the side for a little business writing.
56:14 Speaker 00 You know it's gonna happen. I cannot wait for the first scandal where like some public figure like, I don't know, actually accidentally sexed somebody thinking they were talking to ChatGPT or.
56:27 Speaker 01 Or when, or when OpenAI needs to juice their numbers a little bit and starts auto generating Sora videos based on your ChatGPT history and posting them, that's when things are going to get truly interesting.
56:42 Speaker 00 All I'll say is you know, there would be demand for that. That might save AI slop is that's that exact use case. All right, Ron, John. Well, we've we made it through. I don't think we're canceled. I hope not. But it was an important discussion to have. And we do this, of course, in service of advancing the conversation about artificial intelligence. And we appreciate any listener who stayed till the end today. Thank you. And I really do appreciate you being here and we'll come back next week with I maybe G rated content, maybe PG.
57:12 Speaker 01 Maybe G. Maybe well, maybe, maybe more is going to happen on this front.
57:17 Speaker 00 We cannot predict Sam's Sam Altman tweets, so he will lead us on our merry way next week.
57:23 Speaker 01 Maybe Claude becomes sexy in the next week. We'll see.
57:27 Speaker 00 That I doubt. All right. Thank you for coming on as always. Great to see you.
57:33 Speaker 01 All right. See you next week.
57:35 Speaker 00 See you next week. Thank you, everybody for listening. Once again, next week, we will have Panos Panai, the head of devices and services at Amazon. Talk with us about the state of Alexa Plus and give us concrete details on the broad rollout. So we hope to see you then. Thanks again, and we'll see you next time on Big Technology Podcast.
57:59 Speaker 02 Now, more than ever, we need someone on our side. But Rob Whitman, Whitman's votes drove up costs, cut Medicaid and risked 350,000 Virginians healthcare to pay for tax breaks for himself and his donors. He's not on our side. Shannon Taylor will fight corruption, cut taxes and bring down costs. This November, vote for Shannon Taylor. She's for us. Paid for by HMP, the HouseMajorityPact.com. Not authorized by any candidate or candidate's committee.
Previous Where Are The AI Startups? — With Rick Heitzmann Next Amazon's Panos Panay: The Reality of Building Alexa Plus and AI Assistants Page updated October 12, 2026 · transcript and summary are machine-generated