Pod Insights The Cognitive Revolution Babysitting the Machine: Glean's Rebecca Hinds on the Hidden Human Labor of AI at Work About this episode Rebecca Hinds, author of "Your Best Meeting Ever" and Head of the Work AI Institute at Glean, breaks down the surprising findings from the new Work AI Index 2026 report surveying 6,000 workers. While 87% now use AI and report saving 13 hours per week, only 13% say their organization is performing significantly better—a paradox explained by two new concepts: "botsitting" (the hidden labor of making AI useful) and "botshitting" (delivering AI-generated work you can't defend). They discuss practical solutions including better-integrated AI systems, smarter AI detection policies, and aligning work to meaningful missions.
LINKS:
Rebecca Hinds Personal Website
Glean Work AI Institute
Your Best Meeting Ever Book
Glean Enterprise AI Platform
Stanford Future of Work
Glean Enterprise Graph
Pangram Labs AI Detection
OpenAI ChatGPT Product Page
Anthropic Claude Product Page
Google Gemini Product Page
Microsoft 365 Copilot Page
Glean AI Transformation 100
Rebecca Hinds LinkedIn Profile
Sponsor:
Claude:
Claude by Anthropic is an AI collaborator that understands your workflow and helps you tackle research, writing, coding, and organization with deep context. Get started with Claude and explore Claude Pro at https://claude.ai/tcr
CHAPTERS:
(00:00) About the Episode
(03:22) Grounding AI adoption
(06:46) Methodology and Glean
(12:25) Productivity paradox emerges (Part 1)
(20:31) Sponsor: Claude
(22:22) Productivity paradox emerges (Part 2)
(25:36) Bot sitting burden
(34:00) Hidden time savings
(39:56) Meaning versus automation
(47:14) Enterprise graph potential
(53:13) Detecting bot slop
(01:00:32) Retention and incentives
(01:07:54) Transformation and mission
(01:20:06) AI teammate model
(01:26:01) Future organizational design
(01:32:31) Research and meetings
(01:41:43) Episode Outro
(01:45:07) Outro
PRODUCED BY:
https://aipodcast.ing
Transcript 17,446 words · 3 speakers
Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.
0:00 Nathan Labenz? Hello and welcome back to The Cognitive Revolution. Today, my guest is Rebecca Hinds, author of the bestseller, Your Best Meeting Ever, and head of the Work AI Institute at Glean, which has just published the new Work AI Index 2026 Report, which draws on a survey of 6,000 digital workers to describe the state of AI as it's used and experienced by employees at companies that are operating well outside of the AI bubble. The headline numbers are genuinely strange. 87% of workers now use AI. 73% say it makes them more productive. And on average, they report saving 13 hours per week, a third of a full work week.
0:43 Nathan Labenz? And yet, only 13% say their organization is performing significantly better as a result. The report contributes two new terms to the AI discourse: bot-sitting and bot-shitting. Bot-sitting is all the unglamorous, untracked labor required to make AI useful: feeding it context, debugging its outputs, and cleaning up its messes, which the report finds consumes 6.4 hours per week, or roughly half of all the time that AI supposedly saves. For those who are being asked to automate parts of their work that they'd rather do themselves, such as, for example, a customer service representative who enjoys talking to people but is now being asked to supervise agents, this can be especially painful.
1:28 Nathan Labenz? Such alienation predicts both reduced engagement and increased turnover, and helps explain bot-shitting, which is when people deliver AI-generated work that they can't explain or defend. In the extreme, business becomes farce, a perpetual motion machine of AI slop. And shockingly, in the survey, 69% admit to doing it, a number that reflects both the incredible progress that AIs have made, and perhaps the amount of bullshit work that people are asked to do. Obviously, one part of the solution is more integrated AI systems, which have the context that they need. My experience with my own deep context system is that it's dramatically reduced my own time spent bot sitting.
2:10 Nathan Labenz? We discuss how Glean's enterprise graph product is playing a similar role for enterprises. Beyond that, we also consider what organizations can do to create a more functional AI culture, including how to use AI detection to protect the business without discouraging positive use, rewarding people monetarily for effectively collaborating on AI solutions, and perhaps most powerfully, aligning work to a meaningful, shared mission. My mission for this show, as you may know, is mostly to learn and to help others learn as much as possible. But lately, I've also been trying to entertain and delight you with original songs made with Suno, which we've been playing at the end of each episode. I've really enjoyed the comments that people have sent about these, and I encourage you
2:53 Nathan Labenz? to stay tuned to the end of this episode for a legitimately catchy tune with some outstanding, poignant AI-written lyrics. It did require quite a bit of bot sitting to get it just right, but I do enjoy the final product, and I hope you do, too. With that, I hope you enjoy this groundbreaking look at AI as it's practiced in large-scale organizations throughout the English-speaking world with Rebecca Hinds, head of the Work AI Institute at Glean. Rebecca Hinds, head of the Work AI Institute at Glean and author of the new Work AI Index 2026 Report, welcome to the Cognitive Revolution.
3:31 Speaker 01 Thank you so much for having me, Nathan.
3:33 Nathan Labenz? I'm looking forward to this conversation. I think people like me, who live very much in the AI bubble, which is kind of a social bubble, albeit a very online one, and also a day-to-day work bubble, you know, that's just like how I use my computer, I think is kind of diverged pretty significantly from what the rest of the world is doing. I think people like me sort of run a bit of a risk of getting detached from, especially because I'm, you know, I work by myself largely these days. Kind of run a risk of getting detached from what's going on in the real world at real companies that are actually driving most of the economy and where not everybody has the luxury or the inclination to be a bleeding edge early adopter with all of
4:16 Nathan Labenz? the, I'd say more ups than downs certainly, but certainly a mix of ups and downs that come with that. So today's conversation, I think is going to be a really good exercise in grounding and calibrating myself and understanding in the bigger world, what is the current state of play. I would love to start just by getting a little bit of grounding from you, though. In terms of how you understand AI, I think so many AI conversations kind of diverge early or the people can sort of talk past each other if they're expecting very different things in the near term future of AI and that's not necessarily put on the table beforehand. So what is your kind of expectation?
4:59 Nathan Labenz? Like, are you an AGI, short timelines, AGI soon person? Do you make analogies to other technology waves? Give us kind of your zoomed out view and then we'll zoom in on the report itself.
5:11 Speaker 01 It's a great question. I think in many ways, what we're seeing with AI is not unlike what we've seen with previous technologies, in particular, when we think about the change management. And that is what we're seeing above all else. This is a human change, just as it is a technology change. And as we've seen with every other technology change, we underestimate the human piece. We underestimate resistance, we underestimate fear. Now, AI has this very unique element in that the fear is more visceral. And I think in large part, as trivial as it might seem, the naming, it comes back to the naming, the fact that we've named this thing, artificial intelligence, etymology, it's fundamentally in tension with human intelligence.
5:55 Speaker 01 And I don't think organizations take that seriously enough. The fact that even if the technology... Works objectively. If employees don't see it as a teammate, if they don't see it in the context of something that can amplify or augment their skillset, well, they're going to either resist or they're going to symbolically use the technology as opposed to meaningfully using it. And that's, that's what we're seeing. You know, that's what we're seeing on the ground is we're seeing pockets of excellence. We're seeing individuals, teams and organizations fundamentally transform themselves with this technology in very, very exciting ways. But we're also seeing the vast majority of, in particular, teams and organizations struggle,
6:36 Speaker 01 struggle to translate the individual productivity gains, which pretty much everyone is getting on some level, to real business and team level outcomes.
6:47 Nathan Labenz? Makes sense. I might have a couple little follow-up questions regarding your expectations as we go, but tell me about the methodology. I mean, everything we're gonna discuss here in terms of findings is downstream of basically two main data sources, as I understand it. One is a big survey, which you can tell us more about, and then the other that caught my eye in the report is aggregated telemetry from the Glean platform. And I'm interested in what that actually looks like and understanding a little bit better the substance of that data as well.
7:18 Speaker 01 Sure. And there, you know, the main bulk of the data is the survey data. This was something that has been in the works for, for months and months. We fielded it December and January 2025, 2026. And I think what's, what's novel about how we collected the survey data, so it's 6,000 knowledge workers, 3,000 in the US, and then 1.5K in each of the UK and Australia. It was developed in partnership with our eight founding members of the Work AI Institute, which is our internal research center at Glean. And what's special is each one of these experts, these eight experts, comes at the AI conversation a little bit differently. Some are very much focused on the psychology, the mindset around
7:59 Speaker 01 AI. Others are more focused on the technology, you know, digital transformation. Others are more focused on org design. You know, how do we think about this from a systematic, you know, org design perspective? And we thought it would be important, you know, given the transformative nature of the technology, to have a pulse into all of these different dimensions. So that's the survey component. A lot of conversations, you know, we're talking with our customers at Glean as well as, you know, organizations broadly in terms of what works, what doesn't work. And so that informed a lot of the narrative. And then the aggregated anonymous Glean telemetry data is something that, you know, is very exciting because it's objective.
8:44 Speaker 01 And, you know, triangulating the data in terms of both the subjective survey data, which is, you know, inherently biased for many different reasons, pairing that with something that is objective, we thought was important. And in particular, looking at how we're seeing adoption happen on the Glean platform, you know, the importance of cross-functional adoption, the importance of, you know, whether your manager adopts or a team member or cross-functional team member adopts, the network effects associated with this technology are massive. And when we think of change management overwhelmingly right now, we're seeing top-down change happen, you know, mandates, memos telling employees to use AI or else.
9:27 Speaker 01 Well, the best organizations, the most effective ones, they're having a bifurcated strategy. Yes, top-down change is important. We absolutely need a policy. We absolutely need principles. We absolutely need to see the CEOs and executives using the technology. But bottom-up change is just as important and finding these AI influencers or champions within your organization is so essential to activate and activate meaningful change and not just the symbolic change because the CEO has told us to use the technology.
10:00 Nathan Labenz? Good moment to just take a beat on Glean and what Glean does. I think, you know, our audience is generally AI obsessed. And I think that's the one commonality that we all share. So everybody has heard of Glean at least. I will confess though, you know, as an individual operator, I'm obviously not in the sweet spot of the target market. And so I've never actually used it. And I don't know too much about what the experience is like, although, you know, I certainly have a sense. And I also don't know how you go to market, you know, whether it's a sort of enterprise sales model versus, you know, a kind of product-led bottoms-up, or maybe it's a hybrid. But maybe give us like the double click on Glean so people can understand.
10:45 Nathan Labenz? You know, in a little bit more of a functional procedural way, what that how that data is being generated?
10:50 Speaker 01 Sure. So Glean is a work AI platform. Historically, we started in enterprise AI search, you know, solving the problem of how do we find the right relevant information within an organization? This was pre-AI, pre-mainstream AI. Now our platform has an intelligent assistant as well. So every employee has that intelligent teammate that deeply understands not only how they work, but also how the organization works. So starting to, you know, give you recommendations in terms of what you should be prioritizing each day, as well as when you ask it questions, knowing enough about you and your, your, your job function to provide intelligent answers. And then agents are a big part of the platform as well.
11:34 Speaker 01 So automated workflows that again have that organizational context and able to streamline, you know, tasks and cross-functional tasks across the, the organization. And, you know, the real, I think, bread and butter of the platform is context. There's a lot of conversations right now around the importance of the context graph. Well, our data model enables us to surface that context and feed off of it in a really exciting way. When AI is able to truly understand, you know, your work, your team's work and the organization's work. Well, then you avoid generic answers and you start to get into this really exciting territory
12:15 Speaker 01 of predictive AI and proactive AI telling you, you know, what matters right now in the moment of, of your day-to-day work.
12:26 Nathan Labenz? Cool. Interesting. The, the mix of company context and individual context is definitely a pretty live discussion. I'm thinking of Dan Shipper and the EveryTeam and how they've kind of experimented with various versions of this and already, you know, evolved their approach in a meaningful way. I have my own, you know, pretty elaborate personal AI infrastructure at this point that is kind of an extension of me in one lane. And then also increasingly like trying to get it to be sort of an employee that, you know, can do its own thing with more and more autonomy as we go over time as well. Maybe let's again come, come back to that. I want to make sure we don't bury the lead on the headline of the report,
13:07 Nathan Labenz? which I do think is interesting food for thought at a minimum. So I'll, I'll give you the headline and you give me the, the expanded version of it. Eighty seven percent of people that you surveyed are using AI. Seventy three percent say it makes them more productive. And the one that really blew me away, on average, they say they save 13 hours a week thanks to their use of AI. That's a third of a work week. Some caveats to come, obviously, but that's a lot of time, like a really strikingly large number. But then the flip side of this is only 13% of the survey respondents say that their organization as an organization is performing much better than it used to be based on all
13:52 Nathan Labenz? this AI that's happening. Those are the big headlines that jumped out to me. Give me the, the double click on how, how we should start to understand that.
14:01 Speaker 01 Sure. And I think, you know, you've hit the nail on the head with your previous setup to the, the, the question in that, you know, we're seeing this massive disconnect between individual productivity gains and organizational performance. Now, this is survey data, so it's, you know, it's, it's inherently biased in terms of how people are reporting, depending on how we ask multiple questions around time savings. And, you know, depending on the question, we saw ranges from 10 hours per week to, to 14 hours per week. On average, what we're seeing is people are reporting that based on the work output, they have fully automated with AI. It's about 11 hours of, of time savings.
14:46 Speaker 01 But when you ask them about the organizational performance, you know, are, do they see their organization perform significantly better as a result of the technology? You know, we see this gap, just 13%. And the fact that 13% of employees, only 13% are saying that their organizations are significantly performing better, performing better significantly because of the technology. And it's a big disconnect that we've seen in multiple different studies. We've certainly seen in the headlines, the budgets that don't pay off, the ROI that doesn't pay off. What's novel about this report, this work AI index is
15:26 Speaker 01 Where we're theorizing the time savings is going and we're coining this phrase "bot sitting" as the hidden human labor that is required to make the technology usable. I think we all feel it on some level. It's the feeding AI context, it's the overseeing the AI, it's the debugging the AI, it's the cleaning up after the AI. And it's a massive chunk of labor, on average upwards of six hours per week, that workers are spending on this bot sitting activity that is often tedious. We make a point in the report to point out not all bot sitting is negative, certainly. There are healthy forms of bot sitting, but more often than not, it is negative,
16:10 Speaker 01 it is tedious, it is exhausting, it is not rewarded, and it's not appreciated or tracked or measured, and certainly not incentivized within the organization. And I think that is feeding a lot of this failed expectations, the ambition-execution gap that we see across the board, not recognizing the human labor and recognizing that this isn't, in most cases, a problem in terms of the individual employee. This is a systematic issue where we've invested in tools that don't have that context. We've invested in tools in silos that now we're seeing AI sprawl and agents sprawl. And it's a whole host of different factors that are coming
16:52 Speaker 01 from multiple different directions to feed this bot sitting, which then turns into what we're calling "bot shitting." Bot shitting is the dissipation of work that hasn't been checked, that workers can't explain. We see 40 to 41% of employees saying they ship AI work that they couldn't explain if asked. This is bot shitting, and I think it's pervasive. We often see the polished nonsense come where it looks polished, it looks finished, it looks like we've done the assignment. When we dive a little bit deeper, it's actually quite hollow. There's very little substance. That's part of it, that's the most visible form. But it's also, it's the shadow AI, it's the using AI that you can't explain in terms of the output.
17:37 Speaker 01 It's a whole host of different dimensions as well.
17:40 Nathan Labenz? I guess to give you my personal bot sitting and near miss of bot shitting experience just in preparing for this conversation, I have an agent that's runs every day and it looks for new podcast bookings on my calendar. And then its job is to, and it does have a pretty good access, but this anecdote goes to show just how important connecting all the dots is because for lack of one connection, the result came out not so good. But I've given this agent access to my drive and in my drive, I've got hundreds of these previous documents where I've written up these outlines of questions. So it can go in and look at all those that I've previously done and use those for inspiration. Of course, it can go search
18:24 Nathan Labenz? the web and whatever. And so it saw you pop up on the calendar and then it went and did its thing and did a big, pretty extensive deep dive into your background and your book, and which we can touch on a little later as well, and the previous reports and things you've been involved with. And it missed one point, which is that there's this new report, which I had gotten a copy of in email from one of your teammates, not specifically sent by you. And so basically, the whole thing was not going to work. It was like, maybe 10 to 20% of that was the conversation we actually were going to want to have, but it missed 80 plus percent of the substance of what we were really going to be talking
19:08 Nathan Labenz? about. And you think I know better and I didn't send that off without noticing that. But if I had, that would have been, I would think, textbook bot shitting behavior, which I do think we should all be very much watching out for. Now, I got a much better result when I said, hey, you missed something really crucial, which is the report we're actually going to be focusing on. And then still, there's another round where I feel like
19:35 Nathan Labenz? To do a good job, to be respectful to you as a guest, to be respectful of the audience who's trusting me with their time, which is obviously the one resource they can't possibly get more of, is I have to come having internalized that information and ready to make it my own. So even though I did get a great jump and a very meaningful assist from the agent, and in some sense, it was maybe good enough as an artifact that I could have shared and you would have been like, this is fine, good thorough outline of questions. I still need to do that extra work to be able to show up and have the interaction in a way that hopefully allows me to do a good job and not feel like I'm making it up or reading it cold as I go. So I definitely relate to those two different
20:16 Nathan Labenz? things. I think I've had, fortunately, very few instances where I've let something get away from me without noticing that the bots have gone haywire.
20:26 Speaker 01 Hey, we'll continue our interview in a moment after a word from our sponsors.
20:30 Nathan Labenz? Today's episode is brought to you by Anthropic, makers of Claude and Claude Code. Over the last few months, Claude has helped me build and refine a personal deep context database that now contains all of my emails, Slack messages, tweets, DMs across platforms, video calls, and podcast transcripts, going back a full five years. On top of that, we've now layered summary articles describing my relationship with hundreds of contacts, organizations, and ideas. And now that this exists, there's almost nothing that Claude can't help with. For my angel investing, Claude can now draft investment memos in exactly the form that my venture fund requires, based on the calls
21:11 Nathan Labenz? I've had and the emails I've exchanged with the founders. And when someone needs a favor, Claude can often do it as well as I can. Recently, a friend reached out to ask if I know anyone who might be a fit for a role that he is currently hiring for. Initially, nobody came to mind, but then I thought to ask Claude, and sure enough, it identified two great leads. Claude is the AI for minds that don't stop at good enough. It's the collaborator that actually understands your entire workflow and thinks with you. So for problems worth solving, get started with Claude at claude.ai/tcr. That's claude.ai/tcr. And check out Claude Pro, which includes all of the features mentioned in today's
21:56 Nathan Labenz? episode. That's claude.ai/tcr.
22:01 Nathan Labenz? And I wonder, what do you think is the root of this problem? Especially the bot shitting one, where people are just putting work out there into their team environment that they can't even defend. What's the root of that? Is it that they don't understand that the AI is not always going to do a good job? Is it that they're just alienated in the first place and fundamentally don't care? Are they low? Obviously, there's an issue in general with not everybody is super conscientious. So maybe this is just a new flavor of not doing a very good job for some people. What can you tell me about the psychology or like, how do you understand the mistake people are making when they do that?
22:38 Speaker 01 I think, as most things are, it's multifaceted. And in the report, we theorize the cycle at play here. I do think it starts with bot sitting. I do think it starts with all of this manual work that is often a reflection of all of the AI that's being deployed in our organization and the pressure to adopt. Organizations are under massive pressure to adopt this technology and implement it. So you start to get more pressure to adopt. You have more need to bot sit the technology. That is exhausting. It's exhausting because it takes up a lot of time, but it's also exhausting because you're not rewarded for it.
23:20 Speaker 01 And there's really not very much incentive in many organizations to bot sit well. And what we start to see is good enough. In the research, they sometimes call it satisficing. Once you see an AI output that is good enough, well, that's often permission to ship it. In your case, you're an expert, your skill that you're craft, right? You're recognizing that good enough isn't good enough. And so that's a big, I think the bot sitting is a precursor to the bot shitting. It's the exhaustion. And employees hit a breaking point. They can no longer bot sit and they start to bot shit more and more. I think a big part of this is the lack of context, the lack of context in the AI tools,
24:04 Speaker 01 the fact that so many AI tools don't speak to one another. In so many organizations, employees want to use different models and different tools. And that's why I'm excited about Glean as a platform as well, because there's no situation in my mind that I can envision where we have a single model. You know, a single tool environment. Employees want that choice. We're seeing models leapfrog each other left and center. Employees want different models, different tools for different use cases. It becomes very complicated if you don't have that contextual layer to connect them and make sense of them. And not just in terms of how are the dots connected, but also in terms of recency.
24:45 Speaker 01 Knowing that this report is published this week, this month versus a report that was published two, two months ago, two years ago. That should be given different treatment. The authoritativeness of the content as well. Very hard to discern in an enterprise context. So I think context is the big feeder as well from a technical standpoint. And then you have all these perverse incentives in organizations. The token maxing, the rewarding, the clicks of the tool. That is a big contributing factor as well.
25:15 Nathan Labenz? Yeah, I used to tell people when I did any sort of AI advisory consulting. I would say you could do a lot worse than as a leader, just watching your token consumption. But definitely don't tell the team that's how you're going to be measuring them. So it's really super easy to cheat on that. It's amazing. That's actually, that's honestly been probably years ago that I was saying that. And it's funny to see that people are still shooting themselves in the foot that way. I guess in terms of understanding my fellow human.
25:51 Nathan Labenz? I struggle a little bit with the idea that this bot sitting work is so onerous. My attitude, which I don't expect everybody to share, but I just will give it to you for compare and contrast is like. I used to have to do stuff and now I get to have AI largely in many cases do this stuff for me. I still have to make a contribution, but I definitely get a lot more done a lot faster. And I also get to learn a lot more about AI and what it can do, which I find to be always a very interesting question unto itself. And just a lot more because I'm able to take on so many more different things.
26:35 Nathan Labenz? I'm able to learn much more broadly and satisfy my curiosity in all kinds of ways that I never could before AI. So if you combine that with a, and I would say mine is even more. I was just in a, I was at this AI event recursive last weekend. And a question of people in the audience was if your team had to replace you plus AI as it exists today, how many of you, unaided by AI, would they have to hire to get the same output? The median answer in that room was like, basically two. In other words, people thought that they were twice as productive, thanks to AI, as they would be if they were unaided. And that's pretty much where I put myself as well.
27:17 Nathan Labenz? So even though, leaving that aside, okay, so people are reporting 13 hours gained. There's another stat in the report that says, let me make sure I get it exactly right. People are spending 6.4 hours, basically half of that time savings, on this bot sitting activity, reviewing outputs, connecting things, different products that don't connect. I think anybody listening to this show certainly had that experience of, okay, I got a Claude prompt, I got a Claude report or plan or whatever, but now I got to put that into copy and paste. So the phrase you just used is the human becomes the integration layer. And I felt that, and it is certainly tedious, although it's honestly also just a part of general computer work, right? We've all got kind of Slack and then this other task tracker and then there's email.
27:59 Nathan Labenz? And so it's all a little bit disjointed anyway. All that to say, I don't really get it. Like, why is it so bad to be responsible for babysitting the bots or bot sitting? What is it that's really bothering people so much or alienating them so much about that?
28:20 Speaker 01 So it's the taking away from the meaningful work. And in the report, we look at three categories of interaction with AI. One is the bot sitting. One is the using the technology. So using the technology to do real work. You prompt it and it gives you the answer, or it asks you a follow up question in a way that you're moving work forward, iterating with the technology as opposed to you're asking it a prompt. It doesn't have the context, so you're re prompting it. We're seeing about 36% of all AI sessions fail, meaning a worker goes to use the technology and it's not successful. They either have to start completely from scratch or do significant rework. Imagine if it was right on the first time.
29:03 Speaker 01 Imagine if you could put those 6.4 hours into either using the technology to drive work forward or the third category, which is learning or building agents. The time savings would be significantly higher. And so I think, again, there's a small component of bot sitting that I think is healthy. And for people who are curious, this is less of a problem. And I love to believe in human curiosity. I think the reality for many, and I think Nathan, you and I are probably an outlier here, the reality is employees are too exhausted to be curious right now. They're too overwhelmed with work to spend those one, two hours tinkering
29:43 Speaker 01 with the technology and prompting four different tools and picking the right answer. And that's the problem. The fact that it's not meaningful work and it's not meaningful learning with the technology. We also look at along the different dimensions of bot sitting. What is most exhausting? In the report, we call it the exhaustion multiplier. And what we see is the highest exhaustion multiplier is associated with feeding AI context, right? Because that is, in the best case, something your AI should know. It should know where the documents are, which documents are authoritative. And you should not be supplying that as a human in most cases. The other one is the debugging, the debugging.
30:27 Speaker 01 You see an output, you know it's wrong, but because of the nature of LLMs, you're not quite sure why it's broken, what's wrong. You try to tweak one thing because the nature of the technology is probabilistic. It's not deterministic. You're not really sure what you tweaked that worked and didn't. That is the biggest contributor to this exhaustion multiplier.
30:51 Nathan Labenz? Yeah, that's interesting. The idea that I do have this experience sometimes.
30:57 Nathan Labenz? One thing I've been really enjoying doing lately is creating songs for each episode of the podcast. So you can start thinking about, if you want to request the genre. I try, but I can't always promise to be able to make something great in any given genre. It's really striking how sometimes I'll just, you know, run my kind of produce episode Claude code skill, which includes coming up with an idea for a song, writing lyrics, prompting Suno with that. Sometimes I show up and it's like banger immediately. And then other times I find myself sitting there and it is this kind of black box thing where you're like, you know, I tweaked the style prompt, maybe I tweaked the lyrics a little bit, go again. And for some reason it's just not working.
31:41 Nathan Labenz? It's just not landing, it's just not giving me what I want. And that can be definitely a sort of exhausting thing, especially because sometimes I get in this spot where I'm like, who even cares about these songs? Like, am I doing this for anyone? Although actually I do get remarkably a lot of positive commentary on the songs. Anyway, I can relate to that sort of exhaustion point. I can definitely also relate to the shoveling context point. I used to have before my, you know, now much more integrated setup. I used to have just a single PDF that had a bunch of intro essays that I'd previously done for the podcast. And I found it was kind of exhausting, although this is like such a baby first world thing to say.
32:25 Nathan Labenz? Even just to like go find that PDF every time and put it into the web UI. So, you know, Claude would have it to use as examples. And it's like, man, that's really not much to complain about. And yet somehow it feels so much better now that those sort of moving of files and context around have been mostly automated away.
32:49 Nathan Labenz? Just on the time, though, I mean, I'm empathizing with some of these problems, some of these pain points, for sure, but it still seems like there's something, I guess one other hypothesis we should always keep in mind is people maybe just, in many cases, don't like their jobs that much. I think this is something that the AI discourse broadly should remember much more than it does. And I've probably got on my soapbox enough times about that already, but that's for sure, an ingredient in this overall recipe. But it was just striking still that, like, okay, 13 hours saved, a little under half of that sort of reconsumed by doing this copying and pasting and double checking sort of work, but that still gives you almost a full workday back, right? Am I reading that right? Are people,
33:32 Nathan Labenz? like, have we created a four day work week that we're just not ready to talk about?
33:39 Speaker 01 So here's the problem, Nathan, and when we look at the individual level, we're seeing all of this exciting productivity gain, even if we consider bot sitting, the net net is positive. The problem is, where is that time savings going is one aspect. And what we do see, especially in organizations that haven't communicated an AI strategy and employees aren't confident in their organization's AI strategy, employees are taking it for themselves, right? They're, the amount of non-disclosure, the hiding of the AI usage to managers, it's rampant, and we have some data points in the report. And so they're managing the perception, they're
34:20 Speaker 01 managing the perception of how they're using the technology, because in many cases, you tell your manager or your organization, you're getting six hours back, probably you're going to then get six hours more of work. And that is the wrong calculus. But I actually think the bigger problem is, what happens at the individual level often does not translate to the team and organization. In the research, it's sometimes called coordination neglect, right? And I think the most concrete example of this is, you can have me as an individual worker, I take a single bullet point, I convert it into a five page report, I send it to my colleague.
35:03 Speaker 01 The colleague takes that five-page report. It's too long, turns it into a single bullet point. Right? Each person looks productive. Each person looks like they've saved massive amounts of time. But when you put the pieces together, it's just this hamster wheel of AI slop, work slop, bot shitting in a way that does very little service to the organization. And I think that's the disconnect here. It's very hard to measure, but it's certainly something we're seeing in practice, in conversations with executives. And some of the data speaks to it certainly in terms of its individual productivity gains not translating to real team and organizational gains.
35:42 Nathan Labenz? Part of me feels like that might be healthy. It could be more healthy perhaps, but a four-day work week would be a nice step, stepping stone perhaps on the, on the road to the AI future.
35:54 Speaker 01 I don't want to present the perception that I, I think in many ways, we should be giving time savings back to the employee to be innovative, to be creative, to have better work-life balance. The problem is we don't have, most organizations, in part because of the context problem, don't understand where the time savings is going and how to extract meaning from it at the team and organizational level. And that's the problem because we start to see, you know, that's, I think, feeding a lot of this more is more pressure. You don't know how X translates to Y, Y being business outcomes, KPIs. You know, the knee-jerk reaction is the only thing I can associate is more tokens,
36:39 Speaker 01 more clicks of the tool is more output, is a proxy for productivity, and that becomes very dangerous.
36:46 Nathan Labenz? Do we see harm? It's one thing to say people are saving 13 hours a week. They have to give half of those back to these sort of somewhat annoying tasks.
36:58 Nathan Labenz? Maybe they save a bunch of time, they get more leisure, they, I don't know, do more social media at work or whatever, at least as long as nobody's asking too many questions. Only 13% though say their organization is doing much better, but is there a sort of corresponding stat for, are some people saying their organization is doing much worse? Because I think one, the sort of optimistic read of the results so far would be like, as people often say, it's still the worst it'll ever be. A survey was done at a point in time which was coinciding with a, by many anecdotal accounts at least, another step change, advance in models' ability to do search and assemble their own context on the fly effectively, at least have given access programmatically to do it. And if
37:41 Nathan Labenz? you were to say, hey, only 13% are doing notably better, but like, we're not really seeing anybody doing like terribly worse, then I'd say, hey, that's like, we're off to a pretty good start. But you might say, actually, no, there's like a bunch of people who are saying their organization is like outright suffering as a result of this. So what do we see on that side of the ledger?
38:01 Speaker 01 It's a great question. So this particular question, and again, the time savings range from 10 hours to 13 hours, the automation is 11 hours per week, but in terms of the 13%, it's a like-er, it scales. So we essentially ask, do you strongly agree, disagrees? So we definitely see all aspects of the spectrum. I think the optimism in me says you're right in the sense of we shouldn't expect transformative gains from this technology too quickly. I think what gives me pause and what does concern me is the volume of not just the bot sitting, but also the bot shitting, the shadow AI, the not disclosing, not being transparent
38:43 Speaker 01 to the organization, right? That is not going to get better if all else remains similar. It is only going to get worse. But I think we shouldn't rush to transform our organizations so quickly. I think that's also really, a really dangerous area to be in. In the most effective organizations, they're measuring and as part of that measurement, they're baking in failure. In the best cases, we're seeing executives pinpoint eighty percent of AI initiatives failing because failing is part of innovation. And that I think we need to keep in mind, too, is a lack of transformation in certain areas is very healthy because it indicates that in the best cases,
39:28 Speaker 01 you're taking well-intentioned risks and benefits and hopefully learning from those failures as well.
39:36 Nathan Labenz? One thing I wanted to follow up on was your comment on meaning.
39:45 Nathan Labenz? And I, because I thought that this was a, I would say apparent, striking apparent contradiction in the report is the observation that the people who feel most threatened by AI seem to be most eager to adopt it and use it more and more. And they're going so far as to automate work that they'd rather keep. And I'd love to hear a little bit more that it's obviously very connected to this question of meaning versus alienation. Could you give us some examples of things that you heard like from individuals on how you end up in a spot where this is the part of my job that I actually liked, but I'm feeling pressured to have AI do it? What does that actually look like? I'd love to get a couple sketches, if you could.
40:31 Speaker 01 It's such an insightful question. And we unpack several of these paradoxes or contradictions because there are many of them, right? There are many of them at play in part because this is such a psychological technology. And the fact that we're treating it as a human adds a whole bunch of different complexities. And one of these paradoxes, one of these contradictions is around, why do we see the people who are most fearful of the technology, most worried about being replaced or displaced, leaning in more? And I think a lot of it is the perception. The you feel a threat, you don't fully understand the technology. Perhaps you don't have the support of your organization. And you want to look AI native.
41:15 Speaker 01 You want to look like you're transforming. And so the natural, you need your reaction in too many cases is to automate as much as possible. And unfortunately, in many cases, if you're looking to automate and visibly show that you're transforming with the technology, you're probably going to point it at parts of work that you are most familiar with. And in not all cases, but in many cases, the parts of work that you're most familiar with are probably the parts of work that give you the most meaning. Not always, but certainly a case. So concretely, what we're seeing is around relationships with other people.
41:55 Speaker 01 Um, customer service, for example, these amazing customer service representatives who have spent years, decades, developing that craft of the personal relationship, the long-term relationship. All of a sudden, you have a technology that can, in theory, automate some of that relationship building, perhaps take it completely off your plate so that you're no longer interacting with a human. If that's what gives you joy and meaning at work, that is very dangerous. And that is what we're seeing. And not just in this survey, there was a fascinating study that came out of Stanford a while back that found forty-one percent of Y Combinator AI startups are automating things that people would prefer to keep human.
42:39 Speaker 01 And again, this again boils down to the psychology of this. We can't just assume that because the technology can do something, because it can automate something, it should be automated. We know that so much of work and so much of the process is meant to be messy. It's meant to be full of friction because that friction, sometimes it's called the IKEA fact, right? When we build something ourselves, when we do the hard work of doing the thing. Well, that builds ownership, it builds good judgment, it builds purpose, it builds pride. And these are not feel-good, nice-to-haves. These are hard drivers of performance. And it's a very difficult calculus because it differs for every person, every team, every organization.
43:21 Speaker 01 But it's absolutely essential that we think about, okay, what is this division of labor between humans and AI? And the calculus should not just be can the AI do the thing? It also needs to take into account this human piece. What does the employee find meaningful? Because that meaning is going to drive their best work. And it's going to drive situations where, when they do get the time savings, they're reinvesting it into the betterment of themselves, their teams and the organizations, rather than more clicks of the tool or taking the time savings for themselves and not sharing that with the organization.
43:58 Nathan Labenz? That customer service example is a really good one. And I do think it goes to show how tough this is going to be in a lot of ways. Because I can totally imagine being a person who is in that kind of job because you like talking to people, you're a people person, and that is what gets you going every day. And then to think, okay, you're not going to do that anymore. But instead, you're going to get to sit in front of this agent builder UI or whatever and like try to string together what you used to do and, you know, watch out for its failures. And it's like, I didn't sign up for this. I don't really, I never would have wanted this job in the first place if I had to do this. But here I am.
44:42 Nathan Labenz? And at the same time, if you put yourself in the leadership standpoint or honestly, in the customer position as well, I think the logic of it is like pretty unavoidable that if only for responsiveness. I mean, I've looked at, for example, my company's response times when Finn is active on our intercom versus when it's a human. And we do a great job on customer service. And we do have, you know, real people, people. And our customers have always really spoken very highly of our customer success team. And yet, the like...
45:19 Nathan Labenz? Immediate response of fit is, you know, in many cases, it's like, it's a real value driver for the customer too, because they get out of there in a couple of minutes instead of, you know, with the longer back and forth of a human could be, you know, 30 minutes plus the doing it the old way. So I think that is really tough. If you think about, I've seen this said recently that companies are graphs of algorithms and that I think did not come from Glean, but it very much rhymes with some of the recent releases around the enterprise graph. How do you think people should be thinking about this from a sort of leadership executive competitive dynamic standpoint? I think it's hard to say. Maybe
46:03 Nathan Labenz? we want to keep some humans in customer service because whatever, we got super high value customers, they're going to value it, there's something intangible. But I think it's hard for most companies to really make an argument that we shouldn't take a 90% cost savings and, and the ability to be instantly responsive to all of our customers because people like doing it the old way. But then there are, that's one algorithm in the, in the graph of algorithms that constitute a company. But then there may be other ones where you maybe do have a better reason to keep it more human. How do you think leadership should be decomposing their organizations and thinking for all the different parts of it, what they have to accept the tides of history and where they maybe want
46:48 Nathan Labenz? to hold on to things for special reasons?
46:53 Speaker 01 So this is where I can really geek out because I think it's so exciting. And when we think about the enterprise graph in particular, the enterprise graph isn't just a connection of people and tasks and documents, right? It's a collection of everything from the mission of the company to the, the goals, to the projects, to the tasks, to the people, to the documents, to the technology. And you can easily imagine a world where if, and we're starting to see it certainly with our customers at Glean. If you have an AI platform that understands enough about your organization, and we'll take this customer service example, it can do two things that are really exciting.
47:36 Speaker 01 One, it can understand, given all the interactions you've had with customers, your sales team has had, or anyone else, and understand, okay, what is, for example, the level of complexity in those interactions? What did the customer or client want in those interactions? Did they want that fast response? Or was it a long-term relationship-building conversation? It can then make a determination or a recommendation to you in terms of, okay, this is a predominantly human warranted interaction. This is a human-in-the-loop type interaction. This should be completely automated. And we should be making the trade-off ourselves of,
48:19 Speaker 01 absolutely, I don't want to live in organizations that over-index on keeping work meaningful for employees. In the best case, you sometimes automate parts of work that employees do find meaningful, but you absolutely replace that with parts of work that employees can now take on, that they find just as meaningful, if not more meaningful, in the best case. So that's one dimension of this. The second dimension is, if you have an understanding of not just the enterprise E and A, but also how individuals work, their skill sets, their career ambitions, you can start to make recommendations using AI
49:03 Speaker 01 in terms of, okay, what is the task allocation now for this specific person? Given their expertise, given the goals of the organization, given the development of the technology, given their career ambitions. And it becomes incredibly exciting. We're seeing this in terms of how some of our customers will now staff project teams in fundamentally different ways. Previously, we've relied on the static org chart to staff our projects. If AI knows enough about your organization, it can make a dynamic recommendation in real time. Who, across your 1,000, 2,000, 10,000 employee base?
49:41 Speaker 01 Is the right mix of people based on skill sets, based on expertise, based on career ambitions and passions, bandwidth, and do a complex calculus that we as humans could never do. That is, in my opinion, the North Star of enterprise AI. It's the power of the enterprise graph. And we're starting to see snippets of this come to life in a way that I think is incredibly exciting.
50:05 Nathan Labenz? Yeah, I like that notion of, boy, it's been a long time since I've worked at a big company, but when I did, I had a lot of outside the box ideas, briefly, when I did briefly, I should say. I had a lot of outside the box ideas of how to use things like internal markets or, you know, auction mechanisms to figure out how to allocate people to the best and highest uses. And those mostly fell on deaf ears. And for understandable reasons, because there was going to be, even if you're seeing buy in, which we didn't have, there was still going to be a lot of like time spent operating those mechanisms. And I could just see why, you know, it just wouldn't happen. The younger me didn't understand those things quite as well.
50:50 Nathan Labenz? But this is, you know, because you can have the AIs grind through, this is sort of the, in a sense, it's like the positive version of the mass surveillance use case, right? Like, we used to be safe from mass surveillance because there just wasn't enough human brain power to process all the logs. Now we've got that problem solved in a potentially very problematic way. But here, you can actually imagine going through your full roster and really trying to tinker with all the different assignments and configurations that you might spin up. And you can imagine how that could really unlock a lot of potential that nobody would have had the time, certainly perspective probably as well, to be able to do in a pre-AI era.
51:35 Nathan Labenz? So I do think that is like, pretty exciting.
51:39 Speaker 01 And there's a small finding in the report that I'm incredibly excited. We have one of our co-authors, Aruna from Berkeley. She made a note as soon as we put this in the report. Wow, this is so exciting. I think so, too. We didn't, we don't foreground it because there's so much. But what we see in the most effective organizations, so the 13% who are, who have employees saying significant productivity gains are occurring, they measure, they measure a lot of different things. In particular, they don't just measure productivity, but they also put that data disproportionately more in the hands of employees. And this is not new. I saw it with collaboration technology, too. I saw it with remote and hybrid work and yajing type situations.
52:24 Speaker 01 If employees have access to that data, it is transparent to them. Everyone is better off. Unfortunately, we're seeing cases of that not happening in organizations. Again, another benefit of the enterprise graph is everyone has access to it, right? Everyone is able to query the graph and understand the state of play within the organization in a way that I think is going to drive much better outcomes for both organization and individual.
52:53 Nathan Labenz? So speaking of measurement, one thing that I was kind of pondering myself as I was imagining myself leading an organization through these challenges based on all the findings in the report, and I don't know if we said this yet, but 69% of people admit to some form or some amount of bot shitting, which I think has like a couple of different definitions, but for me, it's like passing off AI work in, you know, down the line somewhere where you yourself cannot defend the quality of the work. That's a very high rate. So it does strike me that, again, kind of my earlier thought, in a way, that's maybe a really optimistic thing for how well AI is working because if you already have two
53:38 Nathan Labenz? thirds of people just doing AI outputs blindly, sending them down the line, and the wheels aren't falling off entirely, you know, that's like. Kind of an amazing finding. But then if I'm trying to manage that as a leader, I'm thinking, how do I detect who's doing it? And how do I detect where it's actually working? And, you know, maybe I do want to share that with with employees. Maybe I do want to partially share it. I'm not sure exactly what the right level of transparency would be there. But have you seen anybody? You know, I've seen also recently, historically, my attitude or my my synthesis of available information has been AI detectors don't work. So like when I go to present to a group of teachers, I'll say, don't do AI detectors. Or at least if you do, you know, you certainly can't.
54:23 Nathan Labenz? They can be wrong. So you're like, you can't trust them too much. These days, it does seem like Pangram Labs is getting a lot of praise in in the general discourse around being pretty reliable. So I'm kind of wondering, should I be, if I'm a leader, adopting like something like Pangram Labs and having, you know, all these intermediate work outputs evaluated such that I can potentially both realize who's doing this, but also like maybe where like which, again, this is kind of an angle on which nodes in my graph of of activity that constitute my enterprise, which ones can I actually just have AI do? Like a potentially already have a lot of answer to that question in the work product that people have, the AI work product that people have passed off
55:08 Nathan Labenz? as their own. Do you see anything like that?
55:11 Speaker 01 Yes, and I think it's so early there. And also, there's not going to be a right answer for every organization. A lot of it depends on the psychological safety within the organization. I've long followed Amy Edmondson's great work, and I think psychological safety has never been more important in our organization because ideally you have the people raising their hands and saying, this is bot shit, or I contributed to bot shit, and here's why. I think AI detectors, you know, there is for sure, and I'm seeing it from multiple different angles. You know, there will be a world where all of our AI tools will flag the
55:50 Speaker 01 The level of uncertainty associated with the response as well as the likelihood of purely AI generation versus human AI. I think what's exciting about the more context you have as well is you can feed it more data points. You can feed it not just generically, is this likely to be generated by AI? If it knows enough about you as an individual, it can know, okay, Rebecca's default writing style as a human is this versus doing something generic. And I think that's why we're seeing a lot of detectors not work. Why I think this isn't necessarily, and certainly isn't strictly a technology issue or solution, is organizations need to understand the why.
56:35 Speaker 01 The why behind the bot shitting is just as important as the bot shitting. In particular, when we think about using shadow AI tools, right? That is a form of a bot shitting. You're injecting risk into the organization by using an unapproved tool or a sanctioned tool in an unapproved way. We're seeing a cohort of organizations crack down and punish employees for doing that. And then we're seeing a portion that definitely have guardrails and repercussions for unsanctioned use of the technology, but not strictly that. It's understanding why are employees using unapproved tools? Or why are they coloring outside the lines?
57:19 Speaker 01 Because usually it's the highest performers that are doing that. And usually they're doing that because the existing tech stack isn't working for them. They see so much potential in the technology and they're making that calculus in their head. Hey, I would rather get the productivity gains, in the best cases, hopefully get the gains for the organization. And they're doing this trade off. Ideally, organizations recognize that and make the safe path, the more efficient path. That is the gold standard. I think part of it is a technology piece, but a part of it is deeply human.
57:52 Nathan Labenz? Another stat that jumped out at me was, I believe, both the people that do the most bot sitting, so doing, first thing should be said is,
58:05 Nathan Labenz? Doing more bot sitting is associated with being more successful with AI. So both probably because you need to do it to get good results and because you are going to naturally do more of it, the more you use AI in the simplest analysis. But then also, the more bot sitting seems to be associated with higher likelihood of being on the job market and actively looking for your next phase of your career. And the same is also true on the bot shitting side. People that are doing more of that are, again, more likely to be looking for a job. That sounds scary, and it might be scary.
58:48 Nathan Labenz? I guess another way I might interpret it, if I think about the person who was in the traditional sort of customer service or customer success role and is now being asked to babysit bots, is maybe like, maybe some of this turnover could in fact be healthy. If people are like, doing something they don't want to do. I guess a big question in general with AI is like, obviously, is it going to create more jobs than it destroys? But even more locally and like focused on specific organizations and teams and individuals, is the new job that gets created, whether it's greater or less than one per job that gets eliminated, is it something that the person that had the original job can pivot
59:31 Nathan Labenz? into or would want to pivot into? And I guess my read on some of this stuff is like, it sort of suggests that in a lot of cases, the answer is no. People that are doing a lot of this AI stuff, good and bad, it sounds like are kind of voting with their feet that this is not really what they want. Maybe they don't see themselves being successful in this new world. And so I guess I wonder, do you see that as a sign? Do you see that as something that like leadership is doing wrong? Or do you see it as sort of an actual signal of just change? Is
1:00:04 Nathan Labenz? Often not what people want, and so they're kind of reacting in a ultimately what might be a perfectly sensible way.
1:00:12 Speaker 01 So I'll hypothesize here based on the data because we certainly don't know causation. These are correlations more than anything else. I think when we think about bot sitting, it's very different than bot shitting. Bot sitting, what we're seeing in the data, what I'm certainly seeing in practice is there are two big links between the act of bot sitting and the desire to leave the organization. One is, and we have an amazing co-author on the report, Paul Leonardi, who's done foundational, impactful work on what he calls digital exhaustion. The digital employee experience is increasingly the employee experience. We often trivialize it, but the reality is overwhelmingly we're seeing if employees
1:00:57 Speaker 01 are exhausted by technology, they're wanting to leave the organization. And when we think about bot sitting in particular, what I'm seeing is if employees are spending all of this time manually feeding context to the AI, that doesn't instill a whole bunch of confidence in the employee, that their employer, the organization, has a strategy or a good one around the technology. And I think that's a big part of it. If you're wasting your days bot sitting and your organization is vocalizing in all hands in town halls that this is a transformative technology and we're transforming, there's a disconnect that if you're seeing all else being equal in other organization that is investing in technologies that do have context, you're going to choose the latter.
1:01:42 Speaker 01 So I think that's the bot sitting piece, certainly not the whole piece, but I think that those are reasonable conclusions to hypothesize. The bot shitting, I think, is different. The bot shitting is, in my opinion, and what I'm seeing in conversations.
1:02:00 Speaker 01 You've decided that you're disengaged from the organization, perhaps because you're spending so much time bot sitting. And you're wanting to leave the organization is a reflection of that broader disengagement. Right? If you're bot sitting and no longer feeling a sense of ownership over your AI-generated work, probably that's part of a bigger disengagement, disengagement picture and feeling and sentiment within the organization. I certainly don't think that's the case for every employee, but I do think that's, that's a part of it as well. Aruna, who I mentioned before, she, you know, she hypothesizes in the report
1:02:45 Speaker 01 that perhaps it's also that people have bought sitted so, or they've become such an expert in the technology that they've realized their market value is higher outside the organization than inside of the organization. And that's a reflection of the disengagement, both in terms of bot shitting and the desire to leave the organization. Your market value has increased. I certainly think that's for a subset of employees, the association as well.
1:03:14 Nathan Labenz? Yeah. So basically, the key is if you're leading an organization, you got to tell who are the good AI users and who are the bot shitters. And you're going to want to take steps to retain your top performers. You need to both use your AI detector to know who's using AI, but then also you need like a quality score to know who's actually using it effectively. And those people that are using it a lot, but using it effectively are ones that you're at risk of losing if you don't level up your game in one way or another, which could be better AI tools for them, could be better comp for them perhaps. The ones on the other end that are just passing off AI work that they can't defend, probably in the end, you're going to have to make your peace with this is part of ways
1:03:59 Nathan Labenz? with these people is going to be the cost of transformation. How do you see people telling the difference? And do you, on the upside, obviously in, deep in the AI bubble, I'm not this central in the AI bubble, but we've got all these stories of.
1:04:13 Nathan Labenz? Basically, sports star, pop star incomes for top-end ML researchers. I don't expect that is happening in quite such an extreme way in enterprises. But are we seeing like retention plays where people are getting like meaningfully rewarded in terms of comp if they are really on the cutting edge of helping their organization with AI transformation, if only in terms of embodying it and bringing it to their own role in an elite way?
1:04:48 Speaker 01 I love this question. No, not in a meaningful way. Should they? Yes. And this is not new, right? We, my colleague, Rob Cross, who has been an inspiration for me for many years, some of his research shows that high-performing organizations, they're up to 5.5 times more likely than lower effective ones, less effective ones, in measuring and rewarding effective collaboration. The great organizations do this. They build some sort of measurement. It looks different for every organization. Sometimes it's tied to pay. Sometimes it's more informal. But fundamentally, the most successful organizations, the most enduring organizations,
1:05:31 Speaker 01 they do something to reward the collective and not just the individual. I think that could not be more important with AI when we're starting to see this tragedy of the commons, hyper-focus on individual productivity in a way that's not translating. I'm seeing it in bits and spurts is one example where they take something like a hackathon or an agentathon, and they think very carefully about what are we going to incentivize? And they're not just giving prizes for the biggest business impact, as most organizations do. They also give prizes for improvement, best before and after prompt. They give prizes for co-creation, feedback, peer feedback, not just are you using the
1:06:15 Speaker 01 technology to drive your individual productivity gains, but are you creating value together? Those types of things we're seeing in effective organizations, but we're not seeing it at scale in a way that I think we should. And again, if I think Ten steps ahead, if you do have a context graph, if you do have an enterprise graph, well, it can help you make that determination because it will know where value has been created and it can start to give you recommendations. And we see it in the data where, you know, a large portion of employees are saying already their organizations are using AI to inform performance management, hiring and firing too. And when we ask, what is your expectation?
1:06:59 Speaker 01 Not surprisingly, it's even higher. I think where I hope, this is the hopeful part of me, I hope we see a world where not only can AI help us drive more objective, fair performance reviews when they've been riddled with biases for forever, and it can help us feed the performance evaluation with a bigger focus on the collective as opposed to the individual. That becomes incredibly exciting. And I think we're going to see it because we are already seeing bits and spurts of it.
1:07:34 Nathan Labenz? So tell me a little bit more about how you think leaders should approach this culture building. I have said that many times myself, you know, it's got to be a cultural thing. And, you know, you mentioned like, we need to see executives using AI. That's, I think, a very sensible starting point, but it's got to go farther than that. And in some cases, it's going to be in a pretty tough messaging environment, let's say, right? Because we do have quite a few rounds of layoffs from tech companies, mostly so far, being attributed to AI. I, tell me if you think this will play out differently, but
1:08:17 Nathan Labenz? I suspect that we're going to see a pretty similar phenomenon extended to the rest of the economy and probably a few successive waves over the not too long of a time horizon. And certainly, my sense is that public company CEOs feel like, geez.
1:08:38 Nathan Labenz? Whether I like it or not, I'm under a lot of pressure to figure out how to make this stuff work and I'm told that my competitors are going to be dramatically cutting their costs and can I really compete if I don't? So they're going to be presumably in a pretty tough spot where they're like, okay, here's me as the CEO using some prompts. At the same time, though, we are cutting headcount by 10 to 20% or whatever and we're going to work better together and it seems like it's going to be a very tough messaging plane to land. What advice do you have for people that are facing this difficult challenge?
1:09:11 Speaker 01 This is an area where we do know so much about what works. Unfortunately, we don't see it implemented and employees can call bullshit from a mile away. And if they see a talk track that's different from what's happening in practice, that does not instill confidence and you start to see a whole bunch of this symbolic use of the technology. Transparency is so important right now for so many reasons, but in particular to understand the why. The why behind organizational changes in either direction, the why helps people understand whether they're willing to believe in it and willing to commit to it in a reasonable way.
1:09:56 Speaker 01 Now, what I'm seeing overwhelmingly is performative theater at every level of the organization, but in particular with executives. And I spend a lot of time with executives and the amount of conversations I've been part of where one executive decides that they're going to cut 15% of headcount and then there's a conversation around, should it be 16%? Should it be 14%? And there's this very, you know, very disturbing narrative that there's a one size fits all for every organization. There is not and we've seen efforts to change organizations and dismantle hierarchy, flatten
1:10:39 Speaker 01 the org chart, time and time again. Often they don't work because they're short-term, perceived short-term fixes that don't help the underlying problem. This is an organizational design transformation in its fullest sense, having an understanding of What is your culture? What sorts of behaviors does your culture embody? Does it reward? Does it punish? That is very important right now. And articulating that to employees in the context of AI as well. What is AI in relation to humans is very important. And what we see overwhelmingly is in these organizations, and we talk about it in the report.
1:11:21 Speaker 01 Employees are significantly more likely in these transformative organizations to view AI as a teammate and how they interact with it. But not as an employee on the same level as them. Because that becomes dangerous when we're starting to deflect blame on the AI tool. Right? The blame, the onus, the responsibility rests with humans. But ideally, the organization is positioning AI, both psychologically and in the tools and technologies they invest in, as a teammate in a way that employees can rock. How might I interact with this technology? How might I start to delegate work to? It's a multi, multifaceted problem.
1:12:04 Speaker 01 But the answer is not to make cuts or make sweeping changes without understanding the impact of those changes on a smaller level. And I think that's why coinciding with these, you know, these layoffs, these cuts, is a lot of regret because we don't fully understand what employees do. And we've seen this in customer service cases where you cut the human agents. You realize, wow, those human agents did a really important work in building long-term relationships with customers. You then bring them back. And again, this is the power of an enterprise-type graph is you can do that proactively and you can understand the real value of the humans in a way that is much more thoughtful
1:12:46 Speaker 01 and is much more long-term thinking than just doing the thing before understanding the ramifications. It's not easy. But the answer is not to move quickly without understanding the foundations.
1:12:59 Nathan Labenz? It strikes me that the importance of mission and mission buy-in might really be
1:13:08 Nathan Labenz? At a premium in the near term, because I can just imagine a hugely different reaction if you sort of, you know, imagine you're seen from the office where it's kind of generic widget code, you know, PaperCo, you know, indistinguishable from tons of other competitors, where if you ask, if we don't do it, who will? And the answer is like, well, lots of other people and they'll do it pretty much just as well. And the world won't really be that much different. That seems like a really hard place to manage this sort of transformation from. Whereas I do know some organizations where they're really, in a very meaningful way, bought in on the mission and the success of the
1:13:50 Nathan Labenz? organization. And then when things like this happen, even if it does result in somewhat painful change, if people believe that the mission itself is going to be advanced by this change, then presumably their tolerance for certain pain is dramatically higher. I guess it's, the tough thing is, it's like, it's hard to synthesize a mission where there really isn't a very compelling one. But any thoughts on the mission premium, we might call it?
1:14:16 Speaker 01 So it's super insightful. And I, so one of our other contributors to the report and one of our founding members, Bob Sutton and I, we're working on a piece right now, hopefully it'll be in Harvard Business Review, on if you are going to flatten, how do you do it well? And what are the pieces you need in place to do it well? This is not necessarily job cuts. It's strictly looking at flattening and hierarchy. And one of the core arguments backed by research and evidence is you can't flatten well if employees don't understand the mission. Because what you're starting to do with job cuts, but also just flattening in general, is you're dismantling hierarchy. And hierarchy gives employees a sense of
1:15:01 Speaker 01 what to do in situations of uncertainty. If you don't have that hierarchy, you need to replace it with something else. And the mission is a key way to do that, right? If employees have a strong sense of what is the company's mission and they believe in it and invest in it, they're going to make the right decisions when no one's watching or no one's surveilling them. If you don't have that, even if you have a super strong company mission, but employees can't make the connection between their work and the company mission, that's just as detrimental. Right? You can't do any of this well. And I think we underestimate, and I love that you called this out. I think it's incredibly insightful and important that we need to think about the bigger picture.
1:15:43 Speaker 01 And when we think about the DNA of an organization, the mission is at the top. And again, the enterprise graph of it knows enough about that. It can start to give you proactive insights in terms of, okay, does the work we're doing, do employees understand the mission? Does the work they do at an individual level ladder up to the mission? Or is it completely disconnected from the rest of the enterprise graph? That again, becomes very exciting. I think we underestimate just how important purpose and pride and meaning at work is. If nothing else, without that, it drives certainly more bot shitting within the organization.
1:16:24 Nathan Labenz? How much of an impact do you think that Elon's Twitter takeover and subsequent managerial decisions have had on, let's say, executive culture broadly? I guess my read on that is it sure looks like it basically worked. I was asking AIs about this in preparation. It's something like 7,500 employees was what they had when he took over. He took that down to something like 1,000, maybe as an absolute low, maybe 1,500. Did hire some people back, has hired some people. It seems like the team has grown a little bit since then, but it's maybe a third of what it used to be. They did lose a lot of revenue.
1:17:07 Nathan Labenz? I would say that was mostly because advertisers didn't like him slash his content policies slash just the general vibe and kind of walked away. But on all the other metrics, they've kept their users, the site. I'm old enough to remember when people said the site wasn't going to work anymore. It continues to work. If anything, I think recently they've started to accelerate some things with a really nice new API that I'm building on, where I'm like, oh, this thing is actually really well done. Elon's obviously a special case in many ways that has options seemingly available to him, financing and otherwise, that not everybody has. But do you think that example has, does it entice executive thinking broadly throughout the country to think, geez, could I do something similar?
1:17:50 Nathan Labenz? Or is it just so far out that it's not, doesn't even really register with most company leaders?
1:17:54 Speaker 01 So I'll comment generally on this because I think we're seeing multiple different instances of CEOs making pretty radical changes and executives jumping on the bandwagon and wanting the promised gains for their organization. That is natural, absolutely. We see it with any high-profile CEO. We're certainly seeing with Jensen at Nvidia. Very interesting leadership strategies. I admire him deeply in so many ways. What works for Jensen and Nvidia doesn't work for 99.9% of other organizations. Part of it is mission as boss, right?
1:18:38 Speaker 01 We do a lot of work on meetings. The fact that Jensen doesn't have one-on-one meetings with his direct reports, that does not work in most organizations. It works in Nvidia because they have this mission as boss, right? Every employee, at least the report of Jensen, his direct reports, they have a super, super clear sense, as far as I can gather, of what the mission of the company is, and they're fully bought in. So they don't need as much that one-on-one interaction with the boss. I think this holds for AI as well. What works for one organization, especially when we think about AI, that is, again, so deeply psychological, isn't going to work for your organization. I think we can take inspiration, and certainly, I think we underestimate the power of a leader
1:19:23 Speaker 01 who motivates and a leader who makes bold changes during this time in a way that employees feel a sense of energy around them. But I do think it's very dangerous to think that what works, especially in the headlines and the external perceptions, for one organization can be translated, copy and pasted into your organization.
1:19:45 Nathan Labenz? I think I also wanted to double back on and get a little more color commentary is you said that the most successful organizations, you're seeing this pattern of people relating to the AIs as teammates, but not necessarily peers. I'd love to hear a little bit more about that. And maybe you could fill in some of the details with what is your experience of using Glean at Glean like today? You obviously have human teammates, you have AIs, presumably these AIs have as good of an integration into the deep context of Glean as any AIs anywhere could possibly have. So what is your mental model for like when you go to an AI, when you go to a person, when you start a group chat between you and another
1:20:30 Nathan Labenz? person and the AI? How's, what's the difference also between the sort of you, Rebecca, extension AI versus the, I don't know if it is it a central like Glean bot that is the company wide version? I guess paint a picture of your present is everybody else's future, right? So tell us what's going on at Glean now so people can have a little more concrete sense of what they're going to be walking into.
1:20:55 Speaker 01 Sure. And this is a nuanced argument for sure. And I think I've done enough research on this sort of mental model. I did in a previous life, I did some research with colleagues with Carol Dweck at Stanford, her lab on mindsets and the importance of this psychological framing. What we're seeing in practice, and I'm not convinced this won't change, but when we think about the mental model of a teammate, that is extremely valuable right now because it gives employees something concrete to explain, how do I think about this thing in my day to day work? And in particular, we see when employees adopt that teammate mentality. They're not treating the technology as transactional, right?
1:21:40 Speaker 01 It's not like a hammer or a calculator, something you can pick up, use and put down, right? Treating it as a teammate means you're not expecting the perfect answer. You're not expecting the technology to work perfectly. The teammate is in the interaction. If it knows enough about me, so the glean assistant is my personal assistant, my teammate that I go to every hour of the day for things I need help with and to move work forward. The danger of the teammate mentality in practice, when we think about the psychological aspect, is deflecting blame. This isn't a human teammate where if the AI makes a mistake, we can blame the human.
1:22:22 Speaker 01 And Paul Leonardi, who I mentioned, he's done fascinating research to show when a human screws up, if I have an assistant and the assistant makes a mistake, a human assistant, we blame the human assistant. When an AI makes a mistake, we blame the human as well. If we're on the receiving end, unfortunately, as we're deploying these tools, so often we think that, oh, this person, this AI is agentic, it has agentic capabilities, we can deflect blame. No, that's not the case. So that's the danger of the metaphor. But in terms of glean, the assistant knows enough about me and also I use it all the time when I'm wanting to do a lot of executive-type communication, upward reporting, for example.
1:23:05 Speaker 01 Every executive likes to consume information in a different way. And so being able to ask my glean assistant, okay, what is the preferred mode of consumption for this executive versus this executives is very helpful. As I was joining the organization, I'm about 11 years, 11 years, 11 months in, feels like 11 years some days, it's, I'm able to
1:23:29 Speaker 01 Query the AI and understand the institutional context that came before me. I'm able to, I wrote an article on this. I'm able to understand not only what was a decision made around this? Why did we launch this specific feature? Who are our customers? What's our product roadmap? All of those things are super important. But I also asked it, what makes a successful employee successful at Glean? And it was able to understand from the culture. This is what the successful employees do differently. And I fundamentally acted a little bit differently because of that, knowing what the culture rewards. So that becomes really exciting.
1:24:05 Nathan Labenz? Could you share a little bit, out of it's too close to the, to the secret sauce? But could you share a little bit more about what Glean AI said makes a employee successful at Glean?
1:24:16 Speaker 01 Yeah, I wrote an article because I, I used my exact queries, but it was something around the team mentality. And I think what we've talked about today, it's not a culture of rewarding individual performance. It's a culture of rewarding the team. And it's also a culture of long-term thinking as opposed to other organizations. And so that innovative spirit, and I feel this every day, it's rewarded when you raise your hand and you share the weird, wacky idea, share the, the future of what's possible with the enterprise graph. Those types of things that do differ case by case were some of the things I asked it in my early days.
1:24:56 Speaker 01 And now it knows enough about how I work where it's able to produce information that is unique to me. I'm also able to choose different models depending on the task at hand. And it has memory capabilities that it's constantly learning with every query, with every day, what my priorities are. It'll proactively flag when I haven't followed up on an email, which I, working at Asana for many years, I've become horrible at email, so that's really helpful. And again, proactively telling me when I've missed something, when there's an action item in a doc that I've forgotten, it's helpful in making sure I don't drop the ball on too many things.
1:25:40 Nathan Labenz? So on that note of long-term thinking, tough question here for sure. But if you try to see through the fog and imagine maybe what Glean looks like in a few years and more broadly, like what large companies in general look like a few years from now, what do you see? I think we we kind of have the easiest time imagining a version of the world that's pretty similar to the current one, but where like a lot of stuff is automated. And so the savings kind of get passed on to the consumer. Like, you know, maybe companies are both more profitable and their stuff is cheaper and people are able to buy more because everything got so much more efficient.
1:26:25 Nathan Labenz? It does seem like, though, that idea of efficiency and like both higher profits and higher consumer surplus is kind of premised on major labor cost savings, AKA companies are going to be smaller in terms of headcount than they are now.
1:26:44 Nathan Labenz? There's a lot of people who want to tell me a different story about how it's not going to be like that and, you know, it's really going to be about growth. And then I'm kind of always like, well, sure, it's going to be growth for some. But I also kind of see a trend in general in in business that starts again with technology toward kind of winner take all dynamics. You know, it seems like we're seeing more and more market concentration in a lot of different places. So I do believe that like some companies will really win through growth, but a lot of that's probably going to be taking share from other companies. So is there a is there another vision that you find compelling aside from that default vision? Or is that ultimately kind of the future you think we're headed toward?
1:27:25 Speaker 01 The two separate questions. A vision I think is compelling is different than I think the reality that will play out. Answer everyone loves to give is AI freezes up for higher order work and we're going to have more jobs than ever before. I think we will. There's certainly going to be jobs created that have never existed before, and that's exciting. I don't think costs are going to decrease in the short term at all when it comes to using the technology. And you speak with executives every week where they've blown their AI budgets in a very short time for the year. Sometimes they're blowing, and we've seen headlines where you blow your token budget for a year and a month, the costs are not decreasing. And I think
1:28:06 Speaker 01 that is a very real concern for every organization. And that's why I think the future is not a single model platform. It's a multimodal, multi-tool platform. In the best cases, the AI is able to proactively route the task to the right model, given a multitude of different dimensions, efficiency, complexity, cost as well. So that I'm pretty confident in. I think we are seeing smaller and smaller teams. And I think that makes sense because if we're using AI in the right way, A, it should reduce the massive coordination tax of work. We should probably have slightly smaller teams. We should probably need fewer managers if a core part of the
1:28:51 Speaker 01 managerial role has been to manage this coordination tax that can now be taken on with AI. That becomes exciting in many ways because we are seeing an opportunity for specialists to become more generalists. We're certainly seeing roles rebundle where, and I've seen this in practice, in particular through my PhD, I saw the org chart pressure tested and organizations start to think about, okay, where can AI give me insights across silos in a way that now makes sense to redraw roles that previously lived in two, three, four different roles, now in a single role. I think we're going to see that in the companies that survive and thrive.
1:29:37 Speaker 01 I hope for a world where we're spending more work on the deeply human parts of work and we have a much clearer sense of what is the right division of labor. I'm starting to see enough evidence where I think that's a possibility. I spend a decent amount of time with an amazing CHRO at one of the largest healthcare organizations and they've used AI to task map all their roles and just determine that 70% of all tasks are overlapping with other roles, across roles. And so in those sorts of situations, you can easily imagine the enterprise type graph making the determination in terms of, okay, what does make sense to live in a human role versus what makes sense to live in an agent role?
1:30:21 Speaker 01 How many agents is the right agent to human ratio? That is certainly going to be in flux and I think organizations are going to grapple with that. Those are the things that I'm pretty confident. In terms of beyond that, I think a lot of it is up for grabs and I think a lot of it depends on the level of intentionality that organizations put into the human aspect. This is not a technology that's inherently good or bad. It's not going to inherently make our organizations better or worse. It's about how we enact them. And my optimism says that, yes, this is going to make for much better organizations in terms of delivering customer value, delivering employee value. But I think we're seeing enough evidence that if you're not invested in the human
1:31:05 Speaker 01 piece, this can easily create a world that's worse for the individual team and organization. I hope that's not the case and I think I'm seeing enough evidence it isn't, not if we're not intentional about it.
1:31:18 Nathan Labenz? Yeah, there's probably going to be a healthy amount or perhaps an unhealthy amount of creative destruction in any case. I do imagine we'll see a lot of organizations that look great, but there's going to be probably a strong survivor bias in the organizations that continue to exist in however many years' time. That's obviously another cycle. All these cycles are getting shorter and shorter.
1:31:39 Speaker 01 A hundred percent. And I think what I'm also seeing is what works for an AI native company does not work for a legacy company. I think there's going to be two models. Unfortunately, I think for many reasons, AI native companies have a leg up. They don't have that existing baggage. They don't have the existing legacy org chart, but don't try to copy and paste AI native business model onto a legacy organization, figure out what has been working for so long and figure out what what needs to evolve versus what what shouldn't evolve.
1:32:11 Nathan Labenz? So, thank you for giving me so much of your time today. Just a couple of final questions. One, on your own work, if you just imagine the next couple of cycles of this, and whether it's the biggest companies on the stock market getting displaced, or the model release cycle, it seems like everything is speeding up. In work like this, my gut says that this is like, you probably already used AI pretty extensively in producing this report, but it feels like we might be hitting a phase change moment for you where the way in which you can study organizations is probably changing pretty dramatically. So I would imagine that you might imagine, or I would imagine that you might be planning to use AI interviewers
1:32:56 Nathan Labenz? in the future and, you know, data analysis and maybe this sort of thing becomes less of a one-off report and more of like a rolling index where there's like a monthly update or even sort of real time sort of vibe to it. Because certainly, everybody is going to want to be as close to the moment as they can in terms of understanding what is really going on. How do you anticipate your own work changing over the next couple of cycles?
1:33:22 Speaker 01 So, we are, this is planning to be, we're planning to have this be a pulse type survey, which I've long been excited about, and especially because we're looking at it from multiple different dimensions. Every six months or so, the goal is to be able to track this longitudinally. And I think when we think about what will the bot sitting percentage look like, the bot sitting, how do we see roles evolving, that becomes incredibly exciting and uniquely possible with AI in many ways, in particular because of the data analysis. I think we were writing this report. The co-authors and myself as one of them were very passionate about human narrative and human storytelling. And so there are parts of the research process
1:34:05 Speaker 01 that absolutely are 100% human. But there are parts that now we can do much more quickly and effectively because of AI. So I think that aspect's exciting. I, as a researcher, I'm trained in a methodology called ethnography, which essentially means you embed yourself in an organization and watch over many months and years how things change. I actually don't think that's going to change a whole lot with AI. I certainly think field notes and some of the ins and outs of how you do the method change, but these are long-term changes. And I think there are parts of this change that we will never be able to glean fully from survey data.
1:34:48 Speaker 01 We're going to need to have the lived experience of the people on the ground. Interviews can get you some of the reason, some of the way there. But I think there's no substitute for embedding yourself in an organization, doing truly grounded research and figuring out all of the unexpected ways that this is going to change our organization. Because I think we as humans don't even see it a lot of the time. So that aspect, I don't think is going to change much. The importance of really grounded research where you're taking the time and this is a technology that you can't learn everything from subjective survey data or even the exciting telemetry data that gets you a piece of it.
1:35:30 Speaker 01 There's no substitute for that sort of multi-method research approach, in my view.
1:35:36 Nathan Labenz? Is there any place, organization, whatever, that you would love to embed in that would be your dream deep research environment? Another version of that, I guess, would be like, I don't know that there were any experiments. It's, all of this was pretty observational, but, and organizations obviously got enough on their plate without letting academics like you come in and do controlled experiments, but. What do you think would be, if somebody really wanted to offer themselves up as tribute, what would be the kind of big questions you think are hardest to answer that if you were really able to get the right kind of access or structure and experiment in the right way would shed the most light on the biggest questions that are currently open for you?
1:36:18 Speaker 01 Gosh, this is so tempting. And I'll give a cheesy answer, which one of the reasons I joined Glean was we do have this bias for experimentation. And while we don't have any experiments in the traditional sense in the report, we do have a whole bunch of experiments going on. And one that I'm excited to talk about in the short term in terms of how are we pressure testing AI alongside some of our practices, meetings is one where we've done experiments around how do employees, Glean employees, respond to AI now being brought into our meetings in a way that is deeply psychological and exciting. So that's an exciting piece. I think the org chart transformation is top of mind for me and
1:37:01 Speaker 01 Bob Sutton, who I work very closely with. I would love to embed in a traditional, sometimes it's called extreme cases, where organizations will do something completely radical and observe on the ground how this is happening. I would love to go in a legacy organization that has decided they're going to fundamentally rewire the org chart and watch on the ground.
1:37:23 Nathan Labenz? I should also mention your book, The Best Meeting of Your Life, right? That's what it's called. Your Best Meeting Ever. Your Best Meeting Ever.
1:37:28 Speaker 01 Stuck.
1:37:29 Nathan Labenz? You just reminded me of it in that comment about how bots are being brought into meetings. What's new in meetings? What new, how would you update your advice as we see evolving cultural expectations, practices around meetings?
1:37:44 Speaker 01 Oh, gosh, this is a, this is an hour question. It's, I think, meetings.
1:37:51 Speaker 01 Are not unlike any other work practice in many ways. They're the most dysfunctional work practice. And but what we're seeing with every work practice is AI is helping in some places and AI is making things more dysfunctional. I'm incredibly excited about the potential of AI injected in meetings to help us have a better sense of the health of a meeting. And I'm seeing so many examples, working with organizations all across the world of people using AI in fundamentally different ways to understand whether the dynamics in the meeting are healthy, understand whether executives are dominating the airtime,
1:38:32 Speaker 01 automatically auto delete meetings from calendars when they fail to have a good meeting design and agenda or people accept. Even measuring collaboration, understanding are people in the right collaborative mode for creativity versus coordination. That is all. I could nerd out on that forever. Where I'm seeing a lot of dysfunction is cognitively offloading to AI and sending our digital twins to meetings instead of showing up ourselves. And we have, I don't know if these stats made it into the end report. They certainly, we have a UK piece where we see this on another level. And certainly there's some stats on the sheer amount of people who have sent digital twins to lead meetings on their behalf
1:39:17 Speaker 01 and the sheer volume of meetings that now have at least one note taker. That's where I become very nervous and frustrated because meetings are so expensive. They're one of these activities that the power and potential of them is that they are deeply human. If we think that we can send a note taker bot to a meeting instead of showing up ourselves, well, that is a symptom of we didn't need the meeting. And that is something that maybe AI can fix. Maybe if it has enough information, it can fix. But some of these things, ground zero fundamentals, having an understanding of what deserves to be a meeting in your organization is the first step. It's largely independent of AI in terms of fundamentally rethinking,
1:39:59 Speaker 01 having the right purpose for a meeting and ensuring that it truly does warrant that live synchronous time that is incredibly expensive. And the last point I'll say around this is we often, it's being referred to in the research right now as mental proof around the technology. The fact that We are watching how people use AI very carefully. And we're starting to be able to tell when people are bot shitting, not always, but when people are bot shitting versus not. And when you see someone appear, certainly a manager, but anyone bot shit, that triggers a sense of they don't value your time, right? The opposite is also true.
1:40:44 Speaker 01 If we see someone has invested enough time into designing a meeting, understanding how to use AI in a disciplined way, that's a reflection of the person. And I think that's what we're seeing in meetings as well. You send your digital no-taker bot to a meeting. It signals that you don't value other people's time in a way that that is a deeply human phenomenon. And I think that's another big piece of this whole picture inside and outside of meetings as well.
1:41:10 Nathan Labenz? Cool. Thank you. Time, again, the scariest resource. I appreciate how much you've been willing to share with me today. Rebecca Hinds, thank you for being part of the cognitive revolution.
1:41:20 Speaker 01 Thank you for having me.
1:41:35 Speaker 02 Woke up early, opened the tab. Fifty windows, half of them bad. Fed it context, watched it spin. Ran the whole thing back again. Six hours gone for noon. Making sure the bots knew what to do. Work looks finished, polished, clean. But I don't know what the hell it all means. I'm bot sitting, bot sitting. Babysitting the machine.
1:42:08 Speaker 02 I'm bot sitting, bot sitting. Best you've never seen.
1:42:15 Speaker 02 Honest nonsense. Hollow sheen.
1:42:22 Speaker 02 I'm bot sitting, where's my curiosity? Save thirteen hours, gauge six right back. Copy the context, cover my tracks. Everybody's fast and nobody moves. Hamster wheel on premium fuel. Boss asked where the hours went. Opened five more tabs, paid the toggle rent.
1:42:49 Speaker 02 Output's perfect, nobody knows whose mind it came from, which way it goes. I'm bot sitting, bot sitting, babysitting the machine.
1:43:01 Speaker 02 We're bot sitting, bot sitting, best you've never seen.
1:43:08 Speaker 02 All this nonsense, hollow sheen.
1:43:15 Speaker 02 We're bot sitting, where's my curiosity?
1:43:21 Speaker 02 I used to love the hard part. I used to love the mess. Now I'm the integration layer, a human work hardness. Sodom made my joy, then wonder why I'm tired. We used to come and burn into know. Now we just feed it and let it go. Six hours a week, nobody sees. Sewing seeds, nobody reads. But oh, the company we keep. We're bot sitting, bot sitting, babysitting the machine.
1:44:08 Speaker 02 We're bot sitting, bot sitting, best you've never seen.
1:44:14 Speaker 02 All this nonsense, hollow sheen.
1:44:21 Speaker 02 We're bot sitting, where's my curiosity?
1:44:28 Speaker 02 Bot sitting, bot sitting.
1:44:32 Speaker 02 Ooh, I'm babysitting the machine. Bot sitting.
1:44:46 Nathan Labenz? If you're finding value in the show, we'd appreciate it if you'd take a moment to share it with friends, post online, write a review on Apple Podcasts or Spotify, or just leave us a comment on YouTube. Of course, we always welcome your feedback, guest and topic suggestions, and sponsorship inquiries, either via our website, cognitiverevolution.ai, or by DMing me on your favorite social network. The Cognitive Revolution is part of the Turpentine Network, a network of podcasts, which is now part of A16Z, where experts talk technology, business, economics, geopolitics, culture, and more. We're produced by AI Podcasting. If you're looking for podcast production help for everything from the moment you stop recording to the moment your audience starts listening, check them out and see my endorsement at ai podcast dot
1:45:29 Nathan Labenz? ing. And thank you to everyone who listens for being part of the Cognitive Revolution.
Previous AI in the AM — Week 1 Highlights (June 2026) Next AI in the AM — Week 2 Highlights (June 2026) Page updated October 26, 2026 · transcript and summary are machine-generated
