AI Word Choice | When Dwarf Lemurs Hibernate, Their Chromosomes Do Something Odd

Certain words are overrepresented in text written by AI language models. A study investigates why such patterns develop. Also, the ends of chromosomes, called telomeres, typically shorten as an organism ages. But when some fat-tail dwarf lemurs hibernate, they lengthen.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  WNYC is supported by Bear. Science is about asking questions, testing, trying again. It's not easy, but it's relentless. It evolves, and that's why science delivers. Learn more at sciencedelivers.com.

• 0:14Flora Lichtman?

  Science Friday is supported by Dell. Gifts mean more when they have the power to unwrap more of who you are. This Black Friday, give a gift that goes beyond the box. The Dell XPS 13 laptop. It's the thinnest, lightest XPS laptop yet, with a long battery life, beautiful design, and powerful performance with Intel Core processors. The XPS laptop unlocks more of what you love. Plus, at dell.com, you'll find perks like Dell Rewards, fast free shipping, and flexible financing, and big savings on monitors and accessories. Head to dell.com/deals. That's dell.com/deals.

• 1:04Flora Lichtman?

  This is Science Friday. I'm Flora Lichtman. Today in the podcast, the annoying words large language models overuse, and what that means for how we talk.

• 1:14Speaker 02

  It's like someone pulled a switch, and here's delve, here's intricate.

• 1:22Flora Lichtman?

  You know how when you read something, you can sometimes get a picture of the person who wrote it? Like, if I start talking about touching base to synergize after we circle back, first of all, please call for an intervention. But second of all, you might reasonably suspect that someone from the e-suite got a hold of this script. Or if I talk about giving 110%, or winners don't quit, you might clock me as a sports person. Well, in recent years, people started noticing that AI chatbots, large language models, had their own linguistic tells. Certain words that seem to crop up a lot more often in AI sentences than in human English. Words like delve and realm. And it wasn't subtle.

• 2:07Flora Lichtman?

  It was a big, sudden shift in word usage. Joining me now to talk about that are two researchers who decided to delve into the realm of AI linguistics. Tom Yuzek is an assistant professor of computational linguistics in the Department of Modern Languages and Linguistics, and Xena Ward is an assistant professor in the Department of Philosophy, both at Florida State University in Tallahassee. Hello to you both. Welcome to Science Friday.

• 2:34Speaker 03

  Hi, thanks for having us.

• 2:35Speaker 02

  Yes, thanks for having us.

• 2:37Flora Lichtman?

  Tom, I have to know more about AI vernacular. What are some of the words that AI loves to overuse?

• 2:44Speaker 02

  Some of the words that we found, and it's quite a list, is the more obvious ones, like "delve," "garnered," "realm," and "evolving landscape."

• 2:58Flora Lichtman?

  "Evolving landscape" is one of them?

• 3:01Speaker 02

  I've seen that a lot, so I think that's a candidate. And the more subtle ones are something like "underscore," "emphasize," and "showcase it."

• 3:13Flora Lichtman?

  How did you figure this out?

• 3:15Speaker 02

  It started with a discussion on social media, that people noticed that certain words, especially "delve," really suddenly popped up everywhere, especially in scientific writing and education. And so people started to look into these more systematically. But then what interested us from the beginning was the "why is that happening?"

• 3:38Flora Lichtman?

  Why does this happen?

• 3:40Speaker 03

  So our hypothesis, which we investigated with a couple of different experiments, is that the models prefer these words because they were trained on human feedback, where the humans exhibited a preference for those words. So that's the thing we wanted to test, the idea we wanted to test. And in short, what we did is ran a couple of online studies where we asked participants to judge the quality of abstracts with and without those words. And we found, in the most recent run of the study, that participants do exhibit a very slight preference for abstracts with words like "showcase" and "underscore" and "comprehend." And so the models are trained to produce responses that human evaluators

• 4:25Speaker 03

  like, right? The models learn from human feedback in a certain stage of their training. And so if these human evaluators are exhibiting that preference, the models are going to pick up on that and reproduce those words more frequently. So that's what we think is happening.

• 4:39Flora Lichtman?

  That's so fascinating. I mean, to me, DELV and evolving landscape really feel like words I might hear in a Silicon Valley conference pod or whatever. Does, is that a coincidence? I mean, is that who's training these models?

• 4:54Speaker 03

  Well, we don't know for sure. Tech companies don't publish the details of their training procedures. But it seems likely that the workers in general are employees in the global south. The tech companies often outsource that kind of labor to countries where wages are lower. And so those workers are seeing potential outputs from the models and providing their feedback on which ones are higher quality. And then the models are being trained to reproduce those sorts of responses. So it's really probably the preferences of these employees in the global south that are filtering through and shaping the lexical choices of these large language models.

• 5:31Flora Lichtman?

  Yeah, that's fascinating. Tom, I mean, we've seen linguistic fads before. You know, I'm old enough to remember the meteoric rise of touch base. How is what you observed here different?

• 5:44Speaker 02

  Rather rapid language change. It's also nothing new. Touch base, looked up some millennium speak. Awesome, cool. What they exhibit, when you look at the data over the time, is that they have a period of several years of pretty steep rise, almost like an S curve. They start to rise, then they have this period of really quickly gaining traction, and then they plateau out. Sometimes we do see a sudden spike, which is when a real world event occurred that motivates that spike, concretely SARS or Omicron.

• 6:25Speaker 02

  Now, what is different, the now observed changes is that there is the sudden spike, almost like a step function with an abrupt breakthrough, but there's no real world motivation, why it should be DELV or intricate or nuanced. And that is different.

• 6:42Flora Lichtman?

  You mean, like, it's, it's, it almost feels random?

• 6:44Speaker 02

  Yeah, it's like someone pulled a switch and here's DELV, here's intricate.

• 6:49Flora Lichtman?

  I mean, that seems only possible using AI, right? Because humans maybe don't change as fast.

• 6:56Speaker 02

  Yes, and that is one of the areas where still a lot of research is directed to. The question Do these words really sit in our language systems now? I mean, is there delve in or intricate in the abstract of a scientific article or a student essay? Because people have this in their language system and this is what they put down? Or is it actually tool usage, AI usage? And so far, this is under, under research. I mean, it's a hypothesis one way or the other. And I think what we will be seeing sooner or later is where people look at spontaneous spoken language.

• 7:38Speaker 02

  And I think chances are they will find some traces of these AI words having entered the human language system.

• 7:44Flora Lichtman?

  Oh, I'm really interested in this. I mean, we talk a lot about us training AI. But is AI training us? I mean, is there evidence that these AIs are changing the way that we talk and we write and we think?

• 7:58Speaker 02

  Yeah, the state of the research is that this is an hypothesis. And the key here is to look at spoken language. Most research has focused on written language. And when it comes to spoken language, I think it's fair to say we do not see these abrupt changes that we've seen in written texts. But now there is first research coming out. There's an analysis of YouTube talks, which is still scripted spoken language, where there has been an uptick of these AI induced words. And there is research in the making, the student working on this, that when it comes to semi spontaneous spoken language, conversational language,

• 8:41Speaker 02

  there seems to be an uptick, but that seems to be more mixed.

• 8:45Flora Lichtman?

  I mean, that to me seems really profound.

• 8:48Speaker 03

  Absolutely. I mean, and it's interesting too, that to the extent that these models are changing our language and to the extent that their preferences about words are shaped by these workers in the global south that we've talked about. It's a really interesting inversion of the usual way that linguistic change happens. So linguists and historians of language have studied over time how changes in language in the Western industrialized World trickle outward, especially in this sort of globalized culture and economy to everywhere, to to other English speaking parts of the world, if we're looking at English in particular. And what's interesting about these linguistic changes is that if our language really is being shaped by L L M's

• 9:30Speaker 03

  and L L M's language is in turn being shaped by employees of tech companies in the global south, there's a kind of reversal of the usual direction of influence.

• 9:41Speaker 02

  And I might come in on this, there are two sides to this. One is today's produced data will become tomorrow's training data for these models. So there's a chance that we will see a loop and all this accelerating. And then the other side, there is what one could call the creep in factor. We observe A I influences human language to quite some degree. But it might well be that when we reflect on it, we might come to the conclusion, this is not something we actually want. And so some of that language that now enters our system does so beyond the level of perception.

• 10:26Speaker 02

  And and items like underscore multifaceted or necessitate, they're less discussed. But of course, that links to the discourse of a more concerning version of this creep in factor, which is, say, undesired political, right, that then gradually seep into our belief system. And I think this is why the research to try and identify where this model behavior comes from matters to a good degree.

• 10:54Flora Lichtman?

  Can these words be used as a diagnostic, like as a way to tell that something was written by A I?

• 11:00Speaker 03

  Not with high confidence. As you probably know, A I detection is a is a really, it's a cat and mouse game and it's really quite difficult. So we're, I think, a little bit pessimistic about the potential to to use this for for diagnostics. But it it it certainly raises eyebrows, I think, for us when we see these words. It raises questions, even if it doesn't provide a conclusive answer.

• 11:24Flora Lichtman?

  Xena, you're a philosopher. Why does this interest you?

• 11:27Speaker 03

  I'm a philosopher of science, and so these models just fascinate me. I mean, I think, like many people, I'm amazed by how well they work. And it's all the more amazing, given that we don't really understand why they work as well as they do. And so it's also a kind of intellectual challenge, trying to figure out how they work, because it's not like you can just pop the hood and look at the word choice module, right? They're really complex systems. So you have to be quite creative in how you probe them to try to figure out what they're doing. So, yeah, for me, that's why it's of interest. It's a complex system that really requires some ingenuity to understand.

• 12:04Flora Lichtman?

  And Tom, what about you?

• 12:06Speaker 02

  From a linguistic perspective, I mean, what we're seeing right now is almost unprecedented language change. I mean, the shifts in word usage that we're observing over such a short period of time, that's really remarkable. I say almost because we've seen in history, I mean, we've seen in technology influencing language. I'm thinking like the printing press, the internet, social media. But what we're observing right now is quite something. We could be entering a period of rapid language change. So what we're seeing is not just a year or two, a few dozen words, but really this continues for an extended period of time.

• 12:51Speaker 02

  This is one possibility. The other possibility is that now we had two, three years of rapid language change, and it will kind of fade out. And we don't know yet what is going to happen. We'll find out. But there is a chance that we will see considerable language change over an extended period of time.

• 13:09Flora Lichtman?

  I want to thank you both for joining me today to talk about this.

• 13:12Speaker 03

  Thanks for having us.

• 13:14Speaker 02

  Thank you so much.

• 13:15Flora Lichtman?

  Tom Yuzek is an assistant professor of computational linguistics in the Department of Modern Languages and Linguistics, and Xena Ward is an assistant professor in the Department of Philosophy, both at Florida State University in Tallahassee.

• 13:30Flora Lichtman?

  Don't go away after the break. Lemurs and the weird anti-aging things that happen inside their cells when they hibernate.

• 13:38Speaker 04

  Yeah, I don't think we've hacked the fountain of youth yet, but I do think that this provides some sort of tantalizing clues about how longevity can be maximized.

• 13:52Speaker 00

  Science Friday is supported by PBS, presenting Going Wild. If you love learning about the natural world and meeting the scientists who help us understand it, be sure to check out the new season of Going Wild with Dr. Ray Wynn Grant. It's the chart-topping and Webby Award-winning podcast from the folks at Nature on PBS, now with a video companion series. In this season of Going Wild, host acclaimed wildlife ecologist Dr. Ray Wynn Grant heads out into the field to explore the animals, people, and stories that make nature worth saving. Stops include a hibernating black bear den in Arkansas and an underwater shipwreck site off the Florida coast. If you're looking for a place to start, check out the season's debut episode, where Ray joins beloved biologist and influencer Jordan King in the Florida Everglades to learn about

• 14:36Speaker 00

  his unlikely journey into science and how to study a wetland when it's not very, well, wet. So don't miss out. Follow Going Wild with Dr. Ray Wynn Grant on Apple Podcasts, Spotify, YouTube, or wherever you get your podcasts. WNYC is supported by Bayer. Every day in America, science delivers, not just in the headlines, but in the moments that matter most. Science is a journey, one of curiosity, persistence, and progress. It's about asking questions, testing, learning, and improving again and again. Science delivers harvests that feed families, tools that help farmers grow more with less, and new ways to protect land for generations to come.

• 15:17Speaker 00

  Let's keep asking, keep testing, keep discovering, so science can keep delivering. Learn more at sciencedelivers.com.

• 15:25Flora Lichtman?

  Support for Science Friday comes from the William K. Bose Jr. Foundation. Up next, new research into lemurs, those fluffy, big-eyed primates from Madagascar. Specifically, we're talking about the fat-tailed dwarf lemur, one of the few primates to hibernate. Limerologists were curious about what's going on inside their cells during hibernation, and they found something really surprising. It turns out that these lemurs' telomeres, those are the ends of their chromosomes, grow longer when they hibernate. Typically, telomeres shorten as we age, as our cells continue to divide. So why do their telomeres lengthen? What does it mean for how they age?

• 16:09Flora Lichtman?

  Have these lemurs tapped into some longevity hack? Here to take us into the lemur burrow are co-authors on this study, who also happen to be married to each other. It's Dr. Marina Blanco and Dr. Lydia Green, research scientists at Duke University in Durham, North Carolina. Welcome to Science Friday.

• 16:25Speaker 04

  Thanks very much for having us.

• 16:27Speaker 05

  Thank you.

• 16:28Flora Lichtman?

  Lydia, give me the 411 on this lemur species. What do they look like? Where do they live? What's their deal?

• 16:33Speaker 04

  So imagine a fluffy, fat-tailed squirrel with forward-facing eyes and human-like hands that could grasp onto tree branches and lots of fruit. And then imagine them in the western forests of Madagascar that are dry, deciduous forests, maybe hanging out in a baobab, and facing food scarcity during the dry season. And so they decide to curl up inside a tree hole and live off the junk in their trunk, the fat in their tail that's been stored up in the preceding season, and basically curl up and just pass winter by not eating, not foraging, not moving, and saving a lot of energy by living off the fat in their tail.

• 17:08Flora Lichtman?

  The junk in their trunk? That's where they store all their fat?

• 17:12Speaker 04

  Yes.

• 17:12Flora Lichtman?

  In their tail?

• 17:13Speaker 04

  As do I.

• 17:14Flora Lichtman?

  Is that unusual, though? Like, is that why it's in their name? I just want to go one level deeper on the tail, I think.

• 17:21Speaker 04

  Yeah, I think I would say that there is a good reason to store your fat in your tail, because it's a pretty safe place to put it. If you were to put your fat around your organs or in other places in your body cavity, that might be more dangerous. We know that those fats are not great for humans either. And so putting it in your tail just is a safe place to keep it out of harm's way, and you can use it when you need it. And so they can hibernate for four to seven months a year without eating, and also without drinking, and without even leaving their tree hole. So they'll spend up to seven months just living off that fat.

• 17:53Flora Lichtman?

  Marina, tell me about what you found in this recent study. What was the biggest takeaway?

• 17:58Speaker 05

  So we knew that telomere elongation was possible in some animals, particularly in hibernators, because a few studies had been About ten years ago, where small temperate hibernators would elongate their telomeres after the hibernation season, when they had access to rich fruits. And so we knew that hibernators may have a mechanism to elongate telomeres. And we also knew at the time that hibernators tend to live longer lives than similarly sized animals. So we wanted to test if telomere elongation was also possible in dwarf lemurs, which are tropical hibernators.

• 18:41Speaker 05

  After we were able to sort of facilitate hibernation in dwarf lemurs at the center, we separated into groups. And so we had the dwarf lemurs that were housed in rooms with cold temperature during hibernation and no food at all, so they could live off their fats. And then we had a group of dwarf lemurs that were also housed in cold rooms, but they were given a daily ration of food. And so the expectation was that the dwarf lemurs in the cold rooms that had access to food probably could be able to elongate their telomeres because they had, in addition to the fats, store they have extra food. And so if they needed to protect themselves and their bodies during hibernation,

• 19:26Speaker 05

  that they could be able to elongate their telomeres. But what we found is that it was actually the dwarf lemurs in the cold rooms with no food, the ones that elongated their telomeres at the end of the hibernation season. And so we were a little surprised by that and sort of concluded that it was the lemurs that were at higher risk or maybe more vulnerable at the end of the hibernation season that needed to elongate telomeres to protect themselves.

• 19:52Flora Lichtman?

  What does hibernation look like for them?

• 19:55Speaker 05

  So during the hibernation season, these animals do depress their metabolism. They go into these long torpor bouts. But these torpor bouts are interrupted by arousals. And arousal are these short periods where lemurs basically heat up and go from zero to a hundred metabolically. And they stay in this arousal time for about 24 hours. During this time, you know, heart rates go up, breathing rates go up, they actually sleep. And then after the arousal, they return, they go back down into a torpor bout.

• 20:32Flora Lichtman?

  What does a torpor bout look like? Like, what does that mean?

• 20:35Speaker 05

  So, basically, your systems are shut down to a minimum, to a sort of a suspended animation state. So, during the torpor bout, your brain basically is flatlining in an EEG. Your heart rates go down to maybe six or eight beats per minute, instead of, you know, 300 when you're active. You don't breathe for several minutes, eight to 10 minutes.

• 21:01Flora Lichtman?

  Wow. You don't breathe for several minutes?

• 21:04Speaker 05

  No, they have apnea, so they don't breathe. Everything is really shut down. They're called to detach, so it's minimum survival mode. But, you know, you can stay like this for maybe seven to 10 days, and after that torpor bout, arouses come. So, there is something inherently important about arousing from a torpor bout to sort of reset your systems. And it is during those arouses where their bodies really are at a vulnerable stage, because imagine these metabolic surges that have to happen in very few hours. And I think that's when we start looking at, you know, potential mechanisms of protection that these animals have to protect themselves from these arouses that could be dangerous.

• 21:50Flora Lichtman?

  And that's why you think the telomeres are lengthening, is that when they arouse, like, there could be a lot of damage to cells, and so you would want some protection, extra protection? Is that the idea?

• 22:01Speaker 04

  Yeah, and I was gonna add more context. At some point, you need to re-warm up again, to go through these arouses, to sort of maintain physiological health. And so, during these arouses, they're essentially burning their fats to warm up. And there's a lot of, like, potential damage that can happen to the cells as a result of that intense fat burn. And so, there might be a reason why an animal, sort of at the end of the hibernation season, when they're burning through the ends of their fat, may put a last surge to lengthen their telomeres as a way to protect the integrity of the cell at the very end of the season.

• 22:32Flora Lichtman?

  I mean, Lydia, we know that telomere shortening is associated with aging. Did these lemurs live longer?

• 22:39Speaker 04

  Yes, so there's a fascinating correlation between hibernation and longevity, and that mammals that hibernate tend to live longer lives than do similarly sized counterparts that don't hibernate. So in the counterpart to the dwarf lemurs would be the bush babies that are about the same size primates, but they have much shorter lifespans, what, Marina, like 12 to 13 years? Whereas dwarf lemurs can live to almost 30. And so we've known for a long time that there's this interaction between longevity and hibernation, but the mechanisms are not well understood, particularly in these dwarf lemurs. And so what we found in these animals is you might expect that the stress of hibernation would shorten telomeres much faster than it would in a non-hibernator. But what we seem to find is that these animals have some ability to lengthen their telomeres

• 23:24Speaker 04

  to protect themselves. And maybe that is what helps them live longer lives, despite the fact that they're going through these stressful periods.

• 23:32Flora Lichtman?

  Well, that's what I was going to ask. I mean, does this mechanism or understanding this mechanism tell us anything about longevity? Or, of course, people are very interested in this.

• 23:42Speaker 04

  Yeah, I don't think we've hacked the fountain of youth yet. But I do think that this provides some tantalizing clues about how longevity can be maximized. But I think the question for us is still always going back to this mechanism of how our telomeres lengthening. And, you know, we talk a lot about this lengthening in this project, but also two weeks after they came out of hibernation, their telomeres had shortened again. So maybe that stress of those first two weeks of being aroused and of trying to find a mate, because that's the reproductive season. So it's not that their telomeres lengthened and stayed long. They actually ultimately shortened again. And they started off the hibernation season of year two with the same length that they started off the hibernation season of year one. So it's not like they're indefinitely lengthening their telomeres.

• 24:27Speaker 04

  But I do think that if we continue this work, and if colleagues and peers and collaborators continue this work, there's a lot we can learn about the mechanisms underlying telomere dynamics that could downstream be applied to people.

• 24:38Flora Lichtman?

  Yeah, I'm interested in this. I mean, I know bats can be a kind of poster child of longevity. And I know that in some species, researchers have found their telomeres lengthening during hibernation. Like, do we need to get all the people who study animal superagers together to work on this mystery?

• 24:58Speaker 04

  Yeah, and I think we can throw in there people that do deep diving in the bottom of the ocean and people that are traveling to outer space, because there's also been some interesting findings that maybe they are able to lengthen their telomeres under sort of the extreme physiological stress of humans at the maximum of their physiological potential.

• 25:15Flora Lichtman?

  Hmm, that's really fascinating. What have we missed about this study?

• 25:20Speaker 04

  These are critically endangered primates from Madagascar, and so we're not going to be doing the invasive work to really challenge their cells in ways that would allow us to understand the mechanisms. But we can potentially grow cell lines from these animals and expose the cells in a Petri dish to the sort of challenge that the animal would experience. And so we can answer some of these questions without doing any invasive work on the animals themselves. But I also think that there's real value in us looking to Madagascar and looking to wild populations of dwarf lemurs to try to understand the variety of conditions and environmental heterogeneity and environmental challenge that they're experiencing in the wild, and to start modeling some of these telomere dynamics, just from the same cheek swabs we used, applied to these captive animals, to understand what are the dynamics

• 26:03Speaker 04

  going on in the wild for animals hibernating under cold conditions, for animals hibernating under warm conditions, for animals hibernating at the beginning of their lives or hibernating at the end of their lives. And I think there's all sorts of questions we can also ask in the wild. So I think this dual approach of sort of the natural ecology, natural history perspective in Madagascar, coupled with really high-quality, rigorous lab work that doesn't have the animal involved in it, is really, I think, the duality of the approach that we see.

• 26:26Flora Lichtman?

  Okay, well, when you head to Madagascar for your fieldwork, please phone us in. And thank you both for joining me today.

• 26:32Speaker 04

  Thank you so much for having us.

• 26:35Flora Lichtman?

  Dr. Marina Blanco and Dr. Lydia Green, research scientists at Duke University in Durham, North Carolina.

• 26:44Flora Lichtman?

  And that is about all we have time for. Lots of folks helped to make this show happen, including

• 26:50Speaker 06

  Jordan Smudgick.

• 26:51Speaker 04

  Rasha Ureidi.

• 26:52Speaker 07

  Charles Bergquist.

• 26:54Speaker 06

  Shishana Buxbaum.

• 26:55Flora Lichtman?

  I'm Flora Lichtman. Thanks for listening.