Kobuk the Destroyer

Every product has to be tested somehow, and sometimes that means finding increasingly creative ways to break it.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Roman Mars?

  This fall, LL Bean is celebrating the moments people look forward to all year. The first school drop off, the first sweater weather day, and the first chilly evening around the fire pit. For over 100 years, LL Bean has been part of these traditions. Crunching leaves in Maine-made Bean boots, cheering from the sidelines in Scotch plaid flannel, and walking the dog in a rugged field coat. So grab the layers and people you love and get outside. Visit llbean.com to shop the fall collection. LL Bean, be an outsider.

• 0:36Roman Mars?

  If you're a small business, the right hire can be make or break. Indeed sponsored jobs gets you quality candidates when you need them most. Join the 3.3 million employers worldwide that use Indeed to connect with quality talent that fits their needs. Listeners of this show will get a $75 sponsored job credit to help get your job the premium status it deserves at indeed.com/podcast. That's indeed.com/podcast. Terms and conditions apply. Hiring now, then this is a job for Indeed sponsored jobs. 99% Invisible is presented by Acura. Curating and designing the perfect experience takes meticulous craft, an obsession with detail, and a love for innovation. Just like museum

• 1:21Roman Mars?

  designers, Acura carefully considers every detail to curate the most engaging, exhilarating, and rewarding experience for drivers. That craft isn't always something you can see, but it's something you'll feel. That flutter in your heart, the engine roars. Every Acura is designed with deliberate intention around how people actually use the vehicles. And that is precision crafted performance. This is 99% Invisible. I'm Roman Mars. I live in Northern California, and when it comes to camping in the backcountry up here, bears are always something you plan for. The best way to avoid bears is to not attract them in the first place. And that means putting your food and any fragrant

• 2:06Roman Mars?

  items into a bear canister. But how do we know that bear canisters actually work? For decades, product testers would assess the bear resistance of a canister by dropping a weight on it from a set height, or by trying to puncture it with a spike that simulated a bear's tooth. But they kept running up against a problem. These tests weren't close enough to reality. They weren't accounting for a bear's creativity and resourcefulness. So then, in the early 2000s, they hit upon an idea of testing the canisters by using something slightly more realistic: bears.

• 2:44Speaker 01

  A manufacturer would say, "I have this new design for a bear resistant canister that I want campers to use." They bring it to this bear sanctuary, they fill it up with bear treats, like fish and honey and all sorts of goodies, and they just throw it to a grizzly bear.

• 3:04Roman Mars?

  This is journalist Alex Davies. He says that these bears will bite, chew, claw, and jump up and down on these products. If a product gets through one hour of contact with a bear and isn't opened, it gets certified as bear resistant. Some bears are more successful than others. And the most famous of these bears, his name is Kobuk.

• 3:26Speaker 01

  Kobuk became Kobuk the Destroyer because he was the best.

• 3:31Roman Mars?

  As a cub, Kobuk was dubbed a problem bear for getting into human food. He was removed from the Alaska wilderness and brought to a sanctuary where he and his fellow problem bears were put to work.

• 3:42Speaker 01

  And there, instead of becoming problem bears, they became problem solving bears. Because the work of the bear sanctuary wasn't just to keep bears safe, it was actually to have those bears test out supposedly bear resistant products.

• 4:01Roman Mars?

  Kobuk, above all other bears, became known for his ability to break into almost anything. If your product survived Kobuk, it might even get written up in a local paper.

• 4:12Speaker 01

  Kobuk was more a destroyer of ego and of product design than anything. He was just really good at it.

• 4:20Roman Mars?

  Alex Davies is the author of the new book Kobuk the Destroyer: And Other Tales From the Wild and Unseen World of Test Engineering. His book takes us through the long history of how things are tested, and all the behind the scenes work that goes into making sure things work.

• 4:36Speaker 01

  And I constantly felt like an emotional pendulum, where one day I'd feel like, everything is crap. Nothing is tested properly. They're all cutting corners, they're just trying to make a profit. And then the next day, I'd read a different example, and go, "Oh my God, these engineers are heroes. The work they put into figuring out to make this thing safe for my kid is incredible." And I, obviously, like all things, the truth is probably somewhere in the middle. But I do think that, for the most part, you can come away with a sense of awe, that there is all of this work that goes into not making something, but making it work.

• 5:21Roman Mars?

  I think when people, certainly when I picture product testing, I don't picture a bear. I picture like a man in a white lab coat, maybe with eye protection on, and he's dropping a bowling ball on a hard hat to see if it endures such treatment. In your book, I think you roughly classify this kind of testing as limit testing. Could you describe limit testing and its origins?

• 5:43Speaker 01

  Limit testing is probably the most basic kind of testing. You're examining a product usually for its strength and for its durability. So it's everything from how far can you bend the wings of a 777 Boeing airplane before they snap, to how many times can you hit the spacebar on your computer before it breaks?

• 6:10Speaker 01

  The understanding of a product's limits has been around as long as people have been building stuff. Everyone knew that if you're building a new bridge, it has to be really strong. But the actual work of limit testing, of trying to figure out in a scientific way with a rigorous method of evaluation, I trace that back to the foundation of the underwriters' laboratories, which came about in the very beginning of the 20th century. And that was

• 6:47Speaker 01

  started by a guy named W. H. Merrill. And he had this idea of, people are terrified of electricity because it sets a lot of stuff on fire. This was an age when entire cities were still burning down on a fairly regular basis. And also, at the same time, a lot of electrical appliances were coming into the home. Before, you had an electric iron. An iron was a chunk of iron that you got really hot and you pressed it on your clothes. That's why it's called an iron. And now, all of a sudden, electricity was coming into

• 7:30Speaker 01

  the home, and Merrill saw this business opportunity to say like, "Hey, what if I actually tested these things to make sure they're not liable to set your entire home or your entire city on fire?" And he created a whole business out of this. Underwriters Labs has always been about testing a product against a manufacturer's claims. And so, within 15 years or so, they were testing millions of products a year. And the products that passed got the Underwriters' Labs seal of approval physically stamped onto them. And that became a real mark of consumer trust at a time when electricity coming into the home, all new kinds of products

• 8:11Speaker 01

  coming into the home, created a new kind of risk. And test engineering rose to meet the challenge of that risk.

• 8:20Roman Mars?

  Yeah. And this, you know, this mark of Underwriters Laboratory, that, you know, it really mattered to consumers and to retailers.

• 8:28Speaker 01

  It became a huge deal. There were entire cities, I think Los Angeles was one of them, and store chains like JCPenney, which existed at the time, that said, "You can't buy an electric appliance if it's not UL approved. It has to have that stamp on there."

• 8:45Roman Mars?

  I mean, to do this type of testing, you need a lot of standardization, right? How did Underwriters Labs go about making sure everything was tested in a way that was considered fair and trustworthy?

• 8:58Speaker 01

  They kept incredibly detailed written, handwritten reports at the time of just exactly what it did. When they were testing safes, for example, which the big thing with safes at the time was, one, so that they could keep burglars out. But they were also really important for resisting fire. Because if your building caught fire and all of your business papers were in your safe, it was hugely important that your, all of your business records didn't burn up. So a lot of the testing they did on safes was fire resistance. It wasn't just, "We're going to heat this thing to 1500 degrees Fahrenheit and see what happens." They had a very specific heat over time gradient, and it was this chart. And it said, "After three minutes, it should be 90 degrees. After four and a

• 9:43Speaker 01

  half minutes, it should be 115 degrees." And that's how meticulous they were in their testing.

• 9:50Roman Mars?

  Yeah, it brings up this interesting dilemma. I mean, I just wonder how manufacturers and testers decide how safe is safe enough? Like, how reliable is reliable enough? How does this line get determined for each product?

• 10:04Speaker 01

  If you look at different products, it's always a sliding scale. An airplane has to be more reliable than your laptop's keyboard, right? A medicine bottle that could get in the reach of a two-year-old has to be more child resistant than a jar of jelly. And it's always this kind of negotiation between things, asking, "What's the product? What's the user? What's the cost?" And what's the risk?

• 10:34Roman Mars?

  Right, right. The designing of these tests is, you know, they can get pretty ingenious. And there's ways in which you're trying to sort of balance this idea of repeatability versus real world uses. I wanted to talk about the bird ingestion test in this regard, when it comes to aviation testing. Could you describe what is going on there and what they're testing for?

• 10:58Speaker 01

  Sure. So if you remember the miracle on the Hudson story, where Captain Sully had a bunch of geese take out both engines of his planes, and he miraculously, although real pilots will say, "Well, he just did what..." Anyway, that's going down a rabbit hole.

• 11:16Speaker 01

  Captain Sully had a bunch of geese take out both engines on his plane, and he very impressively safely landed on the Hudson. And that's a bird strike. Bird strikes are super common in aviation. The first bird strike was recorded by the Wright brothers. And you know, a seagull got tangled in the cables of their plane. And so what we do about it is that we test jet engines against bird ingestion, which is a very sanitized version of, we have a cannon and we shoot euthanized chickens into a running jet engine. And there are very specific rules around this.

• 11:58Speaker 01

  There are different versions of this test for different jet engines, and it's all very carefully calibrated. But basically, the idea is, how do you know whether or not a jet engine can either keep running or shut down safely, i.e. not catch on fire or explode? If a bird flies into it, the best way to do that is to turn it on and have a cannon that shoots chickens in. And it shoots them in at around 200 miles an hour, because that's roughly the speed of a jet at takeoff. Because takeoff and landing are the most common times for bird strikes, because the rest of the time, they, planes fly higher than birds do.

• 12:38Roman Mars?

  So for a test like this, how do they strike this balance between making sure that the test is conducted similarly enough that it's repeatable, but also that it replicates real-world conditions as closely as possible?

• 12:52Speaker 01

  Yeah, you want a test to be, to recreate as similarly as possible the real-world conditions that the plane will face, right? Bird, jet engine, cannon. The cannon is there to recreate the speed of the plane. The bird is there to recreate the real-life bird who's going to go into it. But you also want your test to be very standardized and very repeatable. So that, say, you're making a new jet engine, and you had this iteration, and it did okay, but you've tweaked this thing, and you're going to test this new version of it. You want to know that the test results you're getting are exactly the same.

• 13:33Speaker 01

  The reason we use chickens for this test is because they're highly available. They're pretty similar, and they almost exactly meet the FAA's requirement that you test the jet engine against a four-pound bird. But the thing is that chickens don't fly. Chickens don't end up in jet engines.

• 13:58Roman Mars?

  That's true.

• 13:59Speaker 01

  And the FAA at one point did like a 20-year study of all the different animals that have been hit by planes in various ways. And there are more plane-on-bearded seal encounters than plane-on-chicken encounters. That's one seal and zero chickens. But again, like chickens fit the test, chickens are easily available. And basically, this is something where we shrug our shoulders a little bit and go, well, this is pretty safe. And so you have the repeatability or the workability of the test, and the similarity to real-world conditions are always in tension.

• 14:42Speaker 01

  And just like picking a standard, it's this thing where you have to go, well, this makes it a little more doable, even if it takes away from the real world just a little bit. And it's finding that balance.

• 14:53Roman Mars?

  So another element of test engineering is something that you call foolproofing, which is essentially making sure that a product not only stands up to what it's supposed to do, but also if someone were to use it wrong, it would still be somewhat safe. So how do you go about trying to foolproof a product?

• 15:11Speaker 01

  So the first thing you have to do to foolproof a product is think really carefully about the user. And this is a thing that, I don't want to disparage engineers, but what I'll say is, I'll base this on a real fact, is that I talked to a guy named Ken Dontrimal, who teaches product safety engineering. And he tells me his students don't naturally think about this stuff. Engineers are often geared toward making a product that works, not making a product that works for a person. So to actually foolproof something as an engineer,

• 15:50Speaker 01

  you have to think about, what is someone going to do with this thing? Despite the fact that I tell them not to? Despite the fact that it's nowhere in the instructions? Despite the fact that it's an obviously stupid thing to do? So for example, you make a screwdriver. A screwdriver is made to turn screws. People also use them to open paint cans. Everyone who's opened a paint can has probably used a screwdriver to do it, because that's how you open a paint can.

• 16:20Roman Mars?

  It is the tool for the job, yes.

• 16:22Speaker 01

  It is the tool for the job. So it has to be made so that even when you're levering something that might be tough, it doesn't shatter and throw plastic or metal shards into your eyes.

• 16:32Roman Mars?

  Right.

• 16:33Speaker 01

  A screwdriver has to be made to open paint cans effectively. But you can imagine someone sticking it in their ear to clean out earwax.

• 16:44Roman Mars?

  Sure.

• 16:45Speaker 01

  And puncturing their eardrum. But you don't have to make it so that it won't puncture your eardrum, because even though you could foresee that as a reasonable person, there's no real pattern of people doing that, because people are at least that intelligent. And so it's always, foolproofing is, again, finding the balance between what makes something safe and what makes something usable. Like, I go camping a lot. I hate our bear canister, because I find it almost impossible to open. I get hurt, it drives me crazy. And I say, but at least I can get it open, and I'm pretty confident that a bear here in the Sierra Nevada Mountains can't open this.

• 17:30Speaker 01

  So, okay, that's a fine trade-off.

• 17:33Roman Mars?

  It's interesting when it comes to foolproofing, when you really can't design the hazard out of the product. Or maybe like you can, but it means that the product becomes like very difficult and annoying to use, or becomes very expensive?

• 17:46Speaker 01

  Yeah, so one great example of that is SawStop, which is a table saw safety device created by a guy named Steve Gass, who was an amateur woodworker and by day, a patent attorney, which, if you go really deep into the story, becomes quite relevant. But he was using his table saw, and he had the very correct thought, I'll probably eventually hurt myself using this thing. And is there a way to make a table saw safe? Because there are these things you can get that are kind of guards over them that maybe stop your fingers putting in, but they also make the saw somewhat less usable.

• 18:30Speaker 01

  And there's a very clear pattern of people pulling them off and throwing them away. I don't need, this thing just gets in my way. He created a thing called SawStop, where he ran an electric circuit through the blade with a microprocessor. And he put what looks like essentially an aluminum brake below the blade. And the idea is, if your finger touches it, touches the blade, you will complete that electric circuit, because we conduct electricity. And the moment that circuit is completed, it's very much like putting a stick in the spokes of your bicycle. It just stops the thing from running.

• 19:15Speaker 01

  And the result is that he created a way to stop a table saw in a fraction of a second before you could even actually do damage to your finger. You might come away, you might need a Band-Aid. But you won't need stitches, and you won't need someone to sew your finger back onto your hand. It was an incredible invention, and the Consumer Product Safety Commission lauded him, said, this is amazing. This should be attached to every table saw ever made. The problem is, it was expensive. It added hundreds of dollars of cost

• 19:56Speaker 01

  to the price of a table saw, which otherwise is a pretty affordable product. And all of the table saw manufacturers go, we don't want to do that. One, because this guy owns the patent, and we'll have to pay him money for every table saw. But two, the real big reason is that it's going to make it too expensive for our consumers, and they won't want to buy these things.

• 20:20Roman Mars?

  I mean, you can still go out and buy one of those things, right?

• 20:22Speaker 01

  Yes. Yeah, what Steve Gass ended up doing was saying, fine, I'll just sell a line of table saws called SawStop that have this thing built into them.

• 20:31Roman Mars?

  Yeah, yeah.

• 20:32Speaker 01

  And they're more expensive, they're safe. And actually, some of his best clients are the schools that still have shop classes.

• 20:42Roman Mars?

  Totally.

• 20:43Speaker 01

  Which is, again, that risk calculus of, if you're just one person, you're going, do I really want to pay a couple hundred extra bucks? Can't I just be careful? Versus a school that's like, these are teenagers. And we don't want to get sued by their parents, so they're going to pay the extra money. So it's, again, it's that sliding scale. And what I love is, I talked about this with the product safety engineer, Ken Dontrimal. And he goes, would I buy one? Nah, it's too expensive.

• 21:19Roman Mars?

  You know, we're basically so far talking about products, you know, being used as intended functioning, but there's a whole class of testing has to do with the fact that products fail, cars crash, planes fall out of the sky. You term this disintegration testing. Can you describe what that is and how they test for it?

• 21:45Speaker 01

  Disintegration testing is based on the acceptance of the fact that things fail. Planes do crash occasionally, dams burst, and it's all designed with the idea of how can I make something fail safely? And car crash testing is actually one of the most important places for this. So, disintegration testing for cars started with a guy named Hugh De Haven. He wanted to fight as a pilot in the First World War. He had bad hearing or something, so he got rejected by the US. He ended up flying with the Canadian Royal Air Force.

• 22:25Speaker 01

  And during training, his plane collided with another plane in midair. There were four people between these two planes, and he was the only one who survived. I mean, he very nearly died. He burst organs, he broke his legs. The doctors just assumed he would die, so they didn't bother to set his legs that were broken. But he lived. And he spent a lot of time in his convalescence just wondering, well, why did I survive? What happened in my plane that didn't happen in other planes? And he started researching this after he got out of the hospital. He just started thinking about it. And he would do things like drop eggs onto foam mats to see what broke them.

• 23:10Speaker 01

  And he studied suicidal jumps by people who had survived. And he'd look at the conditions of the people who jumped from a certain height that should have killed them and why they didn't, why they survived effectively. And so, he came up with this term that he called the second collision within a car or an airplane. And he said, specifically within vehicles, it's not the first collision. It's not the plane hitting the ground or the car hitting the other car that hurts the occupant. It's the occupant hitting the inside of the vehicle.

• 23:49Roman Mars?

  Right.

• 23:50Speaker 01

  As they're propelled forward by Newtonian physics. And he said, that's what we actually need to pay attention to. And looking at things like the eggs that didn't break when he dropped them onto certain materials, and the people who jumped from great heights but survived because they landed on a freshly tilled lawn, or they hit a wooden structure before hitting the ground that kind of slowed their fall. He said, basically, we need to cushion these people and we need to restrain them. And that's where we get ultimately airbags and seat belts, which are the things that made cars less incredibly dangerous. But he also said, well, if you think about car design in the 1950s,

• 24:31Speaker 01

  when his work was really taking off, he said, how about fewer metal spikes?

• 24:39Roman Mars?

  Fair enough.

• 24:39Speaker 01

  Inside the car? And how about even before the age of airbags? How about a steering wheel that'll compress when you hit it rather than impale you?

• 24:50Roman Mars?

  Yeah.

• 24:51Speaker 01

  Which was actually pretty common and very gruesome. And, but it took this whole different way of thinking because really up until his work and for years and years after it, until the federal government managed to bludgeon car companies into obeisance, car companies were saying, it's the driver. All we need is driver education. We just need to educate drivers about how to be better drivers. And it's those nuts behind the wheel who cause car accidents. It's basically the I told you so argument.

• 25:26Roman Mars?

  Yeah, yeah, yeah.

• 25:27Speaker 01

  And it comes up a lot in foolproofing, too. I found a quote from an Underwriters Labs engineer who said, "Why should I bother to design a toaster that doesn't get hot when the same result can be achieved by not touching it?"

• 25:42Speaker 01

  And it's like, because it's not, people are gonna touch hot toasters and not because they're idiots or because they're trying to hurt themselves, because it's a moment of inattention, because you're holding your baby in one arm and you're trying to move something like, things happen, failure happens.

• 26:01Roman Mars?

  Yeah, yeah.

• 26:01Speaker 01

  And you have to design against it.

• 26:04Roman Mars?

  You know, we talk about infrastructure a lot on this show, and I was really interested in the aspect of test engineering when it comes to making things safe to fail. Like, it's one thing to be testing a product where you're producing millions of copies of the thing. You can, you know, keep testing it and taking it through iterations where it gets better over time. But when it comes to infrastructure, I mean, you get one chance to build a bridge or a dam. Like, how do you design an infrastructure with failure in mind?

• 26:33Speaker 01

  The baseline, commonplace way to design infrastructure is to look at the conditions, which are usually historic climate conditions. Let's say we're talking about a dam. You say, okay, wind speeds hit this, you know, storms hit this level, temperatures hit this. So, we'll build a big thing out of concrete that's strong enough to exceed all of those conditions. Even if we know winds hit 100 miles an hour in this canyon, we'll design it to 150 miles an hour and make sure it's safe.

• 27:04Roman Mars?

  Right.

• 27:04Speaker 01

  The problem is that with climate change especially, historic, this idea of what's called a design storm, which is the storm you have in mind when you're designing a piece of infrastructure. The design storm isn't a very helpful gauge anymore because weather's getting so much wilder. Saying, you know, more wildfires, more intense hurricanes, faster winds, et cetera. And so, there's a school of thought now in civil engineering that says, well, let's stop just trying to make things stronger and stronger and stronger and piling more and more and more concrete. Let's instead design things with failure in mind.

• 27:48Roman Mars?

  And that doesn't necessarily mean that you just, you're just resigned to the fact that infrastructure will crumble, right? Like, you talk about an example of infrastructure in the Netherlands that was designed with failure in mind. Could you say more about that project?

• 28:01Speaker 01

  Yeah. There was a project called Room for the River, where they found that over time their rivers kept flooding. And they kept flooding more and more and more. And the damage was becoming worse and worse. It was flooding cities, it was destroying crops. And they were building levees taller and taller and taller. And they were building dikes and all these ways to try and rein in their rivers. And eventually, they said, this is not working anymore. Ultimately, they decided to look at it from a completely different perspective, accepting that their human-made designs to stop the rivers from flooding would eventually fail.

• 28:45Speaker 01

  And instead, they created Room for the River. It's actually several rivers that I can't pronounce.

• 28:52Roman Mars?

  Fair enough.

• 28:53Speaker 01

  They said, we're gonna build these big fields around them. Farmers who are right next to these rivers, we're gonna buy them out and we're gonna help them buy land elsewhere. And the farmers who refuse to stay, we're gonna create compensation programs for them. They said, we know this will flood. How do we accept these? And how do we make the costs not catastrophic rather than how do we stop this from happening in the first place? And it's classic disintegration testing. You accept that the bad thing will happen and you look for ways to mitigate the damage.

• 29:29Roman Mars?

  Right. It sounds like a much more complicated approach because it's not just like you're building something and you're just make it stronger and better. You have to make all sorts of concessions and make sure everyone's on board.

• 29:40Speaker 01

  It's more complicated. Because if you're just saying, we're gonna stop the river from overflowing, everyone says, great, build a big levee.

• 29:49Roman Mars?

  Taller wall, yeah, thicker wall.

• 29:50Speaker 01

  No one has a problem with that. That's, that makes sense. It doesn't affect anyone. But if you're saying, actually, we're gonna let these things run wild, you have to think about who is that going to harm? And you have to bring more stakeholders into the conversation. You have to think like, is it okay that this field floods, but this one doesn't? Is it okay that this series of buildings gets water in their basement, but this series of buildings doesn't? And so, on a societal level, it's much harder. But it works a lot better if you can get it right.

• 30:29Roman Mars?

  More with Alex Davies after the break.

• 30:37Roman Mars?

  Sonos is a sound system engineered to make you feel. Sound is as much a part of the design of your home as your furniture, as your art. It can completely change the experience of a room, even though you can't actually see it. Sonos works as a system throughout your home, so the sound can move with you and help set the mood wherever you are. A familiar song can make the kitchen feel less like the place where you unload the dishwasher and more like somewhere where you actually want to hang out and dance. Two speakers can sync up and play music in the bedroom, and, well, you can fill in the rest. Whatever you want to feel, Sonos can bring it to life. My Sonos system is indispensable. I have Sonos speakers throughout my house. I use them every day, all the time.

• 31:20Roman Mars?

  If I'm not recording in the home booth, there is music playing somewhere in the house, and sometimes different music in different rooms. Love the sound, feel the system. Visit sonos.com to build your system. That's S-O-N-O-S dot com.

• 31:36Roman Mars?

  Support for this episode comes from Amazon Business. When it comes to your business, procurement shouldn't be a guessing game. Whether you're running a small business or managing a large organization, Amazon Business offers smart purchasing experiences designed to meet your unique needs. Smart tech, smarter decisions. Streamline your buying process, save time and money, and gain valuable insights. Amazon Business empowers you and your team to buy with confidence. Learn more at amazonbusiness.com. When you're at work, you never know when you'll be interrupted. But with the Dell Pro powered by Intel Core Ultra with V Pro, no matter what distracts you, your laptop won't. It's battery optimized for the way you work with built-in intelligence that quiets distractions

• 32:21Roman Mars?

  when you need to focus. Your laptop will help keep you locked in even when it's Bring Your Dog to Work Day. Built for those who stay in the flow. The Dell Pro, built for you. Dell.com slash Dell dash Pro.

• 32:39Roman Mars?

  If you're a small business, the right hire can be make or break. Indeed Sponsored Jobs gets you quality candidates when you need them most. Join the 3.3 million employers worldwide that use Indeed to connect with quality talent that fits their needs. Listeners of this show will get a $75 sponsored job credit to help get your job the premium status it deserves at indeed.com slash podcast. That's indeed.com slash podcast. Terms and conditions apply. Hiring now, then this is a job for Indeed Sponsored Jobs.

• 33:16Roman Mars?

  We're back with Alex Davies. Something you talk about in your book is the idea that no matter how much you test something in a lab, the real world will ultimately throw way more things at it than any lab could possibly devise. And you use this example of the Golden Gate Bridge, which I love, where a new design element was added to the bridge, but it ended up having a major unintended effect, which is that it turned the bridge into a gigantic musical instrument. Can you talk about what happened there?

• 33:44Speaker 01

  So in 2014, the owners of the Golden Gate Bridge decided to add nets under the bridge to mitigate or prevent suicidal jumps from the bridge. They knew that adding nets would increase the wind load on the bridge, and they wanted to make sure the bridge would maintain its structural integrity under higher winds.

• 34:08Speaker 01

  And what they ended up doing was taking the slats that are along the railing, the pedestrian walkway on the bridge, which were originally parallel to the bridge, like the slats on a picket fence, and they took them and they turned them 90 degrees. And so that way, they're not catching the wind. And so we're balancing it out.

• 34:30Roman Mars?

  Yeah.

• 34:30Speaker 01

  And so they said, of course, we need to test this properly. So they took a scale model into a wind tunnel, and they blew wind at it from all sorts of different directions. They said, great, it holds up super well. No problem. So they went and they turned all of the slats on the thing. And then almost immediately, you get a windy day, because it's San Francisco, and you get this

• 34:57Speaker 01

  noise that people on the other side of the San Francisco Bay are hearing, and they're going, what on earth is this eerie humming noise? It's like the noise you get in a horror movie. The first time, things start to go a little bit wrong. And what they didn't realize, they didn't think about the acoustics of the bridge. They thought about the wind load on the bridge. And this is what I call dynamics testing. You're effectively testing, how does something affect its environment? And how is something affected by the environment in which you put it? And so what they ended up doing was, so they went back a little bit to the drawing board. They said, well, we still want the nets here.

• 35:41Speaker 01

  We still think turning the slats perpendicular is the best way to reduce wind load and even that out. But what they ended up doing was they put these little rubber lined clips, a U-shaped clip, on every single slat to basically stop it vibrating. Because what was happening was, the wind was coming through, and like a giant harmonica, all of these things were vibrating a little bit, and that's what was making the humming noise. This time, they actually tested the acoustics of it, and they found that in almost all wind conditions, the bridge was silent. In some very particular gusty conditions, it would make a little bit of noise. But they said, this is acceptable.

• 36:24Speaker 01

  They put all the clips on, and they painted them all the iconic orange of the Golden Gate Bridge.

• 36:29Roman Mars?

  One aspect of testing that I found really intriguing in your book was this idea of intention. Basically, how to test for a product when the user is not just using the product wrong, but is using it maliciously. And I think a great example of this is the AirTag, which is a little tracing tag that's meant to help find lost personal items. And if you thought about, you know, testing an AirTag, the first things you might think of are like, okay, so if I drop it, does it still work? You know, how long does the battery last? If I move it 30 feet, does it still connect? How about 100 yards? But what I don't really think about is how you test it, keeping in mind that it might be used maliciously. Could you talk about that?

• 37:08Speaker 01

  Almost, I think, maybe possibly even before they were on the market. When people knew that Apple was making a thing called an AirTag, that you could attach to your keys, or even attach to your dog, or put it in your kid's backpack to keep track of where things are, people immediately said stalkers are going to use these to track people. Because they're really small, they don't make any noise, it's really easy to slip into something. And eventually, Apple got hit with a class action lawsuit by people who, a lot of, it

• 37:46Speaker 01

  was almost exclusively women, who were being tracked by abusive, either partners or former partners. And this was a genuine problem for a lot of people. And Apple ultimately went back and thought a little bit more about it. They did put some measures in from the beginning, to give them credit. There was a thing that after a couple of days, it would say, hey, there's an AirTag that's matching your location almost all the time, but it's not on your account. Should you, should you check that? Like, and I get those alerts sometimes, even like, like, I travel a lot with my husband,

• 38:30Speaker 01

  and sometimes it says, hey, this case of AirPods has been going everywhere you're going. I'm like, yeah, because we're on vacation, we're going to all the same places.

• 38:42Speaker 01

  But it's true, it's the kind of conventional testing we've been talking about tends to fall short when you're talking about, not just is someone going to use this in a stupid way, but is someone going to use this in a malicious way?

• 38:56Roman Mars?

  It's easy to take test engineering for granted, I think. But so many things we interact with have gone through rigorous testing, and we have benefited tremendously from it. The vaccines we get, the planes we fly in, the bridges we drive across, the refrigerators that we have at home. In your book, you also write that we're in an era where it feels like test engineering is maybe more important than ever, especially now that we're kind of in a real world scenario where it feels like we're being tested all the time. And I'm thinking of algorithms and AI technologies that are being tested in the real world on us, learning from us in ways that are faster than we can possibly understand. Why do you think it's important that we know how things are tested?

• 39:42Speaker 01

  I think knowing how these tests are done is important, because these tests underpin how basically everything you ever buy is made. And I think it's becoming more important, because testing is breaking out of the laboratory.

• 40:02Speaker 01

  The best example here is self-driving cars. Right? If you've seen a self-driving car, which basically means, have you been to San Francisco or Austin, or are there those different places? If you've seen a self-driving car go by, you are part of that test. Part of that test is, is this thing going to drive up onto the sidewalk and mow you down? Fortunately, like, they don't put these things out in the real world until they're very confident about that. But testing is happening in all of these different ways around you. Right? A new Facebook algorithm is being tested in real time on real people.

• 40:41Speaker 01

  And so I think there's a lot to be said for being more knowledgeable about how these engineers work, how these tests are run. You can start to question, what are the trade-offs between safety and reliability and progress and profit? You can start thinking, how close is this to the real world? What trade-offs? What did they sacrifice to make this a workable test? I call testing the hidden backstory of everything in your life. It lets you see that backstory, or it lets you imagine it with a lot more clarity.

• 41:21Roman Mars?

  Well, Alex Davies, thank you so much for talking with me. I had such a fun time, and I really enjoyed your book.

• 41:26Speaker 01

  Thank you so much for having me.

• 41:30Roman Mars?

  99% Invisible was produced this week by Laish Madon. Additional production by Jacob Medina Gleason. Mixed by Martin Gonzalez. Music by Swan Real. Kathy Too is our executive producer. Kurt Kohlstedt is the digital director. Delaney Hall is our senior editor. The rest of the team includes Chris Berube, Jason DeLeon, Emmett Fitzgerald, Christopher Johnson, Vivien Le, Kelly Prime, Joe Rosenberg, Talon and Rain Stradly, and me, Roman Mars. The 99% Invisible logo was created by Stefan Lawrence. We are part of the SiriusXM Podcast family, now headquartered six blocks north in the Pandora Building in beautiful Uptown Oakland, California. You can find us on all the usual social media sites as well as our own Discord server. There's a link to that,

• 42:13Roman Mars?

  as well as every past episode of 99PI at 99pi.org.

• 42:26Roman Mars?

  This episode is presented by Air France. Air France Business Cabin offers comfort from start to finish. Enjoy priority check-in and boarding, followed by access to peaceful lounges. Onboard, savor menus created by renowned French chefs paired with wines and champagne selected by sommelier. Stay connected with free high-speed Wi-Fi. Then unwind in a fully adjustable lie-flat bed with a mattress topper developed with Sofitel MyBed, a signature touch of French hospitality. The art of travel elevated because Air France Business Cabin goes further in every detail to make your journey exceptional.

• 43:07Speaker 02

  This podcast is supported by Nurtac ODT. Remedy Pant. We know you didn't ask for an interruption, but migraine doesn't wait for the right moment to interrupt either. It just barges in, takes your time, and throws everything off. So when migraine takes your time, take Nurtac. It's for the acute treatment of migraine with or without aura in adults. Nurtac can provide pain relief in two hours, which can last up to two days. Ask your healthcare provider if Nurtac is right for you because your time is for you, not migraine. Don't take if allergic to Nurtac ODT. Allergic reactions can occur even days after use. Get help right away for trouble breathing, rash, swelling of face, mouth, tongue, or throat. High blood pressure and Raynaud's syndrome can occur. Get help for high blood pressure, numbness, coolness, pain,

• 43:51Speaker 02

  or color changes in fingers and toes. Common side effect is nausea. For full prescribing information, call 1-833-4-NUR-TAC or visit nurtec.com. All right, back to your podcast playlist or whatever's keeping you going today.

• 44:07Speaker 03

  Sometimes a little treat is your daily dose of joy. With the new Hershey's Creme Bars, you'll discover your new happy place. It's classic Hershey's Milk Chocolate layered with rich salted caramel or affogato creme. Bite into a more textured, more flavorful, sweet treat worth talking about. Try the new Hershey's Salted Caramel or Affogato Creme Bars wherever you shop for snacks and choose happiness with every bite.