Pod Insights Freakonomics Radio 270. Bad Medicine, Part 3: Death by Diagnosis About this episode By some estimates, medical error is the third-leading cause of death in the U. S. How can that be? And what's to be done? Our third and final episode in this series offers some encouraging answers.
Transcript 8,382 words · 15 speakers
Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.
0:01 Stephen J. Dubner? Freakonomics Radio is sponsored by Southern New Hampshire University. The best investments are the ones you make in yourself, and no one knows that better than Southern New Hampshire University. With more than 200 online degree programs, no set class times, and low online tuition, Southern New Hampshire University is built to fit your life today and set you up for success tomorrow. Education is an investment. Why not make it a smart one? Apply for free at SNHU.edu/freakonomics. Freakonomics Radio is sponsored by hotels.com. Hotels.com helps you find and book the right stay for work faster. With business preferences, save your travel must haves like gym access or breakfast just
0:46 Stephen J. Dubner? once, then get tailored results whenever you search for work travel. Plus, with a free membership, you can save up to 20% on hotels and earn rewards on every stay for future travel. Book now at hotels.com. Visit hotels.com for details. Freakonomics Radio is sponsored by Amica. You know what they say, if you want to go fast, go alone. If you want to go far, go together. So go with Amica and get coverage from a mutual insurer that's built for their customers, one that looks after what's important to you together. Auto, home, life, and more, coverage that fits your unique needs. Amica helps you protect what matters most.
1:29 Stephen J. Dubner? Visit amica.com and get a quote today. Freakonomics Radio is sponsored by ChatGPT. ChatGPT Work is a new way to work in ChatGPT. ChatGPT Work can pull info from across your apps and connect to your tools to help you create finished work. You can even automate work in ChatGPT with the Scheduled Tasks feature, and the whole time, you stay in control. Put ChatGPT to work on your most ambitious ideas and projects. Get started at chatgpt.com by selecting Work Mode, available on Plus and Pro plans.
2:21 Stephen J. Dubner? Before we get on with today's episode, part three of Bad Medicine, I've got a quick favor to ask. As you may know, Freakonomics Radio is produced by the public radio station WNYC, and a big part of public radio funding comes from listener donations, from people like you. So please go to Freakonomics.com, click the Donate button, and do your thing. You can also donate by texting. Just send the word FREAK to the number 69866, and you'll get sent a link to the donation page. This is, of course, the best time of year to donate, not only because it's the season for generosity, not only because it's your last chance to qualify for 2016 charitable gift tax break,
3:05 Stephen J. Dubner? but also because your donation right now will be tripled. How's that? The Tao Foundation, a generous supporter of WNYC, has offered to triple donations to Freakonomics Radio. They will contribute up to $50,000. So if you give $100, that's a $300 donation to our program. And if you want to use up the Tao Foundation's generosity in one shot, just send us $16,666.67, and that will land there 50 grand. All you have to do is go to Freakonomics.com, click on Donate, or text FREAK to 69866. We've got some great Freakonomics Radio swag to choose from,
3:46 Stephen J. Dubner? including Titleist golf balls marked with the Freakonomics Radio logo, which are good for golfing, but also, I have discovered, small dogs love to play with them. Probably cats, too, but I don't have any cats. In any case, happy holidays. Thanks for your support, and thanks especially for listening to Freakonomics Radio.
4:14 Speaker 01 This is an American condition. This is an American disease. This has been one of the great mistakes of modern medicine.
4:24 Stephen J. Dubner? That's David Kessler, who ran the Food and Drug Administration during the 1990s. Surely, you know the "condition," the disease he's talking about. President Obama's been talking about it.
4:35 Speaker 02 This crisis is taking lives. It's destroying families. It's shattering communities all across the country.
4:45 Stephen J. Dubner? But what does Kessler mean when he says, "This has been one of the great mistakes of modern medicine"?
4:50 Speaker 02 Drug overdoses now take more lives every year than traffic accidents. A lot of time, they're from legal drugs prescribed by a doctor.
4:59 Stephen J. Dubner? What Kessler is talking about is a combination of good intentions, greed, and a complicated, changing relationship between doctors and their patients. The result? People dying every year from prescription drugs that are supposed to heal us, not kill us. It's a sick twist, isn't it? So, how'd this happen?
5:21 Speaker 03 It's part of the recurring sense of hope and despair associated with these drugs that are supposed to solve problems, but they end up being problems in themselves.
5:31 Stephen J. Dubner? The numbers are remarkable.
5:33 Speaker 04 Prescription opioid use has gone up about 300% to 400% since the year 2000.
5:39 Stephen J. Dubner? America is a world leader in the consumption of painkillers. Here's what a 2007 report found.
5:45 Speaker 03 We were consuming about 83% of the world's oxycodone in the United States. And it is not because we had 83% of the world's pain. It's because we are a consumer society that believes in the power of a magic pill.
6:02 Stephen J. Dubner? How did medicine get taken over by consumerism?
6:05 Speaker 05 Doctors used to practice medicine on sick and injured patients. And it was those two players in the healthcare system. And now, the same two people in the room, the doctor and the patient, behind the room is a gigantic industry.
6:24 Speaker 05 Of people buying, selling, trading, bartering, discounting, marking up all of our services.
6:31 Stephen J. Dubner? Today on Freakonomics Radio, the third and final part of our Bad Medicine series. This time, we look at the doctor-patient relationship. Who's got the real leverage in that relationship?
6:43 Speaker 05 They cope with their job by giving an angry patient what they want, not what they need.
6:49 Stephen J. Dubner? What's the number one problem in healthcare?
6:51 Speaker 05 I think the number one problem is we don't measure performance. We don't measure the outcomes of patients in healthcare for 99% of the healthcare that's delivered.
7:01 Stephen J. Dubner? And is it a better idea to just stay away from the doctor? So I would think that you are a downright danger to your patients. How is it that you're not?
7:13 Speaker 05 No comment.
7:25 Speaker 06 From WNYC Studios, this is Freakonomics Radio, the podcast that explores the hidden side of everything. Here's your host, Stephen Dubner.
7:42 Stephen J. Dubner? In the first two episodes of our Bad Medicine series, we looked at some of medicine's biggest mistakes. Drilling holes into people's skulls.
7:49 Speaker 07 It would cause a whole series of malformations and probably a lot of fetal death.
7:54 Speaker 08 It was literally taking someone to hell and back.
7:56 Stephen J. Dubner? And we looked at how better science is pushing medicine not always forward, but often backwards.
8:03 Speaker 04 It is quite common to see practices that end up getting reversed. And the best estimates are that happens about 15% of the time.
8:12 Stephen J. Dubner? We talked about who has been excluded from a lot of clinical trials.
8:16 Speaker 07 The study of women in general became part of the collateral damage.
8:22 Stephen J. Dubner? And these days, who gets included?
8:24 Speaker 09 When you look at the evidence, what you often find is that trials are conducted in absolutely perfect dream patients, people who are, by definition, much more likely to get better quickly. Now, that's very useful for a company that are trying to make their treatment look like it's effective. But actually, for my real-world treatment decisions, that kind of evidence can be really very uninformative.
8:53 Stephen J. Dubner? Today, in our final episode of Bad Medicine, we focus on those real-world treatment decisions. We focus on where healthcare really happens when a patient gets together with a doctor or another healthcare professional. And what's one of the main reasons any of us might go to a doctor? It's easy. It's because we're in pain.
9:14 Speaker 03 Pain illuminates what is, I would argue, a general problem in medicine.
9:19 Stephen J. Dubner? Keith Waylu is a Princeton historian who focuses on health policy.
9:24 Speaker 03 That is to say, who's to say what degree of pain a person is in? And what constitutes truly effective relief other than the patient themselves? And two different people might actually require different doses of medication to alleviate the pain.
9:41 Stephen J. Dubner? In the late 1980s and early 90s, there was a push to mandate the recognition and treatment of pain. This culminated in the promotion of pain as the fifth vital sign, along with temperature, blood pressure, pulse, and respiratory rate, which made pain the only vital sign that is determined not by objective measurement, but by the patient's own assessment. So doctors were put in the position of having to determine whose pain was worthy of a prescription painkiller and whose wasn't. Very often, doctors have decided, yes. In 2015, more than 650,000 opioid prescriptions were dispensed per day in the US.
10:24 Stephen J. Dubner? One result of this prescription onslaught? It is believed to have contributed to a recent uptick in mortality rates. Anupam Jena is a physician and a healthcare economist at Harvard. Mortality rates in the US have risen for the first time in 10 years. Which is striking, considering that mortality rates have been falling for at least 100 years. The US rise has been concentrated among a few groups, particularly white, middle-aged men and women. Among white men with a high school education or less, the death rate has risen an astonishing 22%.
11:00 Speaker 04 And the attribution of these issues is in part due to opioids. And this is a problem that was created by medicine.
11:09 Stephen J. Dubner? And yet, you certainly can't blame your profession for that because it's an effective drug when used well, correct?
11:17 Speaker 04 Correct, yeah. And you know, like many drugs in medicine, they're effective in certain situations. So for patients who fall at home and break their hip and have a hip fracture, opioids for situations like that are known to be effective pain relievers. Or in patients with cancer, particularly in cancer with bone pain because of disease that has metastasized to the bone, opioids in that situation have been shown to be highly effective in terms of reducing pain. But opioids for low back pain, or headaches, or knee pain, or hip pain, or just chronic pain in general, opioids are not thought to be an effective strategy.
12:01 Speaker 04 And yet, we've seen the proliferation of their use in the last decade.
12:08 Stephen J. Dubner? So how do you maximize the use of opioids when appropriate and minimize their overuse? That's not easy. There are a lot of confounding factors. But it's hard to come up with good prescribing protocols for pain relievers when you don't even have good measurement for pain.
12:25 Speaker 03 Because we don't have any objective measures for actually figuring out what works, we are necessarily in a realm where not just subjective assessment, but also trial and error medicine is necessary to figure out what works.
12:38 Stephen J. Dubner? And to that end, Weilu says,
12:40 Speaker 03 We need to think about over-medication and under-medication as not two poles of the use of pain medicine. Because then what we do is we kind of just whiplash like a pendulum. We go from believing that under-medication is a problem to believing that over-medication is a problem. What we need to do is to understand that both of these things can be a problem at the same time.
13:08 Stephen J. Dubner? The American Medical Association, hoping to address this problem, recently turned back the clock. It recommended that pain be removed as a fifth vital sign. But how much will that help? Anupam Jena again.
13:21 Speaker 04 As an economist, I think about supply and demand. So there's the demand of patients, increasing demand for patients, buy patients for opioids.
13:29 Stephen J. Dubner? Once you've put the power in the hands of the patient, or just to call it what it is, in the hands of the consumer, it can be hard to reclaim it. So how did we get here?
13:39 Speaker 03 Yeah, so pain management was really emerging as a recognizable and legitimate area of medical practice and care in the 1960s, early 1970s, with the development of multidisciplinary pain centers.
13:53 Stephen J. Dubner? Keith Weilu again.
13:54 Speaker 03 There was a general recognition that you needed more than just drugs to deal with people in chronic pain. You needed social workers, you needed surgeons, you needed psychologists, you needed a wide range of others, as well as people with pharmacological expertise.
14:09 Stephen J. Dubner? But those multidisciplinary pain centers were really expensive.
14:13 Speaker 03 And so, you know, one of the economic trends since the 1980s, with the rise of cost containment, is to sort of see drugs as the cheapest and the fastest solution to our problem.
14:26 Stephen J. Dubner? This coincided with a big shift in how drugs are marketed to the public.
14:31 Speaker 03 Before the 1980s, the idea that you would see prescription drugs being advertised on television was laughable. It emerges in the mid-1980s that, you know, we're sort of seeing government regulation as the problem and the market as the solution to our problems. Zoloft, prescription medicine can help.
14:52 Speaker 04 With Aegir? Prestor.
14:53 Speaker 03 Cymbalta. And out of this era emerges this idea that People have the right to have the information at their disposal.
15:03 Speaker 10 Increased risk of prostate cancer, worsening prostate symptoms, decreased sperm count, ankle, feet or body swelling, enlarged or painful breasts.
15:10 Speaker 03 About prescription drugs and to bring that knowledge into the physician's office.
15:14 Speaker 10 Ask your doctor. That's between you and your doctor. Talk with your doctor.
15:17 Speaker 03 In order to, not so much demand, but to shape clinical decision making. Ask your doctor, ask your doctor.
15:25 Speaker 06 Ask your doctor. Call your doctor right away.
15:27 Stephen J. Dubner? In fact, the aggressive marketing of Oxycontin as a safe pain medication led to criminal convictions for top executives at its manufacturer, Purdue Pharma, for misleading the FDA, clinicians and patients about its risks. But just because one painkiller is declared risky doesn't mean that consumers wouldn't demand other painkillers because, as Keith Weilu told us earlier.
15:51 Speaker 03 We are a consumer society that believes in the power of a magic pill.
15:58 Stephen J. Dubner? And once consumers gained more leverage in the medical realm, guess whose opinions began to matter a lot more? Yep, the consumers, in the form of those patient satisfaction surveys you fill out after a doctor's visit.
16:13 Speaker 05 Yeah, it is a problem. You know, that's the problem when we just measure things that are easy to measure.
16:20 Stephen J. Dubner? That's Marty McCary, a surgical director and health policy scholar at Johns Hopkins.
16:25 Speaker 05 By putting all this attention on customer satisfaction, consumer satisfaction or patient satisfaction, we're creating a consumerist culture in healthcare. People come in, they want an antibiotic for their kid and they don't care what your diagnosis or explanation is. They want to walk out with that antibiotic prescription. Or you're in pain and you want that pain script. If the doctor is under the microscope for their patient satisfaction scores, you can imagine the perverse incentive here.
16:54 Stephen J. Dubner? Indeed, a 2012 paper in the Journal of the American Medical Association pointed to an unintended consequence of this perverse incentive. Physicians who do not comply with patient requests, the authors wrote, may be the recipients of poor ratings on patient satisfaction scores, possibly resulting in emotional, financial, and professional penalties. So imagine this: you are a doctor and your patient asks, maybe by name, for a prescription painkiller. You may think the patient doesn't really need it. You may, in fact, be worried they'll abuse it, maybe even sell it. But if that consumer has the ability to punish you professionally, well, you might just write the script.
17:36 Speaker 05 They respond to demands. They cope with their job by giving an angry patient what they want, not what they need, because they have to see five patients in an hour. I can tell you emphatically, doctors are getting crushed out there. They're getting crushed with record rates of burnout due to increasing overhead, higher malpractice premiums, declining pay, lowering Medicare reimbursement, being forced to see more patients in a single hour. Corporate medicine.
18:11 Stephen J. Dubner? On top of all that, McCary says, there is a brutal paradox. Patient satisfaction is not a helpful metric when it comes to measuring health outcomes. Well, at least not helpful in the direction you might think it would be. A 2012 study found that the most satisfied patients had higher rates of hospitalization and higher mortality rates. Why? The authors suggest that more satisfied patients may request more discretionary treatments, which may increase the likelihood of adverse effects.
18:45 Speaker 05 So, you know, it's a big problem. What's important to a patient when they come to a doctor? The doctor's patient satisfaction score? Well, that's a piece of the doctor's quality. But really, what you're interested in is the doctor's judgment, and the doctor's skill, and the doctor's ability to empathize.
19:08 Stephen J. Dubner? Those are the sort of metrics Marty McCary argues that will help doctors treat patients better. So, coming up on Freakonomics Radio, now all you've got to do is collect all the data on doctors' judgment, skill, and empathy, right? But, again, not so easy, in part because of the sheer volume of that data.
19:28 Speaker 05 We are doing more than we've ever done before. We are doing more procedures, giving more medications, hospitalizing more patients, diagnosing more things than we ever have in the history of medicine.
19:42 Stephen J. Dubner? Also, why feedback for doctors is so important, especially for doctors who've been practicing a while.
19:48 Speaker 04 What we find is that if you happen to be treated by a doctor who is 10 years or 15 years out of residency, your mortality within 30 days of being hospitalized is higher.
19:59 Stephen J. Dubner? And remember to make a year-end donation to WNYC, the public radio station that produces Freakonomics Radio. Just go to Freakonomics.com/donate or text the word FREAK to the number 69866. Thanks.
20:22 Stephen J. Dubner? Freakonomics Radio is sponsored by Granola. You know that moment when a meeting ends and someone says, "Let's circle back on this next week," and everyone nods, but no one writes it down? Then next week rolls around and it's radio silence? That's why Granola exists. Granola is an AI-powered notepad built for the way real people actually meet. You take rough notes like you normally would, and in the background, Granola securely transcribes the meeting. Then it turns everything into clean, structured, actually useful notes when the meeting ends. And the best part? Granola works through your device's audio, which means it integrates seamlessly into the video conferencing tools you already use. No setup, no awkward bots. It's just your normal meeting with superpowers. If meetings are eating up your day, Granola is a no-brainer. You can try it totally free.
21:06 Stephen J. Dubner? Just head to granola.ai/freakonomics. That's granola.ai/freakonomics to get your time back. Try it for free at granola.ai/freakonomics.
21:24 Stephen J. Dubner? Freakonomics Radio is sponsored by Quince. You know those pieces in your closet that you find yourself wearing on repeat? The sweater that goes with everything? The perfect pair of pants? Or the tea you somehow always reach for first? Those are the pieces that make getting dressed easy, and that's what Quince does best. Quince focuses on high-quality wardrobe staples made with premium materials like 100% Mongolian cashmere, organic cotton, and merino wool. The styles are timeless, versatile, and designed to become the dependable pieces you reach for day after day. And it's not just clothing. Quince brings that same approach to everything they make, from hotel-quality bedding and bath to kitchen essentials and thoughtfully designed furniture. Find your next fall favorites at Quince.
22:08 Stephen J. Dubner? Download the Quince app for app-exclusive offers or go to quince.com/freak. Get free shipping on your order and 365-day returns. Now available in Canada and the UK, too. That's Q-U-I-N-C-E dot com slash freak. Freakonomics Radio is sponsored by PNC Bank. Boring. Great word, bad rep. Yet, time and time again, here at Freakonomics, we find that when something culture-changing happens, boring things like calculations and careful planning are usually behind it. Which begs the question, why not apply it to other aspects of life? Like banking, for example?
22:49 Stephen J. Dubner? Well, PNC Bank did since its inception, proving time and again that the best banking strategy isn't the exciting type, but the steady, reliable, definitely-not-YOLO type. PNC Bank: brilliantly boring since 1865. Brilliantly Boring Since 1865 is a registered mark of the PNC Financial Services Group, Inc. PNC Bank, National Association, Member FDIC.
23:22 Stephen J. Dubner? Marty McCary, the surgeon and health policy scholar we've been speaking with, is a big advocate for medical reform. First step: improving the feedback loop. That is, what we know, and way too often what we don't know, about what actually works.
23:37 Speaker 05 I think the number one problem is, we don't measure performance. We don't measure the outcomes of patients in healthcare for 99% of the healthcare that's delivered.
23:48 Stephen J. Dubner? McCary might be exaggerating a bit, but still, how can this be? When you go in for medical treatment, don't the health professionals who treat you find out if their intervention actually worked? The short answer is, often, no. But the longer answer is much worse. The longer answer is that not only do medical interventions often not work, medical interventions will sometimes kill you. Marty McCary and co-author Michael Daniel recently published a study arguing that the third-leading cause of death in the US after heart disease and cancer was medical error. I'm going to say that again. The third-leading cause of death in the US, accounting for 10% of deaths annually, is
24:33 Stephen J. Dubner? medical error. How can this be? Are doctors and nurses showing up for work stoned out of their skulls? Are they sneaking into hospital rooms at night and smothering their most annoying patients? Are they surreptitiously removing healthy organs to sell them on the black market? If only. That would make the problem so much easier to solve. Why are so many deaths the result of medical error?
24:57 Speaker 05 Well, I think anybody that practices medicine knows that medical errors are a function of the amount of things that we do in healthcare.
25:09 Stephen J. Dubner? The "amount of things" meaning what?
25:12 Speaker 05 We are doing more than we've ever done before. We are doing more procedures, giving more medications, hospitalizing more patients, diagnosing more things than we ever have in the history of medicine. Right here today in the United States, we have the most medicalized, the most diagnosed population in the history of the world.
25:36 Stephen J. Dubner? In economic terms, you could say there's both an oversupply and an over-demand of healthcare, since the supply and demand are both fueled by the setup of our healthcare insurance system. Patients who buy expensive insurance want to get their money's worth and may overconsume, just as you might overconsume at an all-you-can-eat restaurant. And doctors who make money primarily when they do stuff may tend to do more stuff.
26:02 Speaker 05 When we're doing all of this stuff, it makes you wonder, does that mean we're also making mistakes proportional to the amount of stuff that we do?
26:12 Stephen J. Dubner? Well, that sounds scary.
26:13 Speaker 05 So first of all, I don't want to scare people out there. Most doctors are doing the right thing and always will.
26:21 Stephen J. Dubner? All right, but how can it be that the people we entrust to heal us, the people who've worked their entire adult lives to learn how to heal us, may sometimes be killing us? To get to that answer, you first have to understand that for decades, we've been making a sort of clerical error.
26:41 Speaker 05 Our research found the methodological flaw in our country's national health statistics. We use a billing code system to tally causes of death from death certificates. And people don't just die from billing codes. They die from medical mistakes, communication breakdowns, overdoses, fragmented care, closed insurance networks, preventable complications, unnecessary treatments. And if you look collectively at this group of problems, let me call it medical care gone wrong, it's got a significant burden in society.
27:16 Stephen J. Dubner? But those complications and oversights and errors, McCary says, seldom wind up on the death certificate.
27:23 Speaker 05 When you fill out the death certificate, you have to list the reason the patient died, both the direct reason and the underlying reason the patient died. Well, we all knew what the real reason was, but you can't put that on somebody's death certificate.
27:40 Stephen J. Dubner? Why not?
27:41 Speaker 05 When somebody experiences a fatal mistake, they're hard stops, and then you do CPR, then you pronounce them dead. What do you put on the death certificate when it says, what was the cause of the patient's immediate death?
27:55 Speaker 05 And that's really what got us thinking. And that's what led to this study. Because you end up putting cardiovascular arrest. And then it turns out what we put on the death certificates populates our country's national health statistics. So when the government puts out every year, these are the most common causes of death in the United States. And by the way, that list is a big deal. That list informs all of our research funding. It informs all of our public health campaigns in America. That list is a big deal. So you realize we're misclassifying medical mistakes as other causes and that medical mistakes don't even show up on the list.
28:38 Stephen J. Dubner? So McCary and his colleagues got hold of a mountain of data and started digging.
28:42 Speaker 05 Well, we basically looked at the best available research on the topic from the New England Journal of Medicine and Health Affairs and a big Medicare analysis and something called the OIG report. It was a government report that was independent.
29:00 Stephen J. Dubner? And what'd they find? Before I tell you that, let me tell you this. There is a famous report put out by the Institute of Medicine in 1999 that set a benchmark for death by medical error. That report estimated there were between 44,000 and 98,000 deaths annually in the US due to medical error. Those are obviously large and frightening numbers. So large and frightening that I've heard many, many medical professionals insist those numbers had to be way too high. So what number did McCary come up with? At least 250,000 deaths every year in the US due to medical error. A quarter of a million people.
29:44 Stephen J. Dubner? Before we get into the errors themselves, let's think for just a minute about how the story of those deaths was hidden in the data. As we've noted throughout these three episodes on bad medicine, a lot of what we take as factual and empirical within medicine often isn't very empirical. That includes how data from clinical trials are manipulated or misinterpreted. And as Marty McCary argues, it includes how the cause of death is categorized. And that's why he's pushing for a fundamental reform to require that doctors, when they fill out a death certificate, specifically indicate if a medical error was involved. Because how do you solve a problem if you don't even acknowledge the problem?
30:29 Stephen J. Dubner? And with medical errors, the problem is both deep and broad.
30:33 Speaker 04 Medical errors have a complex taxonomy.
30:37 Stephen J. Dubner? That, again, is the Harvard doctor and economist Anupam Jena.
30:41 Speaker 04 But for someone like me, I would just break them into two categories. There are errors of diagnosis, and then there's errors of commission. When a patient has surgery on the wrong leg, or when a patient is given an antibiotic, despite it being well documented in the medical record that he or she has an allergy to that medication. Or when a patient receives a dose of insulin that is five times as much what it should have been because someone couldn't read a doctor's handwriting in the chart. There are errors that occur in the hospital because of poor hygiene and infectious disease management, where people get hospital-acquired infections.
31:25 Stephen J. Dubner? I've got to think that those errors of commission are extraordinarily rare, though, yes?
31:30 Speaker 04 Well, you would hope so, but it turns out that they're not. The Johns Hopkins study is actually more about those second set of errors.
31:38 Stephen J. Dubner? So when I hear that, I, as a potential patient, I say to myself, self, unless you are bleeding heavily,
31:48 Stephen J. Dubner? Or unconscious, just stay away from every doctor and certainly every hospital.
31:53 Speaker 04 Well, hopefully, if you're unconscious, you won't be making that decision. Well, you know, I think you also have to take a step further and say, okay, well, when a diagnostic error occurs, what is the implication of that? Does it mean that the diagnosis is ultimately made later in a safe and effective way? Well, that's much less alarming than if an incorrect diagnosis by a doctor leads to, let's say, a biopsy that then causes longer-term problems. The only thing that I'd mention there is that this is not just an issue of decisions that are made by individuals. In fact, most of the thinking on this issue points to system-level problems that lead to diagnostic errors.
32:35 Speaker 05 The problem is a system problem.
32:37 Stephen J. Dubner? That's Marty McCary again. Remember, here's what McCary argued earlier.
32:42 Speaker 05 I think the number-one problem is we don't measure performance.
32:47 Stephen J. Dubner? In other words, the medical system often fails to collect useful feedback.
32:52 Speaker 05 Simple data, simple transparency.
32:54 Stephen J. Dubner? McCary himself is a surgeon.
32:57 Speaker 05 99% of people that have surgery in the United States go home and no one documents or keeps track at a systematic level, that is, national or regional or hospital, of how the patient does. At six months, are you glad that you had your knee surgery done? At six months after hip surgery, are you walking again? Or a year after weight-loss surgery, what is your weight today? We don't keep track of those things in healthcare for most of the procedures or treatments that we do. And the problem is that how can you really come up with a quality metric if nobody's tracking it?
33:41 Stephen J. Dubner? This doesn't mean doctors never check in with their patients, but the system simply isn't designed to capture robust follow-up data.
33:49 Speaker 05 Well, there's a follow-up visit. You know, we'll scribble some note, patient's doing well, incision has healed nicely. Who's actually measuring the real patient-centered outcomes six months later or a year later? That is a giant opportunity in healthcare to fix the system by creating...
34:11 Speaker 05 A marketplace centered around value, not just around quantity.
34:17 Stephen J. Dubner? That, of course, would require incentives for doctors that reward preventive care and maintenance rather than just interventions. McCary points to a few areas of medical care where patient outcomes are well-tracked.
34:31 Speaker 05 But it's only for a small sliver of medical care. It's like heart surgery and cystic fibrosis outcomes.
34:38 Stephen J. Dubner? In those cases, he says, money plays a big role.
34:41 Speaker 05 It's almost this hodgepodge of conditions where there's been leaders and good funding or foundation support.
34:49 Stephen J. Dubner? But absent good follow-up data and absent good feedback in general, it's hard to tell what works and what doesn't. Of course, this is true for anything, not just medicine, but with medicine, the stakes are high. And if you're the patient, the stakes are practically infinite. You are putting your life in someone's care, and you only have one life, as far as we know. Other choices might seem hard, like which house to buy, how to invest your money, how to pick a career or a college major. But if you've got a serious health concern, your choice of treatment and doctor is an existential choice. So given a choice between two doctors, let's say, one fresh out of medical school and
35:33 Stephen J. Dubner? the other with 15 years' experience, which one do you go for?
35:37 Speaker 04 I think one question that any patient would have when they see a doctor is, how much experience does my doctor have?
35:44 Stephen J. Dubner? That's Anupam Jena again. Most patients, he says, like the idea of a gray-haired physician.
35:50 Speaker 04 Because the gray-haired physician has more experience, he's seen more patients like me, and he's just going to take better care of me.
35:56 Stephen J. Dubner? That makes sense, doesn't it?
35:58 Speaker 04 But the challenge is that there hasn't been a lot of actual, high-quality evidence to assess that issue.
36:04 Stephen J. Dubner? So Jena and some colleagues set out to gather some evidence, but it wasn't so simple as comparing patient outcomes for experienced doctors and newer doctors.
36:14 Speaker 04 One problem that you're going to run into is the notion that more experienced physicians will take care of sicker patients. And how do you Get around that issue. The way that we've tried to get around it is to focus on a very specific group of doctors that are called hospitalists. Hospitalists are internal medicine doctors who focus on hospital-based care.
36:36 Stephen J. Dubner? Jenna is himself a hospitalist. Because of his research and teaching, he only sees patients for a month or two each year, but he's familiar with the hospitalist setup.
36:47 Speaker 04 And the unique thing about these types of doctors is that they tend to work either shifts or scheduled work. For example, I might work for two weeks and then my colleague is on for two weeks and then her colleague is on for two weeks.
37:01 Stephen J. Dubner? Which is nice because we can isolate the effect of you, correct?
37:05 Speaker 04 Exactly. So, patients more or less end up getting quasi-randomized to physicians with different characteristics. So, for example, if you happen to get hospitalized in the first week of May, you may be treated by a group of doctors who, on average, have five years less experience than if you happen to get hospitalized in the second week of May. And we can basically see what happens if a patient happens to be treated by a doctor who is 20 years out of residency versus five years out of residency. And what we find is that if you happen to be treated by a doctor who is 10 years or 15 years out of residency, your mortality within 30 days of being hospitalized is higher.
37:45 Stephen J. Dubner? Just to be clear, if you happen to draw a more experienced doctor, you are more likely to die.
37:56 Speaker 04 And so, it does suggest that more experience actually could have a negative effect on outcomes.
38:02 Stephen J. Dubner? And what's your best explanation for why that's the case?
38:05 Speaker 04 So, I think the most likely explanation is two things. One is that the field of medicine is constantly evolving. And there's always new knowledge, new evidence emerging, both in terms of how to make better diagnoses and what are the right treatments for particular patients. And as you get further and further away from residency, I think what happens is that the knowledge that you had that you, as a resident, which time when you spend 80 to 100 hours per week in the hospital, that knowledge gets somewhat ingrained in you. New knowledge isn't picked up as rapidly. So I think what happens is that older physicians are just less up to date, if you will. I'll give you one caveat.
38:48 Speaker 04 We don't see this effect among high-volume doctors, doctors who are seeing a lot of patients. And so what that suggests is that if you're an older doctor who is seeing a lot of patients, you are protected from this adverse effect, which makes sense.
39:01 Speaker 05 Unfortunately, some people come out of medical school or training thinking, all right, I've mastered this body of knowledge or this skill set, and I'm good to go for the next 50 years of practice.
39:11 Stephen J. Dubner? Marty McCary again.
39:12 Speaker 05 And the reality is, even as a tenured faculty at Johns Hopkins doing complex surgery in a group that does, you know, the four of us do the most pancreatic surgery of any group in the country, I'm still learning every day. And my senior, senior partner, who's about to retire, he's still learning, you know, the year before he stops operating every day. So medicine's a career of learning, and I think the more feedback we can get at any level.
39:43 Stephen J. Dubner? That said, Anupam Jena's research shows that surgeons are among the subset of physicians who do seem to improve with experience.
39:51 Speaker 04 There's the thought that muscle scale experience in the surgical field over time improves outcomes, and we find that as well. But outside of surgery, when you're thinking about the care of patients that requires a lot of cognitive skill and being up to date on current medications and diagnoses, we actually find that over time, older doctors do worse.
40:12 Stephen J. Dubner? So someone like you, so I don't mean to turn this into a tack on you, but someone like you, who, A, medical school is getting further in the rearview mirror, as it is for every doctor, but additionally, you're only practicing for a couple of months out of the year, not full-time. So I would think that you are a downright danger to your patients. How is it that you're not?
40:35 Speaker 04 No comment. Well, you know, so usually when I work on service, I'm paired with someone who is a full-time clinician educator. And there's a huge difference in the amount of knowledge. And it's very humbling to see that.
40:51 Stephen J. Dubner? Jenna's research looks specifically at physician experience as it relates to patient outcomes. But there's another angle to consider when we talk about experience in the medical realm, especially if you're interested in reform. We have supposedly entered the era of evidence-based medicine. This is still relatively new ground.
41:12 Speaker 08 The reality was that what we were practicing was something called eminence-based medicine.
41:17 Stephen J. Dubner? That's the physician and researcher Vinay Prasad.
41:20 Speaker 08 It was where the preponderance of medical practice was driven by really charismatic and thoughtful, probably to some degree, leaders in medicine. And, you know, medical practice was based on bits and scraps of evidence, anecdotes, bias, preconceived notions, and probably a lot of, you know, psychological traps.
41:41 Stephen J. Dubner? As outdated as that sounds now, keep in mind that a lot of our institutions, including medical institutions, are still eminence-based, which is to say, in many institutions, many big decisions are made by the highest-ranking people, who tend to have the most experience. And people with a lot of experience tend to have fixed views on things. They're attracted to the status quo, or some minor variation of it, because that's what they know. It's what they trust and believe in. Also, if you want to be a bit uncharitable for a moment, we might argue that the status quo is additionally appealing to senior people because, well, because they got theirs already. They've got their job, their status, their salary.
42:26 Stephen J. Dubner? And all that disruption that reformers like to talk about, it's messy, it's time-consuming, it's a pain in the neck. Like I said, that isn't a charitable view, but I'm afraid it's not wrong either. Change can be hard. Uncertainty can be scary. True improvement can be elusive.
42:46 Stephen J. Dubner? But one thing that's so inspiring about all the people we've been speaking with for this series is how they embrace the notion that it's OK to challenge the very institution that you've devoted your career to. In fact, with medicine, it's a requirement. I think back to something we heard from Philip McCoviac, the doctor who unraveled the true story of 98.6.
43:09 Speaker 11 As a medical historian, it is patently obvious to me that future generations will look at what we're doing today and ask themselves, what was grandpa thinking of when he did that and believed that? Look at us now, how good we are. Why weren't they that good? And they'll have to learn all over again that science is imperfect and to maintain a healthy skepticism about everything we believe and do in life in general, but in the medical profession in particular.
43:52 Stephen J. Dubner? So what happens now? There's a long list and reasons to be excited. Marty McCary is particularly enthusiastic about new ideas for collecting better patient feedback.
44:04 Speaker 05 Well, Washington State has a really neat program. In select hospitals, after you have a certain operation, you get a text question. It says, how functional are you? After your surgery, you're just a scale from 1 to 5. Are you glad that you had the procedure done? Do you feel that the alternatives were adequately explained to you before the procedure? And those few questions populate a quality database, and they keep track of outcomes. But that's a rare thing in healthcare. We need to be doing that for every procedure in the United States. Everyone in the United States that has robotic surgery, or a tonsillectomy,
44:47 Speaker 05 or gallbladder removal, or heart surgery, or colon, or whatever it is, should have some data that follows up and allows us to make conclusions about where we can do better, what's working and what's not working. You know, we just sort of discovered, or rediscovered, if you will, recently, that we don't need to treat appendicitis with surgery. You can come in with early appendicitis, and we can give you antibiotics, and it works more than 60% of the time. That's cool. And we probably could have learned that if we had the right databases to look at those conclusions to say, hey, of those patients that refused surgery and we just gave them antibiotics for the last half century, how did they do?
45:32 Stephen J. Dubner? McCary says a lot of this change is being driven by players outside the medical establishment.
45:37 Speaker 05 It's happening really led by startup companies. The startup community in America is doing great things in healthcare, and they're starting to say, hey, can we track how well someone does after surgery? How was your experience? How was your outcome? How was the care that you received after whatever procedure you had done? And over enough time and with enough patients, they're going to be actually able to make conclusions about quality using firsthand patient data.
46:10 Stephen J. Dubner? But given the complexities of medicine, McCary warns, we shouldn't expect quick fixes.
46:16 Speaker 05 First of all, it's different. In every area of medicine, it's different. If you're a cardiologist, or an OB, or a psychiatrist, you can't simply implement strategies to improve quality and standardized care in the same way. In my own field of surgery, we believe there's something that can be done called benchmarking. That is, we can see how we stand as a surgical group, as individual surgeons, relative to other surgeons in our region and nationally that take on similarly complex cases. And that's why we've proposed, and we have a grant to do this nationally, we want the doctors' associations
47:00 Speaker 05 to come up with a metric of performance. We want to apply it to all the doctors in that specialty. And then we want to just share the data with the doctors individually in a confidential, peer-to-peer, civil fashion. This is where you stand. This is where the rest of the country stands. And we're not making a judgment. We just want to share with you your data.
47:23 Stephen J. Dubner? The point, McCary says, is improvement, not punishment.
47:27 Speaker 05 As a matter of fact, firing people for making mistakes in hospitals is the absolute wrong approach. We need to learn from our mistakes, not send a message that if you have a concern, or speak up, or you do a mistake, we're going to kick you out.
47:46 Stephen J. Dubner? Doctors are already in a tough place, under attack for nearly every quarter, including, for these past few episodes, Freakonomics Radio. And the fear of making a mistake, or what may be construed as a mistake, is already so high that doctors practice way too much defensive medicine. That is, tests and procedures primarily meant to avoid a malpractice suit. A 2010 study found that US hospitals and doctors spent about $45 billion a year on defensive medicine. But if the present looks occasionally bleak, the good news is there's plenty of optimism about the future of medicine, as we learned from the variety of clever and motivated people we've spoken to for this series.
48:30 Speaker 07 Where science and medicine is going in the future is to more and more precision medicine, so that we can get closer to an autonomous and individualized diagnosis.
48:40 Stephen J. Dubner? That's Teresa Woodruff, a professor at Northwestern and director of the Women's Health Research Institute.
48:46 Speaker 07 When someone comes in with a cancer, there's a set of protocols, there's the way we treat in general populations, but we can't tell the specific outcome for that individual. How will they tolerate that drug? Will it clear the circulation faster for one individual versus another, which means it might be more efficacious or less efficacious on an individual basis? Those are some of that precision medicine that eventually we have to get to.
49:12 Stephen J. Dubner? So I promise not to hold you to the prediction I'm about to ask you to make, but in terms of precision medicine, like you're talking about, whether it's diagnostic, prescriptive, whatever it is, I just want to know what kind of timeframe you see for that being a real, practical, everyday thing. Is it more like 2 to 20 years, or is it more like 50 to 100 years from now, or somewhere in between, or somewhere beyond?
49:39 Speaker 07 I think science is becoming even more catalytic, so it's going faster and faster and faster. Breakthroughs are coming about every day. And I suspect within the next 10 to 15 years we'll really understand enough to get away from radiation and chemotherapy. And that eventuality is the promise of basic science in medicine. And what that means is that every day as we discover more and more fundamental biology about cells, or about animals, or about the way systems work, that translates into better and better medicines that ultimately will change the patient who is seen tomorrow versus the way the patient that's seen today.
50:20 Speaker 12 There's a lot of promise right now that in the post-genomic world, that some personalized medicine or precision medicine will allow us to do that much better.
50:30 Stephen J. Dubner? Jeremy Green again, a physician and historian of medicine at Johns Hopkins.
50:34 Speaker 12 Although at present, that's still highly promissory, except for in a few very well circumscribed cases. Some people will, will or won't respond to a certain drug for hypertension. And you fish around, you try one, you try another, and then you find a cocktail that works for them. Other people will develop allergies to specific medicines. And then you're constrained in ways that you hadn't originally anticipated.
50:58 Speaker 08 I think the game is going to be the same game, which is a game where, if we're really honest, perhaps a lot of the low-hanging fruit in medicine has been plucked, some of the great interventions.
51:07 Stephen J. Dubner? And that, again, is Vinay Prasad.
51:09 Speaker 08 Now it's a matter of sorting out interventions with medium to, to small benefits. But that's okay. But with a medium and a small benefit, you really have to be sure that you can minimize bias, you can minimize the role of, of your own sort of preconceived notions. And that's why we need careful randomized studies.
51:27 Stephen J. Dubner? But the biggest reason for optimism, Prasad argues, doesn't have to do with better evidence, or better protocols, or better medicine per se. Has to do with better thinking. And that, he says, is happening.
51:39 Speaker 08 I see it every day in medicine. I see it in movements like the British Medical Journal's really commitment to evidence, to transparency, to data sharing. I see it in JAMA Internal Medicine's commitment to knowing when more is harmful, when too much medicine is harmful. And that took many years for us to realize. I think we- You know, are increasingly allowing people with diverse points of view in medicine, contrarians, perhaps even like myself, to write articles in really important journals so that they can be read and thought of by other people. So I think we're at a moment where, you know, we're much more open to different ideas on how to move medicine forward.
52:19 Stephen J. Dubner? So here's to moving forward, and here's to your health and even happiness during the upcoming holidays. Thanks so much for listening to this three-parter on bad medicine. One more reminder, Freakonomics Radio's producing partner is WNYC, a public radio station, and their business model relies on listener donations. So please go to Freakonomics.com to make one. You can also donate by texting. Just send the word freak to the number 69866. Thanks again, and take care.
52:53 Stephen J. Dubner? Freakonomics Radio is produced by WNYC Studios and Dubner Productions. This episode was produced by Stephanie Tam with help from Irva Gunja. Our staff also includes Shelley Lewis, Christopher Wirth, Jake Howitt, Merritt Jacob, Greg Rosalsky, Noah Kurnis, Alison Hockenberry, Emma Morgenstern, Harry Huggins, and Brian Gutierrez. You can subscribe to this podcast on iTunes or wherever you get your podcasts. And come visit Freakonomics.com where you'll find our entire podcast archive, as well as a complete transcript of every episode we've ever made, which includes the music credits and lots of extras. Thanks for listening.
53:43 Stephen J. Dubner? Freakonomics Radio is sponsored by Ozempic. Innovation happens through rethinking what's possible. And when it comes to GLP-1s, Ozempic pill does just that. Learn more about Ozempic semaglutide tablets, 4 and 9 milligrams, by calling 1-833-OZEMPIC or visit Ozempic.com to view the medication guide and ask your doctor what's possible with FDA-approved Ozempic pill.
54:14 Stephen J. Dubner? Freakonomics Radio is sponsored by Southern Company. The world and its energy needs are always changing. Southern Company's commitment to meeting this demand stays the same. That's because Southern Company believes energy is more than a utility. It's what powers possibilities. So they are looking ahead and investing $80 billion in infrastructure upgrades and are committed to fueling growth in ways that benefit all customers so that reliable and affordable energy is accessible for generations to come. Go to southerncompany.com to learn more. Southern Company, building the future of energy.
54:52 Speaker 13 With the Discover Cash Back Card, it's payback time when you earn cash back on everyday purchases. Activate and earn 5% cash back at different categories each quarter on up to $1,500 in purchases. That's 5% cash back at different places each quarter, like grocery stores, on gas, and at restaurants. It pays to discover. Terms apply. See discover.com/five for details.
55:18 Speaker 14 This episode is brought to you by Charles Schwab. Is there a right time to sell a stock? Are you taking the right risks with your portfolio? Financial decisions can be tricky, and often, your own cognitive and emotional biases can lead you astray. Financial Decoder, an original podcast from Charles Schwab, can help. Join host Mark Reapy as he offers practical solutions to help overcome the cognitive and emotional biases that may affect your investing decisions. Listen at schwab.com/financialdecoder.
Previous 269. Bad Medicine, Part 2: (Drug) Trials and Tribulations Next How to Be More Productive (Rebroadcast) Page updated September 30, 2026 · transcript and summary are machine-generated
