Skip to content

Ray Madoff (on how billionaires avoid taxes & threaten capitalism)

Armchair Expert with Dax Shepard

Hosted by Dax Shepard

2h 26m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

The guest explains how modern tax codes have inadvertently created an American aristocracy, mirroring pre-revolutionary France where the ultra-wealthy avoid taxation while wage earners carry the heaviest burden. Rather than paying traditional income taxes, billionaires leverage massive stock holdings to secure tax-free loans, utilizing loopholes that have persisted since 1990. The host and guest analyze the mechanics of wealth accumulation, discussing how stock buybacks replaced dividends and why taxing unrealized gains directly is a fraught proposition.

  • High income earners pay the vast majority of income taxes, while ultra-wealthy individuals with massive assets often pay little to no income tax. 20:32
  • Gifts, inheritance, and life insurance payouts are completely exempt from income tax, providing a massive loophole for the ultra-rich. 36:37
  • Since 1982, stock buybacks have largely replaced dividends, driving the stock market upward while allowing wealthy shareholders to defer taxes. 1:16:26
  • Ultra-wealthy individuals borrow against their stock portfolios rather than selling them, funding extravagant lifestyles completely tax-free. 1:34:43

Chapters

  1. 0:00
    Episode Introduction and Guest Announcement

    Hosts introduce the episode and announce Ray Madoff as the guest.

  2. 0:34
    Ray Madoff’s Background and Book Overview

    Ray Madoff explains her academic background and introduces her book on tax inequality.

  3. 1:06
    The Problem of Billionaires Avoiding Taxes

    Discussion of how billionaires exploit loopholes to evade taxes and threaten capitalism.

  4. 4:10
    Personal Anecdotes and Host Banter

    Hosts share light‑hearted stories and jokes before diving into the main topic.

  5. 9:23
    Ray Madoff’s Academic Path and Motivation

    Ray recounts her journey from philosophy to law and her interest in tax policy.

  6. 14:00
    Evolution of the U.S. Tax System

    Hosts trace the development of income, estate, and gift taxes from the Civil War to the 1980s.

  7. 17:19
    Historical Tax Loopholes and Wealth Accumulation

    Ray details how early tax codes allowed the rich to avoid paying, creating an American aristocracy.

  8. 38:41
    Current Inequities in the Tax Code

    Ray explains how the modern tax system exempts wealth transfers while taxing ordinary income.

  9. 40:08
    The Decline of the Estate Tax

    Ray discusses the political campaigns that weakened the estate tax and the rise of loopholes.

  10. 48:27
    Future Directions and Call to Action

    Ray outlines potential reforms and urges public awareness to protect capitalism from tax evasion.

  11. 49:56
    Leaked IRS Returns Reveal Low Effective Tax Rates

    Review of ProPublica’s leaked returns showing billionaires paying near-zero tax rates and the mechanics of their avoidance.

  12. 51:41
    Payroll Taxes and the Hidden Burden on Workers

    Explanation of payroll taxes, their hidden nature, and how they disproportionately affect the working class.

  13. 57:00
    Borrowing Against Wealth: The Ellison Example

    Illustration of how billionaires like Larry Ellison use stock as collateral to acquire massive loans without paying taxes.

  14. 1:08:00
    California’s Wealth Tax Proposal and State Funding Gaps

    Discussion of California’s attempt to tax wealth, its challenges, and the impact on state revenue and federal policy.

  15. 1:12:00
    Debating a National Wealth Tax and Constitutional Concerns

    Exploration of the feasibility, political obstacles, and constitutional issues surrounding a national wealth tax.

  16. 1:16:00
    Closing Thoughts on Tax Reform and the Future of Capitalism

    Final reflections on the need for tax system overhaul, the role of wealth taxes, and the broader implications for capitalism.

  17. 1:22:31
    Step‑Up in Basis and Estate Tax Loopholes

    Analysis of how step‑up in basis allows heirs to inherit wealth tax‑free and the broader estate tax evasion strategies.

  18. 1:35:34
    Debating Billionaires’ Tax Contributions

    The hosts discuss how wealthy individuals avoid paying taxes and the fairness of the tax system.

  19. 1:37:31
    Estate Planning and Will Complexities

    The hosts discuss the intricacies of estate planning, wills, and how wealth is distributed among heirs.

Highlights

  • 18:17

    The Second Estate Origininsight

    The guest explains how the book's title originates from pre-revolutionary France, where the aristocracy was explicitly written out of the tax system, drawing a parallel to modern America.

  • 21:30

    Closing Tax Sheltersdata

    The guest details how the 1986 tax reform under Reagan successfully closed passive-loss loopholes that high-income earners previously used to avoid taxes.

  • 41:07

    Anti-Estate Tax Campaignstory

    The guest explains how 18 of the country's richest families funded a 1990 campaign to turn public opinion against the estate tax.

  • 56:54

    Borrowing Against Stockstrategy

    The guest explains the mechanism of how billionaires like Larry Ellison use stock holdings as collateral to secure massive, tax-free loans.

  • 1:00:58

    Life Insurance Loopholeinsight

    The guest highlights life insurance as a major scam that allows massive sums of money to be handed down completely tax-free.

  • 1:15:37

    The Rise of Stock Buybacksdata

    The guest recounts how a 1982 SEC rule change permitted companies to buy back their own shares, transforming the stock market trajectory.

  • 1:27:10

    California Wealth Tax Debatedebate

    The guest discusses why California is driven to propose a wealth tax due to federal erosion of state tax bases.

Quotes

  • “The public doesn't know that the rich have been written out of the tax system.”
    Unnamed speaker · 19:33
  • “The estate tax was very non-controversial. Congress used to do its job keeping it up.”
    Unnamed speaker · 40:08
  • “The number has gone way, way down of estate tax returns.”
    Unnamed speaker · 48:09
  • “Taxes serve to legitimate a capitalist system when it's working right.”
    Unnamed speaker · 34:26
  • “The Second Estate: How the Tax Code Made an American Aristocracy.”
    Dax Shepard · 1:02
  • “They can pass anything he says in his campaign”
    Unnamed speaker · 48:49
  • “He keeps it in the books.”
    Unnamed speaker · 49:00
  • “people would wonder, wait, wait, I don't understand.”
    Unnamed speaker · 49:15
  • “They are doing zero dot grats, and all these different things, that'll be too boring to explain”
    Unnamed speaker · 1:20:57
  • “The fact that Jeff Bezos claimed the child tax credit, which is what it showed, feels wrong.”
    Unnamed speaker · 1:35:52
  • Quince 1:50–2:18
  • YouTube Premium 3:33–3:59
  • Allstate 29:15–29:55
  • Superhuman 31:26–33:39
  • Peloton 1:06:38–1:06:55
  • Service Now 2:01:17–2:02:00

About this episode

Ray Madoff (The Second Estate, Immortality and the Law, Practical Guide to Estate Planning) is a Boston College law professor, author, and tax-policy expert. Ray joins Armchair Expert to discuss being a proudly mediocre high school student, reluctantly trading philosophy for law school, and becoming a terrible Wall Street tax lawyer who loved teaching. Ray and Dax talk about America’s return to a pre-revolutionary aristocracy, how “salaries are for suckers” among the ultrawealthy, and why $50 trillion in wealth yielded only $28 billion in estate tax. Ray explains why high earners and wealth holders aren’t the same, how fair taxation could rescue capitalism, and why the problem is the system and not billionaires themselves. Thank you to our presenting partner Lilly. Lilly’s Foundayo™(orforglipron). Advertisement Disclaimer: Please see Indications and Safety Summary with Warnings for Foundayo™(orforglipron) at https://www.foundayo.lilly.com/risk Start your 2 month free trial today: https://youtube.com/premium . Terms Apply. Cancel Anytime. Check Allstate first for a quote that could save you hundreds: https://www.allstate.com/ See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Transcript

0:00
2:26:23

29,131 words · 7 speakers

Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.

Topics

  • Boston
  • The Second Estate: How the Tax Code Made an American Aristocracy
  • New York
  • Newton
  • Boston College Law School
  • Beach Plum Inn
  • Kensington State Park
  • Martha's Vineyard
  • Newport

Page updated · transcript and summary are machine-generated