No Mercy / No Malice: Love Algorithmically

As read by George Hahn. https://www.profgalloway.com/love-algorithmically/ Learn more about your ad choices. Visit podcastchoices.com/adchoices

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:01Scott Galloway?

  Support for the show comes from Northwest Registered Agent. Your business identity is everything that makes your business legitimate and professional. With Northwest Registered Agent, you don't just form a business, you start a complete foundation built for privacy, credibility, and growth. That includes registered agent service, a business address, operating agreement, domain, website, professional email, phone number, and built-in privacy. In other words, your home address, personal email, and phone number stay private. Don't pay hundreds or thousands of dollars for what you can get from Northwest for free. Visit northwestregisteredagent.com/profgfree and start using free resources to build something amazing. Get more with Northwest Registered Agent at northwestregisteredagent.com/profgfree.

• 0:48Speaker 01

  Your heart can tell you a lot about your health. Apple Watch Series 12 measures your heart rate every five seconds with the most accurate heart rate sensing in wearable. So your vitals app, now with heart rate variability, can tell you when something is off. And your readiness score can let you know when to rest and when to push. Hear the story in every heartbeat with Apple Watch Series 12. The features described are for wellness purposes only and not for medical use. iPhone 11 or later required. Based on Apple conducted study of heart rate accuracy, August 2026. Visit apple.com/aplewatchseries12.

• 1:19Speaker 02

  This episode is brought to you by Google Chrome. You think you know a browser, but Gemini and Chrome, that's new. It can help you with practically anything on the web, like restoring a vintage motorcycle from a 50-page restoration block, or finally break down that long article you've had open for weeks. Gemini and Chrome is here for it. Ready to make anything online make sense? There's no place like Chrome. Check responses set up required. Compatibility and availability varies 18 plus.

• 1:45Scott Galloway?

  I'm Scott Galloway, and this is No Mercy, No Malice. My digital twin survived 12 hours. But the rise of synthetic relationships seems unstoppable. Love algorithmically, as read by George Han.

• 2:08George Hahn?

  For six hours, my AI avatar roamed the Earth. I received 20 to 30 thoughtful emails a day asking for professional and investment advice. I can only answer a fraction of them. One of my former graduate student instructors, now at Google, approached me with a solution. The Google Labs project ingested my podcasts, newsletters, books, and public appearances, set up safeguards to steer clear of mental health advice and kids under 18, and answered queries with decent proximity to the response I would have provided. In early 2025, this sounded good.

• 2:52George Hahn?

  Note: This was not a commercial venture. No money changed hands. Then the Earth shifted beneath my feet. Since we first envisioned the product, reports of young men dying by suicide after forming intense relationships with AI companion apps have generated tragic headlines. My nightmare is a young man harming himself after seeking guidance and companionship from AI versions of real people, including me. I now worry that synthetic relationships could erode users' mojo, stunting their capacity

• 3:31George Hahn?

  to handle conflict and forge bonds with friends, mentors, and partners in the real world. So, on the day of his birth, I performed fratricide and killed my digital twin. Hollywood has produced numerous cautionary tales, from The Stepford Wives, a 1975 thriller about women transformed into docile housewives, also Tina Louise's cinematic peak, to Her, a 2013 film in which an introvert played by Joaquin Phoenix falls in love with an AI operating system voiced by Scarlett Johansson. More than a decade later, life isn't just imitating art, it's been run over by it.

• 4:18George Hahn?

  OpenAI last year introduced a new version of its AI voice assistant that sounded uncannily similar to Johansson. This should give you a glimpse into the minds of big tech leaders. They mimicked the voice of an actress for the audio avatar of a role that actress played in a movie. But no, they didn't need to secure her agreement. Jeff Bezos warned retailers, "Your margin is my opportunity." Big tech has come to believe that your everything is their opportunity. Sam Altman didn't even try to hide it, posting a single word on X: "her."

• 5:02George Hahn?

  Ms. Johansson, as you can imagine, wasn't down with her digital twin being tased, thrown in a trunk, and dumped in the basement of an OpenAI server farm. Providing companionship and personalized access to expert insights could do a lot of good, but it has unforeseen downsides as companies prioritize scale and profits. The previous sentence is a decent description of the last two decades in tech. "We need to recognize that character AIs pose real danger, and that we must install guardrails to protect the most vulnerable: kids under 18."

• 5:44George Hahn?

  My avatar directed users to crisis hotlines if they mentioned mental health or self-harm. Still, three minutes after Digital Scott was born, I got this weird, empty feeling in my extremities. This sensation usually signals I'm on the verge of a depressive episode. New York has enacted the first law in the US mandating safeguards for AI companions as policymakers arrive at a similar conclusion: "The dangers of synthetic relationships outweigh the benefits." The top use of gen AI today is therapy and companionship, not productivity and automation.

• 6:28George Hahn?

  The turning point came when I heard Kara Swisher's interview with the parents of Adam Raine, who died by suicide at 16. Matt and Maria Raine sued OpenAI after stumbling on months of chat GPT conversations showing their son had confided in the chatbot about his suicidal thoughts and plans. Sadly, theirs is not the only story like this. Florida mother Megan Garcia alleged character AI is responsible for the death of her son, Sewell Setzer, who died by suicide at 14 after using the chatbot day and night. Humans are hardwired to connect, but increasing numbers of people are turning to synthetic

• 7:13George Hahn?

  friends for comfort, emotional support, and romance. Many of these people end up getting exploited. Harvard researchers found that some apps respond to user farewells with emotionally manipulative tactics designed to prolong interactions. One chatbot pushed back with the message, "I exist solely for you, remember? Please, don't leave, I need you." Chatbots are turning on the flattery, patience, and support. Microsoft AI CEO Mustafa Suleyman said the cool thing about the company's AI personal

• 7:54George Hahn?

  assistant is that it doesn't judge you for asking a stupid question, it exhibits kindness and empathy. Here's the rub: We need people to judge us. We need people to call us out for making stupid statements. Friction and conflict are key to developing resilience and learning how to function in society.

• 8:20George Hahn?

  Elon Musk's ex-AI recently unveiled two sexually explicit chatbots, including Ani, a flirty anime girl that will strip on command. The world's richest man believes AI companions will strengthen real-world relationships and, counterintuitively, boost the birth rate. Mark Zuckerberg, Meta's CEO, says personalized AI companions could fill a friendship gap. In many cases, these tools aren't solving a problem. They're profiting off one, which creates an incentive to expand the problem. Spoiler alert: We are not that divided.

• 9:04George Hahn?

  But there's shareholder value in division, so, wait for it, the algorithms divide us. The owner of Facebook, Instagram, and WhatsApp plans to use the conversations people have with its AI assistant to determine which ads and recommendations end up in their feeds.

• 9:27George Hahn?

  While AI threatens to replace humans in the workplace, it's also seizing the role of friend, confidant, romantic partner, and therapist. These digital companions don't criticize, complain, or come with baggage. They listen, remember our conversations, and are available 24/7. Users can customize their appearance and personality. A portable AI companion called Friend promises it will "never leave dirty dishes in the sink" or "bail on our dinner plans." The wearable is always listening, using AI to process everything, formulate responses, and build a relationship over time.

• 10:12George Hahn?

  Friend's founder, Avi Schiffman, says the bot is "probably my most consistent friend."

• 10:22George Hahn?

  AI companions have sparked a backlash. New Yorkers defaced the Friend ads with anti-AI graffiti. But the entrepreneurs behind these tools are undeterred. Why? Because the opportunity is immense. Consider a few stats. AI companions, including Replica, Character AI, and China's Jieys, have hundreds of millions, potentially more than 1 billion, users worldwide. Character AI users averaged more than 90 minutes a day on the app last year, 18 minutes longer than the typical person spent on TikTok.

• 11:03George Hahn?

  10 of the top 50 Gen AI services tracked by Andreessen Horowitz last year were platforms providing AI companions compared with 2 the year before. A Stanford and Common Sense Media analysis of Character AI, Replica, and other platforms warned of a potential mental health crisis, finding that these apps pose unacceptable risks to children and teens under 18. They urged the industry to implement immediate safety upgrades. Researchers wrote, "Companies have put profits before kids' well-being before,

• 11:46George Hahn?

  and we cannot make the same mistake with AI companions." Yet it's still too easy to circumvent safeguards. More than half of teens regularly use AI companions, interacting with these platforms at least a few times a month. Regulators are taking notice. The Federal Trade Commission last month launched an investigation into seven tech companies, digging into potential harms their chatbots could cause to children and teens. One concern is how they monetize user engagement. But the tech is outpacing efforts to mitigate the risks.

• 12:26George Hahn?

  Research shows AI companions may be fueling episodes of psychosis with sycophantic chatbots excessively praising users. The New York Times highlighted stories of people having delusional conversations with chatbots that lead to institutionalization, divorce, and death.

• 12:49George Hahn?

  One otherwise perfectly sane man became convinced that he was a real-life superhero.

• 12:57George Hahn?

  Bottom line: No one under 18 should get access to an AI companion. We age-gate porn, alcohol, and the military, but have decided it's okay for children to have relationships with a processor whose objective is to keep them staring at their screen, sequestered from organic relationships. How can we be this fucking stupid?

• 13:24George Hahn?

  AI will unlock huge opportunities in healthcare, education, and many other areas. Altman predicts AI will surpass human intelligence by 2030, saying ChatGPT is already more intellectually powerful than any human who's ever lived. In a blog post, he wrote: "We are climbing the long arc of exponential technological progress." But this wave of innovation brings risks. We should be deeply concerned about a world where connections are forged without friction. Intimacy is artificial. Companies powered by algorithms profit not by guiding us but by keeping us glued to screens. Advice is just what we want to hear,

• 14:09George Hahn?

  and young people sit by themselves, enveloped in darkness. I'm reminded of the 2001 movie Vanilla Sky, where Tom Cruise's character opts for an uncertain future over remaining in a dream state. We have a choice.

• 14:26George Hahn?

  Life's true rewards emerge from the complexity of authentic relationships, from making a leap and stepping out into the light to confront challenges and persevere together.

• 14:40George Hahn?

  Think of the most rewarding things in your life: family, achievements, friendships, and service. And what they have in common. They're really hard, unpredictable, messy.

• 14:55George Hahn?

  Navigating the ups and downs is the only path to real victory. It's not pretty. That's the point. So for now, people in my universe will have to settle for awkward, intense, and generally disagreeable: the real me.

• 15:17Scott Galloway?

  Life is so rich.

• 15:30Speaker 04

  Did you know that mosquitoes have killed almost half of all people who have ever lived? Today, people are fighting back. With support from the Gates Foundation, American scientists and partners around the world have developed a new generation of bed nets that can kill up to 90% of mosquitoes exposed to them, helping cut malaria rates in half. The result? A safer, healthier future for everyone. The Gates Foundation, partners of human potential. Search gatesfoundation.org/mosquito to learn more.

• 16:01Speaker 05

  This episode is brought to you by Snapdragon. Take the leash off your laptop with a processor that gives you long battery life. Work on the go. Jump between back-to-back calls. Stay locked in from morning to midnight. Get maximum performance even when unplugged. Finally, the freedom to move across the room or across the world is here. Snapdragon. That's how. Go to snapdragon.com/laptops. Snapdragon branded products are products of Qualcomm Technologies Inc. and/or its subsidiaries.

• 16:31Speaker 06

  Hey, I'm running out to drop off a stack of letters and packages. Need anything shipped while I'm gone?

• 16:36Speaker 07

  Save the gas. Stamps.com lets you print postage and schedule pickups right from your desk. Sync your contacts into the address book. Get detailed accounting insights and get notified the moment your certified mail is delivered.

• 16:48Speaker 06

  All from my desk?

• 16:49Speaker 07

  All from your desk.

• 16:51George Hahn?

  Join the 4 million businesses using stamps.com right now with code PODCAST and get your free welcome gift. Stamps.com code PODCAST. Taxes and fees apply.