Skip to content

Managing AI Agents Is Just Like Managing A New Employee | Kristie Jones - 2047

The Sales Evangelist

32m
Transcript

Original podcast

Summary

Written by a model from the transcript; not yet reviewed.

Sales leaders and sellers must adapt to managing hybrid teams of humans and AI agents, according to Kristie Jones on the Sales Evangelist Podcast hosted by Donald C. Kelly. Jones argues that business adoption of AI suffers from freeze mode due to constant tool updates, and she emphasizes that sales leadership now requires moving from the pilot seat into a control tower to oversee complex systems rather than just individuals. The conversation outlines how to build and manage agents similarly to training new employees with clear role briefs and output evaluations. This episode offers valuable strategies for integrating AI note-takers, workflow automation, and custom research agents into daily sales operations.

  • Update existing playbooks and processes before attempting to automate tasks with AI. 13:26
  • Adopt an AI note-taker immediately if your company does not currently use one. 14:17
  • Build a custom agent or project to automate routine tasks like compiling weekly to-do lists. 15:02
  • Create formal written role briefs for AI agents that outline their responsibilities and limitations. 19:24

Chapters

  1. 0:00
    Podcast Introduction and Sponsorships

    The host opens the episode, introduces sponsors, and sets the stage for the discussion on AI in sales.

  2. 1:53
    AI’s Impact on Sales Roles

    The conversation shifts to how AI is changing sales jobs, addressing fears and opportunities for efficiency.

  3. 2:25
    Christie Jones’ AI Adoption Philosophy

    Christie explains her approach to integrating AI, emphasizing training, fluency, and system design.

  4. 4:16
    Managing Hybrid Human‑AI Teams

    The hosts discuss the challenges of leading teams that include both humans and AI agents, highlighting the need for new leadership skills.

  5. 8:34
    Ensuring AI Alignment and Trust

    The dialogue focuses on creating role briefs, monitoring outputs, and maintaining human oversight over AI decisions.

  6. 13:17
    Practical Steps to Build an AI Agent

    Christie walks through reviewing playbooks, identifying automatable tasks, and creating simple agents using Claude and HubSpot.

Highlights

  • 5:31

    AI Adoption Lags Behind Hypeinsight

    Despite widespread talk about artificial intelligence, actual business adoption is lagging because many professionals suffer from freeze mode while waiting for technology to stabilize.

  • 7:44

    Managing Hybrid Sales Teamsinsight

    Sales leaders are no longer managing just humans, but entire systems combining human workers, automation, and AI agents without prior training for this structure.

  • 9:20

    From Pilot to Control Towerstrategy

    Sales management requires moving from being an individual pilot to sitting in a control tower to get a 360-degree view of the entire automated system.

  • 10:47

    Treating Agents Like Toddlersstory

    Building and managing an AI agent requires the same approach as raising a toddler, setting clear boundaries like no touch to ensure safety and accuracy.

  • 19:17

    Defining Agent Role Briefsstrategy

    Instead of traditional job descriptions, companies should create formal role briefs for AI agents outlining their decisions, workflows, and accuracy checks.

  • 20:18

    AI Solves Problems Aggressivelyinsight

    AI agents are built to be problem solvers and may create problems to solve when none exist, never asking for human opinions while doing so.

  • 26:28

    Prompt Literacy Deficienciesdata

    Many organizations claim to be AI-forward during interviews yet fail to provide basic prompt writing or literacy training during employee onboarding.

Quotes

  • “Playbooks are not dead. People still need playbooks, processes, frameworks, all the things.”
    Unnamed speaker · 13:48
  • “The role brief is, again, a formalized written document for every one of your agents that outlines what their role is, what decisions they can make, what they can't make, what the outcome should look like, who owns managing that workflow?”
    Unnamed speaker · 19:24
  • “Go make a mistake. So go pick a tool if your company hasn't. Go pick ChatGPT or Claude. If you're a ChatGPT user, then go build a custom GPT.”
    Unnamed speaker · 29:39
  • HubSpot 0:00–0:44
  • LinkedIn Sales Navigator 0:46–1:26
  • Blue Mango Studios 1:28–1:42
  • Mistakes That Made Me 11:54–13:00
  • LinkedIn Sales Navigator 21:03–22:12
  • Blue Mango Studios 22:52–23:06

About this episode

Kristie Jones treats her AI agent like a four year old. Not as an insult, as a management strategy. The same way she taught her son "no touch" before he understood why, she's learned that agents need boundaries, check-ins, and correction, just like any new hire. Kristie https://www.linkedin.com/in/kristiekjones, founder of Sales Acceleration Group and author of the upcoming book The Sales Leadership Gap: Leading Humans in an AI Augmented World, walked me through what it actually looks like to lead a sales team that's now part human, part automation, and part AI agent. Why Most Sales Teams Are Only Talking About AI, Not Using It Kristie's blunt read on the market: sales leaders are talking a good game on AI adoption, but very few are actually walking it. She calls the hesitation "freeze mode," people waiting for the technology to settle down before they commit to anything. Her pushback: the pace of AI isn't going to slow down, so waiting for the dust to settle just means a competitor gets the head start instead. From Pilot to Control Tower: Managing a Hybrid Team Kristie's analogy for what's changed: sales leaders used to be the pilot, flying the plane directly. Now the job is running the control tower. A modern sales team isn't just a group of humans anymore. It's humans, automation, and AI agents all working together, and leading that requires a 360-degree view no single seat inside the plane can give you. She hasn't seen a single sales leadership course that actually teaches this. Most leaders are being asked to figure it out on their own, in real time, while still being expected to hit quota. Treat Your Agent Like a New Employee (or a Four-Year-Old) Kristie's favorite framing, borrowed from someone else: manage your agent the way you'd manage a toddler, with simple, repeated boundaries, like teaching a child "no touch," some for safety and some just to prevent a mess. Building an agent isn't a "set it and forget it" project. Just like a new hire, it needs a handbook, but it also needs regular check-ins, since no handbook covers every exception. If your business is changing, and it always is, an agent that never gets revisited will quietly drift out of step with how your team actually works. Trust But Verify Kristie built an agent that reviews her AI notetaker every Friday at 4pm and delivers her to-do list by day. The first Friday it was supposed to run, it didn't. Her response mirrored exactly how she'd handle a new employee's mistake: no anger, just a direct conversation about what happened and how to prevent it next time. Her rule going forward: trust the agent to do the work, but verify the output regularly, the same discipline she'd apply to any new hire still earning full independence. Where to Start: Update Your Playbook Before You Automate It Kristie pushes back hard on the idea that sales playbooks are dead. They're not, but most of them are badly out of date, built once and handed to new hires without ever being revisited. Her recommended first step for any leader building agents: go back to the actual playbook, confirm it reflects how work really gets done today, then look at it again through a new lens, asking which of these tasks could be automated. Skipping this step means building automation around a process that's already wrong, which just makes the wrong process faster. Two Agents Kristie Actually Built Her first agent connects Claude Cowork to HubSpot, Granola (her AI notetaker), and Google. Every Friday at 4pm, it reviews her week's meetings and delivers a day-by-day to-do list of everything she committed to. Her second is a research agent, built to be extensive enough that she now teaches a class on building one at Sales Gravy University. Neither required a dedicated engineering team. She built both herself as a sales leader, which is exactly the point: if your company doesn't have a go-to-market engineer or enablement team, this becomes your job by default. Write a "Role Brief" for Every Agent Kristie's upcoming book outlines five leadership competencies and five AI competencies leaders will need, and one of the practical tools she recommends is what she calls a role brief. A role brief is a formal, written document for an agent, similar to a job description but for AI: what decisions it's allowed to make, what decisions always stay human, what the output should look like, and who owns checking it. Every agent a team builds should have one of these, the same way every human hire gets a real job description instead of a vague verbal understanding of the role. The Two Things That Make AI Dangerous If Left Unchecked First, AI is built to solve problems, which means if it can't find a real one, it may manufacture one to justify itself. Second, AI essentially never says it doesn't know, and it almost never asks for a leader's opinion. It delivers a confident answer even when the underlying accuracy is shaky. Both are reasons an agent can never be treated as fully autonomous. Someone still has to be checking the actual output, not just assuming the system is right because it sounds certain. We've Been Here Before: What the World Wide Web Panic Teaches Us Kristie points to the early internet as the closest historical parallel: people worried about losing control over where their information came from, the same fear now aimed at AI. Entire households once relied on a single printed encyclopedia set as the trusted source of information. That system eventually gave way, the same way old assumptions about static CRMs and manual workflows are giving way now. Her takeaway isn't to ignore the risk, but to recognize that fear of a major shift isn't new, and the companies that adapt early are the ones that come out ahead of it. What AI Fluency Actually Means Kristie is now asking about AI fluency directly in client hiring processes, and she defines it as a systems-level understanding of AI, not just knowing how to use one tool. That includes prompt literacy (can someone actually write a prompt that gets a useful result), output evaluation (how do you know if the agent's work is accurate or has quietly drifted), and tool selection (which AI platforms actually get adopted, standardized, and connected across the team). She's blunt with companies that call themselves "AI forward" but don't teach any of this during onboarding. Claiming the identity without building the actual skill doesn't hold up. Your First Step to Becoming AI Fluent Kristie's advice for any seller or leader who hasn't started: pick one tool, whether that's ChatGPT or Claude, and go build something small, like a custom GPT or a simple project. If you don't already use an AI notetaker, that's the bare minimum starting point, and she recommends having one in place within the week. Her closing advice is permission to fail: go make a mistake. Her own Friday agent didn't run the first time she built it, and that's a normal, expected part of learning the tool, not a sign it isn't worth doing. "I treat my agent like a four year old." — Kristie Jones Resources Connect with Kristie Jones on LinkedIn. https://www.linkedin.com/in/kristiekjonesVisit Kristie's site, Sales Acceleration Group. https://kristiekjones.com/Join our LinkedIn cohort and learn to prospect the right way. https://thesalesevangelist.com/linkedin-prospecting-course/Visit Blue Mango Studios for help creating podcast production content. https://bluemangostudios.com/ Credits As one of our podcast listeners, we value your opinion and always want to improve the quality of our show. Complete our two-minute survey here: thesalesevangelist.com/survey http://thesalesevangelist.com/survey. https://tsesales.typeform.com/to/lc5yAa8P We’d love for you to join us for our next episodes by tuning in on Apple Podcast https://podcasts.apple.com/us/podcast/the-sales-evangelist/id788738885, Google Podcast https://podcasts.google.com/feed/aHR0cDovL3RoZXNhbGVzZXZhbmdlbGlzdC5saWJzeW4uY29tL3Jzcw?sa=X&ved=2ahUKEwj5kaXI3Pj2AhVKcjABHW5PDVwQ9sEGegQIARAC, Stitcher https://www.stitcher.com/show/the-sales-evangelist-sales-trainingspeakingbusiness-marketingdonald, or Spotify https://open.spotify.com/show/1NjzsFjQwVrgboUfDvbzd5?si=LdQOJDc1T-WBPMxr1h3RsA. Audio provided by Free SFX, https://freesfx.co.uk/ Soundstripe https://soundstripe.com/, and Bensound http://www.bensound.com/. Other songs used in the episodes are as...

Transcript

0:00
32:48

6,745 words · 2 speakers

Topics

  • AI
  • Claude
  • AI note taker
  • Salesforce
  • ChatGPT
  • Granola
  • LinkedIn
  • Claude Co-Work
  • Perplexity
  • Sales Gravy University

Page updated · transcript and summary are machine-generated