AI Agents & the Future of Work with LangChain's Harrison Chase | AI Basics with Google Cloud

In this episode: Jason sits down with Harrison Chase, CEO of LangChain, to explore how AI-powered agents are transforming the way startups operate. They discuss the shift from traditional entry-level roles to AI-driven automation, the importance of human-in-the-loop systems, and the future of AI-powered assistants in business. Harrison shares insights on how companies like Replit, Klarna, and GitLab are leveraging AI agents to streamline operations, plus a look ahead at what's next for AI-driven workflows. Brought to you in partnership with Google Cloud. * Timestamps: (0:00) Introduction to Startup Basics series & Importance of AI in startups(2:04) Partnership with Google Cloud & Introducing Harrison Chase from Langchain(4:38) Evolution of entry-level jobs & Examples of AI agents in startups(8:00) Challenges & Future of AI agents in startups(14:24) AI agents in collaborative spaces & Non-developers creating AI agents(18:40) Closing remarks and where to learn more * Uncover more valuable insights from AI leaders in Google Cloud's 'Future of AI: Perspectives for Startups' report. Discover what 23 AI industry leaders think about the future of AI—and how it impacts your business. Read their perspectives here: https://goo.gle/futureofai * Check out all of the Startup Basics episodes here: https://thisweekinstartups.com/basics Check out Google Cloud: https://cloud.google.com/ Check out LangChain: https://www.langchain.com/ * Follow Harrison: LinkedIn: https://www.linkedin.com/in/harrison-chase-961287118/ X: https://x.com/hwchase17 * Follow Jason: X: https://twitter.com/Jason LinkedIn: https://www.linkedin.com/in/jasoncalacanis * Follow TWiST: Twitter: https://twitter.com/TWiStartups YouTube: https://www.youtube.com/thisweekin Instagram: https://www.instagram.com/thisweekinstartups TikTok: https://www.tiktok.com/@thisweekinstartups Substack: https://twistartups.substack.com

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:04Jason Calacanis?

  All right, everybody. Welcome back to Startup Basics. This week in startups.com/basics is the URL where you can find these videos and the series that we've been doing for over five years now. What do we do in Startup Basics? We look at things that founders, you know, need to get right and that they might make a mistake on sometimes, or they might not know about an opportunity. That's why we call it the basics. Legal with our friends over at Wilson Sensini. We do accounting with our friends over at Cruise. And we're really excited because one of the basics you have to get right today is AI. Every startup I see, whether they're an AI startup or not, they're using AI to run their companies.

• 0:47Jason Calacanis?

  And one of the topics we talk about here on This Week in Startups all the time is static team size. A lot of folks are sticking with five or 10 or 100 people at their startup. And instead of hiring people and just running up the headcount, they're deciding, hey, maybe I could automate stuff. Maybe I can use AI to figure things out. And so it is now one of the best practices that you got to get right. Just like you got to get your legal, just like you got to get your accounting right, you got to get your AI right inside your startups. Don't I know it? When people email us their decks and they apply for funding from us, you know what we do? Zip, zip, zip. People didn't know this. I don't want to say because I'm gatekeeping here.

• 1:29Jason Calacanis?

  One of the things we do is we send all that information to Gemini. I don't know if you know Google's really amazing large language model and service. And then Gemini spits out this great report based on our criteria and this analysis of the startup. So we can just read that short summary based on all the information we have. And you know what? I have some researchers and analysts who write short summaries and I get the Gemini one. Think the Gemini one's a little better, I'm totally honest, than the humans. Then the humans can go do more important work. So there's like one example for you of how, you know, this stuff is impacting everything. And we're so excited. We have a partnership with Google Cloud for this series. They just published an amazing report. It's titled "The Future of AI Perspectives for Startups."

• 2:12Jason Calacanis?

  Hey, that is really on brand and on target for us. So what are we going to do here on this series? In other series, we would have one guest and maybe we do four or five topics. Here, we have so many great opportunities to have a rotation of guests on who are building important tools in AI and, uh, you know, who are friends at Google may or may not have partnerships with. And today, we're very lucky to have Harrison Chase, the CEO of LangChain, on the program. They provide a framework for building and designing an LLM of your own, which sounds like something, Harrison, I need for maybe startups and pitch decks. Welcome to the program, Harrison.

• 2:51Speaker 01

  Thanks for having me. It's great to be here.

• 2:53Jason Calacanis?

  Tell me a little bit about LangChain and then let's get right into it. What do you think startup founders should be thinking about when it comes to using AI inside their companies to get an advantage, to save money and to create better products?

• 3:07Speaker 01

  Yeah, the, the types of applications that we see people building, they're starting to be ones that do the work of what humans would do in the past. So if they're kind of like functions inside a company that you would hire, what I like to say, a smart intern to do, um, those are now functions that can kind of be automated by some of these AI systems. So for example, with inside LangChain, we have a few places we use this. I have an email assistant that helps respond to all my emails. We have a customer support bot that helps with some of the customer support issues. We have a marketing bot and, uh, we have a, uh, SDR bot. And so all these are places where we'd hire maybe like in the past, an entry level intern, an entry level person and, and, you know, because we build tools, we like to dog food them. And so we're dog fooding our own tools by trying to automate some of these processes away.

• 3:51Jason Calacanis?

  And the interesting thing about this dog fooding you're doing is the positions you talk about are not positions people want to stay in for a career. They're entry level. They're the first rung of a career ladder. And you know what? There used to be, when I was coming up, I'm a Gen Xer, you're like, uh, I think you're Gen Z or millennial or Gen Z, correct?

• 4:11Speaker 01

  Millennial, millennial.

• 4:12Jason Calacanis?

  You're millennial? Okay, great. You're Team Millennial. No judgments there. You know, Gen X, we're like the last free range generation. We're a little crazy on the margins. But when I was coming up, The reception desk, working in the mailroom, working in the typing pool, working as a runner, which is basically somebody who would run packages of paper around. Those were the entry level jobs. You know what happened to those jobs, Harrison? Email, the internet. You didn't need a receptionist. You put technology in the front. People badged in, they pressed a number and whatever, somebody came and got them. You didn't need all of humans doing those. And now we have another series of them that are entry level jobs. SDR is a super fascinating one. Sales development rep.

• 4:56Jason Calacanis?

  A sales development rep, for folks who don't know, they find leads. They get those leads, they warm them up perhaps, and then they hand them off to an account executive, a salesperson, in plain English. Tell us a little about about the agent that you've created for the SDR role. What do they do? And how well does it work? And how long have you been deploying your SDR agent?

• 5:18Speaker 01

  That's probably one of the newer ones. Basically, what it does is we get a lot of inbound leads. It does some research on who the people are. And it actually drafts an email to them if it thinks they're interesting. So it does, it's, you know, it uses the reasoning of the models to determine whether it's kind of like an interesting prospect for us. It does some research on events that have happened to their company recently. And then it will draft an email. And notably, for all of these positions, you're absolutely right that they're kind of like entry level positions. But I want to call out that we have a sales team. We have a head of customer support. We have a product marketer. It's not like we're eliminating these functions completely. It's rather like these are doing some of the parts of the job that people don't want to do. They're not the creative part. They're not the kind of like the value add part.

• 6:00Speaker 01

  And then they're hooking in, they're communicating with the kind of like the experts when needed. So when it drafts an email, we have a human in the loop that will go in and kind of like approve the email or something like that. So these, these like, you know, we have, we have a really good sales team. I think they can go in and basically talk to this junior intern and say, no, this is the wrong email, like, don't send it to these types of people in the future. So there's still this human in the loop component. I think that's really important for enabling a lot of these applications.

• 6:26Jason Calacanis?

  I think this is critically important at this stage in 2025 when we're recording this because. We do see on the margins a hallucination here or there. And you don't want to have a hallucinated mistake in an outbound email to a prospective customer, nor do you want it to make a mistake and say, this person doesn't need the product. We're not going to email them. So I like this, you know, taking those emails that are outbound, maybe putting them in the, you know, in your drafts box. You take a look at those 10, you just read them. Okay, maybe we shouldn't talk about, I don't know, it pulls their high school or something and mentions their high school in the email. And that's like the super important part.

• 7:07Jason Calacanis?

  Human in a loop, reinforcement learning is a very important piece of this as well. Because over time, you know, these things could take on more and more work. Maybe, you know, you look up, hey, this person's company has 10 employees. This other person has 10,000. Maybe the one with 10,000, we should just book a Zoom. The person with 10 people, hey, maybe it's okay to send that one automated. You know, and it could depend on what you're doing there. How hard is it to create these agents? And then are there situations where these agents have, you know, gotten a little bit out of control? Maybe they jumped the fence? How do you protect against that? Because that's everybody's concern, right? They may not say it to you, but people are like, oh, my God, I don't want an agent to go wild.

• 7:51Jason Calacanis?

  Just like back in the day, we wouldn't want somebody to spam, you know, and send 100 accidental emails. Could be embarrassing, could be annoying to our partners and customers.

• 8:00Speaker 01

  Well, that's exactly why the human in the loop stuff is so important. And I'll get to that after I answer your first question. I mean, we still see that it's still, it's still pretty hard to create these agents. So we build developer tooling to help people build these agents. We see that most of these agents are still being created by developers. There's a lot of integrations to figure out. There's a lot of what we call kind of like the cognitive architecture of the agent, like what information is it looking at? How is it processing that information? It's still a lot of work to get these agents to work. And the ones that we see working, some of the ones that have been built with our tools, Replit, LinkedIn, Uber, Klarna, GitLab, these are like vertical agents. They're not like fully autonomous ones. They're vertical ones doing kind of like, you know, specific domain tasks.

• 8:43Speaker 01

  And then for the, for the question around how do you keep these on the rails? This is, this is why the human in the loop stuff is super important as well. And I think there's two, there's two big benefits to human in the loop. One is what you talked about, like it keeps them. In check. It basically doesn't let them go off the rails. You have people not at every step. Like, I think part of the benefit of having agents running in the background is you don't have to be involved at every step. You can be involved at the most important step. So, for example, like, you can be involved right before an email is sent, because that's more important than before a Google search is done. Like, you know, it's kind of like a read versus write operation. So, it's more, you put them in at kind of like the crucial steps where it actually could do things that would not be good. But the second underrated part of human in the loop is what you were talking a little bit about earlier, is basically

• 9:27Speaker 01

  aligning the agents with what you want them to do. So, when they first start working, there's probably some prompt. And that prompt is, you know, like, I have, like, I think I'm relatively good at prompting. I wrote the prompt for my email assistant. I still forgot a ton of edge cases about who I would want to respond to, or what emails I would want to ignore, just like, didn't come to mind as I was writing that prompt. And I don't, I don't think it's realistic to ever write like a perfect prompt right off the go. And so, this human in the loop helps you kind of like, if you set up the proper kind of like, systems, it helps you update that prompt and update those instructions and basically align these agents with what you actually want them to do. And so, I think there's two really important benefits to human in the loop.

• 10:07Jason Calacanis?

  Well, let's talk about where this will be next year. So, we're referring to AI as interns. And we probably referred to AI three years ago, you know, as, if you're a member in Gmail, you know, would guess the next word. And then it was like, guess the next two words. You know, we were kind of in that nascent phase. If you said, hey, I'd love to invite you, say, "to", then it said, "to lunch", and then it said, "to lunch to discuss", and whatever, you get the idea. And now, here we are, saying, hey, read my email, and draft something, put it there. Where will we be next year? And then the

• 10:46Jason Calacanis?

  year after. So, let's talk about 2026, 2027. If these agents do a good job in 2025, hey, they go from being interns, maybe, you know, they get the full-time job, entry-level job, maybe to the next job. And of course, we're giving this a caveat of, this is the exoskeleton. If you think about this like an Iron Man suit. You still need to have humans at your company, but they're going to be able to take the grunt work, have AI do it, or do 80% of it. You're going to get those superpowers, as it were, right? So maybe talk about what your predictions are for 26 and 27.

• 11:19Speaker 01

  Yeah, I'd say within a year, we'll probably still have, still have interns, they'll just be smarter. I think the models will get better. I think we'll get a little bit better at hooking them up to systems, but I think they'll still be kind of like smarter interns. And after that, I think there's like two, two kind of like steps that will happen. One is this like memory component. So interacting with these agents and having them learn from, from your feedback. I think that'll be really important for aligning them because it doesn't matter how smart the intern is if it doesn't know how you like to do things at your company. Like you have, if you can write down a standard operating procedure for the role, that's fantastic. And we don't have that for all roles. And I don't think it's realistic to ask that, but people do pick up those, those processes that they should be following through memory.

• 12:04Speaker 01

  That's what we do as humans. So I think that'll be something that we start to work on probably towards 2027. And then I think the other thing will be right now, these interns are pretty independent. They just work by themselves. So the agents I talked about, like Replit has its agent. That's pretty separate from Klarna's customer support agent. What happens when these start being able to talk to each other and hand off things? And so multi-agent systems are probably something that will also pop up in like 2027.

• 12:29Jason Calacanis?

  Ooh, multi-agent. So you got the SDR, you know, processing the inbound leads, drafting the emails, and then you're going to have a CRM agent cleaning up the database over there and saying, hey, we just updated everything over here about our customer. And let's say that customer was, I don't know, McDonald's or Starbucks. And it's like, oh, if you see anything from Starbucks or McDonald's on the inbound, please.

• 13:00Jason Calacanis?

  Take the account executive listed in our Salesforce HubSpot, whatever, and check with them first, or CC them, or put it in their outbox. Wow, that's kind of dope when you start thinking about how these things might work together. It could become really interesting. When will they be sort of working next to you? I've always envisioned like these things having a bit of a persona. Maybe we give it a name. Hey, this is Jay Cal, my SDR. And you know, this is Harrison, or this is Chase, my, you know, CRM manager. And they keep the database up to date. Be kind of cool if they were like in the Slack, or they were in your Teams,

• 13:43Jason Calacanis?

  or sitting in a little window here while we're on this Zoom call. And maybe listening in, contributing on the margins. Hey, you know, I was on the sales stand up. We heard you talking about Starbucks. And so we wrote a little update on the latest news from Starbucks. There's a new CEO. Here's what's going on there. So we just took the liberty of writing a dossier to educate everybody. And then we did a quiz where we quizzed all the sales team who are associated and the customer support people on the history of Starbucks. So they know they have a little bit of small talking banter they can do. Why aren't they hanging out with us yet? And when will they hang and be like peers in these spaces?

• 14:24Speaker 01

  So we call our customer support bot Carl, and Carl hangs out in our Slack.

• 14:28Jason Calacanis?

  Oh, he cars in the Slack now?

• 14:30Speaker 01

  Carl's in the Slack, yeah.

• 14:31Jason Calacanis?

  He's not sending dank memes, right? You talked to him about the dank memes. Do not send dank memes. Don't bring up politics at work. Tell him we're focused. That's when you know we hit the singularity.

• 14:43Jason Calacanis?

  Carl starts sharing memes.

• 14:45Speaker 01

  Carl's the only one that's in the Slack. So there's four. Carl's the only one that's in the Slack. Why is that the case? I think like the big thing, or a big thing to figure out is like what these human agent interaction patterns look like. And I think we have some ideas. And I think the idea of treating them as like a coworker in Slack or Teams or something like that makes a lot of sense, but it's still really early. And so I think, I think one of the best spaces that companies can be spending time is thinking about what is this like human agent collaboration pattern look like? If you look at like a lot of the companies that have kind of taken off, I mean, Like ChatGPT, ChatGPT changed the UX that we use to interact with LLMs. You know, turned it into a chatbot, like doesn't seem like a big thing now, but like that was a change in the UX.

• 15:30Speaker 01

  I think Cursor for Coding has done a fantastic job at nailing the UX for developers in the IDE.

• 15:37Jason Calacanis?

  Or Google Search has the snippet up top, and I have to say,

• 15:39Speaker 01

  Exactly.

• 15:41Jason Calacanis?

  That changed my behavior really, because now I get, my behavior was, you know, bifurcating. Okay, I want to walk and do a chat interface on an LLM sometimes, and other times I kind of like the presentation of, let's say, Google Flights, or Google Local, or Shopping. Like, there's like a lot of like intricate things that Google provides, Maps, et cetera, images. And now you kind of have both, and so that's become super powerful. Sometimes I go to do a search and the snippet up top, or whatever they call that. It used to be called the one box snippet. I don't know what they call the little chat window up there, but boy, is that helpful because you get both. And I was wondering when they would do that because that would take a lot of servers.

• 16:23Jason Calacanis?

  But yeah, I do believe the UX is going to be quite interesting. A final question for you. You used to have to hire a developer to do anything and maybe a script kitty on the margins or whatever. Now I'm seeing a lot of people using, you know, pick a platform, Notion, Code, Slack, and then they use something like Zapier, or if this, then that, kind of glue some workflow together. And I think some of those other products are starting to add a little bit of workflow here on the margins. You know, simple stuff. But when will a non-developer be able to do the coding for agents? Because we are seeing, you know, in the startup community, I've had three or four startups come to me with no developer,

• 17:06Jason Calacanis?

  and they built MVPs, and I'm like, well, that's pretty impressive. So can they, do you have that on your roadmap, English? Language agent creation, is it on your roadmap at LangChain?

• 17:17Speaker 01

  I think it's not super close on our roadmap. The agents that we see being built that are the most like intern-like, they're all built by pretty strong kind of like developer teams. So, so Replet has a very strong developer team. GitLab does as well. Klarna does as well. And I think the reason for this is, is a few fold. One, I think the best practices for building these agents is still super early on. Like LLMs have really only been a thing for, in the public's mind for about two years. And agents for maybe like a year. And so we're still figuring out what the best practices are. And so there's a lot of control that you want to be able to have. And then another big part is giving these systems access to all the, you know, other systems that exist within a company.

• 17:59Speaker 01

  And this is very heavy on integrations and, and that's a place where there's a lot of need for coding and data engineering at the moment. So at the moment, to be honest, I'm a little bit skeptical that we'll see that anytime soon. Most of the, most of the, most impressive agents we see are being built by strong developer teams still.

• 18:15Jason Calacanis?

  Small price to pay, good use of developer hours to make an agent that then, you know, takes out, I don't know, if it's like two hours a day and you're working 50 weeks a year, times five, you know, you're talking about 500 hours. One of the nice things too is these things can be working 24/7. That's why they're agents and they're running in the background. So I think it's like a super fascinating concept. So well done. Where can people find out more about your company if they want to use your solution?

• 18:44Speaker 01

  You can find us at langchain.com or on Twitter or LinkedIn.

• 18:48Jason Calacanis?

  Awesome. Everybody go check out LangChain and see if that's the tool right for you. If you want to save, you know, a couple thousand hours of work every year in the intern jobs and not have interns doing grunt work, have them do something more interesting in your company. All right. Thank you to Harrison Chase for joining us here on the AI Basic Series on This Week in Startups. You can see all the This Week in Startups Basic Series at thisweekinstartups.com. It's a long URL, I know, slash basics. And if you want to check out Google Cloud's awesome, the future of AI perspectives for startups. Report, go to G O O dot G L E slash future of AI. That'll be in the show notes as well for predictions, real world examples,

• 19:32Jason Calacanis?

  and tons of startup advice. Once again, the URL, you can write it down right now. G O O dot G L E slash future of AI. No spaces and dashes in future of AI. Discover what all these AI leaders have to say about the future of AI and its impact on your business. Thanks again for listening and we will see you next time on this week in startups. Bye bye.