Multi-Agent AI, Open Protocols & Startup Acceleration with Saurabh Tiwary | AI Basics

In this episode, Jason dives deep into the future of multi-agent systems with Saurabh Tiwary, VP & GM of Cloud AI at Google. They explore how teams of AI agents—not just single models—can collaborate to solve complex problems, helping startups scale faster with fewer resources. Saurabh introduces Google Cloud's open frameworks: Agent Development Kit (ADK) for building flexible, debuggable agents Agent-to-Agent (A2A) Protocol, now part of the Linux Foundation The emerging Multi-Agent Collaboration Protocol, enabling AI systems to work across platforms and organizations They also discuss: Why AI agents are evolving from task-doers to decision-makers How multimodal inputs (text, image, video, voice) will supercharge agent capabilities Why openness and interoperability will define the next era of AI infrastructure * Timestamps: (0:00) Jason introduces Saurabh Tiwary, VP & GM of Cloud AI at Google, and sets the stage for a deep dive on autonomous agents. (1:09) What is an AI Agent Today? (2:54) When Will Agents Actually Work?l (6:30) Inside Google's ADK (Agent Development Kit) (8:35l) Agent-to-Agent Protocol & Open AI Standards (11:35 ) Why Human-in-the-Loop Still Matters (13:41) What's Next: Multimodal Agents & Real Startup Use Cases * Google Cloud Report: "The Future of AI: Perspectives for Startups" Free download → https://goo.gle/futureofai Google Cloud Homepage https://cloud.google.com/ Google Cloud: Agent Development Kit (ADK) https://developers.googleblog.com/en/agent-development-kit-easy-to-build-multi-agent-applications/ https://cloud.google.com/vertex-ai/generative-ai/docs/agent-development-kit/quickstart Agent-to-Agent (A2A) Protocol by Google https://developers.googleblog.com/en/a2a-a-new-era-of-agent-interoperability/ Linux Foundation: A2A Protocol Overview https://www.linuxfoundation.org/press/linux-foundation-launches-the-agent2agent-protocol-project-to-enable-secure-intelligent-communication-between-ai-agents Google Research: AI Agents & Multi-Agent Systems https://research.google/blog/accelerating-scientific-breakthroughs-with-an-ai-co-scientist/ https://cloud.google.com/transform/ai-agents-evolving-with-google-agentspace Google's Agentspace https://cloud.google.com/products/agentspace?hl=en Google's Vertex AI Agent Builder https://cloud.google.com/products/agent-builder?hl=en Watch more AI Basics episodes https://thisweekinstartups.com/basics * Follow Saurabh: X: https://x.com/saurkt LinkedIn: https://www.linkedin.com/in/saurabh-tiwary/ * Follow Jason: X: https://twitter.com/Jason LinkedIn: https://www.linkedin.com/in/jasoncalacanis * Follow TWiST: Twitter: https://twitter.com/TWiStartups YouTube: https://www.youtube.com/thisweekin Instagram: https://www.instagram.com/thisweekinstartups TikTok: https://www.tiktok.com/@thisweekinstartups Substack: https://twistartups.substack.com

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:04Jason Calacanis?

  All right, everybody. Welcome back to another episode of AI Basics. Doing this in partnership with our friends over at Google Cloud. Go check out their report, "The Future of AI: Perspective for Startups." It features insights from 23 leading voices in AI, and it's available to you for free at goo.gle/futureofai. And today, we're excited to welcome Sorab Torwari. He is the VP and General Manager of Cloud AI at Google. Sorab leads Cloud AI products like Vertex, Kaggle, and the agent development stack. And his team works closely with DeepMind to bring AI research into production.

• 0:46Jason Calacanis?

  All right, Sorab, it is a crazy time for AI. Thanks for taking a break.

• 0:51Speaker 01

  No, thanks. Thanks for having me, and really nice to be here on the podcast.

• 0:56Jason Calacanis?

  My lord, have you ever seen a pace like this in our industry?

• 0:59Speaker 01

  I mean, it is crazy. It has been crazy for quite some time now. I guess you probably feel it as well, that the pace of things happening is accelerating, if you can imagine that.

• 1:09Jason Calacanis?

  Which is really the crazy part of it. We see all this amazing innovation over the last two or three years as AI becomes available to a broader group of individuals, whether it's consumers, business executives, consultants, and of course, developers and people building products. And I think today, really good idea to talk about agents.

• 1:30Speaker 01

  Yep.

• 1:31Jason Calacanis?

  Everybody's been obsessed for a couple of years now with chatting and prompting, but agents promise a much different future. Maybe you could explain to the audience what the paradigm shift is between a chatroom and talking to an LLM, doing deep research, all these great features, versus having an agent and setting up an agent?

• 1:52Speaker 01

  Yeah, sure. So I think even the definition of agents has been shifting as the technology has been improving. It's kind of like the shifting goalpost, kind of a thing. People earlier were like, "I will wrap LLM with a prompt, and that becomes my agent." Then there were things like workflows where you have predictable outcomes, and you were kind of like codifying it through LLMs. That became agents. And now I think we are at a point where we are basically asking...

• 2:21Speaker 01

  These agents to make indeterminate tasks, right? Meaning, take a set of actions, look at the output, based on that, define what the next sort of set of actions should be. And so that leads to very interesting possibilities. If you can imagine in this abstract kind of way, like, for example, oh, look at my email, see if there is something important. The definition of important is a little bit vague and broad. Pick those important emails, see what tasks are assigned, try to do those tasks, etc. Just as an example over there.

• 2:54Jason Calacanis?

  When does that future arrive? When do we go into, you know, open our email box and see, hey, by the way, overnight, you had seven emails, two of them were critical, and here's some research, we prepared a reply for you, and here are the tasks that we've already delegated. One of the tasks went to the sales team, another went to customer support, and another one went to operations and finance. When will we start to see that future emerge in your mind?

• 3:21Speaker 01

  So I feel some of the early foundations are already being laid right away. Things are happening. What is happening is, and particularly for these ambiguous tasks, as models keep on improving, what needs to happen is that these tasks need to be done at high enough level of quality, because otherwise you or I am not going to delegate these really, really important tasks to those agents, right?

• 3:44Jason Calacanis?

  Yeah.

• 3:45Speaker 01

  And so as the quality of the foundation models is improving, we are now seeing these bits and pieces getting connected, and that's why all this excitement about agents, that we are going from one step task to two steps and three steps and four steps and so on. And so those things are actually happening. There are products, for example, we have something called Agent Space, which is our enterprise offering, where we are actually building these type of automations.

• 4:11Jason Calacanis?

  And so what are the precursors that you need to make this work and to trust it? So is there a step that you see organizations doing?

• 4:23Jason Calacanis?

  You know, in order to build trust that the agent is going to do the right thing.

• 4:28Speaker 01

  So I think at the end of the day, it boils down to quality. Meaning if you are executing or calling that agent to do certain tasks, how often does it finish, right? And let's say the accuracy is like 50% or so. It's like it's correct one out of two times, not a, not a great.

• 4:44Jason Calacanis?

  Not good enough.

• 4:45Speaker 01

  Thing. Once you go into a territory of like 80, 90% accuracy, that's when things start getting interesting. Another thing that we are observing from our customers is that the ambition of our customers is also increasing. So let's say you have a two-step task and you can get to 80 or 90%. Then people want to add a bit more complexity and a bit more complexity and so on and so forth. Right? So I think agents will continue to evolve in terms of what they are doing and their capabilities and to this full-on ambition. When we talk about in social media or in other places about like, what should agents do of the, of the future do? But I think some of those basic steps are already being taken. A lot of companies are already deploying agents into production environments today.

• 5:28Jason Calacanis?

  We're starting to do it ourselves internally. When, when a founder sends us an update and they say, hey, here's what's going on in my startup. As investors, we have to read that update. Yeah. Sometimes they, you know, organize it really concisely. Hey, here's our growth. Here's our runway. Here's our spend. Here's the number of employees. Here's the open positions. Other times it's just rambling, right? And we don't have the authority or ability to say, oh, fill out a form.

• 5:51Speaker 01

  Yeah.

• 5:51Jason Calacanis?

  Uh, when they send an update. So now we have AI look at it and then normalize and say, hey, here are the data points in there. Here are the ones that aren't in there. Now we don't have it reply and say, hey, you're missing your cash on hand. You're missing, you know, February's revenue. But it will be able, it can now tell us what's missing so that we can save that step. And I would say arguably that saves us 15 to 30 minutes and increases our accuracy. But we're still not ready to have it go back and talk to the founder.

• 6:20Speaker 01

  Yeah, yeah, yeah. As the quality of these agents improve, right? We would start having a little bit more confidence as we, as we go along. And then we start delegating more and more tasks to the, to the agents.

• 6:30Jason Calacanis?

  All right. Now to do this, uh, there's going to need to be infrastructure. I know you guys are working on this ADK. Maybe explain ADK and then agent-to-agent protocols, because in this situation that I described of reading a founder's update and then saying, hey, we're missing a couple of pieces of data here that we could use. On the other side, if that was an email exchange or a Slack exchange, you know, iMessage, it could come any number of ways, the founder could have an agent who says, hey, yeah, we got that information for you. It's right here. So maybe we could talk about those two things, ADK and then A2A, the agent-to-agent protocol.

• 7:07Speaker 01

  Yeah, so ADK is our open source framework for building agents. What we believe is, and it's actually open source in the sense that you can go download it, do whatever you want with it in terms of building multi-agent systems using ADK. It has a lot of nice properties like debuggability, as I was mentioning, quality is really important. And so when founders or developers are building agents, they need to ensure they have the right tools for tracing of like how the conversation goes, debuggability, latency, stuff like that. So it has a lot of tools within the agent development kit itself, or ADK stands for agent development kit, so within itself to help build agents. It is not tied to Google per se. So you can

• 7:50Speaker 01

  take an agent built on ADK, use any LLM of your choice, any large language model of your choice, and you can run it in any cloud or within your on-prem environment as well, right? So it's a fully open agent development kit. Similarly, we have this agent-to-agent protocol, and this is where what we, our thought process was that, yes, we have this agent development kit through which developers or founders can go build agents. But at the end of the day, there will be many, many different platforms, frameworks on which people will be building agents. And we can't just hope that everyone converges to this ADK format, for example, even though we prefer that and we would like people to, but I don't

• 8:32Speaker 01

  think that's practical to assume everyone will be. And so here, what we did was we built this A2A or agent-to-agent protocol, so that if you have fully functioning agents that you might have pre-built, whether using LLMs or whether using traditional rule-based systems, the agent-to-agent protocol can help you talk across agents. So that now, if you think about the multi-agent Kind of ambition that we have where you have many task specific agents and you can call them on demand to do certain things. You can do it in a very interoperable way, independent of where those agents have been built, how they have been built and on what platform are they running.

• 9:10Jason Calacanis?

  Yeah, and this protocol, it's very new. Yeah, we're in year one of this, I think.

• 9:14Speaker 01

  Uh, I mean, we announced it at Cloud Next, the, the growth has been stupendous. Uh, Cloud Next was in March of this year.

• 9:23Jason Calacanis?

  Oh, so we're in three months into this.

• 9:25Speaker 01

  Yeah, actually, April, April of this year. So it's like month two, when we announced we had about fifty to sixty partners, uh, different companies who are supporting this protocol. Now that number has grown to about hundred and twenty. Just yesterday, we donated the A two A protocol to the Linux Foundation. So that it has a completely open governance body in terms of building and adding new features into the protocol. And almost, I think, all the hyperscalers, all the major companies, ServiceNow, Salesforce, Microsoft, Amazon. They are all part of supporting and, and, and they have put in their weight behind the agent to agent protocol.

• 10:02Jason Calacanis?

  And this is critical. If we can get the entire ecosystem to support a standard. Then if, in this hypothetical example, I don't know, we have a billing agent. That goes and checks invoices and which ones have been paid, which ones haven't been paid. It could ping Salesforce and say, well, who's the account executive here? Let's let them know that this hasn't been paid. And then who's the customer and who's the support person at that customer? Let's ask their agent to check. Hey, has invoice number one, two, three, four, five, six, seven been paid or not? Do you have that? It could go back and say, yes, it's been sent. Okay, then we could escalate that call ticket. And these are things that would be done by humans, right?

• 10:40Speaker 01

  Yeah.

• 10:40Jason Calacanis?

  These are chores that humans really don't like to do. Nobody likes to look up stuff. I mean, in the old days, you'd have to send somebody down to, I don't know, the files in the, in the basement to go find the invoice, pull it, bring it upstairs. And there was a run who did that. It, it, the equivalent here is, I think, pretty clear. Clerical work. Chores, they're going to go away and that frees up humans to do whatever the actual business of that business is, the more important high order bits, yeah?

• 11:08Speaker 01

  Yeah, yeah, completely makes sense. And actually, we are already, I mean, to your, it's very interesting, like, we are actually working with SAP for some of these procurement related agents and working with Microsoft so that we can have an orchestration of agents across these different very highly tactical or precise agents, right, which understand that particular domain really, really well and can execute really well at high enough quality and do these higher level tasks on top of them.

• 11:35Jason Calacanis?

  And there'll have to be some permissions here. So there's a whole layer of permissions that will need to be granted. You know, just like if you invited somebody to collaborate in a workspace or a document, if you're using a Google Sheet, you might invite somebody from another organization to it. And you approve it, this will have to happen between the procurement departments and the billing departments between companies. But they're not going to be sending money. That's in the future. And if they do, a human would be in the loop. So maybe you could talk a little bit about the concept of human in the loop here. And is that part of the standard where it says, hey, you know what? This seems important. Human in the loop time.

• 12:13Speaker 01

  Yeah, we, we actually both within the ADK as well as in the, so the A two A protocol just talks about the protocol of like two agents talking to each other and how do you register? The agent development kit actually has capabilities for human in the loop, right? So that you can intervene, you can have function calls or an interrupt where a human can jump in, give feedback that it's okay to proceed. But the, but the point that you are raising is really important, right? Like, security, like, if we envision this view of where agents are going, right? We are providing them a lot of capabilities to go and do and execute tasks on our behalf. Now, almost the way I think about it is almost all the challenges that were there in

• 12:54Speaker 01

  the app ecosystem on Play Store or App Store. You have similar kind of issues, right? With meaning you submit code, you check and you make sure that the apps are doing the right things or not. And also when you install it on the phone, you have permissions and so on, right? Kind of similar kind of issues will pop up over here with respect to all the different agents which are there whom should you trust versus not, while also giving them what kind of controls or ability to make changes do you want to provide them, right? Because even if it is a trustable one, an agent, you don't want it to, I don't know, change the password of an employee, for example, and stuff like that.

• 13:32Jason Calacanis?

  Yeah, we don't want a changing password. You don't need to change the passwords. You don't need to change people's social security numbers. In fact, you don't even need to look at that. We'll keep it a high level. When we're looking at this system a year or two from now, what will success look like for you and for the standard? What will success look like? What will common tasks that will be have been accomplished? And then what do you think is going to take more time?

• 13:56Speaker 01

  I mean, as I said, like this will be a journey. I think in terms of the complexity of the task, definitely this example that we said about like an SAP agent or a ServiceNow agent orchestrating across multiple different things and doing complex tasks, I think those are going to happen. Multimodality will become very, very powerful.

• 14:18Jason Calacanis?

  Explain what that means for folks, yeah?

• 14:20Speaker 01

  Yeah, so multimodality, meaning right now, a lot of like when we talk to these LLMs, generally people think about text-based operation, right? You type something, you get something back, right? Multimodality is where you have speech, image, video, text, all coming in into the model and the model is able to reason on top of it. So for example, when a receipt is submitted for expense approval, does it look like a receipt? Or is it actually just a set of numbers which are submitted as an example, right? That you are just processing text as an example. So multimodality, I feel, will be a very, very powerful construct and the models are already capable and we are already seeing some progress along that domain. So the effectiveness of the agents will become much more stronger.

• 15:07Speaker 01

  As we leverage multimodality.

• 15:09Jason Calacanis?

  Yeah, we saw it a couple of years ago where different sales training software started to incorporate AI, started listening to, you know, video conferences and then coaching people. Hey,

• 15:21Speaker 01

  Yeah.

• 15:22Jason Calacanis?

  You know, this other agent or this other account executive was doing a great job asking these questions. You might want to incorporate those and to have an agent then go correlate. Hey, here were five calls with potential partners, customers. These three actually followed through and bought the product. These two didn't. We're going to look back on the phone calls and the emails and we ping Gmail, we ping Google Meets or Zoom and we put all that together. Here's why we think we lost that customer. Or here's the customer support calls. Here's the tone of their voice and the despair they had and the frustration they had with, you know, your solution. Again, back to multimodal here. It could be fascinating to be putting these data sets together

• 16:07Jason Calacanis?

  and then just getting coaching. The coaching piece of it to me is so interesting.

• 16:11Speaker 01

  Yeah, actually, I will share an example, like one of our customers, Shopify. They actually are leveraging multimodality for their customers who are setting up storefronts. And they have their dashboard, right? The admin dashboard that they have for setting up the storefront. Now it has lots of buttons and so on. And if someone who is like new to it may be stuck into, how do I change the price or do something else? Add a new product or something? What they are doing is they are sharing that dashboard as part of the agentic workflow with the LLM. It is able to look at the screen of the of the user and say, well, click that button, not not that one, the one next to it and stuff like that, right? So that becomes really, really powerful.

• 16:53Jason Calacanis?

  It reminds me of my early days in tech support where I had somebody on the phone when I was in PC support in the late 80s, early 90s. And I said, okay, you know, we're installing this on Windows. Just click any key. And the woman said to me, I see a spacebar, I see a control key, I see an enter key, I don't see an any key. And I said, oh, that means you can pick the key of your choice. Like, so let's hit the spacebar. And she said, that's incredibly frustrating. If you want to be to click the any key, why don't you have a key marked any? And I said, you're a hundred percent right. But just coaching on those things, watching the path in which a customer navigates your store, and then finding out where they're frustrated, or on the backend where they're trying to figure out,

• 17:37Jason Calacanis?

  how do I find taxes and file my taxes? It's going to be incredible for engagement on these products. And then even getting to the product development team. Hey, by the way, these are the three times. And here are the paths where customers are most frustrated with your product.

• 17:54Speaker 01

  Yeah.

• 17:54Jason Calacanis?

  And here's how to fix them. And then eventually, hey, let's talk to the UX agent. Let's talk to the developer agent, have them suggest a fix. And then human in a loop it, somebody puts the bug fix in. I mean, can you imagine the world we're going to be living in in 18 months?

• 18:09Speaker 01

  Yeah, yeah, yeah. No, this is, I mean, and we are moving along that particular direction right away.

• 18:14Jason Calacanis?

  I just love this idea. So I saw somebody had connected. I'm not sure which programs it was, but you know, a co pilot for a developer with either Figma or Canva or something. And the two of them started talking to each other and had to build a lot of glue to make this happen. And they're, this is pre standards. But they got the two of them talking to each other where Figma started or Canva started designing a website. The coder started building it and they were going back and forth, essentially talking to each other.

• 18:43Speaker 01

  Yeah.

• 18:44Jason Calacanis?

  And that you could just watch them work. Pretty interesting.

• 18:46Speaker 01

  Yeah. If you think about it, like the progress that we make is because of the iterative design or iterative work that we do. Right? And if we can provide that capability to agents and provide that agency to them, right? It opens up just new opportunities.

• 19:00Jason Calacanis?

  All right, listen, this is incredible. Google's an amazing partner. Thank you so much for coming on, Saurabh. For more insights, check out Google Cloud's The Future of AI: Perspectives for Startups. Tons of predictions, real world examples and startup advice from 23 AI leaders. Get some great ideas in there, some great techniques, some tactics, some strategy. G O O dot G L E slash future of AI to read the full report. Thanks again for listening. Go to thisweekinstartups.com slash basics to see all our basics. We got legal basics up there. We got accounting basics and now we've added AI basics because this is the fundamental feature that's going to drive startups and commerce and our lives over the next decade. Thanks so much for joining us and we'll see you next time.

• 19:45Speaker 01

  Yeah, thank you.