The path towards trustworthy AI

Elham Tabassi, the Chief AI Advisor at the U. S. National Institute of Standards & Technology (NIST), joins Chris for an enlightening discussion about the path towards trustworthy AI. Together they explore NIST’s ‘AI Risk Management Framework’ (AI RMF) within the context of the White House’s ‘Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence’. Sponsors: Timescale https://www.timescale.com – Real-time analytics on Postgres, seriously fast. Over 3 million Timescale databases power loT, sensors, Al, dev tools, crypto, and finance apps — all on Postgres. Postgres, for everything. Retool https://retool.com/changelog – The low-code platform for developers to build internal tools — Some of the best teams out there trust Retool…Brex, Coinbase, Plaid, Doordash, LegalGenius, Amazon, Allbirds, Peloton, and so many more – the developers at these teams trust Retool as the platform to build their internal tools. Try it free at retool.com/changelog https://retool.com/changelogDeleteMe https://joindeleteme.com – DeleteMe makes it quick, easy and safe to remove your personal data online. Featuring: Elham Tabassi – Website https://en.wikipedia.org/wiki/Elham_Tabassi, LinkedIn https://www.linkedin.com/in/elham-tabassi-b5931b6Chris Benson – Website https://chrisbenson.com, GitHub https://github.com/chrisbenson, LinkedIn https://www.linkedin.com/in/chrisbenson, X https://x.com/chrisbensonShow Notes: Elham Tabassi | NIST https://www.nist.gov/people/elham-tabassiElham Tabassi | TIME 100 / AI https://time.com/collection/time100-ai/6310638/elham-tabassiNIST Trustworthy & Responsible AI Resource Center https://airc.nist.govNIST AI Risk Management Framework (AI RMF) https://www.nist.gov/itl/ai-risk-management-frameworkNIST Artificial Intelligence Risk Management Framework (AI RMF 1.0) (PDF) https://nvlpubs.nist.gov/nistpubs/ai/nist.ai.100-1.pdfNIST AI RMF Playbook https://www.nist.gov/itl/ai-risk-management-framework/nist-ai-rmf-playbookNIST AI RMF Development https://www.nist.gov/itl/ai-risk-management-framework/ai-rmf-developmentNIST AI Risk Management Framework - Engage https://www.nist.gov/itl/ai-risk-management-framework/ai-risk-management-framework-engageNIST Risk Management Framework Aims to Improve Trustworthiness of Artificial Intelligence https://www.nist.gov/news-events/news/2023/01/nist-risk-management-framework-aims-improve-trustworthiness-artificialWhite House Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligenceUpcoming Events: Register for upcoming webinars here https://practicalai.fm/webinars!

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:05Speaker 00

  Welcome to Practical AI. If you work in artificial intelligence, aspire to, or are curious how AI-related tech is changing the world, this is the show for you. Thank you to our partners at fly.io. Fly transforms containers into micro VMs that run on their hardware in 30-plus regions on six continents, so you can launch your app near your users. Learn more at fly.io.

• 0:35Speaker 00

  Okay, friends, I'm here with a new friend of ours over at Timescale Aftar, Suhithan. So Aftar, help me understand, what exactly is Timescale?

• 0:45Speaker 01

  So Timescale is a Postgres company. We build tools in the cloud and in the open source ecosystem that allow developers to do more with Postgres. So using it for things like time series analytics, and more recently, AI applications like RAG and Search and Agents.

• 0:59Speaker 00

  Okay, if our listeners were trying to get started with Postgres, Timescale, AI application development, what would you tell them? What's a good roadmap?

• 1:08Speaker 01

  If you're a developer out there, you're either getting task or building an AI application, or you're interested and you're seeing all the innovation going on in the space and want to get involved yourself. And the good news is that any developer today can become an AI engineer using tools that they already know and love. And so the work that we've been doing at Timescale with the PGAI project is allowing developers to build AI applications with the tools and with the database that they already know, and that being Postgres. What this means is that you can actually level up your career, you can build new interesting projects, you can add more skills without learning a whole new set of technologies. And the best part is, it's all open source, both PGAI and PGVectorScale

• 1:50Speaker 01

  are open source. You can go and spin it up on your local machine via Docker, follow one of the tutorials on the Timescale blog, build these cutting-edge applications like RAG and Search without having to learn 10 different new technologies and just using Postgres and the SQL query language that you probably already know and are familiar with. So yeah, that's it. Get started today. It's a PGAI project. And just go to any of the Timescale GitHub repos, either the PGAI one or the PGVectorScale one, and follow one of the tutorials to get started with becoming an AI engineer just using Postgres.

• 2:23Speaker 02

  Okay, just use Postgres and just use Postgres to get started with AI development, build RAG, search, AI agents, and it's all open source. Go to timescale.com/ai, play with PGAI, play with PG Vector Scale, all locally on your desktop. It's open source. Once again, timescale.com/ai.

• 3:04Chris Benson?

  Welcome to another episode of the Practical AI Podcast. I am Chris Benson. I am a Principal AI Research Engineer at Lockheed Martin. And unfortunately, my co-host Daniel is not with us today, but it is my pleasure to introduce Elham Tabassi, who is the Chief AI Advisor at NIST, which is the National Institute of Standards and Technology. Welcome to the show, Elham.

• 3:31Speaker 04

  Thanks for having me.

• 3:32Chris Benson?

  You guys are doing so much in this area in terms of AI and kind of setting the stage. And I was wondering, for those of us in the audience who may not be familiar with NIST, if you could kind of start out with just telling us a little bit about NIST, what you do both in AI and maybe outside to give a little context and give us a little intro into what NIST is doing in AI and your role in that.

• 4:01Speaker 04

  Yeah, happy to. NIST, or National Institute of Standards and Technology, is a non-regulatory agency under the Department of Commerce. NIST was established in 1902, and our mission has not changed since then. NIST's mission is to advance US innovation and industrial competitiveness. At NIST, we have a very broad portfolio of research, from building the most accurate atomic clock to modeling the behavior of the wildfire. But most importantly, we have a long tradition of cultivating trust in technology. We do that by advancing measurement science and standards, measurement science and standards that makes technology more reliable, secure, private, fair.

• 4:45Speaker 04

  In other words, more trustworthy. And that's exactly what we're doing in the space of AI. As I mentioned, NIST was established in nineteen oh one to fix the standards of weights and measures. Our predecessors created and advanced standards to measure basic things such as length, mass, temperature, I don't know, time, light, electricity, all those that were essential for technological innovation and competitiveness at the turn of the twentieth century. We are following the same course, working with and engaging the whole community in figuring out proper standards and measurement science for advanced technologies of our time, which is artificial intelligence.

• 5:27Speaker 04

  And then the way we do it is exactly, or maybe an improved version of what we have been doing in the past century or so. NIST's day-to-day work is focused on helping industry develop valid scientifically rigor methods. And one thing that I want to emphasize is that we do this through multi-stakeholder, open, transparent collaborations. While we have a lot of really good experts and expertise at NIST, we also know that we don't have all of the answer. And it's really important and vital for us to foster a consensus and buying across our stakeholder community. So what we do is that we listen and we engage. We get the input, we distill them down.

• 6:11Speaker 04

  We develop a path for measurement and to build up or bolster the scientific underpinning. And then we develop tools, guidelines, frameworks, metrics, standards, et cetera, to support industry and technology. And we have done that for development of the AI risk management framework. We have done that for quantum computing, for cybersecurity. And we are continuing doing that for improving methods and measures for risk management and trustworthiness of AI systems.

• 6:45Chris Benson?

  That's a great introduction. I'm curious, you know, you talked about a couple of things about collaboration. You seem to be right at the center, kind of, you know, sort of an interface between government interests in these technologies and the issues around them and industry. And I know you work with a number of different organizations as, you know, that NIST does in these different things that you've talked about. And you specifically called out trust. I was wondering if you could talk a little bit about kind of how those different collaborations work, how trust in technology can evolve? And how does NIST go about that process of starting to, you know, in AI and in other

• 7:30Chris Benson?

  adjacent technologies? How does it go about that process that it's been doing for so long?

• 7:35Speaker 04

  Yeah, thank you for that question. As I said, it's sort of, I think, the magic sauce for us to do stakeholder engagements, to work with the community and ask for their inputs, leverage the knowledge of the community and build on the really good works that the community has done. And by working with all of the experts, strengthen the scientific underpinning, building the right technical building blocks that are needed for development of scientifically valid guidelines and standards. In terms of the engagements, particularly in the space of the AI, we all know that AI

• 8:14Speaker 04

  is a multidisciplinary and in order to understand the concept of the trust, what make AI systems trustworthy and what constitute trust, that was one of the main questions as we were developing the AI risk management framework. And in the engagements that we were doing with the community, early on, we recognized that as much as we need the input from The community that developed the technology. This is the community with expertise in math, statistics, computer science. We also need input from the community that study the impact of the technology. That's economists, sociologists, psychologists, cognitive scientists.

• 8:59Speaker 04

  And we need to bring all of them together because AI systems are more than just data compute and algorithm. They are a complex interactions of data compute and algorithm with the human, with the environment, with the human that operates this, with the human that can impact, be impacted by the systems. So that engagements with a very broad set of actors in the community, bring different expertise and backgrounds, became really important. In the, answering your questions about the trust and what constitute the trust. As I said, that was one of the important and central questions in development of the AI RMF. The AI RMF or the AI risk management framework, very briefly.

• 9:42Speaker 04

  It was directed by a congressional mandate and it's a voluntary framework for managing the risk of AI in a flexible, structured and measurable way. It was, as we do with anything else, developed in close collaborations with AI community and engaging diverse groups of different backgrounds, expertise and perspective to particularly get in and focus and hone on the concept of trust and trustworthiness. So on the side of the, you know, trust, what makes AI systems trustworthy. When we started the process, there have been very good, high level, value-based documents that talk about AI systems to be non-discriminatory, ethical.

• 10:24Speaker 04

  And there has been a lot of different other papers and publications. Basically, there were many different views about what make an AI technology, AI systems trustworthy. And these views were not all aligned on the same page. So it's not a property that can be defined with perfect rigor, but based on the collaborations and engagements and consultations that we did with the community, we understood that there are well-established key characteristics of trustworthy systems. With the help and consultation with the community in the AI RMF describes trustworthy AI systems as those that are valid and reliable, accountable and transparent, safe.

• 11:09Speaker 04

  Secure and resilient, explainable and interpretable, privacy enhanced, and firm with harmful bias managed. It takes it a step further and for each of these characteristics, provide a sort of a definition or bring the community an assured understanding with expectation from each of these characteristics. And also talks about how these characteristics interrelate. And trade offs involved in decisions about how safe is safe, how private is private, or how to enhance interpretability or transparency, while at the same time, for example, preserving the privacy or ensuring the security and resilience of AI systems.

• 11:51Chris Benson?

  I'm curious, and as we go, we'll certainly dive into those topics. But one of the things around trust is, you know, folks like us who are in this industry and are living and working in and around and developing AI every day. You know, there's, these are kind of work topics that we're going through. And the guidance that NIST provides is invaluable, and especially being part of that process of developing. And as you described, but I would, before we surge into all that, there is so many people out there that are not in this line of work as we are. And that are those that are, you know, curious about how they see it in the news every day and they see, you know,

• 12:36Chris Benson?

  they're trying to understand what are these technologies that we're working on. And many people in the audience for this podcast are what we would describe as kind of AI curious as opposed to just, you know, we have practitioners. But we also have AI curious people who are trying to understand how it fits into them. And I was wondering if you'd take a moment and kind of talk about the context of trust and AI for those of us who are not in this industry in a direct way like that. And, you know, like, how does NIST try to frame it for the larger population? Or is it more for practitioners? How do you see that for the larger world?

• 13:13Speaker 04

  Yeah, thanks for that question. So let me try to answer that with an example. We are seeing enormous advancements in the AI technology. And just in the past year, we saw a lot of, you know, release of the powerful models. We are also seeing that these technology, this AI systems are being incorporated into a lot of the functions of of the society and our the way we do our work. I want to explain the the concept of the trust in an examples in use of the AI systems in health domain.

• 13:56Speaker 04

  When we go, you know, for medical imaging, I'm coming from the computer vision. That's where my training was, and that's where they feel they feel comfortable. So when we do a medical imaging, some imagine and some sort of imaging of the brain, and the question is, is it a tumor there or not? So an algorithm can go and be employed to help the physicians to make that decision. So first for that systems, for that algorithm, we wanted to be talking about AI or IMF trustworthiness characteristics. We want it to be valid and reliable. We want to make sure that it has some certain level of the accuracy.

• 14:39Speaker 04

  So the false positive and false negative is low because there is gonna be, you know, you don't wanna scare a patient saying that, yes, there was a tumor when it was there was none, or vice versa. A tumor is because of the errors of the systems is being is going unrecognized. So we want systems functions, functions as intended. We want it to be valid and results being reliable. On top of that, we also wanted the systems to be secure and resilient because if it's not, and if the systems get hacked, there's a lot of the personal informations that can get in the hand of non-friendly users. And talking about that, we want the systems to be privacy enhanced.

• 15:21Speaker 04

  We have heard, read that particularly the large language models, they they have the tendency to memorize the training data. Even before the large language model, there were papers that showed that with certain level of expertise, the training data can be inferred from AI systems. So if the system has been trained on real patient data, we don't want to have any hole that can give, you know, access to those private informations. Explainability and interpretability. So if it comes and say that, yes, there is a tumor, we expect it to give some reasoning, some sort of explanations of why decide that there is a tumor.

• 16:06Speaker 04

  And then there's a lot of nonsense there too, because that explanations, if it's been given to a physician versus a technician versus the patient, it's going to be different level of the technicality and different level of the informations being shared. And of course, we want it to be fair. We don't want AI systems that has been more accurate for certain demographics versus others. You know, this usually happens if the training data is uneven. So all of this, at the end, we want to build the confidence in this, that this technology works. And the results, predictions, recommendations

• 16:49Speaker 04

  that the system is providing for better decision making. In this case, analyzing a scanning of the brain to see if there was any tumor was there or not. So all of these things are with the end goal of AI. Technology has a lot of promises. They are very powerful tools. They can transform the way we work for better, but make sure that at the same time, it uplift all of us and we get the maximum benefits while minimizing the negative consequences of the technology.

• 17:40Speaker 02

  What's up friends? I'm here in the breaks with David Shu, founder and CEO of Retool. So David, Retool has definitely cornered the market on internal tool, software development. But zoom out for me, what's the big idea? Why did you start Retool? What is the big idea with internal software?

• 17:56Speaker 05

  Yeah, so Retool started at this point, seven years ago. And when we started Retool, the core idea was that internal software is a giant, giant category that no one really thinks about. And what's surprising to most people is that internal software represents something like 50% to 60% of all the code written in the world, which might sound pretty surprising. But if you think about it, most of us in Silicon Valley, we work at software companies, whether it's like an Airbnb, a Google, a Meta. These are all companies that are software companies selling software. And so most engineers in these companies are working on external facing software. But if you think about most software engineers in the world, most software engineers in the world actually don't work at these software companies.

• 18:41Speaker 05

  There's not that many of them, there's maybe 10, 20 of them, big ones at least. Most of the companies in the world are actually non-software companies. So if you think about a company like an LVMH, for example, like a Coca-Cola, for example, like a Zara. Zara's not selling any software, but they actually have a lot of software engineers, actually. And all their software engineers, all they do day in and day out is basically build internal software. So that's, I think, one reason we started Retool. The second reason we started Retool is if you look at all this internal software that people are building, it is remarkably similar. So if you take a look at, you know, like a Zara, for example, or a Coca-Cola, two very different companies, obviously, one a clothing company, one a beverage company. But if you actually look at the software they're building internally to go run their operations, it is remarkably similar.

• 19:25Speaker 05

  It's basically forms, buttons, tables, all these sort of pretty common building blocks, basically, that come together in different ways. But then if you think about, you know, not just the UI, but also what's the logic behind a lot of this stuff, they're pretty much just hitting API endpoints. databases, you care about authentication, you care about authorization. There are sort of a lot of common building blocks, if you will, to internal tools. And so for us, the insight was, wow, internal software is a ginormous category, and it's all so similar, and developers hate building it. And so could we create a sort of higher level framework, if you will, for building all this software? And that would be really cool.

• 20:04Speaker 02

  That would be really cool. Okay, so listeners, Retool is built for everyone, built for enterprise, built for scale, built for developers, and that's you. And if you found yourself nodding your head to what David was saying, then check out Retool at retool.com/changelog. It's the fastest way to build internal software. Do yourself a favor, get a demo or start for free today. Again, retool.com/changelog.

• 20:46Chris Benson?

  So I know in the early part of 2023, NIST issued the AI Risk Management Framework that we've been talking about. But a few months later on, or almost exactly a year ago as we're talking, in late October, the White House issued its executive order on the safe, secure, and trustworthy development and use of artificial intelligence. So I was wanting to understand that how the issue of the executive order might have either altered or accelerated or changed any of the work that NIST was already doing. You guys were already very much involved in artificial intelligence

• 21:30Chris Benson?

  through the framework and other activities. Could you describe the impact of the executive order on the work you were doing?

• 21:37Speaker 04

  Absolutely. In answering your question, if I can just go back from the release of the IRMF in January 2023 to release of the executive order, end of October, October 30th, 2023.

• 21:51Speaker 04

  So the AI RMF was released January twenty twenty three. In March of that year, we released the AI Resource Center. This is a one stop shop of knowledge, data tools for AI risk management. It houses AI RMF, its playbook in a interactive, searchable, filterable manner. And by the way, the AI Resource Center is definitely a work in progress and we want to keep adding to that and adding more additional capabilities, things such as Standards Hub, repository for metrics. We want it to be really a one stop shop of all of the informations, but also a place for engagements across the different experts.

• 22:33Speaker 04

  In June of twenty twenty three, just give a little bit of context. The ChatGPT three was released in November twenty twenty two, a month or so before release of AI RMF. And ChatGPT four was released in February or beginning of the March, a year after, a month after release of the AI RMF. So in response to all of these new development and advancement in technology, we put together a generative AI public working group, where more than two thousand volunteers help us study and understand the risk of the generative AI. And then in October, as you said, we receive our kind of our latest assignment,

• 23:18Speaker 04

  executive order on safe, secure and trustworthy AI. This executive order really builds on the foundation works that we have been doing, from the AI RMF to playbook to resource center to generative AI public working group, and supercharge our effort to cultivate trust in AI, mostly by giving us some tight timelines of the things that to deliver. The EO specifically directed NIST to develop evaluations, reteaming, safety and cybersecurity guidelines, facilitate development of consensus-based standards, and provide testing environment for evaluations of AI systems.

• 23:58Speaker 04

  All of these guidelines, infrastructures, true to the nature of NIST, will be a voluntary resource for use by the AI community to support trustworthy development and responsible use of AI. We approach delivering on the EO the same way that we do all of our work, going to the community, we put a request for information out to receive input. Based on the input that we receive, we put draft document out for public comment. Based on the comments that we received, we developed the final documents that we were very pleased that all of them were released by the deadline of July 26 that the EO had given us.

• 24:43Speaker 04

  And quickly, a quick overview of the things that we put out. One of them was a document on a profile of AI RMF for generative AI. The document number is, at NIST, we like to refer to everything with a number. So that document is the NIST AI 600-1. It's a cross-sectoral profile, companion resource to the AI risk management framework. Based on the input that we had and discussions that we had on the Generative AI Public Working Group, responses to the RFI and inputs that we have received. I think one main contribution of that document, if I want to summarize it, is its description

• 25:25Speaker 04

  of the risks that are novel or exacerbated by generative AI technologies. These risks span from CBRN information capabilities, ease access to synthesis of materially nefarious informations that can lead to design capabilities for CBRN, confabulation, dangerous, violent, hateful content, data privacy risks.

• 25:56Speaker 04

  Let me remember the rest. Environmental impact, bias, human AI configuration, information integrity, information security, intellectual property, degrading or abusive content, and the concept of the value chain and component integration. With the generative AI, we are moving from the binary deployer developer kind of actors and dynamics, and now we are having upstream of the third-party components, including data that are part of this value chain. So one of the things that we're working in continuing that work is to work with the

• 26:38Speaker 04

  community to get a better understanding of the technology stack, of AI stack, if you will, for AI, understand the role of the different AI actors involved there, so we can do a better risk management.

• 26:54Chris Benson?

  As you're talking about that, could you describe a little bit, and this is just a question in my mind, like, when we're talking about AI as risks, as a set of risks, and we talk about kind of that effort to create trust in technology, how do you tie those together? In the NIST process, you've identified these risks and you just enumerated those, and with the purpose of ultimately kind of helping people get to a point of trust and being able to implement the technologies productively, how do you approach getting to trust through mitigation of risk?

• 27:38Chris Benson?

  Does that, I'm not sure if the question makes sense or not.

• 27:41Speaker 04

  Certainly makes sense. I'll try to answer the way I understood this. So AI systems are not inherently bad or risky, and it's often the context that determines if a negative impact will occur, and also what are the risks. So example that I usually use is that if I use face recognition to unlock my phone versus face recognition as in the airport that now our faces are boarding pass to get on the plane. Or face recognition in the context of the law enforcement. It's the same technology, but in the different contexts.

• 28:20Speaker 04

  There is different risks and different level of the assurances that we want to have for the systems to work in a trustworthy manner. And so what we have been trying to do as part of our work in approaching trust and trustworthy AI. The first one was to unpack the concept. Try to get into the characteristics that make a system trustworthy. That helps to answer the question of what to measure. If I want to know if it's trustworthy or not, what are the measurements I need to do? So I listed the seven characteristics from valid and reliable, safe, secure, etc.

• 29:03Speaker 04

  So that gives a more of a systemic approach and a structured approach to what are the what are the dimensions, what are the characteristics that that together can make a system trustworthy. And by the way, AI RMF talk about this, that not each of them by itself make a system trustworthy. You can have a system that is very secure, but not valid or accurate. So that's not going to be trustworthy and a system that's hundred percent accurate, but not secure is also not trustworthy. So that gives again more structured approach on what to measure. Then the next step is how to measure, methods and metrics for the measurement.

• 29:46Speaker 04

  Those type of measurement gives an information about limits and capabilities of the systems, the type of the risk that can occur, the magnitude of the impact if those risks occur. And then based on this information, then we can come up with mitigations and management of the risks. So AI RMF is its recommendations is really categorized in the four functions of govern, map, measure and manage. The govern is giving recommendations on procedures and processes, roles and responsibilities that we want to have in an organizations to do effective risk management. So what is the accountability line, what are the role and responsibility involved?

• 30:31Speaker 04

  The MAP functions provides recommendations on understanding the context of the use, you know, going back to that examples of the face recognition, understanding the environment that AI systems are being operating there, understanding the community that can be impacted by that, identify the risks in this particular context, understanding the laws, regulations and policy that are effective in this context of use. The measure functions provides recommendations on the how to measure. So for all of the risks identified in the MAP measure, provides quantitative or qualitative recommendations on how to measure them, how to take into account the trade off between all of those

• 31:14Speaker 04

  trustworthiness characteristics and all of these informations being used during the managing the risk part that can, the recommendations can go from safeguards and mitigations that can put in place to mitigate risk. To sometimes we cannot just mitigate risk and the risk should either be accepted or transferred or the systems is to risk it that it should not be developed or deployed. So that is how the process in AI RMM.

• 31:54Speaker 02

  There's a lot of your personal data out there on the internet and you know this. Anyone can see this stuff. There's more than you think, though. Your name, your contact info, your social security number, your home address, your various addresses, your past addresses. There's even information about your family members, maybe even the name of your cat. This is all being compiled by data brokers and is being sold. Now, these data brokers, they make a profit off your data, obviously. That's why they do it. Your data is a commodity and anyone on the web can buy your private details. They can identity theft you, they can fish you, they can attempt to fish you, they can harass you, they can send you unwanted spam, they can call you nonstop. And this is something I get lots.

• 32:36Speaker 02

  But now you're able to protect your privacy online with Delete Me. As a person who exists publicly for some time now, especially someone who shares their opinions online quite frequently, I'm aware, hyper-aware of safety and security, and I take it seriously. And it's easier than ever to find personal information about anyone online, really. All this data is just hanging out on the internet and can have actual consequences in the real world. That's why I was excited about finding this recent solution. And as sponsor of this show, DeleteMe. DeleteMe is a subscription service that removes your personal information from hundreds of data brokers online. When you sign up, you can provide DeleteMe with exactly what information you want deleted, and their experts take it from there.

• 33:21Speaker 02

  They send you regular personalized privacy reports showing what information they found on the internet about you, where they found it, and what they removed. And DeleteMe isn't just a one-time service. They are always working for you, constantly monitoring, constantly removing your personal information that you don't want on the internet. And to put it simply, DeleteMe does all the hard work of wiping your data, your family's personal information, and all these things you don't want out there from those data brokers' websites. Now, the next step is to take control of your personal data and keep it private forever by signing up for DeleteMe. Now, at a special discount rate for our listeners, of course, this is awesome. Get 20% off your DeleteMe plan by texting "PRACTICAL"

• 34:06Speaker 02

  to 64000. Again, text the word "PRACTICAL" to 64000. And of course, you may know this already, but message and data rates may apply. Check the terms, all that good stuff. Once again, text the word "PRACTICAL" to 64000 and get 20% off DeleteMe. Enjoy.

• 34:44Chris Benson?

  So that was very useful for me in terms of trying to frame and understand, what you're relaying here in terms of govern, map, measure, manage. And you talked about something a moment ago that was really interesting in the sense of you have these characteristics that you're trying to measure toward trustworthy, but it's not just one and it's not just a black or white issue. You have a collection of them and they vary across different types of use cases, it sounds like. So you kind of have a characteristic profiles in a sense. How do you think about, if you were out there as a consumer of the guidance

• 35:29Chris Benson?

  that you're providing from NIST, maybe you're in a small company that's doing some work in AI and you're trying to implement the guidance from NIST and you're kind of evaluating your own profile of characteristics through that govern, map, measure, manage process. How does one frame that if you're kind of just getting into this and trying to implement the guidance? Could you talk a little bit about how an organization that maybe had not done this before might go about implementing a particular, whatever their use case is? And how do they get started in the process? What's your recommendation there?

• 36:09Speaker 04

  The first thing I will say is that you don't need to implement all of the recommendations in the AI RMF to have a complete risk management. So our recommendation is that start by looking at and reading the AI RMF. It's not a very long document. I forgot. I think it's about between 30 to 35 pages. So get a kind of a holistic understanding of this.

• 36:37Speaker 04

  And then check out the playbook in the AI Resource Center. Where for each of the recommendations, AI or RMF is in high level for functions. Each functions is divided into categories and then subcategories. So in a sort of a granular approach, we give recommendations on what to do for the govern. And then for each of those recommendations, get into a little bit more granular recommendations. The playbook for each of the subcategories, which is about, I think, seventy subcategories in the AI RMF, provides recommendations on suggested actions,

• 37:18Speaker 04

  informative documents that you can go read and get more information. And also suggestions about transparency and documentations for implementation of that subcategory. So we often suggest that get a better understanding of the AI RMF. Spend some time in the playbook to get a better understanding of the type of the things that can be done. And then, based on the use case, based on exactly what you want to do, start by simple, small number of recommendations in the AI RMF and start implementing there.

• 38:00Speaker 04

  Govern or MAP functions are useful starting points. Govern provides recommendations about the setup that you need for a successful risk management. So it can give you ideas or an organization's ideas about the resources that's needed, the teams that needed to do that, so they can align it with their own resources and the teams that they have. And the MAP functions, as we discussed, gives recommendations of a better understanding of the context, getting answers to what needs to be measured.

• 38:39Speaker 04

  I will also add that the functions govern, map, measure, manage, there is no order on doing that. Depends on the use case, depends on what needs to be done. The starting point can be recommendations of any of the functions. We usually recommend start with govern and MAP. And then start with as few number of the subcategories or recommendations that the resources and the expertise of the entity allows for their implementations. Of course, prioritize in terms of their own risk management. And then the last thing I also add is also be mindful

• 39:22Speaker 04

  that the risk management is not a one-time practice that we just do at once and you say, okay, I'm done with my risk management. AI systems, you know, there's data drift, model drift. These newer models can change based on the interactions with the users, with the environment. So we suggest a continual monitoring and risk management. So I think one of the recommendations in the MAP or Govern is to come up with a cadence of repeating the assessments of the risks. So that would be my recommendations. Another thing that I would say is that I mentioned the AI RC, I mentioned the playbook.

• 40:04Speaker 04

  We also in the AI RMF talk about profile. So I keep emphasizing the context of the use and mentioning that the importance of the context in AI system deployment, development and the risk management. At the same time, AR RMF by design is trying to be sector agnostic and technology agnostic. We try to kind of come up with the foundations, the common set of the practices that's needed to be aware of and are suggested for risk management. But we also have a section on AI profile and recommendations on building verticals. These are, these profiles are instantiations of the AI RMF

• 40:48Speaker 04

  for a particular use case or domain of use or technology domain, so that each of the subcategories can be slanted or be aligned with that use case. So there can be a profile of AI RMF for. The example that I used, uh, medical image recognition. There, you can imagine a profile of AI RMF for financial sectors. That's something that we have been asked to work with the community on. That was a very long intro to say that there are a couple of profiles posted on the AI Resource Center. And one is the one that Department of Labor did for inclusive hiring.

• 41:29Speaker 04

  Another one that Department of State did for human rights in AI. So that can give some sort of a window to or idea about where the organizations can start. In addition to the profile, we are also, we have also posted a few use cases and we will post more use cases. And that is how different organizations are using AI RMF. That can hopefully be more practical examples of how to use AI RMF.

• 42:03Chris Benson?

  That's a fantastic set of suggestions right there. And I'd actually like to kind of ask a follow up to that. And as a prelude to my follow up, if I'm understanding, kind of go to the AI RMF, read that core document. It's not very long, it's very consumable. Go to the playbook, look at the subcategories. I believe you said there were about 70 of them. You know, it has suggested actions and references to other docs in that. And then start to bite off kind of simple, small chunks in terms of how you're going to approach the functions that you mentioned, starting kind of with government map. And then kind of how to put together resources and teams.

• 42:45Chris Benson?

  And then kind of cycling back with a cadence of repeated assessments that are also specific to the vertical that you're in. And as you're doing that, it's feeling really practical from my step. But you know, we're practical AI, so that appeals to us. I'd like to ask, are there now, or do you expect kind of tooling? You know, like if you look outside of AI, that kind of the software industry at large is kind of a predecessor to that. As standards and workflows and kind of best practices arose in software development at large, lots of tooling arose around how to do, you know, agile methodology.

• 43:28Chris Benson?

  And you name it, there are many different approaches to software development. Are you expecting tooling or do you have any thinking around what kind of tooling might help AI development teams that as they're building these teams and their resources so that they can be productive over time? How are you seeing that evolve going forward? Or do you think that there'll be a cottage industry kind of forming around this the way we've seen in software and other areas where there's a lot of tool support?

• 43:59Speaker 04

  Yes, we have already started seeing some of that. So there are entities that are putting tools for implementation of the IRM and dashboards and all this on that they have developed those tools and they are having it on their websites. If I can just go back and thank you for your excellent summary of my very long windy answers.

• 44:20Chris Benson?

  It's no, it's very good. I'm learning a lot here.

• 44:23Speaker 04

  And I ask your listeners to, I think, start with the AI Resource Center. The URL is aiirc.nest.gov. ARRMF is there and playbook in a interactive, filterable, filterable ways there. So if their businesses is only, you know, there are developers, they can go and first filter all of the, you know, from the 7E recommendations, anything that is only applicable to the developers, so they're not overwhelmed with all of that. Or if they're only care about deployment and the issue of the bias for the deployment, they can go and say, you know, filter for the, from the AI actors for the deployers

• 45:07Speaker 04

  and from the characteristics from the bias and that gives them, that save them sometimes. So that is the, where they get the information from our website and some hint about, you know, kind of, we have it in more filterable way. And yes, there has already started entities that are putting more tooling in. And with the 600 dash one, that was the cross-sectional profile of the IRM for the generative AI. The work that we're doing with the community, we are. We are focusing on, we use the word operationalization. So what are the tools that are needed for operationalizing and implementing AI RMF?

• 45:47Speaker 04

  And going back and emphasizing the community engagements and the role that the input from the community plays in all of these things. Some of the tools can be developed by us, but the majority of the tools are being developed by the community and shared by the community. And we hope that we see more of that.

• 46:05Chris Benson?

  I hope so too. It's fascinating. I love the framework that you've given us here that is, you know, can be applied in so many different verticals and so many different ways, and yet is flexible in its guidance that way. As we wind up here, and we have seen so much advancement in the development of AI, both as a technology and as the industries around it. And as you are kind of sitting there in the nerve center of kind of where these, this guidance and the standards come together, bridging both government and industry. As you look forward, what are some of the things, when you're, you know, not in a particular

• 46:49Chris Benson?

  meeting and you're just kind of winding down and you're, you're kind of thinking creatively about where things are going, what are some of your thoughts about the future of this, both for NIST's role and for the industry and the technology at large? Where we're going, because it's just, you know, it's going at such a rate, it's so fast, and it's fascinating and is, you know, changing the face of business, changing the face of how we are as humans and stuff in terms of the tools and, you know, that are available to us. I'd really love your insights into where you think all of this is going in the days and years ahead.

• 47:28Speaker 04

  I think what, and for me, the end goal, for me, what I'm hoping to see a lot of that. Is to use uh this powerful technology in the way as as a sort of a scientific discovery tool in the way that we are doing the science and discoveries there. I think that is where we are gonna see a lot of uh really advancements into precision medicine, individualized educations, uh you know, all climate change, anything that's uh that's gonna make uh life a lot better uh for for all of us. I I have to say this, that I uh uh you know, my my heart was uh was warmed by seeing uh

• 48:11Speaker 04

  Nobel Prizes for uh things such as Alpha Fold. I keep saying for a long time that, you know, that needs a lot more recognitions. Uh but really, all of the recognition that uh that A I got uh through those uh those prizes and prizes. But we all, I'm also uh very aware of very important things that uh NIST can do and the community needs to do. I think we all agree that there is a lot that we don't know about how these models work and we ought to do something about it. We need to have a better understandings of uh how these models work, their capability and limits. That get me to the uh important topic of evaluations and testing.

• 48:55Speaker 04

  Uh we talk about it at the uh beginning of this podcast, that it's important to unpack the concept of the trust into the things that needs to be measured. But at the end of the day, we need to have reliable measurements for assurance that the systems are trustworthy. We at NIST, we are uh as a measurement science agency, we are the big fan of this quote from Lord Kelvin, that if you cannot measure it, you cannot improve it. So if you want to improve the trustworthiness and and the reliability of the systems, we need to be to have a good handle on how to test them and how to evaluate for reliability, for validity, for the trustworthiness characteristics. And our knowledge on how to test A I systems is very limited. We need better evaluations, as we can see.

• 49:39Speaker 04

  Uh benchmarks are too easy, they get saturated very quickly. We need to have a better understanding of how they work. That gets to the assurance that can build trust into the technology and give users uh everybody confidence that the systems works.

• 49:56Speaker 04

  And the third item that I put in, once we have built that knowledge base, once we have a good scientific foundations, when we have trued the research and the work with the community, we have built the technical building blocks. Let's develop a clear, understandable, technically robust standards that can help with a global improbability of AI evaluations, AI assurance, and AI governance.

• 50:26Chris Benson?

  Fantastic. Well, Alhamdulillah Tabasi, thank you so much for coming on the Practical AI Podcast. It was very, very instructive in terms of how to frame this, certainly information that I'm going to be using going forward, and really appreciate you taking time to talk with us today.

• 50:44Speaker 04

  I appreciate the opportunity to be here and talk and really enjoyed the conversation. Thanks.

• 50:58Speaker 00

  All right, that is Practical AI for this week. Subscribe now if you haven't already. Head to practicalai.fm for all the ways and join our free Slack team where you can hang out with Daniel, Chris, and the entire Change Log community. Sign up today at practicalai.fm/community. Thanks again to our partners at fly.io, to our beat freaking residents, Breakmaster Cylinder, and to you for listening. We appreciate you spending time with us. That's all for now. We'll talk to you again next time.