#73 – Andrew Ng: Deep Learning, Education, and Real-World AI

Andrew Ng is one of the most impactful educators, researchers, innovators, and leaders in artificial intelligence and technology space in general. He co-founded Coursera and Google Brain, launched deeplearning.ai, Landing.ai, and the AI fund, and was the Chief Scientist at Baidu. As a Stanford professor, and with Coursera and deeplearning.ai, he has helped educate and inspire millions of students including me. EPISODE LINKS: Andrew Twitter: https://twitter.com/AndrewYNg Andrew Facebook: https://www.facebook.com/andrew.ng.96 Andrew LinkedIn: https://www.linkedin.com/in/andrewyng/ deeplearning.ai: https://www.deeplearning.ai landing.ai: https://landing.ai AI Fund: https://aifund.ai/ AI for Everyone: https://www.coursera.org/learn/ai-for-everyone The Batch newsletter: https://www.deeplearning.ai/thebatch/ This conversation is part of the Artificial Intelligence podcast. If you would like to get more information about this podcast go to https://lexfridman.com/ai or connect with @lexfridman on Twitter https://twitter.com/lexfridman, LinkedIn https://www.linkedin.com/in/lexfridman/, Facebook https://www.facebook.com/lexfridman, Medium https://medium.com/@lexfridman, or YouTube https://www.youtube.com/lexfridman where you can watch the video versions of these conversations. If you enjoy the podcast, please rate it 5 stars on Apple Podcasts https://podcasts.apple.com/us/podcast/artificial-intelligence/id1434243584, follow on Spotify https://open.spotify.com/show/2MAi0BvDc6GTFvKFPXnkCL, or support it on Patreon https://www.patreon.com/lexfridman. This episode is presented by Cash App. Download it (App Store https://apps.apple.com/us/app/cash-app/id711923939, Google Play https://play.google.com/store/apps/details?id=com.squareup.cash&hl=en_US), use code “LexPodcast”. This episode is also supported by the Techmeme Ride Home podcast. Get it on Apple Podcasts https://apple.co/2vIbh1k, on its website https://news.techmeme.com/180306/podcast, or find it by searching “Ride Home” in your podcast app. Here’s the outline of the episode. On some podcast players you should be able to click the timestamp to jump to that time. OUTLINE: 00:00 – Introduction 02:23 – First few steps in AI 05:05 – Early days of online education 16:07 – Teaching on a whiteboard 17:46 – Pieter Abbeel and early research at Stanford 23:17 – Early days of deep learning 32:55 – Quick preview: deeplearning.ai, landing.ai, and AI fund 33:23 – deeplearning.ai: how to get started in deep learning 45:55 – Unsupervised learning 49:40 – deeplearning.ai (continued) 56:12 – Career in deep learning 58:56 – Should you get a PhD? 1:03:28 – AI fund – building startups 1:11:14 – Landing.ai – growing AI efforts in established companies 1:20:44 – Artificial general intelligence

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Lex Fridman?

  The following is a conversation with Andrew Eng, one of the most impactful educators, researchers, innovators, and leaders in artificial intelligence and technology space in general. He co-founded Coursera and Google Brain, launched Deep Learning AI, Lending AI, and the AI Fund, and was the chief scientist at Baidu. As a Stanford professor and with Coursera and Deep Learning AI, he has helped educate and inspire millions of students, including me. This is the Artificial Intelligence Podcast. If you enjoy it, subscribe on YouTube, give it five stars on Apple Podcasts, support it on Patreon, or simply connect with me on Twitter at LexFriedman,

• 0:45Lex Fridman?

  spelled F-R-I-D-M-A-N. As usual, I'll do one or two minutes of ads now and never any ads in the middle that can break the flow of the conversation. I hope that works for you and doesn't hurt the listening experience. This show is presented by Cash App, the number one finance app in the App Store. When you get it, use code LexPodcast. Cash App lets you send money to friends, buy Bitcoin, and invest in the stock market with as little as $1. Brokerage services are provided by Cash App Investing, a subsidiary of Square and member SIPC. Since Cash App allows you to buy Bitcoin, let me mention that cryptocurrency in the context of the history of money is fascinating.

• 1:28Lex Fridman?

  I recommend A Cent of Money as a great book on this history. Debits and credits on ledgers started over 30,000 years ago. The US dollar was created over 200 years ago, and Bitcoin, the first decentralized cryptocurrency, released just over 10 years ago. So, given that history, cryptocurrency is still very much in its early days of development, but it's still aiming to and just might redefine the nature of money. So again, if you get Cash App from the App Store or Google Play and use the code LexPodcast, you'll get $10, and Cash App will also donate $10 to FIRST,

• 2:10Lex Fridman?

  one of my favorite organizations that is helping to advance robotics and STEM education for young people around the world. And now here's my conversation with Andrew Ng.

• 2:40Lex Fridman?

  The courses you taught on machine learning at Stanford and later on Coursera that you co-founded have educated and inspired millions of people. So let me ask you, what people or ideas inspired you to get into computer science and machine learning when you were young? When did you first fall in love with the field is another way to put it.

• 3:01Andrew Ng?

  Growing up in Hong Kong and Singapore, I started learning to code when I was five or six years old. At that time, I was learning the basic programming language and I would take these books and they'll tell you, type this program into your computer. So type that program into my computer. And as a result of all that typing, I would get to play these very simple shoot them up games that I had implemented on my little computer. So I thought it was fascinating as a young kid that I could write this code, I was really just copying code from a book into my computer, to then play these cooler video games. Another moment for me was when I was a teenager and my father, Chris Doctor, was reading

• 3:45Andrew Ng?

  about exhibit systems and about neural networks. So he got me to read some of these books and I thought it was really cool, you could write a computer that started to exhibit intelligence. Then I remember doing an internship while I was in high school, this is in Singapore, where I remember doing a lot of photocopying and I was office assistant. And the highlight of my job was when I got to use the shredder. So the teenager me, I remember thinking, boy, this is a lot of photocopying. If only we could write software, build a robot, something to automate this, maybe I could do something else. So I think a lot of my work since then has centered on the theme of automation. Even the way I think about machine learning today, we're very good at writing learning

• 4:28Andrew Ng?

  algorithms that can automate things that people can do. Or even launching the first MOOCs, mass open online courses that later led to Coursera, I was trying to automate what could be automatable in how I was teaching on campus.

• 4:42Lex Fridman?

  Process of education, try to automate parts of that to make it more. Sort of to have more impact from a single teacher, a single educator.

• 4:52Andrew Ng?

  Yeah, I I I felt, you know, teaching at Stanford, I was teaching machine learning to about four hundred students a year at the time. And I found myself filming the exact same video every year, telling the same jokes in the same room. And I thought, why am I doing this? Why don't we just take last year's video? And then I can spend my time building a deeper relationship with students. So that process of thinking through how to do that, that led to the first first move that we launched.

• 5:19Lex Fridman?

  And then you have more time to write new jokes. Are there favorite memories from your early days at Stanford, teaching thousands of people in person and then millions of people online?

• 5:31Andrew Ng?

  You know, teaching online, what not many people know was that a lot of those videos were shot between the hours of ten P M. and three A M.

• 5:45Andrew Ng?

  A lot of times, we we we're launching the first move at Stanford, we've already announced the course, about a hundred thousand people have signed up. We just started to write the code and we had not yet actually filmed the video. So you know, a lot of pressure, a hundred thousand people waiting for us to produce the content. So many Fridays, Saturdays, I would go out, have dinner with my friends. And then I would think, okay, do you want to go home now or do you want to go to the office to film videos? And the thought of being able to help a hundred thousand people potentially learn machine learning, fortunately, that made me think, okay, I want to go to my office, go to my tiny little recording studio. I would adjust my Logitech webcam, adjust my, you know, Wacom tablet, make sure my lapel mic was on.

• 6:29Andrew Ng?

  And then I would start recording often until two A M. or three A M. I think unfortunately, that doesn't doesn't show that it was recorded that late at night. But it was really inspiring, the the the the thought that we could create content to help so many people learn about machine learning.

• 6:45Lex Fridman?

  How did that feel? The fact that you're probably somewhat alone, maybe a couple of friends, recording with a Logitech webcam and kind of going home alone at one or two A A M. at night and knowing that that's going to reach sort of thousands of people, eventually millions of people. Is what's that feeling like? I mean, is there a feeling of just satisfaction of? Pushing through.

• 7:11Andrew Ng?

  I think it's humbling and I wasn't thinking about what I was feeling. I think one thing we, that I'm proud to say we got right from the early days was I told my whole team back then that the number one priority is to do what's best for learners, do what's best for students. And so when I went to the recording studio, the only thing on my mind was, what can I say? How can I design my slides? What do I need to draw right to make these concepts as clear as possible for learners? I think, you know, I've seen sometimes instructors, it's tempting to, hey, let's talk about my work. Maybe if I teach you about my research, someone will cite my papers a couple more times. And I think one of the things we got right, launched the first few moves and later building Coursera,

• 7:51Andrew Ng?

  was putting in place that bedrock principle of let's just do what's best for learners and forget about everything else. And I think that that as a guiding principle turned out to be really important to the rise of the movement.

• 8:04Lex Fridman?

  And the kind of learner you imagined in your mind is as broad as possible, as global as possible. So really try to reach as many people interested in machine learning and AI as possible.

• 8:17Andrew Ng?

  I really want to help anyone that had an interest in machine learning to break into the field. And I think sometimes, eventually people ask me, hey, why are you spending so much time explaining gradient descent? And my answer was, if I look at what I think the learner needs and what benefit from, I felt that having that, a good understanding of the foundations, kind of back to the basics, would put them in a better stead to then build on a long-term career. So try to consistently make decisions on that principle.

• 8:48Lex Fridman?

  So one of the things you actually revealed to the narrow AI community at the time and to the world is that the amount of people who are actually interested in AI is much larger than we imagined. By you teaching the class and how popular it became, it showed that, wow, this isn't just a small community of sort of people who go to URIPs. And it's much bigger. It's developers. It's people from all over the world. I mean, I'm Russian, so everybody in Russia is really interested. There's a huge number of programmers who are interested in machine learning. India, China, South America, everywhere. There's just millions of people who are interested in machine learning.

• 9:31Lex Fridman?

  So how big do you get a sense that this, the number of people is that are interested? From your perspective?

• 9:37Andrew Ng?

  I think the number has grown over time. I think it's one of those things that maybe it feels like it came out of nowhere, but it's an insider building it. It took years. It's one of those overnight successes that took years to get there. My first foray into this type of online education was when we were filming my Stanford class and sticking the videos on YouTube. And then some other things, we had uploaded the whole works and so on. But it's, you know, basically the one hour, 15 minute video that we put on YouTube. And then we had four, five other versions of websites that I had built, most of which you would never have heard of because they reach small audiences. But that allowed me to iterate, allowed my team and me to iterate, to learn what are the ideas that work and what doesn't.

• 10:19Andrew Ng?

  For example, one of the features I was really excited about and really proud of was build this website where multiple people could be logged into the website at the same time. So today, if you go to a website, you know, if you are logged in and then I want to log in, you need to log out. It was the same browser, the same computer. But I thought, well, what if two people, say you and me, were watching a video together in front of a computer? What if a website could have you type your name and password, have me type my name and password? And then now the computer knows both of us are watching together and it gives both of us credit for anything we do as a group. Influenza's feature rolled it out in a high, in a school in San Francisco. We had about 20 something users. We had the teacher there, Sacred Heart Cathedral Prep. The teacher was great.

• 11:03Andrew Ng?

  I mean, guess what? Zero people use this feature. Turns out, people studying online, they want to watch the videos by themselves. So you can playback, pause at your own speed rather than in groups. So that was one example of a tiny lesson learned, out of many, that allowed us to hone into the set of features.

• 11:22Lex Fridman?

  And it sounds like a brilliant feature. So I guess the lesson to take from that is There's something that looks amazing on paper and then nobody uses it. It doesn't actually have the impact that you think it might have. I said, yeah, I saw that you really went through a lot of different features and a lot of ideas. And to arrive at the final, at Coursera, at the final kind of powerful thing that showed the world that MOOCs can educate millions.

• 11:49Andrew Ng?

  And I think with the whole machine learning movement as well, I think it didn't come out of nowhere. Instead, what happened was as more people learned about machine learning, they will tell their friends and their friends will see how is it applicable to their work. And then the community kept on growing and I think was still growing. You know, I don't know in the future what percentage of all developers will be AI developers. I could easily see it being north of 50%, right? Because so many AI developers broadly construed, not just people doing the machine learning modeling, but the people building infrastructure, data pipelines, you know, all the softwares surrounding the core machine learning model, maybe is even bigger.

• 12:32Andrew Ng?

  I feel like today, almost every software engineer has some understanding of the cloud. Not all, you know, but maybe this microcontroller developer doesn't need to deal with the cloud. But I feel like the vast majority of software engineers today are sort of having an appreciation of the cloud. I think in the future, maybe we'll approach nearly 100% of all developers being, you know, in some way, an AI developer, or at least having an appreciation of machine learning.

• 12:59Lex Fridman?

  And my hope is that there's this kind of effect that there's people who are not really interested in soft, being a programmer or being into software engineering, like biologists, chemists and physicists, even mechanical engineers, all these disciplines that are now more and more sitting on large data sets. And here, they didn't think they're interested in programming until they have this data set and they realize there's this set of machine learning tools that allow you to use the data set. So they actually become, they learn to program and they become new programmers. So like the, not just, because you've mentioned a larger percentage of developers become machine learning people. The, it seems like more and more the, the kinds of people who are becoming developers is also growing significantly.

• 13:44Andrew Ng?

  Yeah, I think, I think once upon a time, only a small part of humanity was literate, you know, could read and write. And, and, and maybe you thought, maybe not everyone needs to learn to read and write. You know, you just go listen to, to, to a few monks, right? Read to you and maybe that was enough. Or maybe we just need a few handful of authors to write the bestsellers and then no one else needs to write. But what we found was that by giving as many people, you know, in, in some countries, almost everyone, basic literacy. It dramatically enhanced human to human communications and we can now write for an audience of one, such as if I send you an email, you send me an email.

• 14:22Andrew Ng?

  I think in computing, we're still in that phase where so few people know how to code, that the coders mostly have to code for relatively large audiences. But if everyone, or most people became developers at some level, similar to how most people in developed economies are somewhat literate. I would love to see the owners of a mom and pop store be able to write a little bit of code to customize the TV display for their special this week. And I think it'll enhance human to computer communications, uh, which is becoming more and more important today as well.

• 14:56Lex Fridman?

  So you, you think, you think it's possible that machine learning becomes kind of similar to literacy where, where, yeah, like you said, the owners of a mom and pop shop. Is, is basically everybody in all walks of life would have some degree of programming capability?

• 15:12Andrew Ng?

  I could see society getting there. This one interesting thing, you know, if I go talk to the mom and pop store, if I talk to a lot of people in their daily professions, I previously didn't have a good story for why they should learn to code. You know, we could give them some reasons. But what I found with the rise of machine learning and data science is that I think the number of people with a concrete use for data science in their daily lives, in their jobs, maybe even larger than the number of people with a concrete use for software engineering. For example, if you actually, if you run a small mom and pop store, I think if you can analyze the data about your sales, your customers, there's, I think there's actually real value there, maybe even more than traditional software engineering.

• 15:54Andrew Ng?

  So I find that for a lot of my friends in various professions, be it recruiters or accountants or, you know, people that work in the factories, which I deal with more and more these days. I feel if they were data scientists at some level, they could immediately use that in their work. So I think that data science and machine learning may be an even easier entree into the developer world for a lot of people than the software engineering.

• 16:20Lex Fridman?

  That's interesting, and I agree with that, but that's beautifully put.

• 16:25Lex Fridman?

  We live in a world where most courses and talks have slides, PowerPoint, keynote, and yet you famously often still use a marker and a whiteboard. The simplicity of that is compelling and for me at least, fun to watch. So let me ask, why do you like using a marker and whiteboard, even on the biggest of stages?

• 16:46Andrew Ng?

  I think it depends on the concepts you want to explain. For mathematical concepts, it's nice to build up the equation one piece at a time. And the whiteboard marker or the pen and stylus is a very easy way, you know, to build up the equation, build up a complex concept one piece at a time while you're talking about it. And sometimes that enhances understandability. The downside of writing is that it's slow. And so if you want a long sentence, it's very hard to write that. So I think there are pros and cons, and sometimes I use slides and sometimes I use a whiteboard or a stylus.

• 17:20Lex Fridman?

  The slowness of a whiteboard is also its upside, because it forces you to reduce everything to the basics. So some of, some of your talks involve the whiteboard. I mean, it's, there's really not, you go very slowly and you're really focused on the most simple principles. And that's, that's a beautiful.

• 17:40Lex Fridman?

  That enforces a kind of a minimalism of ideas that I think is surprising to me is great for education. Like, a great talk, I think, is not one that has a lot of content. A great talk is one that just clearly says a few simple ideas. And I think you, the whiteboard somehow enforces that. Peter Beal, who is now one of the top roboticists and reinforcement learning experts in the world, was your first PhD student. So I bring him up just because I kind of imagine this is, this was, must have been an interesting time in your life. Do you have any favorite memories of working with Peter?

• 18:22Lex Fridman?

  Your first student in those uncertain times, especially before deep learning really, really sort of blew up? Any favorite memories from those times?

• 18:34Andrew Ng?

  Yeah, I was really fortunate to have had Peter Beal as my first PhD student. And I think even my long-term professional success builds on early foundations or early work that Peter was so critical to. So I was really grateful to him for working with me. You know, what not a lot of people know is just how hard research was and still is. Peter's PhD thesis was using reinforcement learning to fly helicopters. And so, you know, actually, even today, the website heli.stanford.edu, H E L I dot Stanford dot edu is still up. You can watch videos of us using reinforcement learning to make a helicopter fly upside down, fly loose rolls. It's just cool.

• 19:17Lex Fridman?

  It's one of the most incredible robotics videos ever. Some people should watch it.

• 19:21Andrew Ng?

  Oh, yeah, thank you.

• 19:22Lex Fridman?

  It's inspiring. That's from like 2008 or '07 or '06, like that range.

• 19:28Andrew Ng?

  Something like that. Yeah, it's over 10 years old.

• 19:30Lex Fridman?

  That was really inspiring to a lot of people, yes.

• 19:32Andrew Ng?

  What not many people see is how hard it was. So Peter and Adam Coles and Morgan Quigley and I were working on various versions of the helicopter. And a lot of things did not work. For example, it turns out one of the hardest problems we had was when helicopters fly around upside down doing stunts. How do you figure out the position? How do you localize a helicopter? So we wanted to try all sorts of things. Having one GPS unit doesn't work because you're flying upside down. GPS unit is facing down, so you can't see the satellite. So we tried, we experimented trying to have two GPS units, one facing up, one facing down. So if you flip over, that didn't work because the downward facing one couldn't synchronize if you're flipping quickly.

• 20:14Andrew Ng?

  Morgan Quigley was exploring this crazy complicated configuration of specialized hardware to interpret GPS signals. Looking at FPGA is completely insane. Spent about a year working on that, didn't work. So I remember Peter, great guy, him and me, you know, sitting down in my office, looking at some of the latest things we had tried that didn't work and saying, you know, done it, like what now? Because, because we tried so many things and it, and it just didn't work. In the end, what we did, and Adam Coles was, was crucial to this, was put cameras on the ground and use cameras on the ground to localize the helicopter.

• 20:54Andrew Ng?

  And that solved the localization problem so that we could then focus on the reinforcement learning and inverse reinforcement learning techniques. So then actually make the helicopter fly.

• 21:05Andrew Ng?

  And, you know, I'm reminded when, when I was doing this work at Stanford, around that time, there was a lot of reinforcement learning theoretical papers, but not a lot of practical applications. So the autonomous helicopter work for flying helicopters was, is one of the few, you know, practical applications of reinforcement learning at the time, which, which caused it to become pretty well known. I, I, I feel like we, we might have almost come full circle with today. There's so much buzz, so much hype, so much excitement about reinforcement learning. But again, we're hunting for more applications of all of these great ideas that the community's come up with.

• 21:42Lex Fridman?

  What was the drive sort of in the face of the fact that most people are doing theoretical work? What motivate you in the uncertainty and the challenges to get the helicopter sort of, to do the, the applied work, to get the actual system to work? Yeah, in the face of fear, uncertainty, sort of the setbacks that you mentioned for localization.

• 22:03Andrew Ng?

  I like stuff that works.

• 22:04Lex Fridman?

  In the physical world, so like it's back to the shredder.

• 22:10Andrew Ng?

  You know, I like theory, but when I work on theory myself, and this is personal taste, I'm not saying anyone else should do what I do. But when I work on theory, I personally enjoy it more if I feel that my, the work I do will influence people have positive impact or help someone. I remember when, many years ago, I was speaking with a mathematics professor. And it kind of just said, hey, why do you do what you do? And then he said, he, he, he had stars in his eyes when he answered. And this mathematician, not from Stanford, different university, he said, I do what I do because it helps me to discover truth and beauty in the universe. He had stars in his eyes when he said that.

• 22:55Andrew Ng?

  And I thought, that's great.

• 22:58Andrew Ng?

  I don't want to do that. I think it's great that someone does that, fully support the people that do it, a lot of respect for people that. But I am more motivated when I can see a line to how the work that my teams and I are doing helps people.

• 23:14Andrew Ng?

  The world needs all sorts of people, I'm just one type, I don't think everyone should do things the same way as I do. But I, when I delve into either theory or practice, if I personally have conviction, you know, that here's a path for it to help people, I find that more satisfying to have that conviction.

• 23:32Lex Fridman?

  That's, that's your path. You were a proponent of deep learning before it gained widespread acceptance. What did you see in this field that gave you confidence? What was your thinking process like in that first decade of the, I don't know what that's called? Two thousands, the aughts.

• 23:51Andrew Ng?

  Yeah, I can tell you the thing we got wrong and the thing we got right. The thing we really got wrong was the importance of, uh, the early importance of unsupervised learning. So, uh, early days of Google Brain, we put a lot of effort into unsupervised learning rather than supervised learning. And there was this argument, actually, I think it was around, um, two thousand and five, uh, after, uh, you know, NeurIPS, at that time called NIPS, but now NeurIPS had ended. And, uh, Jeff Hinton and I were sitting in the cafeteria outside, you know, the conference, we had lunch, we were just chatting. And Jeff pulled up this napkin, he started sketching this argument on a, on a napkin, which was very compelling, as I'll repeat it. Human brain has about a hundred trillion, so there's ten to the fourteen synaptic connections.

• 24:35Andrew Ng?

  You will live for about ten to the nine seconds, uh, that's thirty years. You actually live for two, two, two by ten to the nine, maybe three by ten to the nine seconds, so just let's say ten to the nine. So if each synaptic connection, each weight in your brain's neural network has just a one bit parameter, that's ten to the fourteen bits you need to learn in up to ten to nine seconds of your life. So via this simple argument, which is a lot of problems, it's very simplified, that's ten to the five bits per second you need to learn in your life. And, um, I have a one year old daughter, uh, I am not pointing out ten to five bits per second of labels to her. So, and, and I think I'm a, I'm a very loving parent, but I'm just not gonna do that, right?

• 25:21Lex Fridman?

  Yeah.

• 25:22Andrew Ng?

  So from this, you know, very crude, definitely problematic argument, there's just no way that most of what we know is through supervised learning. But where you get so many bits of information is from sucking in images, audio, just experiences in the world. And so that argument, uh, and then there are a lot of known forces argument, you know, we should go, go into, really convinced me that there's a lot of power to unsupervised learning. So that was the part that we actually maybe, maybe got wrong. I, I still think unsupervised learning is really important, but we, uh, but, but in the early days, you know, ten, fifteen years ago, a lot of us thought that was the path forward.

• 25:58Lex Fridman?

  Oh, so you, you're saying that, that, that perhaps was the wrong intuition for the time?

• 26:03Andrew Ng?

  For the time, that, that, that was the part we got wrong. The part we got right was the importance of scale. So Adam Coates, another wonderful person, fortunate to have worked with him. He was in my group at Stanford at the time and Adam had run these experiments at Stanford, showing that the bigger we train a learning algorithm, the better its performance. And it was based on that, there was a graph that Adam generated, you know, where the X axis, Y axis lines going up into the right. So bigger you make this thing, the better its performance, accuracy is the vertical axis. So it's really based on that chart that Adam generated that he gave me the conviction that we could scale these models way bigger than what we could on a few CPUs, which is what we had at Stanford, that we could get even better results.

• 26:48Andrew Ng?

  And it was really based on that one figure that Adam generated that gave me the conviction to go with Sebastian Thrun to pitch, you know, starting, starting a project at Google, which became the Google Brain project.

• 27:01Lex Fridman?

  Brain, you go find a Google Brain. And there the intuition was scale will bring performance for the system, so we should chase a larger and larger scale. And I think people don't, don't realize how, how groundbreaking of a, it's simple, but it's a groundbreaking idea, that bigger data sets will, will result in better performance.

• 27:23Andrew Ng?

  It was controversial, it was controversial at the time. Some of my well-meaning friends, you know, senior people in the machine learning community, I won't name, but who's, so people, some of whom we, we know. My well-meaning friends came and were trying to give me friendly advice like, "Hey Andrew, why are you doing this? This is crazy. It's in the near natural architecture. Look at these architectures of building. You're just gonna go for scale? Like, this is a bad career move." So, so my, my well-meaning friends, you know, were trying to, some of them were trying to talk me out of it. But I find that if you want to make a breakthrough, you sometimes have to have conviction and do something before it's popular, since that lets you have a bigger impact.

• 28:00Lex Fridman?

  Let me ask you just in a small tangents on that topic. I find myself arguing with people saying that greater scale, especially in the context of active learning, so very carefully selecting the data set, but growing the scale of the data set is going to lead to even further breakthroughs in deep learning. And there's currently pushback at that idea, that larger data sets are no longer.

• 28:26Lex Fridman?

  That so you want to increase the efficiency of learning. You you want to make better learning mechanisms. And I personally believe that just bigger data sets will still with the same learning methods we have now will result in better performance. What's your intuition at this time on those I on the this dual side is do we need to come up with better architectures for learning? Or can we just get bigger, better data sets that will improve performance?

• 28:55Andrew Ng?

  I think both are important. And it's also problem dependent. So for a few data sets, we may be approaching, you know, base error rate or approaching or surpassing human level performance. And then there's that theoretical ceiling that we will never surpass the base error rate.

• 29:12Andrew Ng?

  But then I think there are plenty of problems where where we're still quite far from either human level performance or from base error rate. And bigger data sets with new networks with without further algorithm innovation will be sufficient to take us further. But on the flip side, if we look at the recent breakthroughs using, you know, transformer networks for language models, it was a combination of novel architecture, but also scale had a lot to do with it. If we look at what happened with, you know, G P two and BERT, I think scale was a large part of the story.

• 29:43Lex Fridman?

  Yeah, that's that's not often talked about is the the scale of the data set it was trained on and the quality of the data set because there's some. So it was like redded threads that had they were uprated highly. So there's already some weak supervision on a very large data set that people don't often talk about. Right?

• 30:04Andrew Ng?

  I find that today we have maturing processes to managing code, things like Git, right? Version control. It took us a long time to to evolve the good processes. I remember I remember when my friends and I were emailing each other C plus plus files in email. You know, but then we had was it C V S a version Git, maybe something else in the future. We're very immature in terms of tools for managing data and think about how to clean data and how to solve our very hard, messy data problems. I think there's a lot of innovation there to be had still.

• 30:36Lex Fridman?

  I love the idea that you were versioning through email.

• 30:39Andrew Ng?

  I'll give you one example. When we work with manufacturing companies, it's not at all uncommon for there to be multiple labelists that disagree with each other. And so we would, doing the work in visual inspection, we will, you know, take, say, a plastic part and show it to one inspector. And the inspector, sometimes very opinionated, they'll go, clearly, that's a defect. The scratch, unacceptable, gotta reject this part. Take the same part to different inspector, different, very opinionated. Clearly, the scratch is small, it's fine, don't throw it away, you're gonna make us, you know. And then sometimes you take the same plastic part, show it to the same inspector in the afternoon as opposed in the morning,

• 31:22Andrew Ng?

  and very opinionated go, in the morning, they say, clearly, it's okay. In the afternoon, equally confident, clearly, this is a defect. And so what is the AI team supposed to do if sometimes even one person doesn't agree with himself or herself in the span of a day? So I think these are the types of very practical, very messy data problems that, you know, that my teams wrestle with. In the case of large consumer internet companies, where you have a billion users, you have a lot of data, you don't worry about it, just take the average, it kind of works. But in a case of other industry settings, we don't have big data. If just a small data, very small data sets, maybe even a hundred defective parts, or a hundred examples of a defect.

• 32:07Andrew Ng?

  If you have only a hundred examples, these little labeling errors, you know, if ten of your hundred labels are wrong, that actually is ten percent of your data set, has a big impact. So how do you clean this up? What are you supposed to do? This is an example of the types of things that my teams, this is a land AI example, are wrestling with to deal with small data, which comes up all the time once you're outside consumer internet.

• 32:29Lex Fridman?

  Yeah, that's fascinating. And so then you invest more effort and time in thinking about the actual labeling process. What are the labels? What are the, how are disagreements resolved? And all those kinds of, like, pragmatic, real-world problems. That's a fascinating space.

• 32:44Andrew Ng?

  Yeah, I find that actually when I'm teaching at Stanford, I increasingly encourage students at Stanford to try to find their own project for the end of term project, rather than just downloading someone else's nicely cleaned dataset. It's actually much harder if you need to go and define your own problem and find your own dataset, rather than you go to one of the several good websites, very good websites with cleaned scoped datasets that you could just work on.

• 33:12Lex Fridman?

  You're now running three efforts, the AI Fund, Landing AI, and Deep Learning.ai. As you've said, the AI Fund is involved in creating new companies from scratch. Landing AI is involved in helping already established companies do AI. And Deep Learning AI is for education of everyone else or of individuals interested of getting into the field and excelling in it. So let's perhaps talk about each of these areas first. Deep Learning.ai, how, the basic question, how does a person interested in deep learning get started in the field?

• 33:49Andrew Ng?

  Deep Learning AI is working to create courses to help people break into AI. So my machine learning course that I taught through Stanford is one of the most popular courses on Coursera.

• 34:02Lex Fridman?

  To this day, it's probably one of the courses, sort of, if I ask somebody, how did you get into machine learning, or how did you fall in love with machine learning, or what gets you interested, it always goes back to Andrew Ng at some point. You've influenced, the amount of people you've influenced is ridiculous. So for that, I'm sure I speak for a lot of people, say, big thank you.

• 34:24Andrew Ng?

  No, yeah, thank you. You know, I was once reading a news article, I think it was Tech Review, and I'm gonna mess up the statistic, but I remember reading an article that said something like, one third of all programmers are self-taught. I may have the number one third wrong, it was two thirds. But when I read that article, I thought, this doesn't make sense. Everyone is self-taught, because you teach yourself. I don't teach people.

• 34:49Lex Fridman?

  That's a well put. So yeah, so how does one get started in deep learning? And where does deep learning dot AI fit into that?

• 34:58Andrew Ng?

  So the deep learning specialization offered by deep learning AI is, I think, was called Sarah's top specialization. It might still be. So it's a very popular way for people to take that specialization, to learn about everything from neural networks to how to tune in your network, to what is a ConvNet, to what is a RNN or a sequence model, or what is an attention model. And so the deep learning specialization steps everyone through those algorithms. So you deeply understand it and can implement it and use it for whatever.

• 35:32Lex Fridman?

  From the very beginning? So what would you say are the prerequisites for somebody to take the deep learning specialization in terms of maybe math or programming background?

• 35:43Andrew Ng?

  Yeah, need to understand basic programming since there are programming exercises in Python. And the math prereq is quite basic. So no calculus is needed. If you know calculus, it's great. You get better intuitions. But deliberately try to teach that specialization without requiring calculus. So I think high school math would be sufficient. If you know how to multiply two matrices, I think that's great.

• 36:09Lex Fridman?

  So a little basic linear algebra is great.

• 36:12Andrew Ng?

  Basic linear algebra, even very, very basic linear algebra in some programming. I think that people that have done the machine learning course will find a deep learning specialization a bit easier. But it's also possible to jump into the deep learning specialization directly. But it'll be a little bit harder since we tend to go over faster concepts like how does gradient descent work and what is the objective function, which we just covered more slowly in the machine learning course.

• 36:37Lex Fridman?

  Could you briefly mention some of the key concepts in deep learning that students should learn, that you envision them learning in the first few months, in the first year or so?

• 36:46Andrew Ng?

  So if you take the deep learning specialization, you learn the foundations of what is a neural network? How do you build up a neural network from a, you know, single logistic unit to a stack of layers to different activation functions? You learn how to train the neural networks. One thing I'm very proud of in that specialization is we go through a lot of practical know-how of how to actually make these things work. So what are the differences between different optimization algorithms? So what do you do if the algorithm overfits? So how do you tell if the algorithm is overfitting? When do you collect more data? When should you not bother to collect more data? I find that even today, unfortunately, there are, you know, engineers that will spend six months trying to pursue a particular direction,

• 37:30Andrew Ng?

  such as collect more data because we heard more data is valuable. But sometimes you could run some tests and could have figured out six months earlier that for this particular problem, collecting more data isn't going to cut it. So just don't spend six months collecting more data. Spend your time modifying the architecture or trying something else. So go through a lot of the practical know-how so that when, when, when, when someone, when you take the deep learning specialization, you have those skills to be very efficient in how you build these networks.

• 37:59Lex Fridman?

  To dive right in, to play with the network, to train it, to do the inference on a particular data set, to build an intuition about it without, without building it up too big to where you spend, like you said, six months learning, building up your big project without building any intuition of a small, a small aspect of the data that could already tell you everything you need to know about that data.

• 38:23Andrew Ng?

  Yes, and also the systematic frameworks of thinking for how to go about building practical machine learning. Maybe to make an analogy, when we learn to code, we have to learn the syntax of some programming language, right? Be it Python or C++ or Octave or whatever. But the equally important or maybe even more important part of coding is to understand how to string together these lines of code into coherent things. So, you know, when should you put something in a function call? And when should you not? How do you think about abstraction? So those frameworks are what makes a programmer efficient, even more than understanding the syntax. I remember when I was an undergrad at Carnegie Mellon, one of my friends would debug their code by first trying to compile it, and then it was C++ code.

• 39:08Andrew Ng?

  And then every line did a syntax error. They want to get rid of the syntax errors as quickly as possible. So how do you do that? Well, they would delete every single line of code with a syntax error. So really efficient for getting rid of syntax errors for horrible debugging errors. So I think, so we learned how to debug. And I think in machine learning, the way you debug a machine learning program is very different than the way you, you know, like do binary search or whatever, use a debugger, trace through the code in traditional software engineering. So it's an evolving discipline, but I find that the people that are really good at debugging machine learning algorithms are easily 10x, maybe 100x faster at getting something to work. So.

• 39:45Lex Fridman?

  And the basic process of debugging is, so the bug in this case, why isn't this thing learning, uh, learning, improving? Sort of going into the questions of overfitting and all those kinds of things. That's, that's the logical space that the debugging is happening in with neural networks.

• 40:03Andrew Ng?

  Yeah, the, the often the question is, um, why doesn't it work yet? Or can I expect it to eventually work? And what are the things I could try? Change the architecture, more data, more regularization, different optimization algorithm, you know, uh, different types of data. So to answer those questions systematically, so that you don't heading down the, so you don't spend six months heading down the blind alley before someone comes and says, uh, why should you spend six months doing this?

• 40:29Lex Fridman?

  What concepts in deep learning do you think students struggle the most with? Or sort of is, is the biggest challenge for them was to get over that hill? It's, uh, it hooks them and it inspires them and they really get it.

• 40:45Andrew Ng?

  Similar to learning mathematics, I think one of the challenges of deep learning is that there are a lot of concepts that build on top of each other.

• 40:54Andrew Ng?

  If you ask me what's hard about mathematics, I have a hard time pinpointing one thing. Is it addition, subtraction? Is it a carry? Is it multiplication? There's just a lot of stuff. I think one of the challenges of learning math and of learning certain technical fields is that there are a lot of concepts. And if you miss a concept, then you're kind of missing the prerequisite for something that comes later. So in the deep learning specialization, try to break down the concepts to maximize the odds of each component being understandable. So when you move on to the more advanced thing, we learn, you have convnets. Hopefully you have enough intuitions from the earlier sections to then understand why we structured convnets in a certain way.

• 41:36Andrew Ng?

  And then eventually, why we built, you know, R N Ns and L S T Ms or attention models in a certain way, building on top of the earlier concepts. Actually, I'm curious. You do a lot of teaching as well. Do you have a favorite? This is the hard concept moment in your teaching?

• 41:57Lex Fridman?

  Well, I don't think anyone's ever turned the interview on me.

• 42:00Andrew Ng?

  I'm glad you go first.

• 42:03Lex Fridman?

  I think that's a really good question. Yeah, it's really hard to capture the moment when they struggle. I think you put it really eloquently. I do think there's moments that are like aha moments that really inspire people. I think for some reason reinforcement learning, especially deep reinforcement learning, is a really great way to really inspire people and get what the use of neural networks can do. Even though neural networks really are just a part of the deep RL framework, but it's a really nice way to paint the entirety of the picture of a neural network being able to learn from scratch, knowing nothing, and explore the world and pick up lessons.

• 42:46Lex Fridman?

  I find that a lot of the aha moments happen when you use deep RL to teach people about neural networks, which is counterintuitive. I find like a lot of the inspired sort of fire in people's passion, people's eyes, it comes from the RL world. Do you find reinforcement learning to be a useful part of the teaching process or no?

• 43:09Andrew Ng?

  I still teach reinforcement learning in one of my Stanford classes. And my PhD thesis was on reinforcement learning.

• 43:14Lex Fridman?

  Right.

• 43:15Andrew Ng?

  I clearly love the field. I find that if I'm trying to teach students the most useful techniques for them to use today, I end up shrinking the amount of time I talk about reinforcement learning.

• 43:25Lex Fridman?

  Interesting.

• 43:26Andrew Ng?

  It's not what's working today. Now, our work changes so fast, maybe this will be totally different in a couple of years.

• 43:33Andrew Ng?

  But I think we need a couple more things for reinforcement learning to get there.

• 43:37Lex Fridman?

  To actually get there, yeah.

• 43:37Andrew Ng?

  One of my teams is looking to reinforcement learning for some robotic control tasks. So I see the applications, but if you look at it as a percentage of all of the impact of, you know, the types of things we do is at least today, outside of, you know, playing video games, right, and a few other games, the scope. Actually, at NeurIPS, a bunch of us were standing around saying, hey, what's your best example of an actual deploy reinforcement learning application? And, you know, among, you know, like, CNA machine learning researchers, right? And again, there are some emerging ones, but there are not that many great examples.

• 44:12Lex Fridman?

  Well, I think you're absolutely right. The sad thing is there hasn't been a big application impactful, real-world application of reinforcement learning. I think its biggest impact, to me, has been in the toy domain, in the game domain, in the small example. That's what I mean for educational purpose. It seems to be a fun thing to explore and you'll networks with. But I think from your perspective, and I think that might be the best perspective, is if you're trying to educate with a simple example in order to illustrate how this can actually be grown to scale and have a real world impact, then perhaps focusing on the fundamentals of supervised learning

• 44:52Lex Fridman?

  in the context of, you know, a simple data set, even like an MNIST data set is the right way, is the right path to take. I just, the amount of fun I've seen people have with reinforcement learning has been great, but not in the applied impact in the real-world setting. So it's a trade-off, how much impact you want to have versus how much fun you want to have.

• 45:14Andrew Ng?

  Yeah, that's really cool. And I feel like the world actually needs all sorts. Even within machine learning, I feel like deep learning is so exciting. But AI teams shouldn't just use deep learning. I find that my teams use a portfolio of tools. And maybe that's not the exciting thing to say, but some days we use a neural net. Some days we use a PCA. Actually, the other day I was sitting down with my team, looking at PCA residuals, trying to figure out what's going on with PC applied to manufacturing problem. And some days we use a proxy graphical model. Some days we use a knowledge graph, which is one of the things that has tremendous industry impact. But the amount of chatter about knowledge graphs in academia is really thin compared to the actual real impact.

• 45:57Andrew Ng?

  So I think reinforcement learning should be in that portfolio. And it's about balancing how much we teach all of these things. And the world should have diverse skills. It'd be sad if everyone just learned one narrow thing.

• 46:08Lex Fridman?

  Yeah, the diverse skill help you discover the right tool for the job. What is the most beautiful, surprising or inspiring idea in deep learning to you? Something that captivated your imagination? Is it the scale that could be, the performance that could be achieved with scale? Or is there other ideas?

• 46:29Andrew Ng?

  I think that if my only job was being an academic researcher, have an unlimited budget and didn't have to worry about short term impact and only focus on long term impact. I probably spent all my time doing research on unsupervised learning. I still think unsupervised learning is a beautiful idea. At both this past NERUs and ICML, I was attending workshops, listening to various talks about self-supervised learning, which is one vertical segment, maybe of sort of unsupervised learning that I'm excited about. Maybe just to summarize the idea, I guess you know the idea, I'll describe briefly.

• 47:05Lex Fridman?

  No, please.

• 47:06Andrew Ng?

  So here's an example of self-supervised learning. Let's say we grab a lot of unlabeled images off the internet. So with infinite amounts of this type of data, I'm going to take each image and rotate it by a random multiple of ninety degrees. And then I'm going to train a supervised neural network to predict what was the original orientation. So has it been rotated ninety degrees, hundred eighty degrees, hundred and seventy degrees, or zero degrees? So you can generate an infinite amounts of labeled data because you rotated the image. So you know what's the ground truth label. And so various researchers have found that by taking unlabeled data and making up labeled data sets and training a large neural network on these tasks,

• 47:48Andrew Ng?

  you can then take the hidden layer representation and transfer it to a different task very powerfully. Learning word embeddings, where we take a sentence, delete a word, predict the missing word, which is how we learn, you know, one of the ways we learn word embeddings is another example. And I think there's now this portfolio of techniques for generating these made up tasks. Another one called Jigsaw would be if you take an image, cut it up into a, you know, three by three grid, so like a nine, three by three puzzle piece, jump up the nine pieces and have a neural network predict which of the nine factorial possible permutations it came from. So many groups, including, you know, OpenAI, Peter P has been doing some work on this too.

• 48:34Andrew Ng?

  Facebook, Google Brain, I think DeepMind, oh, actually, Aaron Van Der Ooit has great work on the CPC objective. So many teams are doing exciting work and I think this is a way to generate infinite labeled data. And I find this a very exciting piece of unsupervised learning.

• 48:51Lex Fridman?

  So long term, you think that's going to unlock a lot of power in machine learning systems? Is this kind of unsupervised learning?

• 48:59Andrew Ng?

  I don't think there's a whole enchilada. I think it's just a piece of it. And I think this one piece, self-supervised learning, is starting to get traction. We're very close to it being useful. Well, word embeddings is really useful. And I think we're getting closer and closer to this having a significant real world impact, maybe in computer vision and video. But I think this concept, and I think there'll be other concepts around it, you know. Other unsupervised learning things that that I worked on, I've been excited about. I was really excited about sparse coding and ICA, slow feature analysis. I think all of these are ideas that various of us were working on about a decade ago, before we all got distracted by how well supervised learning was doing.

• 49:43Lex Fridman?

  Yeah, so we would return, we would return to the fundamentals of representation learning that that really started this movement of deep learning.

• 49:51Andrew Ng?

  I think there's a lot more work that one could explore around this theme of ideas and other ideas to come with better algorithms.

• 49:57Lex Fridman?

  So if we could return to maybe talk quickly about the specifics of deeplearning.ai, the deep learning specialization, perhaps. How long does it take to complete the course, would you say?

• 50:10Andrew Ng?

  The official length of the deep learning specialization is, I think, sixteen weeks, so about four months, but it's go at your own pace. So if you subscribe to the deep learning specialization, there are people that finished it in less than a month by working more intensely and studying more intensely. So it really depends on on the individual. Yeah, when we created the deep learning specialization, we wanted to make it very accessible and very affordable. And with Coursera and Deep Learning AI's education mission, one of the things that's really important to me is that if there's someone for whom paying anything is a is a financial hardship, then just apply for financial aid and and get it for free.

• 50:51Lex Fridman?

  If you were to recommend a daily schedule for people in learning, whether it's through the deep learning AI specialization or just learning in the world of deep learning, what would you recommend? How do they go about day to day sort of specific advice about learning, about their journey in in the world of deep learning, machine learning?

• 51:12Andrew Ng?

  I think getting the habit of learning. Is key and that means regularity. So, for example, we send out our weekly newsletter, The Batch, every Wednesday. So people know it's coming Wednesday. You can spend a little bit of time on Wednesday catching up on the latest news through The Batch on Wednesday. And for myself, I've picked up a habit of spending some time every Saturday and every Sunday, reading or studying. And so I don't wake up on the Saturday and have to make a decision to I feel like reading or studying today or not. It's just, it's just what I do. And the fact there's a habit makes it easier.

• 51:51Andrew Ng?

  So I think if someone can get into that habit, it's like, you know, just like we brush our teeth every morning. I don't think about it. If I thought about it, it's a little bit annoying to have to spend two minutes doing that. But it's a habit that it takes no cognitive load. But this would be so much harder if we have to make a decision every morning. So, and then actually, that's the reason why we're the same thing every day as well. It's just one less decision. I just get up and I wear my blue shirt. So, but I think if you can get that habit, that consistency of studying, then, then it actually feels easier.

• 52:23Lex Fridman?

  So, yeah, it's kind of amazing. In, in my own life, like I, I play guitar every day for, I force myself to at least for five minutes, play guitar. It's, it's a ridiculously short period of time, but because I've gotten into that habit, it's incredible what you can accomplish in a period of a, a year or two years. You could become, you know, exceptionally good at certain aspects of a thing by just doing it every day for a very short period of time. It's kind of a miracle that that's how it works. It adds up over time.

• 52:53Andrew Ng?

  Yeah, and I think it's, it's often not about the burst of sustained efforts and the all-nighters, because you could only do that a limited number of times. It's the sustained effort over a long time. I think, you know, reading two research papers is a nice thing to do, but the power is not reading two research papers, it's reading two research papers a week for a year. Then you read a hundred papers and, and you actually learn a lot when you read a hundred papers.

• 53:19Lex Fridman?

  So, regularity and making learning a, a habit. Do you have, do you have general other study tips for particularly deep learning that people should, in, in, in their process of learning, is there some kind of recommendations or tips you have as they learn?

• 53:37Andrew Ng?

  One thing I still do when I'm trying to study something really deeply is take handwritten notes. It varies. I know there are a lot of people that take the deep learning courses during a commute or something where it may be more awkward to take notes. So I know it may not work for everyone. But when I'm taking courses on Coursera, you know, and I still take some every now and then, the most recent one I took was a course on clinical trials, because I was interested about that. I got out my little Moleskine notebook and I was sitting at my desk, just taking down notes of what the instructor was saying. And that act, we know that that act of taking notes, preferably handwritten notes, increases retention.

• 54:16Lex Fridman?

  So as you're sort of watching the video, just kind of pausing maybe and then taking the basic insights down on paper?

• 54:24Andrew Ng?

  Yeah, so there have been a few studies, if you search online, you find some of these studies that taking handwritten notes, because handwriting is slower, as we're saying just now. It causes you to recode the knowledge in your own words more, and that process of recoding promotes long-term retention. This is as opposed to typing, which is fine. Again, typing is better than nothing, and taking a class and not taking notes is better than not taking any class at all. But comparing handwritten notes and typing, you can usually type faster for a lot of people than you can handwriting notes. And so when people type, they're more likely to just transcribe verbatim what they heard, and that reduces the amount of recoding, and that actually results in less long-term retention.

• 55:09Lex Fridman?

  I don't know what the psychological effect there is, but it's so true. There's something fundamentally different about writing, handwriting. I wonder what that is. I wonder if it is as simple as just the time it takes to write is slower.

• 55:21Andrew Ng?

  Yeah, and because you can't write as many words, you have to take whatever they said and summarize it into fewer words. And that summarization process requires deeper processing of the meaning, which then results in better retention.

• 55:35Lex Fridman?

  That's fascinating.

• 55:37Andrew Ng?

  And I think because of Coursera, I spent so much time studying pedagogy. It's actually one of my passions. I really love learning how to more efficiently help mothers learn. Yeah, one of the things I do both when creating videos or when we write the batch is I try to think, is one minute spent of us going to be a more efficient learning experience than one minute spent anywhere else? And we really try to, you know, make it time efficient for the learners because everyone's busy. So when we're editing, I often tell my teams, every word needs to fight for its life. If we can delete a word, let's just delete it and not waste the learner's time.

• 56:17Lex Fridman?

  That's so amazing that you think that way because there is millions of people that are impacted by your teaching. And sort of that one minute spent has a ripple effect, right? Through years of time, which is fascinating to think about. How does one make a career out of an interest in deep learning? Do you have advice for people? We just talked about sort of the beginning, early steps. But if you want to make it an entire life's journey, or at least a journey of a decade or two, how do you do it?

• 56:46Andrew Ng?

  So most important thing is to get started.

• 56:48Lex Fridman?

  Right.

• 56:48Andrew Ng?

  And I think in the early parts of a career coursework, like the deep learning specialization, is a very efficient way to master this material. So because instructors, be it me or someone else, or Lawrence Moroni teaches our Tensiflow specialization or other things we're working on, spend effort to try to make it time efficient for you to learn new concepts. So coursework is actually a very efficient way for people to learn concepts in the beginning parts of breaking into a new field. In fact, one thing I see at Stanford, some of my PhD students want to jump into research right away.

• 57:29Andrew Ng?

  And I actually tend to say, look, in your first couple of years of PhD, spend time taking courses because it lays the foundation. It's fine if you're less productive in your first couple of years. You'd be better off in the long term. Beyond a certain point, there's materials that doesn't exist in courses because it's too cutting edge, the course hasn't been created yet, there's some practical experience that we're not yet that good at teaching in a course. And I think after exhausting the efficient coursework, then most people need to go on to either ideally work on projects and then maybe also continue their learning by reading blog posts and research papers and things like that. Doing projects is really important.

• 58:10Andrew Ng?

  And again, I think it's important to start small and just do something. Today, you read about deep learning, it feels like, oh, all these people are doing such exciting things. What if I'm not building a neural network that changes the world, then what's the point? Well, the point is sometimes building that tiny neural network, you know, be it MNIST or upgrade to fashion MNIST, to whatever, doing your own fun hobby project. That's how you gain the skills to let you do bigger and bigger projects. I find this to be true at the individual level and also at the organizational level. For a company to become good at machine learning, sometimes the right thing to do is not to tackle the giant project, is instead to do the small project that lets the organization learn and then build out from there.

• 58:52Andrew Ng?

  But this is true both for individuals and for companies.

• 58:56Lex Fridman?

  Taking the first step and then taking small steps is the key. Should students pursue a PhD, do you think? You can do so much, that's one of the fascinating things of machine learning, you can have so much impact without ever getting a PhD. So what are your thoughts? Should people go to grad school? Should people get a PhD?

• 59:16Andrew Ng?

  I think that there are multiple good options of which doing a PhD could be one of them. I think that if someone's admitted to a top PhD program, you know, at MIT, Stanford, top schools, I think that's a very good experience. Or if someone gets a job at a top organization, at the top AI team, I think that's also a very good experience. There are some things you still need a PhD to do. If someone's aspiration is to be a professor, you know, at the top academic university, you just need a PhD to do that. But if it goes to, you know, start a company, build a company, do great technical work, I think a PhD is a good experience, but I would look at the different options available to someone, you know, where are the places where you can get a job, where are the places

• 1:00:01Andrew Ng?

  you can get a PhD program and kind of weigh the pros and cons of those.

• 1:00:05Lex Fridman?

  So just to linger on that for a little bit longer, what final dreams and goals do you think people should have? So what options should they explore? So you can work in industry, so for a large company, like Google, Facebook, Baidu, all these large sort of companies that already have huge teams of machine learning engineers. You can also do with an industry sort of more research groups that kind of like Google Research, Google Brain. Then you can also do, like we said, a professor in academia. And what else? Oh, you can build your own company. You can do a startup. Is there anything that stands out between those options? Or are they all beautiful, different journeys that people should consider?

• 1:00:50Andrew Ng?

  I think the thing that affects your experience more is less, are you in this company versus that company? Or academia versus industry? I think the thing that affects your experience most is who are the people you're interacting with in a daily basis? So even if you look at some of the large companies, the experience of individuals in different teams is very different. And what matters most is not the logo above the door when you walk into the giant building every day. What matters the most is who are the 10 people? Who are the 30 people you interact with every day? So I actually tend to advise people, if you get a job from a company, ask, who is your manager? Who are your peers? Who are you actually going to talk to? We're all social creatures. We tend to, you know, become more like the people around us.

• 1:01:32Andrew Ng?

  And if you're working with great people, you will learn faster. Or if you get admitted, if you get a job at a great company or a great university, maybe the logo you walk in, you know, is great, but you're actually stuck in some team doing really work that doesn't excite you. And then that's actually a really bad experience. So this is true both for universities and for large companies. For small companies, you can kind of figure out who you'll be working with quite quickly. And I tend to advise people, if a company refuses to tell you who you will work with, someone say, oh, join us, the rotation system will figure it out. I think that that's a worrying answer because it means you may not get sent to,

• 1:02:13Andrew Ng?

  you may not actually get to a team with great peers and great people to work with.

• 1:02:18Lex Fridman?

  It's actually a really profound advice that we kind of sometimes sweep. We don't consider too rigorously or carefully is the people around you are really often, especially when you accomplish great things, it seems that great things are accomplished because of the people around you. So that's a, it's not about the, whether you learn this thing or that thing, or like you said, the logo that hangs up top. It's the people. That's a fascinating, and it's such a hard search process of finding, just like finding the right friends and somebody to get married with and that kind of thing. It's a very hard search. It's a people's search problem.

• 1:02:58Andrew Ng?

  Yeah, but I think when someone interviews, you know, at a university, at a research lab, at a large corporation, it's good to insist on just asking, who are the people? Who is my manager? And if you refuse to tell me, I'm gonna think, well, maybe that's because you don't have a good answer. It may not be someone I like.

• 1:03:14Lex Fridman?

  And if you don't particularly connect, or something feels off with the people, then don't stick to it. You know, that's a really important signal to consider.

• 1:03:26Andrew Ng?

  Yeah, yeah. And actually, I actually, in my standard class, CS two thirty, I suppose, an ACM talk, I think I gave like a hour-long talk on career advice, including on the job search process and some of these. So you can find those videos online.

• 1:03:40Lex Fridman?

  Awesome, and I'll point them. I'll point people to them. Beautiful. So the AI fund helps AI startups get off the ground. Or perhaps you can elaborate on all the fun things it's involved with. What's your advice on how does one build a successful AI startup?

• 1:03:59Andrew Ng?

  You know, in Silicon Valley, a lot of startup failures come from building a product that no one wanted. So when, you know, cool technology, but who's gonna use it? So I think I tend to be very outcome-driven and customer-obsessed. Ultimately, we don't get to vote if we succeed or fail. It's only the customer that, they're the only one that gets a thumbs up or thumbs down votes in the long term. In the short term, you know, there are various people that get various votes, but in the long term, that's what really matters.

• 1:04:33Lex Fridman?

  So as you build a startup, you have to constantly ask the question, will the customer give a thumbs up on this?

• 1:04:41Andrew Ng?

  I think so. I think startups that are very customer focused, customer says, deeply understand the customer and are oriented to serve the customer are more likely to succeed. With the provision, I think all of us should only do things that we think create social good and moves the world forward. So I personally don't want to build addictive digital products just to sell a lot of ads. You know, there are things that that could be lucrative that I won't do.

• 1:05:09Andrew Ng?

  But if we can find ways to serve people in meaningful ways, I think those can be, those can be great things to do, either in the academic setting or in a corporate setting or a startup setting.

• 1:05:20Lex Fridman?

  So can you give me the idea of why you started the AI fund?

• 1:05:26Andrew Ng?

  I remember when I was leading the AI group at Baidu, I had two jobs, two parts of my job. One was to build an AI engine to support the existing businesses and that was running, you know, just ran, just performed by itself. The second part of my job at the time was to try to systematically initiate new lines of businesses using the company's AI capabilities. So, you know, the self-driving car team came out of my group, the smart speaker team, similar to what is Amazon Echo or Alexa in the US, but we actually announced it before Amazon did. So Baidu wasn't following, wasn't following Amazon. That, that came out of my group and I found that to be actually the most fun part of my job.

• 1:06:10Andrew Ng?

  So what I want to do was to build AI fund as a startup studio to systematically create new startups from scratch. With all the things we can now do with AI, I think the ability to build new teams to go after this rich space of opportunities is a very important way to, very important mechanism to get these projects done that I think will move the world forward. So I've been fortunate to build a few teams that had a meaningful, positive impact. And I felt that we might be able to do this in a more systematic, repeatable way. So a startup studio is a relatively new concept. There are maybe dozens of startup studios, you know, right now.

• 1:06:53Andrew Ng?

  But I feel like all of us, many teams are still trying to figure out how do you systematically build companies with a high success rate? So I think even a lot of my venture capital friends are seem to be more and more building companies rather than investing in companies. But I find it fascinating thing to do to figure out the mechanisms by which we could systematically build successful teams, successful businesses in areas that we find meaningful.

• 1:07:20Lex Fridman?

  So startup studio is something, is a place and a mechanism for startups to go from zero to success. So try to develop a blueprint.

• 1:07:31Andrew Ng?

  It's actually a place for us to build startups from scratch. So we often bring in founders and work with them or maybe even have existing ideas that we match founders with. And then this launches, you know, hopefully into successful companies.

• 1:07:48Lex Fridman?

  So how close are you to figuring out a way to automate the process of starting from scratch and building a successful AI startup?

• 1:07:57Andrew Ng?

  Yeah, I think we've been constantly improving and iterating on our processes for how we do that. So things like, you know, how many customer calls do we need to make in order to get customer validation? How do we make sure this technology can be built? Quite a lot of our businesses need cutting edge machine learning algorithms. So kind of algorithms are developed in the last one or two years. And even if it works in a research paper, it turns out taking the production is really hard. There are a lot of issues for making these things work in the real life that are not widely addressed in academia. So how do we validate that this is actually doable? How do you build a team, get the specialized domain knowledge, be it in education or healthcare, whatever sector we're focusing on?

• 1:08:40Andrew Ng?

  So I think we've actually been getting much better at giving the entrepreneurs a high success rate. But I think we're still, I think the whole world is still in the early phases of figuring this out.

• 1:08:52Lex Fridman?

  But do you think there is some aspects of that process that are transferable from one startup to another, to another, to another?

• 1:09:00Andrew Ng?

  Yeah, very much so. You know, starting a company to most entrepreneurs is a really lonely. Thing and I've seen so many entrepreneurs not know how to make a certain decisions like when, when, when do you need to, how do you do B two B sales, right? If you don't know that, it's, it's, it's really hard. Or how do you market this efficiently other than, you know, buying ads, which is really expensive? Are there more efficient tactics to that? Or for a machine learning project, you know, basic decisions can change the course of whether machine learning product works or not. And so there are so many hundreds of decisions that entrepreneurs need to make. And making a mistake in a couple of key decisions can have a huge impact

• 1:09:45Andrew Ng?

  on, on the fate of the company. So I think a startup studio provides a support structure that makes starting a company much less of a lonely experience. And also when facing with these key decisions, like trying to hire your first VP of engineering, what's good selection criteria? How do you solve? Should I hire this person or not? By helping, by having, by having an ecosystem around the entrepreneurs, the founders to help, I think we help them at the key moments and hopefully significantly make them more enjoyable and then higher success rate.

• 1:10:19Lex Fridman?

  So they have somebody to brainstorm with in these very difficult decision points.

• 1:10:25Andrew Ng?

  And also to help them recognize what they may not even realize is a key decision point.

• 1:10:31Lex Fridman?

  Right, that's, that's the first and probably the most important part, yeah.

• 1:10:35Andrew Ng?

  Actually, I can say one other thing. You know, I, I think building companies is one thing, but I, I feel like it's really important that we build companies that move the world forward. For example, within the AI Fund team, there was once an idea for a new company that if it had succeeded, would have resulted in people watching a lot more videos in a certain narrow vertical type of video. I looked at it, the business case was fine, the revenue case was fine, but I looked and I just said, I don't want to do this, like, you know, I, I don't actually just want to have a lot more people watch this type of video. Wasn't educational, it's educational, maybe.

• 1:11:13Lex Fridman?

  Yeah.

• 1:11:13Andrew Ng?

  And so, and so I, I, I, I coded the idea on the basis that I didn't think would actually help people. So whether building companies or working enterprises or doing personal projects, I think.

• 1:11:26Andrew Ng?

  It's up to each of us to figure out what's the difference we want to make in the world.

• 1:11:31Lex Fridman?

  With lending AI, you help already established companies grow their AI and machine learning efforts. How does a large company integrate machine learning into their efforts?

• 1:11:42Andrew Ng?

  AI is a general purpose technology, and I think it will transform every industry. Our community has already transformed to a large extent the software internet sector. Most software internet companies, yeah, outside the top, right, five or six or three or four, already have reasonable machine learning capabilities or getting there. There's still room for improvement. But when I look outside the software internet sector, everything from manufacturing, agriculture, healthcare, logistics, transportation, there's so many opportunities that very few people are working on. So I think the next wave for AI is for us to also transform all of those other industries. There was a McKinsey study estimating thirteen trillion dollars of global economic growth.

• 1:12:27Andrew Ng?

  US GDP is nineteen trillion dollars, so thirteen trillion is a big number, or P W C estimate sixteen trillion dollars. So whatever number is is large. But the interesting thing to me was a lot of that impact would be outside the software internet sector. So we need more teams to work with these companies to help them adopt AI. And I think this is one of the things that will make, you know, help drive global economic growth and make humanity more powerful.

• 1:12:53Lex Fridman?

  And like you said, the impact is there. So what are the best industries, the biggest industries where AI can help, perhaps outside the software tech sector?

• 1:13:01Andrew Ng?

  Frankly, I think it's all of them.

• 1:13:05Andrew Ng?

  Some of the ones I'm spending a lot of time on are manufacturing, agriculture, look into healthcare. For example, in manufacturing, we do a lot of work in visual inspection where today there are people standing around using the eye, human eye, to check if, you know, this plastic part or the smartphone or this thing has a scratch or a dent or something in it. We can use a camera to take a picture, use a algorithm, deep learning and other things to check if it's defective or not. And thus help factories improve yield and improve quality and improve throughput. It turns out the practical problems we run into are very different than the ones you might read about in most research papers. The data sets are really small, so we face small data problems.

• 1:13:50Andrew Ng?

  You know, the factories keep on changing the environment, so it works well on your test set, but guess what? You know, something changes in the factory, the lights go on or off. Recently, there was a factory in which a bird flew through the factory and pooped on something. And so that changed stuff. And so increasing our algorithmic robustness, so all the changes happen in the factory. I find that we run into a lot of practical problems that are not as widely discussed in academia. And it's really fun kind of being on the cutting edge, solving these problems before, maybe before many people are even aware that there is a problem there.

• 1:14:27Lex Fridman?

  And that's such a fascinating space. You're absolutely right. But what is the first step that a company should take? It's just scary leap into this new world of going from the human eye inspecting to digitizing that process, having a camera, having an algorithm. What's the first step? Like, what's the early journey that you recommend that you see these companies taking?

• 1:14:50Andrew Ng?

  I published a document called the AI Transformation Playbook that's online and taught briefly in the AI for Everyone course on Coursera about the long-term journey that companies should take. But the first step is actually to start small. I've seen a lot more companies fail by starting too big than by starting too small. Take even Google. You know, most people don't realize how hard it was and how controversial it was in the early days. So when I started Google Brain, it was controversial. People thought deep learning, neural nets, tried it, didn't work. Why would you want to do deep learning? So my first internal customer within Google was the Google Speech Team, which is not the most lucrative project in Google, not the most important.

• 1:15:35Andrew Ng?

  It's not web search or advertising. But by starting small, my team helped the speech team build a more accurate speech recognition system. And this caused their peers, other teams, to start to have more faith in deep learning. My second internal customer was the Google Maps team, where we use computer vision to read house numbers, from basic street view images to more accurately locate houses with Google Maps, so improve the quality of geodata. And it was only after those two successes that I then started the more serious conversation with the Google Ads team.

• 1:16:10Lex Fridman?

  And so there's a ripple effect that you showed that it works in these in these cases. And then it just propagates through the entire company that this this thing has a lot of value and use for us.

• 1:16:20Andrew Ng?

  I think the early small scale projects, it helps the teams gain faith, but also helps the teams learn what these technologies do. I still remember when our first GPU server, it was a server under some guy's desk. And, you know, and and then that taught us early important lessons about how do you have multiple users share a set of GPUs, which is really not obvious at the time, but those early lessons were important. We learned a lot from that first GPU server that later helped the teams think through how to scale it up to to much larger deployments.

• 1:16:54Lex Fridman?

  Are there concrete challenges that companies face that that you see is important for them to solve?

• 1:17:01Andrew Ng?

  I think building and deploying machine learning systems is hard. There's a huge gulf between something that works in a Jupiter notebook on your laptop versus something that runs in a production deployment setting in a in a factory or agriculture plants or whatever. So I see a lot of people, you know, get something to work on your laptop and say, wow, look what I've done. And that's that's that's great. That's hard. That's a very important first step. But a lot of teams underestimate the rest of the steps needed. So for example, I've heard this exact same conversation between a lot of machine learning people and business people. The machine learning person says, look, my algorithm does well on the test set. It's a clean test set, I didn't peek. And then the machine and the business person says, thank you very much, but your algorithm sucks. It doesn't work.

• 1:17:46Andrew Ng?

  And the machine learning person says, no, wait, I did well on the test set.

• 1:17:52Andrew Ng?

  And I think there is a gulf between what it takes to do well on a test set on your hard drive versus what it takes to work well in a in a deployment setting. Some some common problems, robustness and generalization, you know, you deploy something in the factory. Maybe they chop down a tree outside the factory so the tree no longer covers the window and the lighting is different. So the test set changes. And in machine learning and especially in academia, we don't know how. The deal with test set distributions are dramatically different than the training set distribution. You know, that that this research, the stuff like domain annotation, transfer learning, you know, there there are people working on it, but we're really not good at this. So how do you actually get this to work? Because your test set distribution is going to change.

• 1:18:39Andrew Ng?

  And I think also, if you look at the number of lines of code in the software system, the machine learning model is maybe five percent or even fewer relative to the entire software system you need to build. So how to get all that work done and make it reliable and systematic?

• 1:18:56Lex Fridman?

  So good software engineering work is fundamental here to building a successful, small machine learning system.

• 1:19:03Andrew Ng?

  Yes, and and the software system needs to interface with people's workloads. So machine learning is automation on steroids. If we take one task out of many tasks that are done in factories, so a factory does lots of things, one task is vision inspection. If we automate that one task, it can be really valuable, but you may need to redesign a lot of other tasks around that one task. For example, say the machine learning algorithm says this is defective. What are you supposed to do? Do you throw it away? Do you get a human to double check? Do you wanna rework it or fix it? So you need to redesign a lot of tasks around that thing you've now automated. So planning for the change management and making sure that the software you write is consistent with the new workflow.

• 1:19:44Andrew Ng?

  And you take the time to explain to people what needs to happen. So I think what landing AI has become good at, and then I think we learn by making mistakes and, you know, painful experiences. Well, my what what what become good at is working with our partners to think through all the things beyond just the machine learning model, you know, that you put in notebook, but to build the entire system, manage the change process and figure out how to deploy this in a way that has an actual impact. The processes that the large software tech companies use for deploying don't work for a lot of other scenarios. For example, when I was leading large speech teams, if the speech recognition system goes down, what happens? Well, alarms goes off and then someone like me would say, hey,

• 1:20:30Andrew Ng?

  you 20 engineers, please fix this.

• 1:20:32Lex Fridman?

  Right.

• 1:20:32Andrew Ng?

  And it will get. But if you have a system go down in the factory, there are not 20 machine learning engineers sitting around. You can page a duty and have them fix it. So how do you deal with the maintenance or the or the dev ops or the MO ops or the other aspects of this? So these are concepts that I think landing AI and a few other teams on the cutting edge of. But we don't even have systematic terminology yet to describe some of the stuff we do, because I think we're inventing it on the fly.

• 1:21:02Lex Fridman?

  So you mentioned some people are interested in discovering mathematical beauty and truth in the universe, and you're interested in having a big positive impact in the world. So let me ask a.

• 1:21:13Andrew Ng?

  The two are not inconsistent.

• 1:21:14Lex Fridman?

  No, they're all together. I'm only half joking because you're probably interested a little bit in both. But let me ask a romanticized question. So much of the work, your work and our discussion today has been on applied AI. Maybe you can even call narrow AI, where the goal is to create systems that automate some specific process that adds a lot of value to the world. But there's another branch of AI, starting with Alan Turing, that kind of dreams of creating human level or superhuman level intelligence. Is this something you dream of as well? Do you think we human beings will ever build a human level intelligence or superhuman level intelligence system?

• 1:21:54Andrew Ng?

  I would love to get to AGI, and I think humanity will. But whether it takes 100 years or 500 or 5,000, I find hard to estimate.

• 1:22:05Lex Fridman?

  Do you have, so some folks have worries about the different trajectories that path would take, even existential threats of an AGI system. Do you have such concerns, whether in the short term or the long term?

• 1:22:19Andrew Ng?

  I do worry about the long-term fate of humanity. I do wonder as well. I do worry about overpopulation on the planet Mars, just not today. I think there will be a day when, maybe someday in the future, Mars will be polluted, there are all these children dying, and someone will look back at this video and say, Andrew, how was Andrew so heartless? He didn't care about all these children dying on the planet Mars. And I apologize to the future viewer, I do care about the children, but I just don't know how to productively work on that today.

• 1:22:53Lex Fridman?

  Your picture would be in the dictionary for the people who are ignorant about the overpopulation on Mars. Yes, so it's a long-term problem. Is there something in the short term we should be thinking about in terms of aligning the values of our AI systems with the values of us humans? Sort of something that Stuart Russell and other folks are thinking about, as this system develops more and more, we want to make sure that it represents the better angels of our nature, the ethics, the values of our society.

• 1:23:26Andrew Ng?

  You know, if you take self-driving cars, the biggest problem with self-driving cars is not that there's some trolley dilemma, and you teach this, so you know. How many times, when you are driving your car, did you face this moral dilemma? Who did I crash into? So I think self-driving cars will run into that problem roughly as often as we do when we drive our cars. The biggest problem with self-driving cars is when there's a big white truck across the road, and what you should do is brake and not crash into it, and the self-driving car fails and it crashes into it. So I think we need to solve that problem first. I think the problem with some of these discussions about AGI

• 1:24:05Andrew Ng?

  You know, alignments, the paperclip problem is that is a huge distraction from the much harder problems that we actually need to address today. Some of the hard problems we need to address today, I think bias is a huge issue. I worry about wealth inequality. The AI and internet are causing an acceleration of concentration of power because we can now centralize data, use AI to process it. And so industry after industry will affect every industry. So the internet industry has a lot of win and take most or win and take all dynamics, both have infected all these other industries. So also giving these other industries win and take most or win and take all flavors. So look at what Uber and Lyft did to the taxi industry.

• 1:24:49Andrew Ng?

  So we're doing this type of things a lot. So this, so we're creating tremendous wealth, but how do we make sure that the wealth is fairly shared? I think that, and then how do we help people whose jobs are displaced? You know, I think education is part of it. There may be even more that we need to do than education.

• 1:25:09Andrew Ng?

  I think bias is a serious issue. There are adverse uses of AI, like deepfakes being used for various and nefarious purposes. So I worry about some teams, maybe accidentally, and I hope not deliberately, making a lot of noise about things that problems in the distant future, rather than focusing on some of the much harder problems.

• 1:25:33Lex Fridman?

  Yeah, to overshadow the problems that we have already today that are exceptionally challenging, like those you said, and even the silly ones, but the ones that have a huge impact, which is the lighting variation outside of your factory window. That, that ultimately is what makes the difference between, like you said, the Jupiter notebook and something that actually transforms an entire industry potentially.

• 1:25:54Andrew Ng?

  Yeah, and I think, and then just to, to, to, some companies or regulator comes to you and says, look, your product is messing things up. Fixing it may have a revenue impact. Well, it's much more fun to talk to them about how you promise not to wipe out humanity than to face the actually really hard problems we face.

• 1:26:13Lex Fridman?

  So your life has been a great journey from teaching to research to entrepreneurship. Two questions. One, are there regrets moments that if you went back, you would do differently? And two, are there moments you're especially proud of? Moments that made you truly happy?

• 1:26:30Andrew Ng?

  You know, I've made so many mistakes. It feels like every time I discover something, I go, why didn't I think of this? You know, five years earlier or even 10 years earlier. And as recent and then sometimes I read a book and I go, I wish I read this book 10 years ago. My life would have been so different. Although that happened recently and then I was thinking, if only I read this book when we're starting up Coursera, it could have been so much better. But I discovered the book had not yet been written and we're starting Coursera. So that made me feel better. But I find that the process of discovery, we keep on finding out things that seem so obvious in hindsight.

• 1:27:15Andrew Ng?

  But it always takes us so much longer than than I wish to to figure it out.

• 1:27:20Lex Fridman?

  So on the second question, are there moments in your life that if you look back, that you're especially proud of or you're especially happy? The that fills you with happiness and fulfillment?

• 1:27:35Andrew Ng?

  Well, two answers. One, does my daughter know where?

• 1:27:38Lex Fridman?

  Yes, of course.

• 1:27:39Andrew Ng?

  She's like, no, but how much time I spend with her? I just can't spend enough time with her.

• 1:27:42Lex Fridman?

  Congratulations, by the way.

• 1:27:43Andrew Ng?

  Thank you. And then second is helping other people. I think to me, I think the meaning of life is helping others achieve whatever are their dreams. And then also to try to move the world forward by making humanity more powerful as a whole. So the times that I felt most happy, most proud was when I felt someone else.

• 1:28:08Andrew Ng?

  Allow me the good fortune of helping them a little bit on the path to their dreams.

• 1:28:14Lex Fridman?

  I think there's no better way to end it than talking about happiness and the meaning of life. So Andrew, it's a huge honor, me and millions of people. Thank you for all the work you've done. Thank you for talking today.

• 1:28:24Andrew Ng?

  Thank you so much. Thanks.

• 1:28:26Lex Fridman?

  Thanks for listening to this conversation with Andrew Ng. And thank you to our presenting sponsor Cash App. Download it, use code LexPodcast, you'll get $10 and $10 will go to First, an organization that inspires and educates young minds to become science and technology innovators of tomorrow. If you enjoy this podcast, subscribe on YouTube, give it five stars on Apple Podcasts, support it on Patreon, or simply connect with me on Twitter at Lex Fridman. And now let me leave you with some words of wisdom from Andrew Ng. Ask yourself, if what you're working on succeeds beyond your wildest dreams, which you have significantly helped other people. If not, then keep searching for something

• 1:29:09Lex Fridman?

  else to work on. Otherwise, you're not living up to your full potential. Thank you for listening and hope to see you next time.