Pod Insights a16z Podcast a16z Podcast | Exploding the Map About this episode In this episode, Wei Luo, founding COO of DeepMap -- who build HD maps for autonomous vehicles -- and David Rumsey, founder of the David Rumsey Map Collection (one of the largest paper private map collections in the world, now at Stanford University, and *the* largest digital online private collection in the world, at 80,000 + maps) talk with a16z's Hanne Tidnam about how maps -- and mapmaking tools -- are changing in the age of autonomous vehicles.
New ways of mapping the world have always led to profound changes. In the Renaissance -- another golden age of mapmaking -- mapmakers used tools such as sextants to measure distance to the stars and compasses to navigate the world around them. Cartography is undergoing yet another major paradigm shift as it now evolves into HD mapping. So what kinds of data and information do maps now need to contain in order to allow cars (and other autonomous robots of all kinds) to navigate the world around them, down to only a few centimeters of accuracy? How will the nature of maps fundamentally change when they are made by self-driving cars, for self-driving cars, in the era of HD mapping?
Transcript Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.
0:00 Speaker 00 The content here is for informational purposes only, should not be taken as legal, business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any A16Z fund. For more details, please see A16Z.com/disclosures.
0:19 Hanne Tidnam? Hi, and welcome to the A16Z Podcast. I'm Hannah, and we're here today talking about the evolution of cartography, how mapmaking is fundamentally changing in the age of autonomous vehicles, with Waylow, COO and Head of Product of Deepmap, which creates HD maps for autonomous vehicles, and David Rumsey, map collector of one of the largest private paper map collections in the world, now at Stanford, and of the largest online digital map collection. We talk about how the tools we use have changed from sextance to measure the stars, to computer vision and LiDAR, as well as how we think about what maps actually do and are used for. Maps have really evolved from incredibly primitive technology, right, like sextance
1:02 Hanne Tidnam? and stars, really, to now, I guess, satellite and camera and laser and LiDAR and beyond. So, has the nature of mapping itself fundamentally changed, or do we use maps differently now? Or is it the same, just more than it has been in the past?
1:20 Speaker 02 Well, I see, I never referred to sextance as primitive. They were, you know, the LiDAR of the day. Sextance opened up the whole world and created the ability to make scale maps and to map essentially beyond where you were.
1:38 Hanne Tidnam? When would you say the beginning of sort of the golden era of mapping was?
1:42 Speaker 02 Well, it was really around the time of Columbus, because the whole discovery of North and South America produced a phenomenal Amount of desire to map it, to possess it. One of our favorite globes is the, it's called the Earth Apple, which was by Martin Behaim, the year Columbus discovered America, 1492. And there's no North and South America on the globe.
2:06 Hanne Tidnam? Amazing.
2:06 Speaker 02 And of course, there's a huge Japan and China beckoning.
2:11 Speaker 03 And completely not to scale either.
2:13 Speaker 02 Even though we know Columbus sailed west in order to go to China, seeing it on the globe without North and South America makes it so real. So that's when maps get really powerful.
2:23 Hanne Tidnam? Well, and it's interesting because it's capturing an entire time too, right? It's a representation of our, all our knowledge at the time.
2:30 Speaker 02 Well, that's the history in the maps. That globe has information that you cannot get any other way.
2:36 Hanne Tidnam? So if the bones of the maps were once, you know, longitude and latitude and medians, what are the bones of maps now today? Where are we at in the state of mapping?
2:47 Speaker 03 Mapping has always been almost the frontier of technology. People who can make really good maps for that time tend to be the most technically advanced and mathematically advanced.
2:59 Hanne Tidnam? Well, because it's always about processing information, right? It's always about getting the right information.
3:04 Speaker 03 It's about getting the right information and then do it in a very incredibly, the most precise way at the given time. 300 years ago, even 500 years ago, their understanding of the environment is very limited, but somehow they need to predict into areas that they cannot visually see. And today, you know, back to your question, you know, how, what are the backbones of today's digital maps? Well, first of all, we have a lot of sensors that can enable us to see far, right? You know, there are satellites up in the air. There are, you know, airplanes up in the air. Even the cars on the road, a lot of them have a lot of sensors as well. We'll have radars, we'll have cameras and so on.
3:49 Speaker 03 So a lot of this digital information is already getting collected and we can use that information to help us create digital maps.
3:57 Hanne Tidnam? And it's, and they're being created all the time. It's, the maps are constantly being redrawn.
4:01 Speaker 03 That's actually a very interesting question because as of today, that process is actually not happening. We are collecting a lot of data. But the information that is actually being shared for map creation purpose is very small. So if you think about the maps that you actually use today, right, there are maps that you have on your phone, there are maps that are probably in your car navigation system as well. Those maps were not created from the GPS unit that you have on your car or the camera system that you have in your car and whatnot. They were created by special, what we call mapping survey fleets. So companies like, you know, for instance, Google will
4:43 Speaker 03 build these special fleet that has a lot of special sensors mounted on these special cars. They would hire human drivers to drive these road, collect a lot of data, and then they do a lot of offline processing. And at the end of day, some digital map of, you know, cities would be produced and they get inserted into the cars, they get stored in a cloud and then sent to your phone.
5:08 Hanne Tidnam? But even though it's using new tools, it's sort of an old fashioned model of thinking about map making, right? Like you send one pioneer out to map everything and it's a static thing.
5:18 Speaker 02 Absolutely. We, in addition to collecting maps, I do collect the tools of map making.
5:24 Hanne Tidnam? Oh, do you?
5:24 Speaker 02 Sexton's, yeah. And for mapping the West, there would be, you know, typically officers in the army, 1870, where they, we have a big wooden board that they would keep on their arm as they drew the map from their horse, sort of like, not a self-driving car.
5:43 Hanne Tidnam? But like a, like a, like a drawing board? Like a, like a portable drawing board that they would attach? Amazing.
5:49 Speaker 02 They'd be moving through the environment.
5:50 Speaker 03 That sounds like a survey car or survey horse.
5:51 Speaker 02 Yeah, exactly.
5:53 Hanne Tidnam? It was a survey horse, yeah.
5:54 Speaker 02 But you can imagine the length of time for that drawing to get from that person.
6:02 Speaker 02 Onto the map.
6:03 Hanne Tidnam? On the Pony Express.
6:04 Speaker 02 Yeah.
6:04 Hanne Tidnam? And then back to, yeah, years.
6:07 Speaker 02 Which they thought was revolutionary, you know, that it was very fast.
6:10 Hanne Tidnam? So the speed has really increased, right? The mapping speed is what's increased.
6:14 Speaker 02 Yes.
6:14 Hanne Tidnam? But the nature of it hasn't really changed so much. Or would you say no?
6:20 Speaker 02 One thing that has changed drastically from paper maps is that maps are dynamic now.
6:25 Hanne Tidnam? Mm hmm.
6:26 Speaker 02 Maps are changing. You know, with paper maps, we have a sense of scale. The scale is printed onto the map and it's fixed. But with digital maps, the scale is
6:37 Hanne Tidnam? Fluid.
6:37 Speaker 02 Totally fluid and variable. And the accuracy just depends on the size of the resolution.
6:44 Speaker 03 Mapping as a field has evolved or reinvented itself many times throughout history. And now we're reinventing it again.
6:52 Hanne Tidnam? Right. What are those moments?
6:54 Speaker 02 Methods of printing, particularly, shape mapping. So the first maps were done with woodblock. You could only get, you know, 100 good impressions. So maps were held by, you know, people who were rulers, who were wealthy and so on. Then it changed to copper engraving. You could make 500 impressions, copper engraving to lithography in the 19th century, thousands of maps, and now chromolithography. And then eventually digital distribution over the web. So maps have become ubiquitous.
7:25 Hanne Tidnam? It's the access to the map.
7:26 Speaker 02 The access has been the most profound change. The actual depiction of space, I think, or the goal to depict space has been remarkably consistent.
7:37 Hanne Tidnam? It's democratizing the map.
7:39 Speaker 03 You know, not only the printing or the access of the map has changed over time, but if you look at the general trend, maps tend to get more and more accurate over time, just in general.
7:50 Hanne Tidnam? Right. We're already doing that.
7:52 Speaker 03 A lot of people thought that, you know, mapping has been solved with today's commonly available navigation maps because they seem very accurate for
8:00 Hanne Tidnam? Because we all have access.
8:02 Speaker 03 We already have access.
8:03 Hanne Tidnam? They feel like they're updating.
8:05 Speaker 03 That's right. You get real time traffic on your Google Maps app and then so on and so forth. But if you actually dive deeper, maps today, including the digital maps, are actually built for human consumption only. So when or not you are looking at, say, Google Maps or, you know, Apple Maps, Waze and so on, these are maps purposely built to be, first of all, very easy to interpret by human beings and easy to use for navigation purpose. The navigation system is telling the humans how to navigate that car according to some very simple instructions.
8:38 Hanne Tidnam? It's also assuming that there is a human with human capabilities making those interpretations.
8:44 Speaker 03 That's absolutely correct. And what we are, the new period we're going to enter into is, or what's needed to be built for self-driving space is actually maps built, purposely built for robotics systems.
8:59 Hanne Tidnam? So now we have to democratize beyond the human.
9:02 Speaker 03 That's right, that's right.
9:03 Hanne Tidnam? So now we have a totally different set of demands that we need out of our maps. When we start looking at autonomous vehicles, we don't have enough right now to make sure that an autonomous car can predict exactly where something is and be safely in real time, right? So what has to change about mapping to serve that?
9:23 Speaker 03 We need maps that are easy to interpret by robots. Deep Map is focusing on self-driving cars, but you can generalize it to any robot that needs to roam around the physical world.
9:35 Hanne Tidnam? Yeah.
9:36 Speaker 03 Even though robots can outperform humans in certain aspects, in other aspects, they are, intelligence-wise, humans are actually much smarter. Things people tend, or humans tend to take for granted, such as stopping at the right place at an intersection, watching for the right traffic signal.
9:56 Hanne Tidnam? Or making a split last-minute decision to avoid a raccoon in the road.
10:00 Speaker 03 That's right.
10:01 Hanne Tidnam? Yeah.
10:01 Speaker 03 These decisions are very hard for robots to make. And as part of the decision-making process,
10:09 Speaker 03 The mapping becomes a very critical component of helping the robots to make the right decisions.
10:16 Hanne Tidnam? Because they're essentially reading the whole world around them through the map.
10:19 Speaker 03 That's right.
10:20 Hanne Tidnam? What does that mean for the kind of map we're now going to need in the future of autonomous vehicles?
10:25 Speaker 03 The maps that are purposely built for self-driving purpose are usually called high-definition maps or HD map for short. They specifically refer to the maps that have extremely high precision. And we're talking about centimeter level accuracy or precision. Because the robots need very precise instructions on how to maneuver themselves and how to navigate themselves around the 3D space.
10:54 Hanne Tidnam? Right, a few centimeters makes a really big difference when there's like maybe a curb there.
10:58 Speaker 03 Oh, absolutely. I mean, people tend to think, why do I need to say five centimeter or 10 centimeter accuracy when I'm driving down the road? In most cases, you know, the tolerance for error might be higher than that. But then there are going to be cases where if, you know, you're driving on, you know, I don't know, the road to Tahoe, there's literally cliffs on one side and there's really no room for error or any error. So the map needs to be extremely precise and it needs to contain a lot of information that, again, humans may take for granted. So not only we need to know where the lanes are, where the road boundaries are,
11:40 Speaker 03 we also want to know where the curbs are, how high the curbs are.
11:44 Speaker 02 If it's five centimeters in HD mapping, that's approaching something that's been sort of a holy grail for mappers forever, which is what we call the one-to-one map. It's the map of the world as big as the world.
11:57 Hanne Tidnam? Wow.
11:58 Speaker 02 Borjes writes a short story about the cartographer that made a map that was one-to-one. And the problem, he couldn't unroll it. It made me realize that HD mapping is a one-to-one mapping. And yet we don't unroll it, we roll through it.
12:13 Hanne Tidnam? It's so interesting because I think of like maps on some basic level as being condensing a huge amount of information and like taking one element of that information and showing it. Simplifying one in down into one picture of like. You know, borders or topography or land versus sea. But now you're talking about actually way more than one element.
12:35 Speaker 03 It's exploding the simple map to as full, as comprehensive as possible. The map needs to describe every little thing on the road and it needs to describe a lot of hidden things that you don't typically see on the map.
12:50 Hanne Tidnam? Like what?
12:51 Speaker 03 Like, for instance, the speed limit on the road that you see. You want to tell, you know, encode into the map whether or not this lane is allowed to go straight at intersection or is required to make a left turn or right turn.
13:05 Hanne Tidnam? David, am I right that it was only one, sort of one boiling things down to one dimension or is it actually much more multi-dimensional than I'm thinking?
13:13 Speaker 02 I think a little more multi-dimensional because it, it isn't just about scale. It's also about comprehensiveness. So the first atlas was published in 1570 by Abraham Ortelius and it was actually the best selling book in Europe for years and years and years. And the reason it was so important to people was there were maps of the entire world in the book.
13:37 Hanne Tidnam? Oh, so it's always been important to capture as much.
13:41 Speaker 02 As much as possible. Now, these were not, obviously not anything like HD maps or even digital maps, but they were covering the whole earth. People love on old maps, the notion of terra incognita, which is put over the center of Australia or the American West.
13:58 Hanne Tidnam? The literally unmapped space that would call to people to come map it.
14:03 Speaker 02 So I don't think it is gone really. If we think about the oceans, I know Waze not talking about submarines being autopilot. The whole bathymetry mapping is, is, is a complete fascinating frontier.
14:18 Hanne Tidnam? Bathymetry mapping being underwater.
14:19 Speaker 02 Mapping the under, undersea areas.
14:21 Hanne Tidnam? That's fascinating, but it actually sounds like. We are at a whole new frontier, right, of trying to process all that information into a real map.
14:30 Speaker 02 Now you are, you're really just exploding what the map is. The map becomes reality.
14:37 Hanne Tidnam? Well, and it's also it's immersive.
14:39 Speaker 02 It's immersive.
14:40 Hanne Tidnam? It's an immersive map. So what kind of tools allow you to do that? How are we actually starting to explode this map to map reality?
14:48 Speaker 03 On a very high level, obviously, there's the hardware component as well as the software component. The hardware components are more visible because if you look at, you know, even a picture of a self-driving car, you will quickly recognize it's a self-driving car, mostly because it has a lot of sensors typically around its rooftop. And all these sensors are useful for map creation and map update purpose. We use a combination of different type of sensors that includes cameras, LiDAR, GPS, IMU, which is a unit that tracks the movement of the car, and the radars as well.
15:27 Hanne Tidnam? Are you using everything you possibly can? Or have you made strategic choices about what the best combination and why those tools are?
15:34 Speaker 03 We try to actually make good use of all the sensors that are going to be mounted on a, let's say, a typical self-driving car. The reason is that self-driving car, number one requirement is needs to be very safe.
15:48 Hanne Tidnam? Yeah.
15:48 Speaker 03 We want to make sure we can take advantage of all the sensors in case when the cars is, when the car is running and one type of a sensor may fail or may get blocked. We can actually switch between different type of sensors in those
16:02 Hanne Tidnam? Oh, so it's like a backup plan as well. But why isn't just visual enough?
16:07 Speaker 02 Visual's really important, but I mean, for the same reason Wei is saying, today, in the past, they would use other methods, triangulation.
16:16 Hanne Tidnam? Right. It's about space, really.
16:18 Speaker 02 It's about space and taking mathematical calculations that they were doing essentially by hand, which are now done just instant.
16:26 Speaker 03 You know, either you measure with a ruler or with, I don't know, horses.
16:31 Speaker 02 Triangulation.
16:33 Speaker 03 You're trying to get some kind of distance matter, right? Through triangulation with camera data, you can do some triangulation and get distance estimate for sure. But when you're talking about extreme high precision measurement, cameras oftentimes is just not enough. And lasers gives you a precise measurement of depths or distance in the 3D space. If we're talking about sensors that are mounted on self-driving car, lidar and the cameras are always working together. Generally speaking, they're all running very fast, multiple times per second. As the car is driving, for instance, at fairly high speed, I don't know, 70 miles per hour on the highway,
17:16 Speaker 03 you or the car is generating or collecting a lot of data as it's driving at the high speed with both the cameras, the lidars, the radars, and all the other sensors.
17:28 Hanne Tidnam? You have a little like map making bubble, basically that you're traveling around the world in, also reading the map. It's consuming the map and creating the map at the same time.
17:38 Speaker 03 And it's not one bubble, it's lots of bubbles.
17:40 Hanne Tidnam? Well, that's what's interesting, right? Because maybe, because we were always consuming and creating the map at the same time, would you say? Or is that, is that different?
17:49 Speaker 02 Well, there often was a time lag, though, between, you know, the, the, the sources of information long ago would be all the way from sextants that we talked about, but also itineraries. You know, people would walk or go by horse and say how many hours it took from this town to the next, and they could extrapolate what the distance was.
18:09 Hanne Tidnam? Oh, yeah.
18:10 Speaker 02 Yeah, very, so it was never as instant as it is today. What fascinates me about the 21st century mapping is it's so open. You know, way saying that the Cars on the road will actually share information with each other. Sharing information in the history of mapping has been really important in moving accuracy ahead. And not every state in the world believed in sharing information. For instance, at one time in the period of explorations, the Spanish made extraordinary maps, but they did not share them. They viewed the information as totally proprietary.
18:52 Hanne Tidnam? And highly valuable.
18:53 Speaker 02 But their competitors, for instance, in the Pacific Northwest of the United States, the English, were releasing all of their map information. As soon as Vancouver explored the area around Seattle, all that information went to press in Britain and was widely used.
19:09 Hanne Tidnam? Circulated.
19:10 Speaker 02 So it's their names that lasted, and it was their settlers that came. So the whole notion of open content goes back a long time as being a very successful business model in the mapping world.
19:23 Hanne Tidnam? That's fascinating.
19:24 Speaker 02 Generally, those who hold information really tight, it may have short-term value, but long-term, it does not have nearly as much value as sharing. So I think that's one very important theme in terms of the history of cartography.
19:39 Hanne Tidnam? I love that. So we talked a little bit about the sensors. Are there ways that you gather the information? Other sources that are perhaps widely available that you guys are pulling in as part of this?
19:49 Speaker 03 The other part is obviously the software. And then the software piece is really interesting because, as you mentioned, each car is a little bubble collecting data. And obviously, the software needs to be there to power the hardware to collect recorded data. And then this information somehow needs to be shared.
20:06 Hanne Tidnam? Yeah. So where are you right now with your one-to-one map of reality? I mean, is that, are you all ready? How long does it take to get, to get that kind of depth of map? I mean, is, does one car driving through one time do it? Is that enough? One soldier on a horse?
20:24 Speaker 03 I don't think one soldier on a horse is sufficient. A single car cannot map the entire world. The reason is that when we think about how the, we not only think about how the map gets created, we also think about how the map needs to be maintained.
20:39 Hanne Tidnam? And updated.
20:40 Speaker 03 And updated to reflect the changes on the road. So instead of having one soldier with one horse, you know, I don't know, riding down the road once, we design for aggregated effect. Multiple cars driving down the same road and we aggregate all that data from multiple drives, multiple cars together. And the more cars you have on the road or the more data that we collect from, the higher quality the map will be.
21:08 Hanne Tidnam? Right, a constellation.
21:09 Speaker 03 A constellation, yes, many bubbles.
21:11 Hanne Tidnam? So you're dealing with enormous amounts of data that you have to instantly update, right? Receive and process and send. What are some of the challenges or the ways that you think about dealing with that?
21:22 Speaker 03 Cost is definitely a big challenge because you don't want to send tons and tons of data over cellular network. So the way that we think about how to solve the problem is to almost categorize what information that we need to share in real time and what information we don't need to share in real time.
21:40 Hanne Tidnam? That can be, to David's point, a slight lag.
21:43 Speaker 03 That's right.
21:44 Hanne Tidnam? Interesting. How do you qualify those different types of?
21:47 Speaker 03 Well, things that really impact driving behavior needs to be shared and then distributed to other cars that maybe be affected, such as, you know, accident on the road.
22:00 Hanne Tidnam? Right.
22:01 Speaker 03 Or maybe, you know, in the rain, last rainy season that we had in the Bay Area, there were a lot of landslides, trees falling down on the road.
22:08 Hanne Tidnam? How about faster things like a deer runs across the road?
22:11 Speaker 03 You can, but I'm not sure if that information is very valuable to share with the car behind you.
22:17 Hanne Tidnam? That's true. Yeah.
22:18 Speaker 03 There are certain, I don't know.
22:19 Hanne Tidnam? Only in as much as like there might be more, right?
22:22 Speaker 03 That's right. Yeah, that's, that's possible. Or if you have, I'm, I'm just thinking out loud, if you have a delivery van who is spilling out, I don't know.
22:32 Hanne Tidnam? Yes.
22:33 Speaker 03 Oranges.
22:33 Hanne Tidnam? Yeah.
22:34 Speaker 03 Right? That spill may last.
22:37 Hanne Tidnam? Longer than a fleeting second. Yes, yeah.
22:39 Speaker 03 But as a human driver, if you needed to respond to that scenario in the real time and the car behind you would respond in a similar fashion, then that information. Should be shared as quickly as possible.
22:52 Hanne Tidnam? If it's something that needs to be in the broader driving ecosystem instantly.
22:56 Speaker 03 Right. Let's say, you know, there is a new road construction happening, which may take quite some while to actually complete. And as the cars are going over that stretch of road, you can keep collecting the data till the change actually gets into or once the change is actually in effect, and then you distribute that information more broadly to all the cars.
23:20 Hanne Tidnam? It's so interesting that it's sort of exploding the time dimension of map, too. You know, it's like becoming a living organism.
23:27 Speaker 03 It's a very much organic process, the way I think about it.
23:32 Hanne Tidnam? So now you have all this data that we're collecting in these deep maps. What happens to those? Where do they live? And how do they, how long do they live for? You know, are we storing up this map of the world that will, you know, that is recording it in a way we've sort of never seen before?
23:49 Speaker 03 There are a lot of data being, being collected now, and there are going to be a lot more data being collected in the future, once you have more self-driving cars on the road. This is where cloud infrastructure comes into place, of course, is the ultimate storage place. And it's also the place where 99% of the computation is done for map creation and map updates. But then each individual car will have its own, I don't know, memory cells as well as its own intelligence. Another term people tend to use is called edge computing. Essentially, each car will carry some storage and some computing power so that it can make its own decision independently.
24:31 Hanne Tidnam? Right.
24:32 Speaker 03 If, you know, it's completely offline, it should be still fully functional. So the maps are constantly being called by the rest of self-driving software stack, such as the perception system, such as the planning and control system, again, many times per second.
24:47 Hanne Tidnam? The interpretation.
24:48 Speaker 03 The interpretation of the map. And as you come across a change, a change detection module needs to kick in and say, that looks different from what my map tells me. Now I need to decide if that's an important enough change to be distributed in real time, or
25:07 Speaker 03 You know, through the edge compute process, the, the, the, the computers on the cars need to decide whether or not I need to actually maybe enter an active data collection mode and then share that data with the cloud.
25:19 Hanne Tidnam? So the decision making is separate from the map. It's completely two separate functions?
25:25 Speaker 03 So on a very high level, the self-driving software stack consists of four components. The first component is called the perception system. You can think of it as the eyes of humans. It's trying to see what's around the car and figuring out, for instance, do I see a human crossing the road? Or do I see the signal light being red or green? Another piece is called localization. And localization module basically tells the car where you are in the 3D space and what's actually around you. And says, okay, you are 153 centimeters from the next stop line. And here's a crosswalk of this width.
26:09 Hanne Tidnam? You need to do X, Y, and Z with the car.
26:11 Speaker 03 And that's what the planning and control module will kick in and say, okay, I'm gonna slow down.
26:17 Hanne Tidnam? Right.
26:17 Speaker 03 And then make a full stop at the next intersection. And then the first component is the mapping component. And the mapping, you can think of it, mapping is having tentacles into all these three things that I just mentioned earlier. Because, for instance, for localization, mapping and localization actually work very, very tightly together, constantly comparing.
26:39 Hanne Tidnam? It's where you are in the map.
26:40 Speaker 03 Exactly.
26:41 Hanne Tidnam? Basically.
26:42 Speaker 03 It needs to know what is supposed to be here. And then it can tell the difference, right? If I know there's supposed to be intersection and a crosswalk, and then I see a moving object around, like crossing it, that's probably a pedestrian, right?
26:56 Hanne Tidnam? That seems like something really new to me, that a map can not only have a, have, represent what's actually there, but what, a sort of shadow map of what it thought was there, you know, what it was, was once there before, or might be, might have been there on Thursday, you know, but isn't there now.
27:13 Speaker 02 It's a living thing. I think it's a real revolution in mapping. I've never seen anything like it. And of course, I want to collect it.
27:20 Hanne Tidnam? Well, let's, what is it like, what does it look like to the car? Does the car see something? Does a passenger see anything? Has David seen what this map looks like that he wants to collect?
27:29 Speaker 03 Right, right.
27:30 Speaker 02 Oh, yes.
27:33 Speaker 03 So I guess data is data at the end of the day. How we visualize is up to, you know, how we want to consume it.
27:42 Hanne Tidnam? Yeah, it's just like it was the knowledge. Everyone visualized the knowledge in a different way.
27:47 Speaker 03 Right.
27:47 Hanne Tidnam? In the Renaissance.
27:48 Speaker 03 Yeah. And in the digital map, you have even more options.
27:51 Hanne Tidnam? Yeah.
27:52 Speaker 03 You can color code it, you can apply different lifestyles, so on and so forth. But generally, you have two audiences now. The humans and the robots. The robots don't really need to see anything. They need to consume the data.
28:06 Hanne Tidnam? Right.
28:06 Speaker 03 And they consume the data through APIs and so on.
28:09 Hanne Tidnam? So what's the point of having a visual representation at all then?
28:13 Speaker 03 Those are for humans. As part of the map creation and update process, we will have human moderators to check the computer output, to see, you know, there are always ambiguities in the real world. There are certain intersections that are so complex that are hard even for humans to interpret the traffic rules.
28:34 Hanne Tidnam? Yeah, I totally, I know those type of, I used to call what dysfunction junction.
28:39 Speaker 03 That's right. So we have visualization tools to help us as part of the map creation and maintenance process. But again, data is data and data can be useful in so many different ways.
28:53 Hanne Tidnam? There are so many aesthetic choices that go into map making, which I'm sure part of why you love maps so much, right? It is, absolutely. It's an art. So what kind of aesthetic choices did you guys make? Or how are you, you know, that when the human is looking at this, this, this deep map that you guys have been thinking about?
29:12 Speaker 03 Map creation and maintenance, I think for us at least, functionality kind of trumps over the beauty aspect because we need to make sure the quality of the map is very, very high. Otherwise, Our human operators won't be able to work as effectively. So I think productivity and efficiency is what we design for. But when we are displaying the maps for other purpose, you know, for simulation, for virtual reality, then, you know, depending on which use case we are looking at, we can make the right, you know, design choices.
29:47 Hanne Tidnam? Oh, so it's it's not difficult to change. Maps have always been also a representation, right, of law in some form, like of sort of territory and rules and where people are allowed and where they are. How do you guys think about some of the legal issues?
30:02 Speaker 02 Maps have have always been very sensitive in law. There are claims and counterclaims. The Sea of Japan is a, you know, others want to call it the Sea of Korea or. Maps have always had a function, an administrative function, you know, a taxing function, a governing function. Wars, awful as they are, produce an enormous amount of mapping. And I've collected widely.
30:26 Hanne Tidnam? And are fought over, mapping, too.
30:28 Speaker 02 And fought over mapping. I I got a three-volume atlas that was from 1786 that had been captured from a French vessel. And it was a fight between the British and the French right off of Brittany in France during the American Revolution. And the British captain, in his notes, felt that the three atlases he got were more valuable than the ship.
30:51 Hanne Tidnam? Amazing.
30:52 Speaker 02 And, you know, it's just, in those days, that kind of knowledge was very, very powerful. One of the problems today is, of course, it's so malleable.
31:01 Hanne Tidnam? Yeah.
31:02 Speaker 02 It can be counterfeited, it can be falsified, it's it isn't printed. So, you know, people will put out false claims on maps and and they circulate and and then you don't know what is real.
31:15 Hanne Tidnam? So how do you guys make sure that that you protect that information, those three valuable atlases on the ship?
31:22 Speaker 03 It's going to be a big challenge for HD mapping because as of today, even government regulations are not clear, even though digital maps are widely available today. But there are countries who heavily, heavily regulate their geospatial data. You know, China is one, South Korea is one. There's actually a whole bunch of other countries who.
31:42 Hanne Tidnam? Just like Spain back in the day, right?
31:44 Speaker 03 Yeah, explicitly forbid exporting geospatial data.
31:49 Hanne Tidnam? Wow.
31:50 Speaker 03 You cannot move data out of South Korea about. The boundaries and the roads of South Korea streets. So that problem actually already exists today with just the normal navigation maps. When it comes to HD maps, you can imagine all sorts of sensitivity because you have these cars with very high resolution LiDAR and then cameras constantly scanning the street.
32:13 Hanne Tidnam? Right.
32:13 Speaker 03 And possibly seeing into people's private driveways as well.
32:17 Hanne Tidnam? Right, right.
32:18 Speaker 03 So being able to protect people's privacy and fulfill some government regulations. From a security point of view, we can do a lot of encryption and so on to make sure the data don't accidentally leak out. Having said that, the future remains to be seen. US government is fairly active, you know, trying to both protect and advance the self-driving technology and make sure privacy is, people's privacy is well protected.
32:47 Hanne Tidnam? And it's playing out literally week by week.
32:49 Speaker 03 That's right, and the other governments are doing the same. We will, I think in a few years of time, a lot of dust will settle and we'll see what is the, you know, both from the technology side, what we can do, as well as from regulation side, what the government is willing to do. For instance, who should own the data? As the driver of the car, do you own the data? Or as the private homeowner, do I own the data around my private home?
33:13 Hanne Tidnam? Or does the car maker?
33:14 Speaker 03 Or does the car maker?
33:15 Hanne Tidnam? Or does the map maker?
33:16 Speaker 03 Or should the government own the data?
33:17 Hanne Tidnam? What's the classic thinking about that in terms of maps? Was it the person who drew the map that owned the data? Or was it the person who was hired to draw the map or what?
33:26 Speaker 02 The same confusion that we have today. I, I think all these issues just speak to the power of maps and they're just getting more powerful all the time because they, they embody all of these kinds of sensitivities. They, they tell history and they record our lives and particularly these, now these living dynamic maps, which we've never had before.
33:50 Hanne Tidnam? I love this, that you talk about the maps as capturing a moment in history too, because if you're capturing this kind of, this depth of map and this representation of a kind of immersive world that we've never had before, it is capturing an incredible moment of time. Do you think about the historic value of capturing the world like that?
34:10 Speaker 02 I was saying to Wei earlier as we were coming over here. Please hold on to the data.
34:17 Hanne Tidnam? Because it's like capturing, it's like a model of our entire world.
34:22 Speaker 02 There are no out of date maps.
34:25 Speaker 03 Before we had our conversation, I, to be honest, I didn't because, you know, when it comes to
34:30 Hanne Tidnam? Because the value is to have it in the present.
34:33 Speaker 03 It's always about freshest data.
34:35 Speaker 02 And that's the way it should be. That's exactly what you should be doing. But at the same time, you should, you know, preserve the data.
34:42 Hanne Tidnam? Yeah, no, that's fascinating. I mean, I, I used to be an art book publisher and one of my favorite books on the list at Princeton was The Barrington Atlas. Which is just a wonderful representation of what the world used to be. And you can think about people doing these kinds of looking backwards in a totally different way. Last thing, you know, when we think about terra incognita and then it becomes terra cognita, right? It opens up all sorts of new population shifts and trade routes and products and economies. We've talked a lot about the autonomous vehicle. What do you see some of the other sort of unexpected consequences of mapping out the world like this possibly being?
35:18 Speaker 03 Essentially, when we are creating HD maps, we're creating a digital infrastructure of a city's road network. And they do try to create that digital infrastructure today because almost every city in the US has a GIS department. They send out the surveyors, they map the, the road, the public works department oftentimes do the same. This process is static because it's very costly to do, it's very labor intensive and you can't repeat these surveys all the time. On the other hand, when we have cars with the right sensors running on the road, they're constantly updating the road. So the process
36:00 Speaker 03 of actually having a central government having to maintain that digital infrastructure can suddenly be solved with people with cars or just cars. And this information is tremendously useful beyond just self-driving.
36:14 Hanne Tidnam? Having seen maps evolve, what strikes you as some of the possible consequences of thinking of maps, of these exploded maps?
36:21 Speaker 02 Well, everybody becomes a mapper, which is very powerful. Everybody takes ownership and because they contribute as they're driving. To making the great map. I think it will have an effect on people to be part of the knowledge creation system. I'm not sure exactly how, but I think it's part of empowering people.
36:43 Hanne Tidnam? And historians.
36:44 Speaker 02 And then for historians to have access to, you know, what people were doing 50 years earlier.
36:52 Hanne Tidnam? I mean, you can imagine like a Barrington's atlas that you could literally be submerged into.
36:58 Speaker 02 It's almost too much to see patterns in this vast amount of data.
37:02 Hanne Tidnam? That's a fascinating idea to also read it just for human patterns.
37:06 Speaker 02 It's always been something we've wanted so badly was to be able to do, you know, optical character recognition in old maps, but it's impossible to do because the text is going up and down and the different fonts and.
37:19 Hanne Tidnam? Every map is different.
37:21 Speaker 02 That's why we love them. And, uh, but with the, the deep maps, really they can, they are data to begin with. So it completely gets over that particular issue. And I see deep maps being made in rivers and seas. I mean, we're opening up a whole new frontier of mapping that is mapping at a very, very high definitional level, which creates a whole new kind of map. When you map at that level of accuracy, you are making a living map, a map that is full of so much information that we've never had. You're, you're really mapping the world one to one. And that's sort of the holy grail. So there's still
38:03 Speaker 02 tons of terra incognita that needs to be mapped and it's all in front of us. I think it's a big, big paradigm shift.
38:12 Hanne Tidnam? When we all become map makers.
38:13 Speaker 02 We're all map makers. Yeah.
38:15 Hanne Tidnam? What a wonderful note to end on. Thank you both so much for joining us. Yeah, thank you too.
38:19 Speaker 02 Thank you very much.
Previous Company Building in Crypto: A Conversation between Brian Armstrong and Chris Dixon Next What's Next for Education Startups Page updated October 9, 2026 · transcript and summary are machine-generated