Pod Insights If You're Listening How did Palantir get so powerful? About this episode In the aftermath of 9/11, the problem wasn't just intelligence failure; it was information stuck in silos. The FBI and CIA had pieces of the puzzle, but no shared picture. Enter Palantir: a company built on the premise that data, if stitched together properly, could surface threats before they metastasise.
Co-founded by Peter Thiel and Alex Karp, Palantir's early pitch was deceptively simple: give analysts the ability to see connections across messy datasets without compromising privacy.
The arrival of large language models has supercharged what Palantir was already doing: ingesting, structuring, and interrogating enormous amounts of information. The result is a shift from finding needles in haystacks to, arguably, predicting where the needles will land. It's powerful, unsettling, and very on-brand for a company named after an all-seeing stone from Lord of the Rings.
Follow If You're Listening on the ABC Listen app https://radio.abc.net.au/help/apps.
Check out our series on YouTube:https://www.youtube.com/playlist?list=PLDTPrMoGHssAfgMMS3L5LpLNFMNp1U_Nq
Transcript 4,128 words · 28 speakers
0:00 Speaker 00 ABC Listen, podcasts, radio, news, music and more.
0:07 Speaker 01 What's on the mind of the country's biggest, most influential and most innovative business leaders, founders and creators? You're in a very pessimistic place, Alan. You get to find out every Friday with me, Alan Kohler, as I sit down with the people influencing the markets, the economy and the ideas shaping our world. I gauge regularly enthusiastically with the tech sector and some of these big players in AI. Find That's Business with Alan Kohler on the ABC Business Daily Feed on ABC Listen or wherever you get your podcasts.
0:38 Speaker 02 This podcast was produced on the lands of the Uwabikal and Gadigal people. When you work in the news, you see a lot of things that give you nightmares, but there's one image that stays with me. It's the worst PowerPoint slide in human history.
0:56 Speaker 02 It looks like a plate of spaghetti and meatballs with hundreds of lines connecting every meatball heading. It was this incredibly complicated PowerPoint chart. It was produced by the US military in 2010 to illustrate the difficulties they were facing during the war in Afghanistan. When the public got a hold of it, it became a case study for how not to do PowerPoint. This is an actual slide of the Afghanistan strategy last year, and it was prepared by the staff to General Stanley McChrystal. This is a New York Times article. We have met the enemy and here's PowerPoint. Even the head of US forces at the time, General Stanley McChrystal, knew immediately how bad the slide was. When the staff brought this to McChrystal, this PowerPoint slide, he said, when we
1:40 Speaker 02 understand that slide, we will have won the war. At the time, the US military's overuse of PowerPoint was an easy punchline for commanders when they were giving public speeches.
1:50 Speaker 03 Says in there that it is the inalienable right of every four-star army general to use PowerPoint slides when communicating.
1:57 Speaker 04 Leaders who are going to use disciplined but very unregimented problem solving, able to exercise mature initiative, relying on only commander's intent, not detailed orders in multi-coloured PowerPoint format.
2:11 Speaker 02 Marine Corps General James Mattis was fond of saying PowerPoint makes us dumb.
2:16 Speaker 04 I have a friend who runs Microsoft, by the way, and he doesn't like it when I say that.
2:25 Speaker 02 But there's a reason the US military kept spitting out these awful diagrams. They were in the midst of a decades-long battle to figure out how all the different parts of the armed forces could work together more efficiently. The interesting thing is, in the last three years or so, it appears that one company has finally figured it all out.
2:48 Speaker 05 To maintain US and Western military superiority requires deliberate action and technological innovation. At Palantir, we deliver secure, innovative, and scalable software solutions at speed.
3:00 Speaker 02 You might have heard of this company, Palantir. It seems to be the evil multinational corporation de jour. Largely secretive, Palantir specializes in the shadowy practice of data mining. For most of its existence, Palantir flew under the radar. It was an extremely obscure US defence contractor that few people outside the industry had ever heard of. But in the last few years, it's kind of been everywhere.
3:26 Speaker 06 Special thanks to our sponsor, Palantir. What do you think your local Kohl's has in common with the CIA? Well, they both use Palantir.
3:35 Speaker 07 Palantir has been the top-performing stock on the entire US stock market in 2025.
3:41 Speaker 02 These days, Palantir is involved in everything from retail to military operations to immigration enforcement to space travel.
3:48 Speaker 05 From the global war on terror to space domain awareness, Palantir continues to be a mission partner for the US and allied nations.
3:56 Speaker 02 Up until recently, the CEO has tried to remain out of the spotlight, and perhaps that was for a good reason. Because since becoming more of a public figure, he's been saying things like this.
4:07 Speaker 08 We believe Palantir is a metaphor for the splendor in artistry and discipline necessary to build great things, what has made the West great over thousands of years. We are at the core of making the obvious superiority of the West not just a moral platitude, but a factual reality.
4:30 Speaker 06 Our product is used on occasion to kill people.
4:35 Speaker 09 Okey-dokey.
4:43 Speaker 02 Despite its exponential growth in size and strategic significance, Palantir is still a bit of a mystery to most people. We're going to spend the next two weeks on this company, taking a look at Palantir's origin story and how it's grown to be one of the biggest companies in the world. I'm Matt Bevan, and this is If You're Listening.
5:09 Speaker 02 This story begins with a terrorist attack on the World Trade Center in New York City, but not the one you're thinking of. This one happened in 1993. As New Yorkers came to terms with a possible act of terrorism on US soil, investigators released the first pictures of the explosion site, leaving little doubt that a powerful bomb was the most likely cause. A van packed with 550 kilos of explosives was driven into an underground car park of the World Trade Center. It blasted a hole through three floors, killing six people instantly and injuring hundreds more. For some time, it wasn't clear who was behind the attack.
5:51 Speaker 02 As many as 19 groups have claimed responsibility for the explosion, but the mystery of who really did it remains unsolved. One of the FBI agents involved in the investigation was John O'Neill. He'd always wanted to be in the FBI, ever since he watched this imaginatively titled TV show back in the 1960s.
6:09 Speaker 10 The FBI.
6:14 Speaker 10 A QM production.
6:18 Speaker 02 The people behind the 1993 attack were religious extremists from Pakistan, and John was instrumental in their capture. He became obsessed with researching Islamic extremism and quickly became an expert on the growing threat of terrorism on American soil. As he continued rising through the ranks of the FBI's counterterrorism department, he was cognizant of the importance of balancing the need to keep people safe with the infringement on their personal privacy.
6:49 Speaker 11 If you have a lot of order, there is very little liberty.
6:53 Speaker 12 And if you have a lot of liberty, there tends to be less order. And this great experiment that we call the United States of America has a perfect blend of ordered liberty.
7:05 Speaker 02 Ordered liberty, a balance between government surveillance and individual freedom. In the US, the government surveillance side of the seesaw is populated by lots of different intelligence agencies. There's local police and the FBI keeping an eye on people domestically, and the CIA keeping tabs on potential threats abroad. But in the 1990s, that system had a serious flaw. Each of those agencies gathered their own data, but sharing data between them was complicated.
7:37 Speaker 02 To understand how bad the data sharing was, think about information being like marbles in jars. The FBI has a jar of marbles. The CIA has one.
7:51 Speaker 02 And the local police have one. Each agency controls their own information, their own marbles. Sharing marbles between them is incredibly complicated. This whole system keeps things secure, but it means they basically can't work together. And that problem was going to come into sharp focus for John O'Neill. As he probed the World Trade Center attack of 1993, he became interested in one particular marble
8:20 Speaker 02 he believed the CIA had. One that most counter-terrorism experts at the time weren't paying attention to.
8:28 Speaker 12 I think if you asked most terrorism experts in the mid-1990s, "Well, what about this man Bin Laden?", most people in the mid-1990s would have said, "Ah, yes, the financier, the terrorist financier."
8:41 Speaker 02 In 1998, ABC America reporter Chris Isham, a personal friend of John O'Neill, trekked for 10 days across Pakistan to interview the leader of a little-known extremist group called Al Qaeda. Osama bin Laden.
8:55 Speaker 13 He sat down on this kind of bench covered in red fabric and put a blanket kind of over his knee. It was like sitting at storytime with an old uncle.
9:05 Speaker 02 But Chris Isham and John O'Neill shared a growing interest in this old uncle in the Pakistani wilderness, who during the interview seemed pretty harmless.
9:14 Speaker 01 Bin Laden's handlers wouldn't allow anyone to translate the sheik's answers. Miller didn't know what bin Laden was saying, and the Al Qaeda leader's monotonous, measured delivery was deceivingly calm.
9:28 Speaker 02 It was only when the interview was finished and the producers sent the tapes back to be translated that they learned what this seemingly harmless man was saying.
9:36 Speaker 14 We do not differentiate between those dressed in military uniforms and civilians. They are all targets. We predict a black day for America and the end of the United States.
9:46 Speaker 02 Hmm, maybe not as harmless as he seems. When he saw this interview, John O'Neill became fixated on bin Laden. He was sure that after a number of failed attacks on American sites, that the US was due for another domestic attack and that Osama bin Laden would be the person to do it. He tried hard to raise the alarm within the FBI, but because bin Laden was an international threat, it was outside his remit. Chris Isham said that John started getting frustrated that he wasn't being taken seriously enough.
10:17 Speaker 13 I think that he felt that the Saudis were definitely playing games and that the senior officials in the US government just didn't get it.
10:25 Speaker 02 The problem was John didn't have all the marbles. He could only access the information the FBI was gathering domestically, not the stuff the CIA was gathering in the Middle East. His frustration began to compound.
10:37 Speaker 15 John, because of his aggressive posture, his aggressive nature, his willingness to go forward when it may not be politically correct, I think a few people were just uncomfortable with John's aggressive style.
10:57 Speaker 02 In the FBI jar, which John had access to, there were a couple of concerning marbles. One was that a man with known connections with extremist groups had recently been arrested by the FBI while attending a flight training school in Minnesota. Another suggested a coordinated effort may be underway by bin Laden to send people to the United States to obtain flight training, after a number of suspicious people were seen attending flight schools in Arizona. Two interesting marbles in the FBI jar, but not enough to get the full picture. Unbeknownst to John, over in the CIA's jar, they had more data points. The CIA knew that a number of high-profile Al Qaeda operatives
11:40 Speaker 02 were attending planning meetings in Malaysia and intended to travel to the United States. John O'Neill was never across that information.
11:51 Speaker 02 In mid-2001, he left the FBI, partially out of frustration, and took a high-paid job in the private sector.
11:59 Speaker 02 Due to his experience in counter-terrorism and security, he was offered a job as the head of security for the World Trade Center. He called his producer friend, Chris Isham, to tell him the news. Isham said, "Well, at least they're not going to bomb it again", referencing the 1993 World Trade Center bombing. John O'Neill responded, "They'll probably try to finish the job."
12:23 Speaker 02 John's first day was August 23rd, 2001. He died in the center's south tower on September 11th, just three weeks into the job.
12:34 Speaker 16 The coincidence there is just unbelievable. You couldn't write about it. I mean, from the guy that identified Osama bin Laden as the villain that he was, and then the fact that Osama bin Laden was able to kill him, it's just amazing.
13:01 Speaker 02 Now, if you were around back then, you'll remember that there was understandable concern that something like this might happen again. A lot of changes were made to try and make people feel safe from terror attacks. And a lot of those changes were quite annoying.
13:16 Speaker 17 The sort of sense I had was that the way we were going with just ridiculous airport security checks and a super intrusive surveillance all the time wasn't really making us safer.
13:28 Speaker 02 This is tech billionaire Peter Thiel, who has some complicated opinions about how the world should be run, which we'll get into in the next episode of our series. But let's just say, at this stage, he wasn't a fan of the government trying to intrude into people's lives in the name of trying to stop terrorism. He was concerned that if there were another attack along the lines of 9/11, the government would try to become even more intrusive.
13:52 Speaker 17 If the World Trade Center would erode civil liberties as much as it did in 2001, I didn't even want to think what would happen if you had another terrorist attack. And so you have to prevent it to stop more erosion.
14:04 Speaker 02 He was more in favour of the liberty side of John O'Neill's ordered liberty seesaw.
14:09 Speaker 17 Could one do something from a libertarian or civil liberties point of view that would still be tough on terrorism and things like this?
14:21 Speaker 02 He and his university buddy named Alex Karp started focusing on the data. The government already had plenty of information that they could use to prevent terror attacks. They just weren't using the information efficiently.
14:33 Speaker 08 Silicon Valley ought to be involved in fighting terrorism and protecting our civil liberties.
14:41 Speaker 02 Thiel and Karp founded a company called Palantir, named after Saruman's all-seeing glass ball from Lord of the Rings. Now, naming your nascent tech company after a tool used by the very bad guy trying to take over Middle Earth is an interesting decision, but we'll, again, get to that a little bit later. As far as Alex Karp and Peter Thiel were concerned, the company was designed to gather all the data points siloed within individual agencies and make connections.
15:10 Speaker 08 It would allow humans to find needles and haystacks, so make the data intelligible to you and me, which it's not. And by doing that, it would allow them to find bad people trying to destroy our society and could be used also to protect civil liberties by making the data sets transparent.
15:26 Speaker 02 Palantir's first investor was the CIA. It's been widely reported, though never officially confirmed, that in 2011 Palantir played a key role in processing information which led to the killing of Osama bin Laden in his secret compound in Pakistan.
15:42 Speaker 18 Palantir, for example, effectively vectored Osama bin Laden's location.
15:48 Speaker 02 So how exactly does it work? For the first decade of Palantir's existence, basically, nobody knew who they were or what they did. They didn't even start posting on social media until 2015. A person can see a pattern in 100 things, but it's very hard for them to see a pattern in a million. The company embedded technical experts inside classified US intelligence operations and facilities, trying to access as many different information sources as possible and figure out how they relate to each other. Sticking with the marbles in jars, it worked like this.
16:31 Speaker 02 Rather than all the information being siloed in individual jars, Palantir set up a table where all the marbles from the FBI, the CIA, the NSA, and other agencies could be poured onto and examined, allowing users to get a full picture by sorting information more logically and identifying patterns and connections.
17:00 Speaker 17 Like, really what it is is creating a unified view over lots of disparate data sources which don't otherwise make sense together.
17:07 Speaker 02 The reason they had so little public presence is that they really only had one customer: the US government. Fighting ISIS, stopping human trafficking, supporting money laundering investigations.
17:19 Speaker 19 Working with the special forces, law enforcement, the DOD.
17:22 Speaker 02 According to their marketing, Palantir was all about organising information in a way humans would find more intuitive. Humans are incredible at insight. It's just surfacing the right information for them to see. They were effectively creating an enormous, self-updating PowerPoint slide which could be used by humans to figure out what was really going on. The result was software that kind of looked like my favourite type of video game, simulation games, stuff like SimCity, Transport Tycoon or Factorio. Using Palantir's software was like looking down on the world from above with information displayed on a large, flat map you could interact with. When the military used it, it looked like Command and Conquer with military assets, both friendly and enemy, displayed on a clickable satellite map.
18:08 Speaker 02 When it was used to manage logistics and supply chains, it looked like Factorio. When it was used by law enforcement agencies, well.
18:15 Speaker 20 An ICE official said it's basically like a Google's map interface where you can look around the United States, you can zoom in on targets, you then click on an individual person and it brings up their name, a photo.
18:27 Speaker 02 We'll get into how it's being used for immigration enforcement in our next episode, but looking at it dispassionately, it's clearly impressive software, way better than the PowerPoint nightmares they used to deal with. But programming these maps, which Palantir calls the ontology, was slow, painstaking work. It involved writing incredibly complicated software and talking to a lot of different people, so they didn't overemphasise the importance of any one particular data source or ignore another one. It also didn't entirely solve the marble jar problem. Because each industry needed information laid out in different ways, the systems didn't talk to each other perfectly. For instance, Gotham, Palantir's military and law enforcement software, was different
19:12 Speaker 02 from its logistics software, which was called Foundry. But then something came along that was going to put Palantir's marble sorting technology into hyperdrive.
19:23 Speaker 00 Let's start with this language AI, ChatGPT. What is it?
19:28 Speaker 02 Ah, great question. In 2022, people were starting to get excited about the potential uses of large language models like ChatGPT.
19:37 Speaker 21 It can create custom code, it can create entire books that are written from scratch that are not plagiarised, it can write essays.
19:44 Speaker 00 Wow, that really is amazing.
19:46 Speaker 02 But at Palantir, they were quickly coming to a realisation. They had been building software that was to be used by humans. But the way they'd built it was also perfect for large language models.
19:58 Speaker 09 We were pleasantly surprised to see how much the world we had been building for met its moment with LLMs.
20:04 Speaker 02 Palantir's chief technology officer, Shaim Sankar, said that LLMs, large language models, weren't just great at reading their data maps, but needed their data maps in order to be reliable.
20:15 Speaker 09 It's like, wow, you actually cannot unleash the value of an LLM without these things.
20:20 Speaker 02 They had, purely by luck, spent 20 years building a system that organised data in a way that could be intuitively read by the new wave of AI systems. And it was laid out in an ideal way for the AI system to produce reliable information.
20:37 Speaker 09 By January, it was quite obvious that we needed to tear up all our roadmaps and get excited about how we could incorporate LLMs into our software to provide a whole new series of experiences.
20:48 Speaker 02 They developed something called the Palantir AIP, which stands for Artificial Intelligence Platform. AIP is your AI operating system. Now, individual users don't need to look at the marbles on the table at all. They can just use AIP, which sits on top of the marbles and looks at them for you, making connections far faster and more nuanced than any human could. Instead of handling a few marbles, it can handle millions all at once. To use it, all you have to do is ask it a question.
21:24 Speaker 22 AIP leverages large language models to allow operators to quickly ask questions. What enemy units are in the region?
21:30 Speaker 02 The human operator can ask AIP in plain English to deploy surveillance drones.
21:35 Speaker 22 Task the MQ-9 to capture video of this location. The drone footage shows an enemy T-80 main battle tank.
21:42 Speaker 02 Then the operator can ask it to look at what options are available in the area to destroy that tank.
21:47 Speaker 22 Generate three courses of action to target this enemy equipment. Send these three options to my commander for review. Our commander selects a course of action. Approve course of action three.
21:59 Speaker 02 Until pretty recently, executing this kind of operation would have required big maps being rolled out on tables, some little wooden figures pushed around on top, phone calls right up and down the chain of command. AIP allows it all to be done as easily as asking ChatGPT to plan your holiday to Queensland.
22:19 Speaker 02 Not only can AI be used to operate the Palantir software, it can also be used to design it. What once took software engineers years of observing operations and writing code now takes weeks. This rapid increase in efficiency meant that suddenly Palantir had a lot of extra time and resources on its hands. So it started expanding. Previously, pretty much only the US government could afford Palantir services. Now it's getting into everything. ExxonMobil is adding powerful new features by partnering with Palantir Technologies.
22:56 Speaker 06 What do you think your local Kohl's has in common with the CIA? Well, they both use Palantir.
23:02 Speaker 18 With Palantir as the platform for making cricket the number one team bat and ball sport in Europe.
23:07 Speaker 02 I have to say, the European Cricket Network has got to be the most out of pocket of Palantir's clients.
23:12 Speaker 18 With our entrepreneurial intuition, we can now use Palantir to ask the right questions of the data all in one place.
23:19 Speaker 02 This rapid expansion in clients made markets extremely excited about Palantir's potential future profits.
23:26 Speaker 23 The stocks moved pretty ferociously here in the last couple of months.
23:30 Speaker 02 In 2023, Palantir's stock jumped 167%. In 2024, it jumped by 340%.
23:38 Speaker 24 I think there's a golden path right now for them to monetize what we view as potentially a trillion dollar market opportunity.
23:45 Speaker 02 It's become one of the fastest growing companies on earth, with clients all over the world, including government contracts in lots of different countries. And it's basically just a glorified version of that PowerPoint slide General McChrystal was considering during the war in Afghanistan. It was designed to help keep the balance that FBI agent John O'Neill thought was so important.
24:07 Speaker 11 And this great experiment that we call the United States of America has a perfect blend of ordered liberty.
24:15 Speaker 02 He wanted to make sure that the seesaw didn't go too far one way or the other.
24:18 Speaker 11 If you have a lot of order, there is very little liberty.
24:23 Speaker 11 And if you have a lot of liberty, there tends to be less order.
24:28 Speaker 02 But since the capacity of Palantir has expanded exponentially since the advent of these L L Ms, a lot of people are starting to think the company is tipping the balance towards order and away from liberty. Ladies and gentlemen, this is scary. This is us moving towards what China is doing to their citizens. People are really quite scared of this company. The Palantir Surveillance.
24:50 Speaker 25 Palantir is a definite CIA front company.
24:53 Speaker 02 There are more conspiracy theories swirling around about Palantir than any other Silicon Valley company.
24:58 Speaker 26 And Peter Thiel and his company Palantir are some of the most evil forces on our planet conspiring against the American people. Palantir is like a surveillance and predictive policing firm.
25:11 Speaker 27 Palantir, an organisation that is run also by a Zionist psychopath.
25:19 Speaker 02 And that's because even though it really is just a very fancy PowerPoint slide which makes intelligence, military, logistics, customer service and cricketing operations more efficient, its leaders have decided to create a kind of weird public image.
25:35 Speaker 08 We have dedicated our company to the service of the West and the United States of America. Palantir is here to disrupt and when it's necessary to scare enemies and on occasion kill them. And we hope you're in favour of that.
25:49 Speaker 02 So I think it's important to spend some time talking about this guy, Alex Karp, and what he wants to do with his company that now controls so much of the world's data. But we're not going to do it today. We're going to spend our whole next episode on it.
26:04 Speaker 08 And we hope you're in favour of that.
26:07 Speaker 02 We'll see you then.
26:17 Speaker 02 This episode of If You're Listening was written by me, Matt Bevan, and Cara Jensen-McKinnon. Cara is also our supervising producer. It's produced by Adair Shepherd and Pat Sunderland. We'll have our second episode on Palantir next Thursday, but on Tuesday Cara's got a story to tell me about why the FBI and CIA weren't talking to each other in the late 90s. I don't know anything more than that, but she says this story's going to make my head explode. I'll see you next week.
Previous Matt's producers present the weirdest tales from the basement Next The FBI dug a tunnel under the Russian embassy Page updated October 30, 2026 · transcript and summary are machine-generated