Deepfakes and the War on Truth with Bogdan Botezatu

Is there anything real left on the internet? Neil deGrasse Tyson and co-hosts Chuck Nice and Gary O’Reilly explore deepfakes, scams, and cybercrime with the Director of Threat Research at Bitdefender, Bogdan Botezatu.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Neil deGrasse Tyson?

  Chuck, I didn't know we were gonna do a show on the end of the world.

• 0:03Chuck Nice?

  Yeah, it's coming.

• 0:05Neil deGrasse Tyson?

  It's coming.

• 0:06Chuck Nice?

  It's coming.

• 0:06Neil deGrasse Tyson?

  With the help of like AI and cybercrime and deep fakes and what hath we wrought upon ourselves?

• 0:13Chuck Nice?

  Yeah, well, guess what? Frankenstein's monster, it's

• 0:16Neil deGrasse Tyson?

  Looking pretty tame.

• 0:16Chuck Nice?

  Looking pretty tame.

• 0:19Neil deGrasse Tyson?

  Bring back Frankenstein.

• 0:20Chuck Nice?

  Bring back Frankenstein, baby.

• 0:21Neil deGrasse Tyson?

  Coming up, an exploration of how we're gonna go to hell in a handbasket on StarTalk.

• 0:29Neil deGrasse Tyson?

  Welcome to StarTalk, your place in the universe where science and pop culture collide. StarTalk begins right now.

• 0:41Neil deGrasse Tyson?

  This is StarTalk, special edition. Today, we're gonna talk about scams in the age of AI. That it's special edition means we've got Gary O'Reilly. Gary, how you doing, man?

• 0:56Gary O'Reilly?

  Hey, I'm good.

• 0:57Neil deGrasse Tyson?

  All right. Chuck Nice.

• 0:58Chuck Nice?

  I am Chuck Nice and not an AI version of Chuck Nice.

• 1:03Neil deGrasse Tyson?

  AI imitates you better than you faking it.

• 1:05Chuck Nice?

  Exactly, yeah, exactly.

• 1:08Neil deGrasse Tyson?

  So Gary.

• 1:09Gary O'Reilly?

  Yes.

• 1:09Neil deGrasse Tyson?

  This topic is way overdue.

• 1:12Gary O'Reilly?

  Oh, for sure.

• 1:12Neil deGrasse Tyson?

  Or maybe it's exactly when we need it.

• 1:15Gary O'Reilly?

  Yeah.

• 1:15Neil deGrasse Tyson?

  Take us in.

• 1:16Gary O'Reilly?

  I suppose scams, if you think of it, have been with us since people started to use money.

• 1:24Chuck Nice?

  Oh, even before that.

• 1:25Gary O'Reilly?

  Yeah.

• 1:25Chuck Nice?

  So, you know, you can rest assured that before there was a system of currency, somebody was just like, so, that's an interesting bushel of wheat you have there.

• 1:39Neil deGrasse Tyson?

  Little barter scam.

• 1:41Chuck Nice?

  Yeah, a little barter scam, you know what I mean? As a matter of fact, they're one of, one of our most beloved childhood fairy tales is about a guy who trades the family cow for six magic beans.

• 1:57Neil deGrasse Tyson?

  Oh.

• 1:58Chuck Nice?

  Which that was supposed to be a scam, but it turned out, it worked out. Turned out it worked out for him.

• 2:04Gary O'Reilly?

  Lucky Jack. Anyway, if you think about it now, right now, it feels like you can't go an hour without a scam, a text, a call. But how big is this problem? Is it just me getting texts and calls? Or is this really sort of a global phenomenon?

• 2:22Neil deGrasse Tyson?

  I'm sorry, I'm gonna stop sending you those.

• 2:23Gary O'Reilly?

  Yeah, I wish you would.

• 2:23Neil deGrasse Tyson?

  Oh, yeah, it's all Chuck. But texts, phone calls, emails, all of our connectivity into the landscape of humanity. Right.

• 2:33Gary O'Reilly?

  And now, as technology advances, how is that aiding? How is that abetting these bad actors? I mean, tech has been supercharged by AI. There's no doubts about that. And it begs the question, what is real? What actually is real out there? Can we believe what we can't believe? And we're gonna break down the deepfakes. We're even gonna get into the dead internet theory. And if you don't know what that is, stick around.

• 2:59Neil deGrasse Tyson?

  Oh, I gotta stick around then.

• 3:00Gary O'Reilly?

  You really are gonna be in for a surprise.

• 3:02Neil deGrasse Tyson?

  Dead internet theory.

• 3:03Gary O'Reilly?

  And then you'll ask the question, are we all failing daily, turing tests? What happens if it turns out the internet is all bots? How about that?

• 3:13Neil deGrasse Tyson?

  Hmm.

• 3:14Gary O'Reilly?

  Some of that, we'll need an expert.

• 3:16Neil deGrasse Tyson?

  So we've got Bogdan Botezatu. This title is cool. I want this on my business card.

• 3:22Gary O'Reilly?

  Okay.

• 3:22Neil deGrasse Tyson?

  Director of Threat Research and Reporting. YIotta.

• 3:28Neil deGrasse Tyson?

  At Bitdefender, this is a company based in Romania? Oh, well, they know. But they've got offices, they want to protect the world. Yes. And we've got him right here on StarTalk Special Edition. I believe it was Bitdefender that helped Liam Neeson get his daughter back.

• 3:46Gary O'Reilly?

  How do you work, Liam Neeson?

• 3:51Neil deGrasse Tyson?

  Bogdan, welcome to StarTalk Special Edition.

• 3:53Speaker 03

  Hi all, thanks for having me on the show. Literally, nobody will believe me that I'm shooting a video in such a great company. Probably people at home will say that this is a deepfake. And it's going to be very difficult for me to contradict them.

• 4:11Neil deGrasse Tyson?

  Now, you've told us offline that you'd rather go by Bob.

• 4:15Speaker 03

  It's easier for everybody, yeah.

• 4:17Chuck Nice?

  See that and look at that. He says it's easier, not not for him, but for everybody. And by that, he means Americans. That's what he means. Because we some lazy ass name people. Yeah, because people are just like, you know, what is your name? Bogdan Botezatu. Yeah, I'm gonna call you Bob, alright? You cool with that? You cool with Bob? We are so bad.

• 4:38Gary O'Reilly?

  So Bogdan, give us an idea of what it is globally, and maybe sort of land in the US a little bit more deeply, about the kind of numbers and statistics that we're looking at in the present day as far as scams are concerned.

• 4:51Speaker 03

  It's very hard to put numbers next to the global landscape of scams, because most of these scams go unreported. Or if they go deported, they don't get aggregated globally. Thing is that there are some estimations. GASA places, GASA, which is the Global Anti-Scam Alliance, one of the most prominent organizations that deal with anti-scamming, they place scams at inflicting about $1 trillion of losses for 2024.

• 5:25Chuck Nice?

  Did you say T? Trillion?

• 5:28Speaker 03

  Yeah, $1 trillion.

• 5:30Chuck Nice?

  Okay, let me just say I'm in the wrong business.

• 5:33Gary O'Reilly?

  Okay.

• 5:34Chuck Nice?

  It's time to start scamming them.

• 5:35Gary O'Reilly?

  I mean, I have now begun to sit uncomfortably, and it's not the chair. It's, if it's a trillion dollars, are you saying that's the guess, or is that that's reported? But most of them go unreported, so that $1 trillion could be an awful lot more?

• 5:53Speaker 03

  Probably it's in between. The global cybercrime market is around $9 trillion, which means that $1 trillion for just scamming people would be reasonable.

• 6:08Chuck Nice?

  It's very conservative.

• 6:09Speaker 03

  It is, but the thing is that not all scams get reported. There's people who are ashamed of admitting they have lost huge amounts of money. If you look around and talk to these people who got scammed, you'll realize that they haven't lost like $100 or $500. They have lost hundreds. Hundreds of thousands of dollars. Because these kind of scams run for a very long time. People gain their victims' trust and then they proceed to inflict the maximum amount of damage they can. The other thing is that while probably the FBI has stats for what's going on in the United States, there are so many other countries that are affected by scams which do not report centrally

• 6:52Speaker 03

  what they have registered in each country or each region. So it's very difficult to tell how much money people have lost to scams, but one trillion dollar seems an awful lot of money lost.

• 7:07Gary O'Reilly?

  You think? What are the weapons of choice here for scammers? We've all, I think, all of us have experienced some kind of phishing email, but what other weapons are scammers using to get at us?

• 7:19Speaker 03

  Or tactics as well. In terms of attack avenues, hackers have a huge variety. They prefer instant messaging or direct phone calls because they're very immersive. They can apply pressure and that sense of urgency that makes victims comply faster or hold victim easier. Email is a kind of static means of communication because you're getting the email, you're reading it through, you're pausing a little bit and then you're like, hmm, maybe answering this email or hitting the call is not a good thing. But when you're woken up at night via instant messaging,

• 8:00Speaker 03

  "Hey, this is your bank, your account is being depleted as we're texting. Please call us back to find a way to block these transactions." Well, you will be likely to respond to that. So we have instant messaging, we have short messaging, we have phone. We have mass communications because there's a type of scams that goes one too many. We have mass advertising and business social media account compromise. I will detail a little bit later about that.

• 8:44Speaker 04

  Hey, this is Kevin the Sommelier and I support StarTalk on Patreon. You're listening to StarTalk with Neil deGrasse Tyson.

• 8:59Gary O'Reilly?

  What's with the phone call where you get it, you pick it up and there's silence on the end? Cause that, that kind of spooks people up.

• 9:06Speaker 04

  Everybody knows that one.

• 9:07Gary O'Reilly?

  Yeah.

• 9:07Speaker 04

  Yeah.

• 9:08Gary O'Reilly?

  So what's the angle there?

• 9:09Speaker 03

  I have two theories. One is technical and one is a little bit of a scenario that if true, we're completely condemned. I started with the first one. One likely chance of these phone calls is technical glitches. You know scammers use very complex software to spoof their numbers. They use voice over IP gateways to make it look like they're calling from the same country as you and so on. So there's a lot of room for failure when involving this kind of call center grade software.

• 9:49Speaker 03

  Sometimes calls hang up, there's glitches that put the speaker, the operator on pause and so on. So probably there's a technical error that prevents the cyber criminal from getting in touch with you. The other one is, well, I'd say a superstition of mine. How do you answer your phone? With hello? Yes, maybe?

• 10:16Speaker 04

  No, I answer like this. Who is this? Sorry, go ahead.

• 10:20Speaker 03

  Okay, fair enough. Because some people, in some geographies for instance, they will answer with not hello, but yes. Most of Europe has yes as an opening line when you're getting called. What happens if somebody's building a massive database of words, of yes, of acknowledgements, of confirmations? Like if I'm answering my phone and somebody records me saying yes? To them, where can they play that back to bypass some sort of authentication or confirm a choice of mine? Well, voice is biometrics, right?

• 10:59Speaker 03

  And sometimes saying yes to something becomes contractual, like it substitutes your signature. What if somebody, a threat actor or a threat actor group, might ask for confirmations from people?

• 11:17Chuck Nice?

  No, that makes sense. So what they're doing is they're capturing your voice.

• 11:20Gary O'Reilly?

  Yeah.

• 11:21Speaker 03

  If I told people 10 years ago that based on a two-minute conversation that we had on phone, somebody will be able to spoof my voice and impersonate me everywhere for tens of minutes or hours, would they have believed me back then?

• 11:36Gary O'Reilly?

  So Bogdan, looking at that aspect of it, if you've got new technologies, which we know are evolving rapidly, if not quicker, how do we get into deep fakes? How prevalent is the deep fake scam now on the landscape?

• 11:55Speaker 03

  They're very prevalent and they're making most of the victims. I was telling you that I'm clustering scams on a one-on-one type and on a one-on-many type. One-on-one scams are those that happen in instant messaging, where you're getting approached by a stranger and they try to earn your trust and then they will guide you towards some type of scam.

• 12:20Gary O'Reilly?

  Yep.

• 12:20Speaker 03

  There's a one-to-many type of scam communication that is massively aided by deep fakes. Cybercriminals are building deep fakes with people that the world recognizes and trusts, like you folks, right? You are online influencers. Cybercriminals have a lot of footage with you that they can use to train algorithms and people tend to listen to you because that's what they do with key influencers. There's also politicians, doctors, who are very famous and they become the base of deep fakes. With these deep fakes, cybercriminals start promoting all types of scams, from medical supplements to huge crypto investments.

• 13:05Speaker 03

  You know, you name it, they have an opportunity for everything. And these deepfakes get broadcast either on stolen YouTube accounts or on social media, posts that are boosted by paying for advertisements. They use the trust given by the figure that has been impersonated, and they are using large channels to reach huge audiences. And from there on, of course, some people will fall victim to the scam. They will heed the call to action, which is normally visit this page or call this number and sign up for this opportunity.

• 13:49Speaker 03

  So this is how deepfakes work. We took a look at what's going on now, and we see that there are tens of thousands of such ads running on social networks. There are large YouTube accounts that had been compromised and used as a billboard for crypto scams. One of the largest accounts that has been compromised had 28 million subscribers. So when hackers got hold of that account, they were able to broadcast that deepfake to 28 million potential victims. That's more than Romania has population.

• 14:26Chuck Nice?

  Wow. So if you can indulge me, I'm gonna, I wanna tell you that when I fell for a deepfake, I actually fell for one, and I'm embarrassed as hell. But it was very sophisticated, so...

• 14:40Neil deGrasse Tyson?

  Which you have to say because you fell for it.

• 14:44Chuck Nice?

  Why you gotta hurt a brother? Why you gotta hurt a brother? Did I set your lawn on fire?

• 14:51Neil deGrasse Tyson?

  I'm just saying, you can't say this was a simple deepfake.

• 14:55Chuck Nice?

  I'll let you be the judge of whether or not it was sophisticated. Okay, so here's the deal. There was a deepfake of Sam Harris, who happens to be somebody I respect, okay? How they knew that, I don't know, but it came into my feed. And he was touting a very specific...

• 15:15Chuck Nice?

  Kind of product, not a brand, nothing, just a kind of product, okay? Yeah. So I looked it up and of course they have, you know, they have your search history and all that kind of stuff, right? Yeah. So then I received a very specific ad for the product. Okay, so deep fake, right? I respond with just a search and then the search responds back to me with more information. And then over the course of like this back and forth amplification, I bought the product. You dumbass. Okay. So Bogdan, what you've just described there? Alright. I knew he was gonna do it.

• 16:00Chuck Nice?

  He's lacking some empathy, Neil. I'm sorry, not for this man here, go. Is that a common template that you're seeing with a deep fake?

• 16:08Speaker 03

  This is AI going full circle. So the AI is building the billboard that will sell to you. The AI algorithms on social networks will know how to profile you and what ad to serve you for maximum efficiency. And then from there on, you will be chased by ads all pointing to the same product until you're ready to shop. So cyber criminals work most of the time like corporations. So they have their own product division that builds the deep fake. They have the translation division that builds the multi-language content. They have the web dev team that keeps the servers running for the scam pages to reach you.

• 16:52Speaker 03

  And they will have quality assurance and sales support. You mentioned before that we partner with law enforcement. Yes, that's something that we normally do on high profile cases and scams are some part of these law enforcement corporations. What we learned about is that these cybercrime businesses have call centers that take people's calls and sign them up for various stuff. People employed in these call centers are screened.

• 17:25Speaker 03

  Uh before employment, we have lie detectors to make sure that they're not undercover cops, to make sure that uh they will not betray the call centers cause and so on. So this is cybercrime incorporated. It's not a scam business ran out of the somebody's basement. It's business that cyber criminals have invested money in order to make more money.

• 17:51Gary O'Reilly?

  Wow, wow. I mean, that's infrastructure. Is there a specific demographic that these organized scammers are looking at? Is it a gender based? Is it an age group? Is is it geographical? Is what? What is? What is it? Or is it just, you know, what we'll take anyone's money? We don't care.

• 18:09Chuck Nice?

  Is it a black comedian who co-hosts a podcast? I hear that's a very popular demo with the scammers.

• 18:20Speaker 03

  No, i- i- in the end, everybody's welcome to put their money on the table and leave it there. Uh that's perfectly fine with cyber criminals, but they they have various approaches because they don't have a scamming syndicate yet, right? They're not unionized in a way that would allow them to organize in order to target demographics, right? Uh so what what they will do is find out a local scam that converts well. That that depends where you are, right? Uh in in some places of the world, for instance, leaking out your social security number is huge, right? And will will bring you a lot of hurt uh in the foreseeable future. In Europe, for instance, some parts of Europe,

• 19:02Speaker 03

  leaking out your social security number doesn't have any value. It's pseudo-publical, actually. So cyber criminals are looking for information or types of scams that convert well in the region. Uh they don't target demographics, but they are focusing on specific aspects. Some of them are uh focused on romance scams, for instance. Uh they will target men more than women uh because it looks like men are much more.

• 19:32Chuck Nice?

  Horny and desperate and lonely.

• 19:35Speaker 03

  No, careless when it comes with to sharing information with partners, right?

• 19:43Speaker 03

  Women are a little bit more reserved. They they don't go as fast and as far as the male population. But they still, when they fall for the scam, they fall the hardest. To answer your question, I wouldn't say that cyber criminals are targeting demographics, but rather that there are specialized cybercrime groups that prefer one type of scam over another. And us getting targeted by so many scam groups on a daily basis would look like there's something very structured, that's the same organization targeting different demographics with different tactics, while it was about us getting targeted by multiple cybercrime rings at the same time.

• 20:28Chuck Nice?

  So business is good, that's basically what you're saying.

• 20:31Neil deGrasse Tyson?

  No, but we're in a different space there because people would not necessarily do a deep fake to extort who and what we are, but they can they can deep fake our integrity, our name, our authenticity. And there's one case where someone just scripted this narration about the Big Bang. It was like eighty-five percent correct. And I got fully deep faked into being the narrator, the person speaking those words, showing me in a podcast setting. And it went online and it got boatloads of views.

• 21:13Chuck Nice?

  Well, there's the money.

• 21:14Neil deGrasse Tyson?

  And well, I guess, okay.

• 21:15Chuck Nice?

  So there's the incentive.

• 21:17Neil deGrasse Tyson?

  Okay. And even a good friend of mine, Terry Crews, who is himself an actor and a public figure, he texted me and said, Neil, this is great. You this is great what you did here. And I said, what? And I looked at it, that's not me.

• 21:32Chuck Nice?

  Right.

• 21:33Neil deGrasse Tyson?

  That's that's not me. And a funny thing, I don't want to say this publicly, but maybe I could or should or would it matter? When I speak, my words have way more rhythm to them than that deep fake did. I'm just saying, I know me when I'm speaking.

• 21:50Chuck Nice?

  Right.

• 21:51Neil deGrasse Tyson?

  And when somebody's not me speaking, even if they're using my word, I know it ain't me. Anyhow, it fooled him. And so this.

• 21:58Chuck Nice?

  Also, the deep fake sounded like it was on helium.

• 22:02Speaker 05

  Now, when you look out into the universe.

• 22:04Neil deGrasse Tyson?

  It was missing some of the timbre of the lower registers of my voice. So my only point there is, so yeah, 15% of it was either misleading or wrong. And there've been others where, just as Chuck was duped by a deep fake of Sam Harris, there was a deep fake of me commenting on a video game release. And that people thought it was real. And it was almost comical, but it was so. This is Neil deGrasse Tyson. I too like sitting in my mother's basement.

• 22:42Neil deGrasse Tyson?

  As I'm playing this video game right now. So what do we do? But do we call you, the companies like you? What happens? And are we a lower priority? Because no, they're not draining our bank account yet. Where do we fit in that spectrum?

• 23:00Speaker 03

  My guess is that what you described is a crime that has two distinct victims. The first one is you, because you have just become an unwitting accessory to a bigger scheme that was shown to a potential public. Your reputation is at damage here and that somehow can be controlled because you have the leverage to report that video to the hosting platform and probably take it off. But you have still presented some information you. That version of you has presented some maybe misaligned information to your potential audience. And that's how deep fakes normally run.

• 23:43Speaker 03

  Cyber criminals pick up a very prominent figure, like a president, a bank governor, a medic. And then they place a discourse on top of the video. They will attempt to convince people that what that person is saying is true. The people will flock to heed the call to action and probably will lose money. So for some people, there is the reputational damage. That's you, the persons that get impersonated. For some other people is the financial loss that they have caused themselves when they heeded your call.

• 24:26Speaker 03

  No, you don't call Bitdefender for that. You call the platform and have the video removed. You use your outreach to tell the people that you're being impersonated. And they should, they should do their due diligence. And you also might want to educate the users, which we are actually doing right now. We're talking about deepfakes. We're talking about the possibility that everybody can create an online version of us with different hidden agenda. And I think that this educational part is the most important.

• 25:04Chuck Nice?

  Speaking of education, are there telltale signs that you're looking at a deepfake or hearing a deepfake? Now Neil said that the cadence of his speech was kind of a giveaway to him when he saw it. But are there things that we can, as laypeople, look at in a deepfake and say, oh, if I see this, this, and this, most likely or definitely this is a deepfake?

• 25:30Neil deGrasse Tyson?

  And you tell that to the deepfake and next time it doesn't do that?

• 25:34Chuck Nice?

  We're in a losing game. Yeah, we are. But are there, right now, that we know of?

• 25:39Speaker 03

  I would say yes, yes and no. For starters, there are a couple of telltale signs, like maybe poor lip synchronization or some sort of artifacts introduced by the AI. If you remember, a while ago, the AI used to have a very difficult time aligning teeth or representing the amount of fingers. But that changes in time. That as technology evolves, these things get perfected. And what I'm trying to say is that we should rely less on technical artifacts or telltale signs to tell a scam and focus more on the likelihood that what we're hearing and seeing is real.

• 26:23Speaker 03

  I saw the impersonating videos that Neil sent over. And when we analyzed them, we focused on, let's say, a couple of key elements that will demolish the story, like. Neil, Neil is a very knowledgeable person in the science field. He wouldn't spend much time commenting games, right? He wouldn't use that language. He wouldn't be recommending products. He would not do that. Probably we are going to need that than upcoming versions of our technologies for fighting scams to include deep knowledge about public people or the most prominent people in the world that are likely to fall

• 27:06Speaker 03

  victims of impersonation and create some sort of a what would that person do, recommend, speak about, discuss publicly and so on.

• 27:17Neil deGrasse Tyson?

  Very, very important fact, because that video game review, it had a lot of vulgarity in it.

• 27:22Chuck Nice?

  Right.

• 27:22Neil deGrasse Tyson?

  And I'm not a vulgar guy.

• 27:23Chuck Nice?

  Yeah.

• 27:24Neil deGrasse Tyson?

  I'm not that guy. Plus, I don't hawk products.

• 27:27Chuck Nice?

  Sell anything either.

• 27:28Neil deGrasse Tyson?

  I don't sell anything.

• 27:29Chuck Nice?

  Right.

• 27:30Neil deGrasse Tyson?

  Right.

• 27:30Chuck Nice?

  So if you ever see like, hi, this is Neil deGrasse Tyson for delicious Buffy Bison Beef Jerky. You know, it's, it's not real. It's just not real.

• 27:42Neil deGrasse Tyson?

  Yeah, there's even pressure for me to sell things for the, the ad spots of this podcast. I don't do that.

• 27:48Chuck Nice?

  Right. Gary and I are the whores that do that.

• 27:53Gary O'Reilly?

  You're welcome, Neil.

• 27:55Neil deGrasse Tyson?

  You're protecting my, thank you.

• 27:57Chuck Nice?

  That is our pimp.

• 28:00Chuck Nice?

  We out here on these streets.

• 28:02Speaker 03

  That opens up a lot of opportunities because whenever you're misbehaving or do reckless things, you can say, just, you know, it's an impersonation. I'm not doing that normally.

• 28:14Chuck Nice?

  Right.

• 28:15Gary O'Reilly?

  Okay. Bogdan, we've seen, and you've explained it brilliantly, thank you, about the development and use of technologies to bring forward different levels, different types of scams and deep fakes. How much of this is pre-planned psychological attack on victims? And how, how is, how are scammers building in a psychological aspect to this?

• 28:38Speaker 03

  My theory is that 90% of the scams are psychology and probably 10% technology and science. That's because scamming, scamming people is actually hacking into their brain, right? Pushing some buttons that generate emotions.

• 28:56Speaker 03

  Every type of scam that we have analyzed has some sort of psychological cues that cyber criminals want to pick up. Let's take failed package deliveries. You become curious about where did that package come from? And what might be in it? That's enough for your brain to switch off the rattling sound that says, hey, probably what that link you're going to follow will lead you to a phishing page, right? The brain no longer listens to these warning signs. You have romance scams where cyber criminals are exploiting and preying on the lonely. They don't target people who are using technology. They are targeting people

• 29:41Speaker 03

  who are feeling lonely. And they are feeling so lonely that they will be willing to spend all the day talking to a stranger who inadvertently sent a message because they misspelled a phone number. We have cyber criminals that prey on the natural greed that people feel, like, get rich quick now. Would you like to multiply your money 10 times? Again, they're not trying to demonstrate an economic impossibility. They will try to push that button that says, hey, I need more money because that's the human nature. So probably most of the scams that we face on a daily basis are psychology.

• 30:26Speaker 03

  And technology just widens the net, makes cyber criminals more effective, makes them capable of targeting people who are in a different geographic region, speaking a different language. A couple of days ago, I got texted by a scammer on an instant messaging platform. And they wrote the message in Romania. And I do what I usually do, answering Finnish. Finnish is a very niche language. There's like, what, 4 million people speaking an almost impossible language that it's very difficult to understand. And that's, you know, that's my tuning test. If you're able to reply me in Finnish... Ilabot, right?

• 31:11Speaker 03

  And guess what they did? They removed the first message and replied in Finnish. And they carried the conversation for a couple of messages. Sometimes they would revert back to Romanian, delete the message, and then replace it with the Finnish translation. And they would do that in almost real time. So what I'm trying to say here is that technology is an enabler for them. They are using the same psychological patterns that I talked about. But now they're able to cast a wider net because they have APIs to mass mail, mass communicate with people. They have real-time translation to help them address markets that were impossible for them.

• 31:55Speaker 03

  And they have huge opportunities on the payment scale because credit cards are universal. And if credit cards don't do the trick, then probably you're going to have to exchange real money into Bitcoins for cryptocurrencies.

• 32:09Neil deGrasse Tyson?

  And API stands for what? Remind me.

• 32:11Speaker 03

  It's Advanced Programming Interface. It's a way that you can hook up, let's say, an instant messaging application to a computer to mass communicate with dozens, thousands of people at the same time.

• 32:26Chuck Nice?

  Wow. So I think it's, you know, I may sound cliche when I say this, but this is what I was taught my entire life, that one, you don't get something for nothing. Two, if it's too good to be true, then it's not. And three, and this is the part that's very hard, don't ever want to believe something more than you want the truth. Because if you want to believe something, you will discard everything to get to your belief, to see your belief confirmed.

• 33:02Neil deGrasse Tyson?

  None so blind. You left out a fourth one.

• 33:04Chuck Nice?

  What's that?

• 33:05Neil deGrasse Tyson?

  Don't be a dumbass.

• 33:07Chuck Nice?

  That's my rule. Those were my parents' rules.

• 33:11Gary O'Reilly?

  None so blind as those who refuse to see is kind of like another way of rephrasing that. And talking of phraseology, I think we, just us three here, have learned recently some scamming language. Firstly, if, and I'll ask you to break them down. One is honeypot. The other is... Pig butchering. So which one? Well, one sounds pretty good. Yeah. And it ain't a honey pot.

• 33:39Gary O'Reilly?

  So Bogdan, could you break down each each phrase for us so as we understand and gives our audience an understanding as well?

• 33:46Speaker 03

  I like the way you have split them into adversary language and good guys language. I'll start with pig butchering. This is a type of scam that has been going on for quite a while. It's very popular in Southeast Asia. That's where it got its name from. Because it technically means fattening up the pig before you sacrifice it. And that's what cyber criminals are doing to the victims. They gain their trust, they keep conversations going on for weeks, maybe months, trying to gain their trust and get as close to them as possible. And when they earn their trust, they're going to create massive financial losses

• 34:29Speaker 03

  because they already have that person's trust. A very common pig butchering type of attack is somebody texting you normally with an opposite sex handle. Like if you're a man, they will impersonate a woman. And they will be asking you, hey, this is Jennifer. How far away are you from the airport? Because I'm I'm kind of losing patience here. You were supposed to pick me up at ten. And you look at the phone and answer, hey, you have the wrong number. Probably you want to sort it out with your taxi cab, Uber driver, whatever. They will reply, hey, thank you for being so kind.

• 35:11Speaker 03

  By the way, I'm visiting the city. I want to see what what your city offers. Do you have any recommendations? And they kick off a conversation. And they will entertain that conversation with with the victim for months. They will exchange photos that are created with deep fake technology. They will create videos. They will gain your trust up until some point where they start working the con. Hey, look, I'm I'm doing just fine. I have invested in cryptocurrency a while ago and now I'm reaping the rewards. We've been meeting online for quite a while, so I'll tell you my secret.

• 35:51Speaker 03

  Let me teach you how to invest a little bit of money to multiply it ten times, twelve, twenty times and so on. And they will start working on this financial fraud when you have finally fallen in love with them. I've been talking to people who have lost significant amount of money.

• 36:16Neil deGrasse Tyson?

  Wait, wait, they have yet to meet these people. Yeah. They're falling in love via electrons.

• 36:20Speaker 03

  Yes, and you know, emotion is emotion regardless of the vector. So, uh, reminds me of that joke, why is love on the wireless spectrum? Because it's measured in hertz.

• 36:34Neil deGrasse Tyson?

  Oh.

• 36:34Chuck Nice?

  Yay.

• 36:36Speaker 03

  Look at that. Good one.

• 36:38Neil deGrasse Tyson?

  I'll be here all week.

• 36:41Speaker 03

  So people fall in love and they're looking forward to meeting the other one, but it's it's never a good opportunity for that because of travel, because of all these things. And eventually people end up losing a lot of money. Uh, we've been investigating a couple of these scams and the sad thing was that people who had lost like hundreds of thousands of dollars were like, you know what? I don't care about the money. I don't have anybody to wake up to and text.

• 37:12Neil deGrasse Tyson?

  Hmm. Whoa. That is.

• 37:14Speaker 03

  That's that's sad. The psychological damage is some sometimes much more impactful for them than the financial damage.

• 37:22Neil deGrasse Tyson?

  Wow. Wow. So, all right. Wait, wait, so this is sets up the plot for the movie Her. Where just let the AI be your companion, fall in love with AI. And the AI is not going to try to take your money. Take your money? Yeah. Chat GPT, I don't think it wants to take your money, but it'll totally make you think you're in love with it. If you ask it the right questions. That's true. So we have, so we have solutions for this.

• 37:46Speaker 03

  I, I, I have a very limited, uh, movie culture, but my assumption is that that movie didn't end well.

• 37:58Gary O'Reilly?

  You may be right. So we've done pig butchering. Can you just open up the honeypot for us? Let us see inside.

• 38:04Speaker 03

  The honeypot. We have a couple of technologies that we call honeypot. It's something that researchers normally do. That's a computer or a connected system that poses like it's a victim. A honeypot is used by cybersecurity researchers to attract cyber criminals. And they will attempt to hack into that machine, thinking that it's a real user on the internet. It's somebody's computer. And they will attempt to exercise their prowess to hack into that. And the machine, instead of just letting it through, it records every step of the attack for us to be able to decompose

• 38:49Speaker 03

  the way cyber criminals got in. That brings a lot of value for us because it helps us understand how the criminals are operating on the internet, what tactics and tools they're using, how they're approaching this puzzle of hacking into somebody's computer, and what are the telltale signs that we can use in an early stage of the attack to block them. We use honeypots for various things, for collecting virus samples, for instance. We use honeypots for IoT devices to see how cyber criminals are harvesting IoT devices and building large armies of zombie devices that they're using then to attack civilian targets.

• 39:33Speaker 03

  We are using honeypots for recording scam conversations and extracting red flags in that conversation that will help the victim identify when they're being scammed. So that's very short definition of the honeypot. So honeypot is the good guys' tools? Yes, a honeypot is normally somebody's way of staying up to date with the latest tactics in the hacking world. OK, so I'm glad that exists.

• 40:26Gary O'Reilly?

  You've just described the honey pot and the pig box to me, thank you. And now you've kind of closed off both ends. Is anything out there real? I mean, most of this thing happens on the internet. And I'm just wondering now, is anything actually real out there?

• 40:41Neil deGrasse Tyson?

  I mean, real human, you mean, as a human?

• 40:43Gary O'Reilly?

  I mean, we know the victims themselves are generally humans. And there's very rarely a victimless scam. But is anything real? Just really, honestly, anything real out there yet?

• 40:54Speaker 03

  Pretty much everything is real because we're starting to use the internet. We have started to use the internet for real stuff a while ago. Nuclear power plants are being controlled over the internet. The world's money flows through the internet from one bank to another. Our communications flow from one end of the internet to another. Our dreams, our fantasies, everything is on the internet. So that's where the bad guys are lurking, right? And my guess is that your question is like, are we still more humans on the internet than probably bots? Or scripts or automations or artificial intelligence algorithms that are building content?

• 41:38Speaker 03

  Yes, there are way more people on the internet than bots.

• 41:42Neil deGrasse Tyson?

  That's what the bots want you to think.

• 41:48Speaker 03

  Look, if you take a look at what's happening on social media, there's a lot of video being created by humans. Is it useful? Definitely not, right? People dancing all over or sharing that experience is really not useful for the largest part of humankind. But it's still video created by people. They have put effort in doing that. Yes, there's much more content being created by humans at this point than by AI. AI and bots are, bots mostly are being used for scraping this content, a content that will be eventually used for training artificial intelligence algorithms.

• 42:30Gary O'Reilly?

  You don't really see right now a dead internet theory being the reality? You still think the human presence is there? Is it likely the future of the internet will be exactly that? And it's going to be 100% bot?

• 42:43Speaker 03

  There's going to be a lot of automation, but most of those consuming the content will still be humans. So regardless of how much content is being produced, there's still going to be people on the internet consuming that content.

• 43:00Neil deGrasse Tyson?

  Okay, I don't mind being a person on the internet, being entertained by AI-created content, as long as I'm not fooled into thinking it's anything other than that. In the film Blade Runner, based on the story by Philip K. Dick, "Do Androids Dream of Electric Sheep?" That's the original short story. Yeah, it's a great title. In it, there's a whole system in place where there are people trained to test the replicants to see if they're actually replicants. Because they're so well-made, they have to put them through a psychological stress test, where you know how a human would react, whereas the replicants,

• 43:45Neil deGrasse Tyson?

  the AI computer versions of us, would not, and they would fail. And the fact that that test was so subtle, and this story was written 50 years ago. So is there any way today? We mentioned this earlier, but I'm just saying, in a Turing test, if you're going to have a conversation, are there questions we can ask? Is there something about the video we can detect? Is this, other than my voice cadence and other things that I know about myself, how do we defend ourselves? Your company's called Bit Defender. So let me hear the defensive line.

• 44:23Chuck Nice?

  Help me, Bit Defender. Help me!

• 44:32Speaker 03

  The AI and deep fake front is opened relatively recently. We didn't have it five years ago. We didn't have it 10 years ago. You know, most of our defenses as humanity would evolve around staying safe from phishing links, from malware, from what I would tell traditional endpoint security.

• 44:53Speaker 03

  To artificial intelligence and AI-generated content. It's already here. We have like a couple of dozens of very famous online influencers that are ran by artificial intelligence. Like, there are a couple of Instagram accounts that have million of subscribers, and the person does not exist. The only thing that exists is an AI algorithm that's building content to order. Well, unfortunately, there is no defense against that. And would we need a defense to that? Or would we need a defense to probably some nefarious goals that the AI content will attempt to lead us to? And here's the, here's what we're trying to do here.

• 45:36Speaker 03

  We're trying to help people understand the red flags in communication, understand disinformation, understand the likelihood of something that they're exposed to being real. And probably that will be the future of technology. Not necessarily detecting that some content is created by AI, but rather the fact that that content created by whoever is malicious and will have an impact on you and your security.

• 46:04Chuck Nice?

  So when it comes to malicious intent on behalf of interactions, internet interactions, are there some hard and fast simple rules that we can follow? Like, the way you answer an email, or the way you answer if someone were to call you, the way you do or do not offer up information? Are there some simple rules that will help somebody not fall prey to a scam?

• 46:34Speaker 03

  You're asking all the hard questions.

• 46:39Speaker 03

  This is, this is a very important topic for me. Because these nefarious interactions that you described can be used for by a commercial actor, for instance, to, I don't know, make you behave in a specific way that will result in loss of money. But they're also used as hybrid warfare now. Disinformation is a big part of that. And it does. Doesn't have that kind of structure that makes it obvious. Uh, it doesn't have that uh call to action. That would let me know that the message is wrong, false, or uh leading to uh unintended consequences.

• 47:19Speaker 03

  The fact that we have deepfakes uh talking about, I would say, political stuff, impersonations, hidden agendas and so on. Will help an adversary dilute uh our amount of trust. They will cause uncertainty. They will reach the goal by making us question everything and ultimately not caring about the message. Because we cannot distinguish what's wrong from the right, what's uh true from the false and so on. So uh not not sure if this answers the question, but that's probably the best answer I can give at this point.

• 47:53Chuck Nice?

  All right. Well, how about this? And uh what does Bitdefender do? Like, you know, how do you guys defend against this stuff? If I were to have Bitdefender on my computer, what would it do for me?

• 48:05Neil deGrasse Tyson?

  Yeah, if all you do is find it, and plus, is there prosecution at the end of this? What fraction of all offenders are prosecuted? Because apparently with a nine trillion dollar fraud market.

• 48:17Chuck Nice?

  Ain't a lot.

• 48:18Neil deGrasse Tyson?

  It can't be a lot.

• 48:21Chuck Nice?

  Well, but that's what I'm saying. Like, that right there lets you know that this is ubiquitous and it's proliferating. So like, it sounds to me like when you call yourself Bitdefender, maybe there's a real need for you to be on my computer? But what am I putting you on my computer to do is what I'm trying to figure out. And I'm not trying to do a commercial here. I am genuinely interested.

• 48:44Speaker 03

  Cybersecurity is a fundamental part of the way we're interacting with technology right now. Um, I don't want to ring my bells here, but the security solutions are fundamental to uh how our end or our day starts and ends. And they made the difference between another day at the office and the complete disaster. What you have lost, all your money or your data at the end of the day. So what does Bitdefender do? Uh, we build cybersecurity. Security solutions and technologies that help people stay safe from all sorts of cyber threats. We started with what's commonly known as antivirus back in the 90s.

• 49:25Speaker 03

  When the internet was booming and when computers became a fundamental part of every household. We started securing them with what's called as antivirus. The good old days, it was just a virus.

• 49:39Chuck Nice?

  Just a virus.

• 49:40Speaker 03

  Just a virus, the good old days, yeah. We evolved way past that because our attack surface has become a little bit more complex. And now we have to secure not only computers, but our data, our smart devices in households. We have to secure companies that store your information. We have to secure a lot of aspects that were not an issue back in the day. So when you hear that the antivirus is dead or there's no real need for it on computers and mobile devices. That's not true, right? And antivirus solutions are becoming more and more complex. They have changed to complete suits now. They're not just one application.

• 50:25Chuck Nice?

  The virus is mutating. Mr. Smith?

• 50:29Speaker 03

  No, but it's not, it's not just the virus.

• 50:33Speaker 03

  Scams have become an important component of cybercrime. As I, as I told you, it's one ninth of the total losses caused by technology in the world. So at this point, Bitdefender also handles these anti-scamming aspects in various ways. We have security solutions that automatically detect that a specific message is a form of scam. We have advisors where people can describe what they're seeing or taking screenshots or taking a picture of something and feeding it to an AI assistant, asking, hey, is there anything dangerous here if I'm venturing into what's described here?

• 51:15Speaker 03

  And the AI will look at the situation, assess the likelihood of that being a scam and teach the user that. There are a couple of red flags there that probably leads to a scam. So B-Defender, what we do is what we've always done, keep users and companies safe. But now with a lot more technology and a tech surface to defend.

• 51:41Gary O'Reilly?

  So we've talked about-

• 51:43Neil deGrasse Tyson?

  By the way, I like your geometric reference to the texture of your surface that's exposed. The surface is a boundary between what's on one side and what's on the other. And the surface can get larger or more more variegated. I love that reference and how you have to then think about the problem.

• 51:59Gary O'Reilly?

  Bogdan, we've discussed-

• 52:00Neil deGrasse Tyson?

  What you don't want is a fractal surface, then you'll never get to the bottom of it.

• 52:03Gary O'Reilly?

  Never get to it, never get to the end of it, ever. We've discussed the sort of one-to-one aspect. What if you rolled out the sort of deep fake and malicious intents to a grander scale? To a city, a utility, on a national scale?

• 52:21Neil deGrasse Tyson?

  National security.

• 52:22Gary O'Reilly?

  Yeah.

• 52:23Speaker 03

  You know that Romania is on the eastern NATO flank. It's on the eastern part of the European Union as well. And as of a couple of years ago, we've had a war at the border. There's Ukraine versus Russia. Ukrainians are our neighbors. And as they were in the middle of the fight, deep fake of President Zelensky erupted on the internet, calling for every armed person to lay down their weapon because Ukraine had surrendered. That was a deep fake and it was quickly combated by Ukrainian security services. But this could have had awful consequences, right?

• 53:05Speaker 03

  What happened if the whole army fell for that? Or a part of the army fell for that? But that's also part of the hybrid warfare that I was mentioning before that. There's a lot of this information going on. There are calls to action that are completely wrong and so on. But another practical example would not necessarily have to do with deep fakes, but to the state of technology. And the penetration of technology into our homes. Bitdefender also has an I O T security research wing. I O T stands for the Internet of Things and it's normally a category of consumer electronics

• 53:49Speaker 03

  that's comprised of smart stuff, digital assistants. A coffee maker. Smart toasters, coffee makers and smart lights and so on. There's a specific type of I O T device that has started to penetrate the world. And that's the solar inverter. Solar inverters are pieces of technology that convert electricity from solar panels and store it, manage it, or inject it into the grid, right? These inverters are normally hooked up to the Internet at home. And these inverters, most of the time, come from China. Last year in August, we looked into a couple of inverters that are very popular in Europe.

• 54:35Speaker 03

  And we realized that a potential attacker would be able to seize control over each of the inverters made by a specific brand. That would give an attacker access to about one hundred and forty gigawatts of electricity. That's a lot by any standard. I'm not a professional in the energy, but that looks huge. That's a big blackout, man. And one of the things that we uncovered after this first contact was that we will never know whether that was a software bug that allowed somebody to get into all of the inverters made by the same manufacturer,

• 55:18Speaker 03

  or if that was a carefully hidden backdoor that could be accessed by a nation, a rival nation-state to cause a blackout to a city, country, or to a territory. Germany is a European state that's started to take cybersecurity in this inverter space very carefully because they realized that whatever happens in. In this very particular IOT sphere could bring greed down. What happened in Spain this year was a wake up call. That's greed falling, not because of a cybersecurity incident,

• 56:00Speaker 03

  but because solar played a bad role here. All I wanted to say is that greed are very powerful beasts and they used to be isolated from the internet. And now, everybody has a piece of the greed in their home that's connected to the internet. That's a million entry points to something that pertains to national security.

• 56:24Chuck Nice?

  That's why we gotta stick to coal. Gotta keep burning coal, man, that's the problem. Get off that doggone solar energy, okay? Oh, oh, new fangled solar and wind. What about the birds and the cancer? No, let's go with coal and you'll be okay.

• 56:41Neil deGrasse Tyson?

  Thank you, Chuck, for that regressive comment on civilization. Bogdan, we gotta wrap this up. Could you give us just some hopeful news here out of this conversation?

• 56:52Chuck Nice?

  Yeah, man.

• 56:53Neil deGrasse Tyson?

  Where?

• 56:54Chuck Nice?

  Where do you see all this going?

• 56:55Neil deGrasse Tyson?

  Yeah, where's this going in two years, five years, 10 years?

• 56:58Speaker 03

  This will continue to be a cat and mouse game, where the bad guys are advancing, the good guys will be catching up with their tactics and best case scenario, they will find a way to proactively protect against their attacks, right? We've done that for the past decades with malware and we're going to do that with deepfakes and with the rest of the scams as well. So there's hope. The fact that we're still using technology and most of our interactions online are safe gives us hope. We're here to protect. We have the technologies, the solutions, and we're not just waiting for the bad guys to win the game, right?

• 57:43Neil deGrasse Tyson?

  Given how large this marketplace is, you're not the only company out there who is working in this space.

• 57:50Speaker 03

  We have very powerful partners from others. Security vendors to law enforcement. And that's also one thing that I wanted to to tell you about. The fact that we're very successful in this cooperation with law enforcement. We have a lot of cases that we opened together with law enforcement. We have a couple of cybercrime rings that became dismantled as part of this successful cooperation. And police agencies all over the world are taking cybercrime extremely seriously. With our expertise and with their ability to execute arrests

• 58:32Speaker 03

  is something that helps us curb on cybercrime.

• 58:38Neil deGrasse Tyson?

  The ability to kick down a door, that's what that is. Yeah, AI can't do that. AI can.

• 58:45Neil deGrasse Tyson?

  So, Bodha, if a person is famous or otherwise wealthy and then they get scammed, that's kind of embarrassing. Is there some stigma that will go away eventually once people find out that they're not alone in their victimhood? Where does that land on this landscape?

• 59:02Speaker 03

  Well, scamming and malware can happen to everyone. That's because cyberattacks have become so sophisticated and so prevalent that it's difficult for everybody to stay safe at all times. I will give you an example. Cybercrime can happen to everyone. It's not you that you're enabling it, you're just a victim yourself, right? There have been a lot of compromised accounts belonging to highly respected people that have fallen victim to a cyberattack. We have a lot of surface to defend at the end of the day.

• 59:43Speaker 03

  We have email communications, we have mobiles and instant messaging. We have technology everywhere around us, on our body, in our home, in front of us, right? And that's a very, very difficult mission. Staying safe is a difficult mission. I would say is that if you're falling victim to any kind of digital crime, report it. First of all, there's entities there that might be able to help. There's also entities that needs to know that you have fallen victim to a type of cybercrime to be able to assess the magnitude of a phenomenon.

• 1:00:23Speaker 03

  Imagine that, for instance, only about 7% of scams are getting reported. So, police offices all over the world are not correctly budgeted to face this phenomenon because they cannot assess its impact on the local communities.

• 1:00:45Chuck Nice?

  So Bob, in a way, what you're saying is you should report it because if you don't, you're actually enabling the people who harmed you. You're actually helping them by keeping this to yourself and suffering in silence. Go ahead and report it because, one, it happens to everybody and it's not your fault. And, two, by reporting it, you're putting information out there that can be used against the people who committed the crime.

• 1:01:12Speaker 03

  Yes, they say that, you know, if a tree falls into a forest and nobody hears it, has it fallen? That goes with cybercrime as well. If you have been scammed and dozens of other people have been scammed and you have not reported it to the local law enforcement office and neither did anybody, is scamming really part of the police agency's agenda? No, because there's technically no scamming going on. That's why we are advising victims to report it. It's not something that they should be ashamed of. It's not something that they should keep it to themselves. The more they talk about it, the more this message gets pushed on the local agenda

• 1:01:55Speaker 03

  and law enforcement agencies or other people will be able to act on it.

• 1:02:01Chuck Nice?

  Cool.

• 1:02:02Neil deGrasse Tyson?

  That's the lesson right here.

• 1:02:03Chuck Nice?

  There it is.

• 1:02:04Neil deGrasse Tyson?

  Bogdan Botezatu, pleasure to have you on StarTalk Special Edition.

• 1:02:09Speaker 03

  Thank you.

• 1:02:10Neil deGrasse Tyson?

  Even though three quarters of everything you said was completely depressing, we needed that.

• 1:02:16Chuck Nice?

  I know, it was the best depressing conversation.

• 1:02:18Neil deGrasse Tyson?

  Yeah, I guess so. That's another way to say it. Okay, all right. It's the kind of depressing information that can serve you going forward.

• 1:02:27Chuck Nice?

  Absolutely.

• 1:02:27Neil deGrasse Tyson?

  There it is. There it is.

• 1:02:29Chuck Nice?

  So important.

• 1:02:30Neil deGrasse Tyson?

  And we were delighted to work with you guys when we filmed our segment with Formula One and the security necessary in the communication between the pits, the pit and the cars and that whole world. And so thanks for being there both times.

• 1:02:45Speaker 03

  Yeah, thank you for this opportunity. It's one thing to look at you religiously on the other side of the screen and a whole different experience to be part of the show.

• 1:02:55Neil deGrasse Tyson?

  Okay.

• 1:02:56Chuck Nice?

  Wow, thank you.

• 1:02:57Neil deGrasse Tyson?

  That's very nice. Excellent. All right. That's all the time we had.

• 1:03:00Chuck Nice?

  Learned a lot today.

• 1:03:01Neil deGrasse Tyson?

  Oh, yes. Yeah, I do.

• 1:03:03Chuck Nice?

  Yeah, I'm, I've learned, I am burning my computers.

• 1:03:06Neil deGrasse Tyson?

  That's right.

• 1:03:07Chuck Nice?

  That's what I learned. Done with it.

• 1:03:10Neil deGrasse Tyson?

  Going back to an abacus. I got one right. I got an abacus right now.

• 1:03:13Chuck Nice?

  No, no, no, no. I'm writing letters. I'm starting to, I'm writing letters again.

• 1:03:18Neil deGrasse Tyson?

  All right, Gary, always good to have you here.

• 1:03:19Chuck Nice?

  Pleasure, my friend.

• 1:03:20Neil deGrasse Tyson?

  All right, Chuck.

• 1:03:20Chuck Nice?

  Always a pleasure.

• 1:03:21Neil deGrasse Tyson?

  Be good. Neil deGrasse Tyson for StarTalk Special Edition. The, the world is coming to an end. This is the episode. AI will be our overlords and they'll take your money.

• 1:03:37Neil deGrasse Tyson?

  No, I exaggerate. Anyhow, really try to keep looking up. Until next time.