Pod Insights The Investor's Podcast (We Study Billionaires) - The Investor’s Podcast Network TECH011: The History of AI and Chatbots w/ Dr. Richard Wallace (Tech Podcast) About this episode Dr. Richard Wallace, creator of ALICE and AIML, shares his journey from 1990s chatbot innovation to today’s AI frontiers. He and Preston also explore AI’s learning methods, human vs machine intelligence, and the evolving role of creativity in artificial minds. IN THIS EPISODE YOU’LL LEARN: 00:00:00 - Intro 00:02:46 - How a 1990 New York Times article inspired Richard Wallace’s AI journey 00:03:42 - What made the ALICE chatbot revolutionary in its time 00:07:20 - The principles behind minimalist robotics and their influence on AI 00:12:00 - How AIML works and why it was crucial to early chatbot success 00:16:30 - The contrast between supervised and unsupervised learning methods 00:17:20 - Why LLM decision-making processes remain hard to interpret 00:20:33 - How humans and chatbots use language in surprisingly robotic ways 00:24:43 - The philosophical roots of the Turing Test and its modern critiques 00:40:19 - Insights on combining symbolic and neural approaches in AI today 00:41:18 - What Wallace is working on now at Franz in medical AI predictions Disclaimer: Slight discrepancies in the timestamps may occur due to podcast platform differences. BOOKS AND RESOURCES The platform behind ALICE: Pandorabots.com. Website: Franz. Related books mentioned in the podcast. Ad-free episodes on our Premium Feed. NEW TO THE SHOW? Join the exclusive TIP Mastermind Community to engage in meaningful stock investing discussions with Stig, Clay, Kyle, and the other community members. Follow our official social media accounts: X (Twitter) | LinkedIn | | Instagram | Facebook | TikTok. Check out our Bitcoin Fundamentals Starter Packs. Browse through all our episodes (complete with transcripts) here. Try our tool for picking stock winners and managing our portfolios: TIP Finance Tool. Enjoy exclusive perks from our favorite Apps and Services. Get smarter about valuing businesses in just a few minutes each week through our newsletter, The Intrinsic Value Newsletter. Learn how to better start, manage, and grow your business with the best business podcasts. SPONSORSSupport our free podcast by supporting our sponsors: Simple Mining Linkedin Talent Solutions Alexa+ HardBlock Unchained Amazon Ads Vanta Abundant Mines Horizon Public.com - see the full disclaimer here. References to any third-party products, services, or advertisers do not constitute endorsements, and The Investor’s Podcast Network is not responsible for any claims made by them. Learn more about your ad choices. Visit megaphone.fm/adchoices Support our show by becoming a premium member! https://theinvestorspodcastnetwork.supportingcast.fm
Transcript 0:00 Speaker 00 You're listening to TIP.
0:03 Speaker 01 Hey, everyone. Welcome to this Wednesday's release of Infinite Tech. Today's episode is a deep dive into the early foundations of conversational AI and what they reveal about today's language models. My guest is Dr. Richard Wallace, a pioneering chatbot creator and three-time Lobner Prize winner, best known for building Alice and the AI ML language that powered early conversational systems. The Lobner Prize was an annual competition designed to implement Alan Turing's imitation game, awarding the chatbot that could most convincingly carry on a human-like text conversation with judges, just as an FYI. So during the show, we talk about why simplicity beats scale in the early AI race, how supervised rule-based systems differ from modern LLMs,
0:48 Speaker 01 what the Turing test actually misses, and why combining symbolic reasoning with neural networks may matter more than raw model size. This is surely an episode you will not want to miss. So without further ado, let's jump right into the conversation.
1:05 Speaker 00 You're listening to Infinite Tech by the Investors Podcast Network, hosted by Preston Pish. We explore Bitcoin, AI, robotics, longevity, and other exponential technologies through a lens of abundance and sound money. Join us as we connect the breakthroughs shaping the next decade and beyond, empowering you to harness the future today. And now here's your host, Preston Pish.
1:39 Speaker 01 Hey, everyone. Welcome to the show. I'm here with Richard Wallace. And wow, this is really exciting for me to talk to such a pioneer in this space, in the chatbot AI space. And first of all, welcome to the show. Excited to have you here.
1:54 Speaker 02 Thank you. Thank you, Preston. It's a pleasure to be here as well.
1:57 Speaker 01 So where I want to start is I'm just super curious how people kind of fall into, you know, their field of expertise. And when I look at what you accomplished very early on back in the 1990s, I'm curious what drove you or motivated you to be paying attention to chatbots and the Turing Test and all of that. It's such an early phase because I think for most of the listeners, they know that all this stuff has really come to fruition in the last five or 10 years. It's gone on everybody's radar, but you were doing this literally decades before anybody was even aware of these ideas of chatbots and whatnot. So what was your initial motivation to get into this kind of stuff?
2:39 Speaker 02 That's absolutely right. You know, I like to say that nobody knew what artificial intelligence was until a couple of years ago.
2:45 Speaker 01 Yeah.
2:46 Speaker 02 And now I'll be sitting in a restaurant somewhere and I'll hear a conversation at the table next to me and they're talking about AI. Well, anyway, there are several threads that came together that inspired me to work on the chatbot Alice and I'll just pull on a couple of those threads here. One is that in 1990, I read an article in the New York Times about the first Lobner Prize contest. Now, the Lobner Prize was an annual Turing Test, an annual contest based on the Turing Test funded by a rather eccentric philanthropist, Hugh Lobner. And the story with the very first contest was that none of the programs competing came close to passing the Turing
3:31 Speaker 02 Test. They were all just terrible chatbots. But Lobner awarded a bronze medal every year to the chatbot that was ranked highest by the judges in terms of being the most human. And that first year, the bot that won was simply based on the old Eliza psychiatrist program, which if you're familiar with that was a very primitive chatbot developed by Joseph Weizenbaum in 1966. And it, you know, had very few responses, but it had some clever tricks to it. You know, it could sort of match keywords. And the input and had canned responses associated with those keywords.
4:12 Speaker 02 It could invert prepositions. So, you know, if I said, I came here to talk to you, then it would repeat back, you came here to talk to me. So it did that sort of pronoun swapping trick. But when I was in graduate school in the 1980s, this Eliza program was basically considered kind of a dead end or at best kind of a hoax.
4:35 Speaker 01 Yeah.
4:36 Speaker 02 In AI. And not only that, the inventor, Joseph Weizenbaum, ended up pulling the plug on it because he thought it was too dangerous. He thought that people were reading too much into it and was actually there. It was a psychiatrist program, so people were trusting it with their, you know, their personal issues and problems. They were surprised to find out that Weizenbaum could read all the transcripts of their conversations.
5:02 Speaker 01 Wow.
5:03 Speaker 02 And, and so he wrote a whole book after that, Computer Power and Human Reason, where he criticized the whole field of AI and his Eliza program in particular. You know, it's really hard to imagine this now that someone would come up with a new AI application that's very engaging and popular. People are using it. Then they would say, oh no, this is too dangerous. We have to put the genie back in the bottle. I think most people now would run out and try to find venture capital to start a company to commercialize.
5:35 Speaker 01 True, very true. But isn't this fascinating that the thing that he discovered very early on in the 90s, he started playing around with this in the 60s, which is mind blowing to me. But what he found in the 90s was that there was a huge centralization concern with privacy and what people were putting into these discussions, which is now, you know, a major talking point with AI. And it doesn't seem that, I know I'm generalizing here, but it doesn't seem like the population really cares too much or even thinks about these issues that caused him to shut down his, his entire effort behind this.
6:15 Speaker 01 I don't know. I find that really fascinating that he discovered this, what, four decades before it became like, or three decades before it became something that the rest of the world should be very concerned about.
6:26 Speaker 02 Well, he really discovered it in the 1960s. When he first created the program, the other ironic thing about Eliza was that up until very recently, I would say, well, let's say 20 years ago, Eliza was by far the most widely distributed, popular and well-known AI application.
6:47 Speaker 01 Yeah.
6:48 Speaker 02 If you knew anything about AI up until maybe the year 2000, then you would know about Eliza.
6:54 Speaker 01 Hmm. I'm curious, when you read this, I think you said New York Times article in 1990, did you ever think that you would be the winner of this Lobner Prize a decade later?
7:06 Speaker 02 Well, that planted a seed in my mind and I didn't really do anything about it for about five years.
7:11 Speaker 01 Okay.
7:12 Speaker 02 So another thread that led to the development of Alice or the inspiration for Alice was around that time in the early 90s, it was the end of the Cold War. And so there was decreased amount of government funding available for AI and robotics research compared to the 1980s. And so a number of us in the robotics field, I was working in robotics at the time, got interested in the idea of minimalism, robot minimalism. And basically that was the idea that we could build robots with very simple, inexpensive sensors and actuators, you know, very commodity microprocessors.
7:52 Speaker 02 And as a result of that, you could actually get more lifelike behavior out of these robots than you could with, you know, approaches people had tried in the past with much larger computers and so forth. One of the interesting inventions that came out of that period was the Roomba.
8:09 Speaker 01 Yeah.
8:09 Speaker 02 You think of the Roomba rolling around and, you know, bumping into things and changing its direction. It's all basically just a stimulus response application. We call that stateless. So it's sensing something and then taking an action based on what it's sensing, you know, changing direction, for example.
8:28 Speaker 01 Yeah.
8:28 Speaker 02 So that, that whole approach of minimalism, you know, was also in my mind at the time. And that kind of dovetailed with the, the very simple approach of the Eliza program, which was also kind of a stimulus response. You know, it was so simple that it could respond very quickly. It didn't have to go and do a lot of computations to come up with the responses.
8:50 Speaker 01 What was your inspiration for thinking that simplicity was going to lead you to better results? Was there something in your life or something that you were reading at the time? Or what drove you to that intuition?
9:04 Speaker 02 Like I said, we were working on the minimalist philosophy of robotics.
9:09 Speaker 01 Oh, okay.
9:10 Speaker 02 And yeah, at that time, I was working on the development of a robot eye. And by that, I mean a visual sensor that's based on the architecture of the human eye. So the human eye differs from a TV camera in the sense that a TV camera is basically a square grid of square pixels. But the human eye is more like concentric rings of pixels with higher and higher resolution towards the center. We call that a log map. And so we developed a sensor that had that log map, log map pixel organization. In order to use a camera like that effectively, you have to be able to point it. So we developed a little motor, high-speed pointing motor, based on a direct drive design.
9:55 Speaker 02 And that motor could point the camera, the eye camera, and pan and tilt directions very, very quickly. And again, it was a very simple kind of actuator, simple sensors, and it could move very quickly, could move actually faster than the human eye. So you'd sort of see this thing whipping around and looking at different things. And it was very lifelike.
10:19 Speaker 01 So just for the audience to understand, so in 2000, I believe 2001 and 2004, Dr. Wallace won the Lobner Prize, which is this Turing test, with his Alice Protocol or chatbot that he had created. And I guess for me, what was the major insight that you think that you had back then? You talk about this idea of simplicity, but what would you say was the major insight that you had to outperform everybody else that was competing on what is? I mean, for anybody listening, the most complex, challenging, you know, problem you could ever try to go after, right? Like, what would you say was your keen insight that you had that allowed you to do this?
11:00 Speaker 02 Well, it was basically the idea that I could build on the ELIZA program. So the ELIZA program had about 200 rules, 200, you know, stimulus response rules. And you could think of that as a pattern and a response. And my idea was to kind of was to build kind of a super ELIZA, where instead of 200 rules, you had thousands and thousands of rules.
11:23 Speaker 01 Yeah.
11:23 Speaker 02 And in fact, by the time I was entering those contests, I got Alice up to about 50,000 patterns and responses.
11:31 Speaker 01 Wow. Amazing. So, Richard, one of the things that I found really fascinating about you back at this time was that you came up with this artificial intelligence markup language. You effectively, for all intents and purposes, and correct me if I'm mischaracterizing this, you had to come up with your own language in order to kind of build efficiency into how this chatbot was working, which is, you know, as a person who's not very good with languages, I'm much more of a math person. I'm reading this and I'm thinking, this is mind blowing. So, talk to us about this. And what was this insight that you had to come up with the AI ML, artificial intelligence markup language at the time that you did this?
12:13 Speaker 02 Well, AI ML is based on XML, and XML was very popular at the time. One thing that appealed to me about XML for the purpose of writing chatbots was that I always say XML has an implicit print statement. So when you write the responses, you don't have to put in an expression that says print blah, blah, blah, something, you know, between the parentheses, because the XML already just provides the text inside the markup. So the response is just the text inside the markup. And then, basic unit of knowledge in AI ML, I call the category, which is like the rules I was talking about a second ago. So the category consists of a pattern that matches some input.
12:59 Speaker 02 Some natural language input and then a response called the template. Reason it's called the template is because it's not exactly the answer, but it's a template for the answer that can be populated with various other things. And then there was also a recursive element to it where the response could actually simplify the input into a kind of simpler input. So the example of that is I want you to tell me who you are right now. So you can reduce that by removing the right now. So I want you to tell me who you are. And then you can remove the I want you just so it reduces to just tell me who you are. And then that reduces to who are you?
13:40 Speaker 02 So there was that recursive element built into the responses as well.
13:45 Speaker 01 So in general, you're just you were taking language and you were making it way more efficient. And but like, where do you even start with something like that? I mean, you'd literally have to go through. There's just so many different variations of language. And I think of the complexity of this, I wouldn't even know where to begin to start writing something that makes it more efficient.
14:06 Speaker 02 Like, right.
14:07 Speaker 01 Yeah. So how did you how did you think about solving that problem?
14:11 Speaker 02 Well, it all goes back to the conversation logs. So just like Wise and Bum, you know, I can read the transcripts of conversations people were having. By the way, this would have never worked without the Internet, without the World Wide Web.
14:24 Speaker 01 Yeah.
14:24 Speaker 02 Because with the World Wide Web, I could start to accumulate conversations from a very large audience of people. And by looking at the transcripts of those conversations, I could basically program responses to the things people were saying. Later on, I realized that there was kind of zip distribution over the things people were saying. So, you know, there's kind of a most common thing people say, which is hello. And then who are you and how are you? And I like something. So you can create the responses in order of how frequently people say particular things.
15:06 Speaker 01 Let's take a quick break and hear from today's sponsors.
15:09 Speaker 03 Early in my career, I was shipping away at student loans and it felt like it would never end. I'd make a payment, check the balance, and it barely moved. What finally changed my mindset was seeing a real finish line, a date I could actually circle on the calendar. That's what Monarch's debt paydown simulator gives you. It uses your real balances and payments to show your exact debt-free date. Then you can run different scenarios side by side, like adding an extra $100 a month, and instantly see how much sooner you'd be done. Watching that timeline shrink is really motivating, and you're the one in control of the plan. Plus, a quick check-in on your phone or laptop tells you exactly
15:48 Speaker 03 where your money stands. It's so important to manage your finances, and I believe Monarch can help you in doing so. Write your own money story with Monarch. Use code WSB at monarch.com to get your first year of Monarch Core half off at just $50. That's 50% off your first year at monarch.com with code WSB. Interested in futures trading and looking for a place to get started? With Plus500 Futures, you can explore some of the world's most active markets, all from one easy-to-use platform. Trade futures on popular assets like the S&P 500, NASDAQ, oil, gold, Bitcoin, Forex, and more. Whether markets are moving in crypto, commodities, or indices, there's
16:33 Speaker 03 always something to follow. Plus500 Futures is designed to make trading straightforward with a platform you can access wherever you are, right from your phone. And you can get started with a minimum deposit of just $10. Not ready to trade with real funds? Try the free unlimited demo account first and explore the platform without putting real money at risk. Backed by nearly 20 years of experience and trust by millions of customers worldwide, Plus500 gives you the tools to stay connected to the futures markets. Visit us.plus500.com to learn more. Trading in futures involves risk of loss and is not suitable for everyone. Not all applicants will qualify. Plus500, it's trading with a plus.
17:14 Speaker 03 You don't need me to tell you that rent and mortgages are only getting more expensive. That's why Built created three credit cards designed to offer the richest rewards on rent, mortgage, and everything else you spend on. Whether you rent or own, you can earn up to 1.25X points on every housing payment without the transaction fee, no matter where you live. Points can be redeemed for flights, hotels, Lyft rides, a future housing payment, and much more. Turn one of the most unavoidable payments in your life into the most rewarding. Find the card that's right for you and apply at joinbuilt.com/tip.
17:53 Speaker 03 That's J-O-I-N-B-I-L-T dot com slash T-I-P. Use our link so they know we sent you. Terms apply, subject to approval and eligibility. Built cards are issued by Column NA, Member FDIC pursuant to license from Mastercard International, Incorporated.
18:13 Speaker 01 All right, back to the show. My question for you is, and I'm struggling to find a way to frame this, but do you write these thousands of rules? And you're also working on a way to compress or make the English language more efficient. What did you fundamentally learn through the experience of writing these thousands of rules and rules of thumb of compression? Because when I think about it, like you're doing, like we look at these LLMs and machines are doing all of this really hard and complex work. But I would imagine what you were doing there in the 90s and early 2000s was exactly what all these LLMs are doing today, but you were doing it manually.
18:57 Speaker 01 And so I guess it's almost, I hear these people that say, well, we have no idea what's behind these ones and zeros in all these LLMs, which I guess is a true statement, right? But if a human was going to maybe be able to understand what it is that it's doing, I think you would be one of the very few people on the planet that could maybe help us understand what that is because you did this manually for so many years.
19:24 Speaker 02 Right. Well, there are so many things wrapped up in that question. So let me see if I can pull it apart. Yeah, so there's always been a kind of tension in the history of artificial intelligence between, let's say, supervised learning and unsupervised learning. So what I was doing was what we call supervised learning because I was playing the role of a teacher or, you know, a guide. So whenever I added a new response, it was manually added, as you're saying, driven by a particular input that I saw in the in the conversation logs. And so the way that I'm teaching the robot is by acting as its teacher, basically, and saying, you know, when you see this, you should say that.
20:06 Speaker 01 Yeah.
20:07 Speaker 02 And, you know, that's in contrast to unsupervised learning, which is what these LLMs are doing. They're basically, you know, trying to accumulate a lot of inputs and, you know, find the neural network weights that match it to particular outputs. And so with that technique, you can get phenomenal results, obviously, but as you're saying, it's difficult to know how the LLM came up with particular responses. Whereas in the supervised learning case, where it's all a symbolic process, it's very easy to trace back through the, you know, the logic of the program and see what caused a particular response to be generated.
20:49 Speaker 02 And I always say that people who do supervised learning approaches spend all of their time doing creative writing, which is what I was doing with the Alice bot. But people who do unsupervised learning spend all of their time deleting crap from the database.
21:06 Speaker 01 Yeah.
21:07 Speaker 02 And that's sort of what's going on with the LLMs now is, you know, they're having to put a lot of work into filtering to make sure they don't say anything inappropriate or offensive or political. And, you know, that ends up being a lot of manual work as well.
21:22 Speaker 01 Yeah. And I guess my understanding is that everybody that's on the cutting edge of AI today, like, that's the holy grail for them is to get the human out of the loop and for it to be Completely AI generated and filtered and just like there's no humans there. As a person who deeply understands this and the way that you frame that is this back and forth. And there's consequences to one side and the other. Is there a moment where you think that they will be able to get away from complete removing the human out of the loop? And it progressing in a way that's actually beneficial? Or do you think that the more that they lean into removing the human out of the loop? That they actually are setting themselves up for a systemic failure?
22:07 Speaker 01 Because it's going to spiral into this AI slop, if you will. Or it's creating and generating content in a direction that's so fast and so extreme? That they get away from human filtering altogether? And it just kind of turns into this almost like a runaway virus, if you will. Is that how you kind of see this? That it needs to be balanced? Or is it even possible for it to go in that direction without humans?
22:31 Speaker 02 Well, it's so hard to predict the future. I would have never expected this whole LLM development to come along in the first place.
22:39 Speaker 01 Yeah.
22:40 Speaker 02 But you know, I always think of a child learning language. And there are big differences here between a child learning language and an LLM.
22:47 Speaker 01 Yeah.
22:48 Speaker 02 You know, a kid doesn't have to scan the whole internet to learn how to speak a language. In fact, they're pretty good at, you know, what we call one shot learning. You know, if you say to a kid, this is a dog, then they can instantly recognize every dog in the world as a dog.
23:03 Speaker 01 Yeah.
23:04 Speaker 02 But what also comes into play here is the supervised unsupervised learning dichotomy, which is if you are a kid and you have a good teacher and good parents, you'll learn to speak very well. But if you're a kid who has to pick up language on the street without any supervision, then your language learning won't be nearly as good. And so the LLM is more like the kid out on the street. Learning language without any supervision. And that's why they learn so much inappropriate and offensive material and so on.
23:38 Speaker 01 What did the wins teach you back in the day when you were winning this about how humans judge intelligence?
23:44 Speaker 02 Well, you know, I can say the same thing about LLMs now that I said about my chatbot back then, which is that people say, well, these chatbots are becoming more and more like humans. And, you know, I have a different opinion about that, which is that what it's really showing us is that people are more like robots than we would like to think we are. Because it's not that they're robots becoming more like a human, it's that it's revealing to us how robotic we are. And, you know, back in the early days of working on Alice, I came to realize that most people, most of the time, are saying things that they themselves have said before, or that they've heard other people say before. And
24:26 Speaker 02 even when they're, you know, writing, they're basically synthesizing thoughts and ideas that are not necessarily original. And all of these chatbots work because language is predictable. And predictable means robotic. So I always say that if we were all William Shakespeare's uttering an original line of poetry with every sentence we spoke, then these chatbots would never work, because they're based on language being predictable, not original reutterance.
24:57 Speaker 01 Is it fair to say that you would suggest that humans judge intelligence by their flow, or by this response of like, most people are looking at that and they're saying, oh, that's intelligence. But then you're looking at it and you're saying, that's not intelligence, it's just repetition. I think that's kind of what you're getting at.
25:14 Speaker 02 Yeah, absolutely. Repetition, robotic, predictable.
25:18 Speaker 01 Yeah. You know, it's interesting. I just read something, it was like last week, and I think Google came out with this many months ago, but for them to do this long-term learning, where it has much more of a memory, it's highly based on whether something's novel or not, relative to its index of everything that it's been trained on. And that's, and when it sees this novel thing that it wasn't predicting or expecting to come next, that it then stores that in its long-term memory, or Apologize for the terminology here, Dr. Wallace, but it flags it as something that is worthy of being remembered because it's novel and so different and outside of would have predicted to be the next thing. And it's interesting that it's in keeping with Claude Shannon's
26:03 Speaker 01 information theory and how it's all aligned. I'm curious if you have any opinions on that in particular, and whether you think that that has a key component to intelligence, or how new things are discovered in knowledge in general.
26:19 Speaker 02 Well, that really gets to the heart of what I think the difference is between humans and robots, which is that, like I said, I think most people, most of the time, are acting like robots. They're just acting in kind of a stimulus response fashion. Just as an aside, I always used to say that most human conversation is stateless, meaning that what I'm saying to you right now only depends on the question that you just asked me, and we can forget the whole history of our conversation up to this point. You know, one of the pieces of evidence for that is, you know, if you can imagine yourself having a casual conversation with someone at a party, say, and then you say, "Oh, where did you go to college?" And
27:02 Speaker 02 they say, "Oh, I went to Harvard. I already told you that." You kind of forgot that you would already talked about college earlier in the conversation.
27:11 Speaker 01 Yeah.
27:11 Speaker 02 And, you know, you're just responding to the most recent thing you heard and most recent input. But what really gets to the difference between humans and robots is, even though most people, most of the time, are speaking in this kind of reactive, behaviorist way, it is possible for people to have original thoughts and be creative. And, you know, it's almost like a muscle that you need to exercise in order to build it up. If you want to break out of that robotic mold, then you have to put some effort into trying to be creative and original with your thoughts and thinking and ideas.
27:47 Speaker 01 Let's take a quick break and hear from today's sponsors.
27:50 Speaker 03 You know that sinking feeling when a meeting ends, everyone's nodding along and two days later, you realize that nobody wrote down who was doing what. That's why I use Granola. Granola is an AI-powered notepad that makes your meeting notes useful. It captures what happens in your meetings and it turns it into clean, structured notes with decisions and action items pulled out and made easy to find. On days with back-to-back calls like guest prep and team check-ins, community calls, I used to spend the gaps cleaning up messy notes and trying to remember who owned what. Now I stay in the conversation and weeks later, everything is searchable in one place. Once you try it on a first meeting, it's hard to go without. You can
28:34 Speaker 03 try it totally free. Head to granola.ai/wsb. That's granola.ai/wsb to get your time back. Go to granola.ai/wsb and try it on your next call. Interested in futures trading and looking for a place to get started? With Plus500 Futures, you can explore some of the world's most active markets, all from one easy-to-use platform. Trade futures on popular assets like the S&P 500, Nasdaq, oil, gold, Bitcoin, Forex, and more. Whether markets are moving in crypto, commodities, or indices, there's always something to follow. Plus500 Futures is designed to make trading straightforward. The platform you can access wherever you are, right from your phone. And you can get started with a minimum deposit of just
29:19 Speaker 03 $10. Not ready to trade with real funds? Try the free unlimited demo account first and explore the platform without putting real money at risk. Backed by nearly 20 years of experience and trust by millions of customers worldwide, Plus500 gives you the tools to stay connected to the futures markets. Visit us.plus500.com to learn more. Trading in futures involves risk of loss and is not suitable for everyone. Not all applicants will qualify. Plus500, it's trading with a plus. This September, I was in New York for the Intrinsic Value Conference. The talks were great, but what I kept thinking about is what happened around them. On Friday night, about 20 of us crowded around a long table at a family-style Italian spot near Times Square.
30:04 Speaker 03 Saturday, we did it again. And Sunday morning, a group of us were still debating Socrates over breakfast before everyone headed home. Many of the people at those tables had only known each other from our calls in the Mastermind Community. That is the community I host with Kyle Grieve and Daniel Manca. Each week, we get together on live calls to dig into markets and individual businesses. We bring in fund managers, operators, and authors as guest speakers. And a few times a year, like New York this fall and Omaha every spring, we meet in person. If you want to think in decades alongside people who do the same, apply for free at theinvestorspodcast.com/mastermind.
30:46 Speaker 03 If your application stands out, I'll be the one to reach out to you personally. All right, back to the show.
30:52 Speaker 01 Do you think that the Turing Test actually measures intelligence? Or is it something else entirely?
30:59 Speaker 02 I'm so happy you asked me about the Turing Test. So, the Turing Test, most people understand the Turing Test as sort of game where there's three players. You have a person who's called the interrogator or the judge, and then they're communicating through a teletype, a text-only medium, you know, much like texting on your phone, but without any audiovisual, just typing. And then, the two entities that the judge is talking to, one is a human and one is a machine. So then, the judge has to decide which one is the human and which one is the machine. And if they misidentify the machine as the human, then it's said to pass the Turing Test.
31:43 Speaker 02 You see, this has a big problem as a scientific experiment, because it's not really clear how often the interrogator has to, you know, misidentify the human. Is it 50% of the time? 75% of the time? 100% of the time? What does that even mean? That the robot is more human than a human? So in Turing's 1950 paper, Computing Machinery and Intelligence, he actually describes two different versions of the task or the game. And earlier in the paper, he described something called the imitation game, which, as far as I understand, was based on a real parlor game that people played in Victorian England.
32:26 Speaker 02 And in this game, again, there are three players, the judge and the interrogator. And the other two players are a man and a woman. And let's just set aside the, you know, the gender issues and the context of 19, writing in 1950 here. So there's a man and a woman sequestered away in, in the Victorian England case in different rooms. And then the, the judge is sending them handwritten questions back and forth. And the judge's job is to decide which one is the man and which one is the woman. Now furthermore, Turing stipulated that the woman should always tell the truth and the man should always lie. So now if you, if you ask the man, are you a woman? He would say yes, because he has to lie.
33:10 Speaker 01 Okay.
33:10 Speaker 02 And then, you know, the judge's job is to try to figure out which one is the man and which one is the woman. Now, if you replace the lying man in that scenario with a machine, okay? Let's say you replace the man with a very crude chatbot like Eliza or even Alice.
33:28 Speaker 01 Yeah.
33:29 Speaker 02 Then the judge could identify the woman correctly 100% of the time.
33:34 Speaker 01 Okay.
33:34 Speaker 02 Because it's clear that only one of the players is a human at all. And that has to be the woman. So now, as a scientific experiment, we can say, let's run this experiment with, you know, 100 judges and 100 men and 100 women. I don't know exactly how many are needed for statistical accuracy, but let's just say we did a random sample where we collected the results of this game for, you know, a large number of players. Then you could measure a certain percentage of the time that the judge would identify the woman correctly. And, you know, let's say that's 70% of the time. Now, if you replace the lying man with a computer
34:15 Speaker 02 and the computer is a very good AI that can actually play the role of the lying man, then you should get closer and closer to that actual 70% measurement. So that's actually a better scientific experiment than the Turing test.
34:30 Speaker 01 Very interesting.
34:32 Speaker 02 Yeah, yeah. The Loebner contest was really based on the the original standard Turing test.
34:38 Speaker 01 Turing test, okay.
34:39 Speaker 02 Yeah. And, you know, the rules changed from year to year depending on, you know, who was hosting the contest. But Loebner's rule was basically if 50% of the judges, usually there were four judges, so two out of four judges misidentified the robot as a person, then he would award the silver medal for passing the Turing test.
35:01 Speaker 01 That's so cool.
35:03 Speaker 02 Hmm. It was never awarded, by the way.
35:05 Speaker 01 It was never awarded. Interesting.
35:07 Speaker 02 Yeah.
35:08 Speaker 01 If you could get in a time machine right now and go back to your days, call it 2000, when you had done this, what would be the thing that you would whisper to yourself as a hint as to how to improve the chatbot that you had back then?
35:23 Speaker 02 I would probably tell myself, don't even do this.
35:29 Speaker 02 Why?
35:30 Speaker 01 Because you know how hard it is and how, okay, why?
35:33 Speaker 02 There was no money to be made from chatbots until very recently.
35:42 Speaker 01 You were very early. Yeah.
35:44 Speaker 02 The Loebner contest was always the domain of, you know, hobbyists and amateur programmers. There were a few, you know, academic entries, but no, no big companies ever got involved in it. And then in the 2000s, I organized a number of chatbot conferences, you know, international chatbot conferences. And we have a hard time getting 25 people to attend.
36:07 Speaker 01 Oh, really? Okay.
36:08 Speaker 02 Yeah. So, you know, after many years of really struggling with this and trying to figure out how to make a living with chatbots, and I did co-found a company called Pandora Bots, which is, you know, based on attempting to commercialize the AI ml box. But, you know, after a while in the early, after, in the early teens, I should say, I just decided to get out of the field completely and I went to work in healthcare.
36:36 Speaker 01 Yeah.
36:37 Speaker 02 But then in the past five or six years, I've gotten back into AI as it's become more, you know, lucrative, I should say.
36:44 Speaker 01 It it seems like in 2017, Google came out with this paper. It was called Attention is All You Need. And this seemed to be a very seminal breakthrough in how to, for all intensive purposes, do what you were doing in a very manual way and let machines do it way faster and with way more horsepower and more data, right? I'm curious, when this paper came out, did you read it when it first came out? And were you kind of aware of this? Or did it kind of pop on your radar a couple of years after when we started seeing the breakthroughs?
37:20 Speaker 02 Yeah, I was really not paying attention to it at the time, like I said, I was
37:24 Speaker 01 Yeah.
37:25 Speaker 02 working in healthcare. You know, I don't think the LLM industry really came to my attention until, you know, we started hearing about GPT.
37:34 Speaker 01 Mm hmm. Do you think that that paper was kind of like a really important seminal piece of work for people to kind of understand how to start doing this in a mechanical machine kind of way?
37:45 Speaker 02 Yeah, obviously, obviously, that was a breakthrough, yeah.
37:48 Speaker 01 Wow. And so in your own words, what would you say? I mean, we know attention is a big piece of it. But I think for somebody that just kind of hears that label, it's like, okay, well, what does that mean? If you were going to try to explain to somebody in a very simple way, like, what is that paper saying that has enabled, you know, machine learning to do what it does?
38:11 Speaker 02 Well, in a way, I'm reminded of the work we talked about earlier, which was the robot eye in the early 90s, because that was also an attention-based mechanism.
38:21 Speaker 01 Hmm.
38:22 Speaker 02 So I described how, in order to make use of that, you know, log map arrangement of pixels where there's high resolution towards the center, you have to be able to point the camera so that the high resolution can be aimed at something interesting. Well, how do you know it's interesting? It's by if you see something in the periphery, for example, movement, and you want to move your eye towards the thing that you're seeing in the periphery and place the attention on that. So attention has to do with focusing your
38:54 Speaker 02 Resolution sensor sensory capability on whatever seems most interesting in a scene. I think there's an analog for that in the LLM version of attention as well. You know, they're they're sort of swinging in the direction of where the gaze of the robot is looking, depending on what they see in the periphery.
39:15 Speaker 01 Okay, so this is super. I love this example because it's very physical and you can kind of make sense of it very simply because it's dealing with vision. And so when you're changing your attention and you're able to zoom in because you have the capacity to zoom in on something, how are you filtering or knowing what's novel in that broader sight picture? In order to know to adjust the focus to that thing? What gives us that capacity to know, oh, well, I'm looking at you and now I'm focusing on the tree back behind you. And I'm zooming in on that and I'm putting my attention there. What would be that insight in order to say, oh, that's different? That's something I need to dial in on or pay more attention to?
40:00 Speaker 02 Yeah, a long time ago, a guy called Hans Moravec, who's very interesting, we should talk about him some more. He came up with an attention mechanism called an interest operator, and this is for computer vision again.
40:13 Speaker 01 Okay.
40:13 Speaker 02 And it's basically that things in your visual field that have high variance, you know, a high ratio of dark to light, more interesting than other things. So that would typically be edges, like the edges of the tree you just described, or corners of things, or just any sort of bright spot against a dark background or vice versa. And then recognizing those in the periphery of your visual field would cause you to move the center of your visual field towards whatever the interest operator is highlighting.
40:47 Speaker 01 Fascinating. Okay, here's an odd question for you. Do you think your real subjective study ended up being humans rather than machines?
40:56 Speaker 02 Oh, well, you know, I'm a computer programmer. So I was always more interested in the machine side of it. I think I did learn a lot about human conversation from monitoring those conversation logs.
41:10 Speaker 01 The reason I ask this question is, you know, in kind of research and preparation for the interview, it seemed to me that you have this opinion, I suspect, and correct me if I'm saying any of this wrong, but it seems like you were not convinced that any of these chatbots were actually saying anything intelligent. It was just, it was this canned response that was coming back. And then the reaction that humans had was like, wow, this thing is real. And there's like something behind it. And so I guess that's the impetus for the question is because you were, I suspect you were fascinated at the response of people and how duped, I guess, they were by interacting with some of these chatbots.
41:54 Speaker 01 So I guess that's more of the impetus for the question. And would you agree with everything that I just said?
41:59 Speaker 02 Well, I used to categorize the users or the clients, I call them, into three categories, A, B, and C.
42:07 Speaker 01 Okay.
42:08 Speaker 02 So, and A clients are abusive. Okay, so they're going to say, how can I put this, you know, very inappropriate things to the chatbot? And you see those in the conversation logs. Although you always have to wonder if someone is saying, you know, I hate you or I love you even. Is that what they're, what they really have in mind? Or are they just, you know, trying to get a response out of the robot and see?
42:32 Speaker 01 Testing the limits, yeah.
42:33 Speaker 02 Testing the limits, yeah. And then the next category, B, are just average users. So those category B people were the ones who could suspend their disbelief and they would be very engaged with the bot and have, you know, very long conversations, come back and continue their conversations and so on. And so that would be the group that, you know, as you're saying, would be kind of reading more into the bot that was, than was actually there because they're engaged with it on an emotional level. And then the last category, I call the critics, which are people who know something about computer programming and AI and they just think this thing is terrible and, you know, they walk away after a few interactions.
43:17 Speaker 01 Well, I'm curious to hear your thoughts on where we're at now and where you see some of this going next. You know, you have some really smart people in this space that have, you know, demonstrated their knowledge through the things that they've built. And I think, you know, if we back up the tape three years ago, many of them were very suspect as to whether AGI could ever be possible today. And I have a hard time knowing if this is them trying to get more capital or they actually believe that we're on the cusp of AGI. I don't know which one of those two it is, but I'm just curious to hear your general thoughts on where you see us today and like what the next five years might bring.
44:01 Speaker 01 As exciting of a next five years as we've seen in the past five years, kind of just give us your one over the world on it.
44:09 Speaker 02 Well, I definitely think it'll be exciting. You know, the term AGI seems a little strange to me because it's what we've always called AI. You know, AI has always been a goal that's just out of reach. And, you know, we have a, an imagination of what it is based on seeing science fiction movies and that sort of thing. You know, Hal and R2-D2 and all those examples give us a template for what we'd like to see in an AI. And so it seems kind of odd that they've come up with a new term AGI to kind of move the goalpost even further. But I'm very skeptical about that. You know, a very simple answer to this question, which a lot of people I know would not agree with is that God gave human beings a soul, but machines don't get a soul.
44:54 Speaker 02 So, you know, in the sense that human beings have freedom of thought and self-reflection and creativity. I don't think those things will be reproduced in a computer anytime soon.
45:08 Speaker 01 Yeah, and I think I'm with you 100% on what you just said. And I know there's a lot of people that want to argue these ideas and we're not here to do that, but I'm with you 100%. I think that there is something very special and unique about just any living being, not just humans. I think any living being has this special. Connection from, you know, a higher source. And I don't think that we're necessarily going to see, you know, these humanoid robots have whatever that is, and I have no idea how to define that. But I do think that some of these humanoid robots, call it five or 10 years from now, are going to do things. And it goes back to some of your earlier comments about these chatbots and how people were just like, oh, my God, I feel like I'm talking to a real person. This feels real.
45:53 Speaker 01 And I think that some of these humanoid robots are going to feel like real humans to a lot of people. But that doesn't mean that it's the same thing as us. I think we are something very hard to define, very different. But, oh, my goodness, Richard, I really enjoyed this conversation. Anything else that you want that you think is super important on this particular topic? That you see right now or kind of going into the future that you think is worthy of highlighting or that the audience should know?
46:21 Speaker 02 Yeah, well, the company I work for right now, Franz.
46:25 Speaker 01 Okay.
46:25 Speaker 02 It's actually a very old AI company founded in 1985. And Franz started out as a company selling Lisp compilers. But then, you know, by the end of the 1990s, very few people were paying money for software, you know, because there's so much free language software available. So they pivoted to graph database technology.
46:49 Speaker 01 Okay.
46:49 Speaker 02 And, you know, without getting into too much detail about what that is. Now that we have the LLMs, we are taking an approach called neuro-symbolic computation. So in the history of AI, I talked about supervised versus unsupervised learning. Another dichotomy in AI is between symbolic and neural approaches. So symbolic approaches are things like, you know, theorem proving programs or the early chatbots that we were talking about based on rules where basically you're manipulating symbols. Or you can also think of a chess playing program, you know, which is very mechanical and manipulating symbols and searching through the space of moves.
47:33 Speaker 02 And so the symbolic approach is in contrast to this neural learning approach. And now we're basically trying to find the best of both worlds. So one example of that is in the medical field, you can make predictions about how likely someone is to be, well, their mortality, how likely they're going to be readmitted to the hospital after being discharged, you know, within 30 days, how likely are they to be readmitted, or how likely they are to have a stroke, and the various other things. But the medical field has developed these symbolic techniques for making those predictions.
48:15 Speaker 02 And so in the case of stroke from AFib, there's a test called ChadVasq, and it basically takes into account criteria like, you know, your age and gender, whether you've had congestive heart failure, history of hypertension, and various other factors like that. And when you plug in those values, it produces a number which can then be used to, you know, estimate the likelihood of you having a stroke.
48:41 Speaker 01 Hmm.
48:42 Speaker 02 And now, you could also do that with a neural network, a recursive neural network, where you basically train it by feeding in the, you know, the patient data, the diagnostic data and their medical history, and then just look at whether they had a stroke or not. So you can train this neural network to take a new patient data and, you know, give some prediction about whether they're going to have a stroke. Then the third way of doing that is to use an LLM. You can just simply upload the entire patient chart to the LLM and say, how likely is this person to have a stroke? And so what we've been doing is sort of combining those three approaches together. You know, we've got the symbolic estimate, we've got the neural estimate, and we've got the LLM estimate. You know,
49:27 Speaker 02 you could potentially display all three of those, and then it's up to the clinician to make a judgment, or you could even put them all back into a different LLM and ask the LLM which one of these measurements is best, which one of these predictions is best.
49:42 Speaker 01 Wow.
49:43 Speaker 02 So it's an effort to combine the best of the symbolic approaches with these newer neural approaches.
49:49 Speaker 01 Wow. Say the name of the company one more time. I want to make sure I have the name of it in the show notes for people if they want to check it out.
49:56 Speaker 02 Franz.
49:57 Speaker 01 All right. Well, I'm just so thrilled to be able to talk to somebody who's been in this space for decades. It's miraculous to see what's happening. And I can only imagine where we're going to be in five years from now. But Dr. Richard Wallace, thank you so much for making time and coming on the show and imparting all of this knowledge that you have. We really appreciate it.
50:17 Speaker 02 Well, I'm glad people want to talk to me about it after a long time of people not being very interested.
50:23 Speaker 01 Well, there's a lot of people interested now. Let me tell you, sir. But thank you again for making time.
50:29 Speaker 02 My pleasure. It was great talking with you as well.
50:32 Speaker 00 Thanks for listening to TIP. Follow Infinite Tech on your favorite podcast app and visit theinvestorspodcast.com for show notes and educational resources. This podcast is for informational and entertainment purposes only and does not provide financial, investment, tax, or legal advice. The content is impersonal and does not consider your objectives, financial situation, or needs. Investing involves risk, including possible loss of principal, and past performance is not a guarantee of future results. Listeners should do their own research and consult a qualified professional before making any financial decisions. Nothing on this show is a recommendation or solicitation to buy or sell any security or other financial product. Hosts, guests, and the Investors Podcast Network may hold positions in securities discussed and may change those positions at any time without notice. References to any
51:16 Speaker 00 third-party products, services, or advertisers do not constitute endorsements, and the Investors Podcast Network is not responsible for any claims made by them. Copyright by the Investors Podcast Network. All rights reserved.
Previous TIP779: Richer, Wiser, Happier Q4 2025 w/ Stig Brodersen & William Green Next TIP780: Top Stocks for 2026 w/ Shawn O'Malley, Daniel Mahncke, & Clay Finck Page updated November 6, 2026 · transcript and summary are machine-generated