Seeing The Future from AI Companions to Personal Software

Eugenia Kuyda, CEO of Wabi and AI pioneer behind Replika, joins Erik, Anish, and Justine to reveal how personal software will transform from a developer monopoly to a creative medium for all. She exposes why command-line AI interfaces are the new MS-DOS, explains how mini-apps will become as shareable as TikToks, and details her decade-long journey from training language models in 2012 to building the platform where your mom can create custom apps in minutes. Plus: untold stories from OpenAI's apartment days and why voice-only devices completely miss the point. Timestamps: 00:00 - Introduction 00:54 - From AI Companions to Personal Software 02:55 - “It must be an interface problem” 03:43 - The Mac Moment for AI Interfaces 04:50 - When Apps Become Like YouTube Videos 05:54 - Ephemeral vs Durable Software 07:55 - Replacing Paid Apps with Wabi Creatiosn 10:04 - Who Will Create? Who Will Consume? 11:37 - Investing in “Software as Content” 14:17 - Mini-Apps as Community Catalysts 16:41 - The “Organization Layer” for Vibe Coding 19:07 - Wabi as a Framework for Memory, Context, and Expression 20:22 - Software 3.0: Deep Personalization through Shared Context 23:11 - Prompt Sharing as an Emergent User Behavior 28:11 - 100x’ing the World’s Meaningful Software 30:21 - The Creator Economy on Wabi 33:55 - How AI Evolved Since 2012 39:25 - Working From the OpenAI Office 42:01 - “You gotta be right, but also execute” 43:31 - Predicting Consumer Behavior 46:26 - Future AI Hardware: The Trap of Voice-First Resources: Follow Eugenia on X: https://x.com/ekuyda Follow Anish on X: https://x.com/illscience Find a16z on X: https://x.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  Right now, AI is just an app on your phone. It should not be that way. Sometimes you need to sort of go big or go home. Not having the balls to do that, especially in this current environment, you can suffer the consequences. There's a huge mind trap that exists among builders in the space, where they somehow think that voice is the main interface. That's because they are somehow thinking about the movie Her all the time, but not in the right way.

• 0:24Speaker 01

  So you were a true pioneer in this space before everyone else was doing it. Maybe just talk about your reflections of how that category has, as you helped create it and then how it's evolved.

• 0:34Speaker 00

  It definitely evolved. I've noticed.

• 0:39Speaker 00

  It's pretty crazy. We had a very strong belief that it would happen, but we still were so surprised when it actually happened, I guess. This was just, it just still felt like complete magic.

• 0:51Speaker 01

  Personal software is about to explode from 20 million developers to 8 billion creators. Today, you'll hear from Eugenia Koita on how Wabi is building the YouTube of apps, where anyone can create, remix, and share software as easily as posting a video. We discuss why current AI interfaces are holding us back, how many apps will become the new social currency, and what it really means when software becomes ephemeral, personal, and delightful. Let's get into it.

• 1:20Speaker 01

  So Jenna, excited to get into everything you're doing with Wabi, but first, let's contextualize this a little bit. When you look back at sort of the arc of your career, perhaps the last decade, what is the through line through Replica, Wabi, et cetera?

• 1:31Speaker 00

  Oh, wow, that's a hard question. But I guess maybe the main theme is we're always early, sometimes a little bit too early, sometimes, hopefully this time around, the right type of early. But generally, yeah, I've started working on AI in 2012, so over a decade ago, and was always fascinated by kind of the idea that you'll be able to talk to a machine, to have a meaningful conversation with a machine, but more importantly, with the fact that that could influence your life in a really good way. And before, that was really, the focus was on these AI companions, AI friends that could really be there for you and help you live a better life, help you feel better. And now, I guess it's just the same idea, but applied to personal software. Like, can we build mini apps or software

• 2:15Speaker 00

  that will really help us throughout the day in a very personal way and will be focused on you, on helping you live a better life?

• 2:24Erik Torenberg?

  Curious the journey of how you got excited about this new category and what you hope it becomes.

• 2:30Speaker 00

  I guess while running Replica, we always had these conversations with our users about what other products they use and how they use AI. And it always struck me as strange that they were using products like ChatGPT or Gemini Claude, but really, they were mostly using it for very simple use cases, like they were using ChatGPT just for search or to help them write something, help with homework or something else. And no one was really mentioning any of these exciting capabilities that we just kept seeing the models get. And so we felt like there must be an interface problem. When people look at a command line or a chatbot, they really just see search, writing tool, maybe I can talk to this.

• 3:14Speaker 00

  But if you think about that's the affordance of a command line, that really these are the main use cases. I think even recently, ChatGPT OpenAI published one of those studies showing that these are in fact the main use cases for ChatGPT. I think a third of all of the use was around writing, or writing help. And so that gave us an idea that there should be some next interface. There should be something else on top of this. There should be something more interactive, visual, simple for everyone, me included, to actually discover these amazing use cases that all these models already have. And so we started thinking, we got obsessed with this metaphor that the current chatbots are really the Microsoft DOS era for AI interfaces and that there will be some sort of a Windows/MacOS moment.

• 4:00Speaker 00

  And I think the confusing part for most people is that there is so much traction with chatbots anyway. Almost a billion people using these AI tools already, but they only use them for these kind of simpler use cases. And in order to unlock something else, you need a more exciting interface.

• 4:17Erik Torenberg?

  Paint more picture of what the world will look like when this Windows or MacOS moment happens. What will that look like?

• 4:22Speaker 00

  Well, I do think right now we exist in the paradigm of when I was growing up, we had TV and here you had maybe a few dozen TV channels. Back in Russia, we only had six TV channels. And so then, of course, now TV still exists, but now we watch YouTube and Reels and TikTok, a lot of UGC stuff. And so I think the same will happen with software. Right now, we're kind of stuck in this world where these few apps developed by professional developers. And then eventually, of course, we're going to move on to this new world where apps are built by all of us for all of us and maybe sometimes by AI for us. So if you think about it, the operating system of the future, you open it up and you see your regular popular apps you use all the time.

• 5:07Speaker 00

  Maybe it's X, maybe it's Instagram, whatever it is. And then you see maybe some cool apps that you discovered your best friends using, or maybe you built for yourself, or you tweaked one of the apps you found for yourself. And then you'll see AI suggesting some apps for you. Maybe you're going to New York next week and you're into art, so it made an art show finder app for you, which is going to help you find art shows around the Airbnb you're staying at. So it's a lot more flexible, malleable, and very deeply personalized. Think of it as an operating system built on the platform of you and not on some random fixed context.

• 5:45Speaker 03

  Can you talk about that? We've always had this idea that software has to be durable because it's really expensive to make and it seems really serious. What types of ephemeral software, like the New York Art Gallery app, do you imagine existing?

• 5:57Speaker 00

  Well, so right now, we're already seeing some of our first users building very specific apps that would never exist on the App Store. They're just too small, they're too personalized, too niche. They don't have 20,000 features. Someone built a motivational quote app that's only pulling from one particular show that I didn't even know anything about, but he's really obsessed with that show and so he just wants that at 5:30 AM when he wakes up. I feel like people are building very particular things to fit their needs. Like, for example, I was putting my kids to bed the other day and my daughter wants to play these puzzle games. When I tell her something, she's trying to guess what it is. And so we built a game very quickly where it's a puzzle and then she sees four pictures.

• 6:39Speaker 00

  She can click on one, but she also wanted them to be about Princess Elsa and Princess Jasmine. And so we had to incorporate that. And so now she was so happy because now she's doing these puzzles, learning something new. And then we changed it to Italian because she goes to an Italian preschool. And so this is another way to practice. And she's so excited. We couldn't put this thing away. And it took me two minutes to build it and then, you know, a few seconds to tweak it. Versus going on the App Store, I didn't even know if an app like that exists. And going through 15 minute onboarding, pain again, then it's not really what she wanted. There's no personalization there. So I think these are the use cases where something like that should happen. And I do think in the future, I should just be able to say, hey, I'm putting my kids to bed.

• 7:22Speaker 00

  Or it should know that context and just maybe suggest a few apps that are already pre-built for me that I could use right now.

• 7:29Speaker 04

  It's funny, I just got a new iPhone and on the new phone, I got to delete a bunch of my old apps. Cause I like to start fresh. And there were like probably over a dozen apps that I had downloaded. And in some cases paid for, that I just totally didn't need anymore because I had built better versions of it on Wobbie. Everything from like migraine tracking to like tracking restaurant recommendations to like a really hyper personalized notes app to special things around image transformation, a particular style. And I can imagine that will be true for a lot of people, which is like, instead of having to find this long tail app that's running all these crazy ads, pop-ups all the time and is hard to use and is not personalized to you. You can just make exactly what you want on the fly and tweak it, which is another really cool part of the product, I think.

• 8:14Speaker 00

  This is what, and I'm so glad to hear you're using it. But for me, that was kind of the product market fit with Wobbie for me was around that. Where I found, there were a few things I really needed, wanted an app for, to track my weightlifting. Very beginner level weightlifting workouts. I just figured out you gotta go up and wait. This, I didn't know, how would I know, a woman. Anyway, so I got real, I was tracking it in Apple Notes and I tried to find some apps on the App Store. And they're just, there's just so much in these apps that I didn't need. And so I just wanted a really simple. I'm also trying to follow one particular book. I wanted the workouts to be based on that book. So anyway, I built a simple app to track these workouts. And then now, anytime I go to the gym, I built it on the way to the gym.

• 8:59Speaker 00

  But now anytime I go to the gym, I find something else I want to add to it. First, it was just a tracker. Now it's generating new workouts based on all of my inputs, where I am, mad. The book I'm trying to follow, whatever the ladder technique of like progressive overload. And so I put it all in the prompt. And every time I go to the gym, I add a little bit to that. I want a little more of this and a little more of that. So now I'm not just using the app. I'm kind of constantly in the process of tweaking it and republishing it to Wabi kind of mini app store. Hopefully someone will find it useful.

• 9:30Speaker 03

  How many people do you think, or generally as you think your audience? Do you think it will be 90, 10 sort of consumption creation? Or do you think that most people? I think one of the things we saw with Sora, for example, is that many people, the majority of people are creating. Do you think that Wabi will be like that?

• 9:45Speaker 00

  I hope that more people will at least tweak. But I'd say like fully kind of original creators, probably still under 10%. And what we're working on right now, this week, we're releasing, we're pushing sort of a big update, the social graph. So you'll be able to see who is downloading what mini apps, how they're using them. You're going to be able to see comments or like mini apps. And so in this case, for example, if I created that workout app, someone in comments can ask me to tweak it. They can also remix it and change the app however they want. But maybe they just want this particular app to be slightly different. So they could put in comments and maybe as a creator, of course, I'm going to be reading all the comments and changing the app also for these people to be able to use it.

• 10:26Speaker 00

  So I think this is cool because it creates all of a sudden, it's not just about building apps for yourself. It's really about discovering apps and finding what your friends are using, using these apps together and so on, so on. And even asking creators to change them in some particular way.

• 10:43Speaker 03

  Amazing.

• 10:44Erik Torenberg?

  Anish and Justine, how do the categories or the topics that we've been discussing as it relates to personal software relate to themes that we've been exploring on the investing side in terms of what got us excited here?

• 10:53Speaker 03

  Yeah, I mean, like, I think that the YouTube metaphor is the right one that Eugenia outlined, which is that we would have said in 2007 that 100 cable channels is enough, or six in your case. And now, obviously, there's this entire ecosystem, everything from unboxing videos to all of the very YouTube-native content that exists. And I think people are sort of have more content or more fulfilled by it. And then there's also the act of creation. Some people create for a business, but many create and post just because it's fulfilling to themselves. And software has just been so restrictive because there's only 20 million developers in the world. So in a sense, all of the software that we consume is downstream of the preferences of those 20 million people. And it seems intuitive that if more people could make software, they would,

• 11:37Speaker 03

  and that there would be a mass-market consumer product here. I think unlike many of the other products, and you should comment on this, that we've seen, it feels like this is not text-to-app. You know, it's not a developer or developer-adjacent tool. It's truly a mass-market consumer product for non-technical people.

• 11:53Speaker 00

  I agree with you, and we really made this kind of choice early on that we're never going to show any code or anything, or say anything in the app that's even remotely technical. No API keys, no "bring this whatever," "connect this integration," or anything like that. We do have integrations. You can add your apps and services, but you can just say, you know, "use my Apple Health," or "use this," "use that," or "use my email." And we call them power apps. So that's sort of the more, probably the most technical you're going to get here. But we wanted, so yeah, we wanted to make it super simple for anyone to make apps and to make this process very delightful. And almost to feel like you're just creating something really quick. You're not even really building many apps.

• 12:38Speaker 00

  What we're adding right now is more, I think the company, the product we're looking at most is Canva, and the ease with which they're letting people create beautiful presentations. The similar, kind of similar thing needs to happen here. Right now, we're talking about vibe coding a lot, but I feel like we should be more about... By kind of taste or by designing these apps. So we're going to give a lot more of the just visual controls. More in the vein of like, choose a style, choose some colors. And you can go a little bit deeper, but really it's just one button and things look great. Versus, yeah, you need to go deep and just really try to understand what to do and get technical with your mini app.

• 13:22Speaker 00

  And I do think that unlocks a certain level of creativity where all you need to think about is like, what's the use case? One other interesting thing that one of our investors, Soleo, mentioned was that apps, mini apps, could become kind of community starters. So if today, the App Store is very much not social, and it probably won't ever be social because of Apple's mandate for privacy and how important that is for them, which is great. But at the same time, you probably do want to know who else is into, I don't know, toddler activities in Petri Hill. I want to know what other moms are going to Natalin preschool. I want to have their kids go to that preschool.

• 14:07Speaker 00

  And maybe, I don't know, my designer is really into bird watching in London, in his particular neighborhood. So creating that app and finding some other people who could be a little bit of a community building around that topic.

• 14:22Speaker 04

  Yeah, I think there's a bunch of really interesting choices you guys made in designing the product that it feels like really built on the explosion in like vibe coding or building with AI, whatever you want to call it, in a super interesting way. One of which is like, yeah, for many consumers, the existing tools are a lot more accessible than like coding something from scratch. But it's still pretty easy to like break them or get to something where you don't know what to do. Whereas I think Wabi, you've purposely put guardrails around the experience to make it hard to like super mess up, which is actually extremely helpful for consumers. And then it also feels like, you know, we needed to move beyond this paradigm of like, great, you vibe code a website and it exists out there.

• 15:06Speaker 04

  But like, is that the best interface for you to be using a product you want to use daily and storing personal information on and having your own records and like all of these sorts of things? Probably not. And for a lot of people, like their phone is where they spend most of their time online. It's kind of their primary interface and where they want to use things. And so obviously, I know there's like challenges designing for mobile and that sort of thing. But it it felt like a really smart choice for you guys to start there just to get so much more deeply ingrained in someone's daily life or daily workflow.

• 15:40Speaker 00

  You know, I've only pretty much built mobile apps.

• 15:43Speaker 04

  Yeah.

• 15:44Speaker 00

  In my life, I really liked the idea of mobile apps and a lot of things you're not going to be doing on, you know, really just putting in a website or whatever, some link.

• 15:53Speaker 04

  Exactly.

• 15:53Speaker 00

  And I do believe a lot in the concept of an organizational layer, like to a degree, the App Store is the organizational layer for the mobile. And the browser, the organizational layer for internet. And so something like that should exist for vibe coding, I guess, or for this new era of software for AI. But let's call it AI software. And I don't believe that people will be, I do believe that we're all going to be building some sort of software and using software that everyone builds, some UGC software. But I definitely don't believe in links that people will share with each other. And with me relying on some random person somewhere

• 16:36Speaker 00

  who's not a professional developer to support the database for the app where I might store some sensitive data or at least data that I don't want to disappear, even if it's not very sensitive. And we've already seen this with some apps, vibe-coded apps, reaching the top of the App Store thing. The one around women dating that all the super sensitive information got leaked. And that wasn't because they are bad actors, it's just they're not professional developers. So there needs to exist some some platform where everything will live. And to a degree, we're not watching videos somewhere, UGC videos somewhere. We're watching them on Instagram, on TikTok, on YouTube. It's not like people are passing around links. And so the current situation, I do think, is very similar to

• 17:20Speaker 00

  the very beginning of the internet where people were creating personal pages with GeoCities and some other tools like that, which I don't remember very very well because I was very little. But yeah, before LinkedIn, people were sending these links to each other. And of course, now there's LinkedIn, there are certain guardrails, you can't really do.

• 17:39Speaker 00

  Everything, the way you could do in Jewish cities, but at the same time, you have to get the social graph. You get the platform, you get all sorts of cool things there. Guess the same as Shopify for e-commerce. Yeah, you can build your own online store, but no one's really doing it anymore. Everyone's just using Shopify. And then they also get the all the platform benefits. And I feel like the same will happen with Wabi. Yes, you cannot download an app from Wabi and put it on the App Store, but you can use it inside Wabi and you can get the social graph and all the integrations and the potentially the shared context between all the apps and the memory behind, you know, for for that user and so on, so on, so on.

• 18:19Erik Torenberg?

  Our mutual friend Heaton said that Wabi is not just a collection of apps. It's a framework for memory, context and expression. Every time you create or share, you're teaching it who you are. Is that how you see it?

• 18:31Speaker 00

  I believe in it 100%. I think with every, I believe, I still remember, of course, and you guys obviously remember it too, but I do remember how the first iOS apps were just people trying to squeeze those websites into an app format or just kind of toy apps like iBeer. Or there was my favorite one, I Am Rich. That was $999.99 and it didn't, it didn't do anything. And then, of course, people figure out, well, you know, there's some, something special about this being a mobile, mobile app and maybe GPS and connectivity and things like Uber. And Tinder came out of the whole new categories of apps. And so they figured out what's so special about mobile.

• 19:13Speaker 00

  And I feel like for AI, the super special thing is personalization, but really deep personalization. So for me, kind of vibe coding an app, but that still is sort of like the same old software that's not really taking any of your context into consideration, where the data of that app is not exposed to AI that keeps learning. It's kind of just old school. I do believe a lot in Andre's idea of like software 3.0, some next level of software that's super deeply personalized. So if you think in the context of a Wabi mini app, how can you personalize it? First of all, you can personalize the features, the looks, you know, or skin the app in a certain way. But then on top of that, you can also change the prompt. So for example, for my workout app,

• 19:58Speaker 00

  I added to the prompt a couple of things. First of all, the book that I'm reading, that that method that I want to work out using that method. Also, the fact that I go to as a fitness and it has a certain, I added a photo of that gym. So kind of the model is not generating workouts in a completely different size of the gym. If it's a super side, it has to be next to each other. So this is the deep, deep, deep level of personalization that that is following. And of course, on the Wabi platform layer level, the mini app also knows that I'm a certain age, that I live in San Francisco, that I have kids. These are my fitness goals and so on, so on. And then eventually, when I when I build another mini app, maybe around nutrition, those apps should be able to talk and pass along that context. And today, of course, all of that exists in just the,

• 20:43Speaker 00

  you know, the walled gardens. You're fully locked in in one app, which to me feels absolutely crazy. And I can't connect. If I connected my email or my calendar, it can't be connected to both of these apps. I have to go through the process with every developer all the time. They have to build it. I have to connect it. That seems crazy, too.

• 21:05Speaker 03

  Do you imagine people building true social apps where the in-app experience involves a community?

• 21:13Speaker 00

  I'd love that. And we're building multiplayer right now as we speak. We spent the whole day trying to figure out like what. It's really complex just because all apps can be, can have very different type of multiplayer. And that needs to be explained to users as well in a very intuitive way. But yeah, totally believe in first of all, using apps together, at least with. Your friends, your family, but also potentially building these more kind of community apps where everyone can join. Maybe I can make my app multiplayer and open for everyone to join. A good example of that is made some image gen app around dogs where you can turn any of your dogs into like a royal, some user built it, like a royal portrait of different era.

• 21:56Speaker 00

  And so that would be cool for all the dog owners to just join that app and to be able to post to the universal feed. And so that's something we've been talking about today because this would be really cool. And so if you're just making these photos and then sharing somewhere, you're just adding them to the ongoing feed of dog photos. Sorry.

• 22:16Speaker 04

  Yeah, there's a, I mean, no, no, I think it's a great example. Well, yeah, I'm definitely.

• 22:20Speaker 00

  I mean, you're talking to the.

• 22:21Speaker 04

  On my dog. But I feel like there are so many examples too of image and video prompt sharing that happens in very unoptimized ways today. Like I've been following a lot. As you know very well, like teen girls and college aged girls are often early adopters of stuff and they have been making all of these like Nano Banana and Quen Image Edit prompts of like them like lying on a couch and the Ghostface Killers behind them for like Halloween and the, and they'll like post the image on TikTok or Wheels or wherever and it will blow up. And then they'll be like commenting like this long form prompt like in the comments on TikTok, which makes no sense as a way to do it. And then everyone's asking like, where do I go to do this? Like I have the Google app. Why isn't it letting me do this?

• 23:05Speaker 04

  And you have to explain like, no, you need the Gemini app. And it just feels like there's already this consumer demand and consumer behavior around like prompt sharing in particular for creative stuff that could be done. I've already made a bunch of lobby mini apps for this and it could be done so much better. And I think that the creative community would really thrive with this.

• 23:24Speaker 00

  Oh, that was the most, and I guess this is why we started the company.

• 23:30Speaker 00

  How is it possible that we have this godlike technology, yet we pass around these text prompts, which is almost like Microsoft does commands, but worse. Because at least the commands were, it was like, sort of like, you could learn them. There were a few, whatever, like, they were short. They weren't that long. And now these crazy unstructured paragraphs of text, sometimes you also need a reference image or something else. To me, that's a little bit crazy. And I think that is kind of one of the biggest problems with discovery with AI. It's hard to find these prompts. Even if you saw the output of, you know, you saw this cool photo with the ghost, whatever. But then how do I recreate that? I need to find the prompt. I need to know what app. I need, I need to know what model to choose.

• 24:14Speaker 00

  Oftentimes, it's not even very intuitive. And at that point, I've just lost all my motivation to do that. Instead of that, if you could just quickly, you know, click on the link in comments on TikTok and open a mini app where everything's already set up for you. Just add a photo. And you can see examples. You can choose different styles and this and that. And then you can see in comments what other people are doing. I think this is the way to go. And I think what's most interesting, it sort of combines the vibe coding apps, one of the biggest kind of trends of the last year at least, and also just using AI. Before that, it was all, you know, it's either the, are you in the text to prompt to app market? Or are you in some other market? And this kind of puts together like,

• 24:57Speaker 00

  this is really the one place to use amazing prompts. Or, and it kind of blends this difference.

• 25:05Speaker 03

  How much, you know, it's interesting. You mentioned, Justine, that it's a mass market consumer behavior, or maybe like a future one to be sharing prompts this way. How much do you think for the average person whose only AI experience has been with ChatGPT, that this is going to be a surprising new behavior that they have to sort of adjust to? Or something that feels very intuitive and obvious? And like, wow, I've been waiting for this.

• 25:26Speaker 00

  I hope it will be easy because in the end of the day, it's just a mini app. It's just the app graphic user interface. So it's something that we're all used to. You don't need to learn how to use these new tools. I'd argue it's harder to use a command line because you need to know, well, do I copy paste the text here? Do I add an image right here with this prompt? Or do I add it later? It becomes a little bit more. It's too loose. There are no guidelines, but everyone knows how to use apps. And to a degree, a lot of these kind of thin wrappers blew up at some point, like Prisma was one of them or Lensa, where it was just like, change your photo into some avatar, some hat shot apps.

• 26:09Speaker 03

  High school yearbook.

• 26:11Speaker 00

  High school yearbook.

• 26:12Speaker 03

  Quatch.

• 26:13Speaker 00

  But a lot of, you know, they're awesome. But again, like, there's a reason why apps like that gain traction and not, you know, people just passing along this prompt. Because again, it's too high. Whenever there's, the motivation is not too high. This amount of friction just kills all of my mojo. I wake up in the morning, I'm on Twitter or Reddit, I'm finding all these cool prompts. I'm like, I gotta try it. And then I'm like, oh, copy paste. It didn't really work. Whatever, I forgot about it. So that, I think, is something that, at least, we're super excited about. And it's not about just image and prompts, but also some cool text prompts. Like, people come up with all sorts of cool stuff. There are millions of people in the subreddits like ChatGPT prompt genius, which I love those.

• 26:58Speaker 00

  Sometimes you can find some crazy stuff in it. But you would never even know that this could be a cool way to use ChatGPT unless you found it there. Like, for example, someone made a fantastic prompt to analyze your blood work. But again, I don't even, at this point, remember where it was and how I'm gonna find it.

• 27:16Speaker 03

  Right.

• 27:18Speaker 00

  Versus I could just download a mini app from Wabi and kind of keep it in my health folder.

• 27:24Erik Torenberg?

  On the investment team, we've said that there's, you know, the world has 1% of the software that it needs and that the rest is gonna be built in the next five years. So let's give an example or say more about what that looks like if we're 100 X-ing the amount of, you know, meaningful or impactful software.

• 27:41Speaker 00

  Well, I don't know. I guess I'm always going back to how magical YouTube felt in the very beginning and all of these platforms where it was all.

• 27:53Speaker 00

  Really about just creativity and very raw, you know, sometimes weird things like putting a home tape, whatever, home video on online for TikTok. I still remember all my, you know, young, whatever, friends, younger kids, lip syncing to different music and how weird it was and felt like a toy. And then all of a sudden became really, really huge. And I think the same will happen with, or at least we hope that this similar trend will happen to Wabi, where in the beginning, maybe a lot of that will look like toys or something very simple, very kind of funny almost and innocent. And then eventually can grow into a much larger platform. But I guess if you think about it, like today,

• 28:38Speaker 00

  we just treat apps as software. But what if apps, we could treat them as content? If I'm a health influencer or fitness influencer on TikTok, maybe I should put out, here's my, here are my five mini apps on Wabi I built that are kind of showcasing my fitness protocol. Get them and maybe there's a way to commoditize it in some way. Maybe it's a way for, for that fitness creator to create more content that's now useful. Right now, people sell courses and stuff instead of that. I think a mini app could be much better. And then people can be talking about that in the community, in the comment section. Again, this is a start of some community. People are working out together. People are doing something together. I do think we'll see just a completely different type of software,

• 29:23Speaker 00

  not just apps, not just stale, fixed apps, but more content, community builders, community starters, conversation starters and, and just fun little toys.

• 29:34Speaker 03

  Do you imagine like a creator class, a kind of professional class on Wabi?

• 29:39Speaker 00

  Oh, a hundred, you know, yes, of course. I do believe that ideally this should happen. If we're really thinking about it as YouTube, that's sort of the last frontier. At this point, creators can make their own professional content. They can make videos, they can make shows, they can write, but they still cannot create software. It's still really not happening. But any, anyone, and especially small niche creators, should be able to afford to create for free any software for their fans. And that's what I'm really, really looking forward to.

• 30:13Erik Torenberg?

  I've been struck that by the idea that Mr. Beast, the biggest creator in the world, has such a close connection with his fans. They'd do anything for him and the thing that he makes is chocolate. Like, that's the thing, the thing that he chooses to do. That seems like the best monetization. And it just feels like this is yet another sort of, you know, type of offering that creators can provide to be, you know, have a closer relationship with their fans.

• 30:35Speaker 00

  Exactly. And if you think about it, just even the style, like, I would love, like, certain designers, I want their apps that they build, because I'm sure they're going to build very beautiful apps. And I want to look at them, and even if it's the same functionality, the same whatever, Pomodoro Timer, but I want their take on it and so on. I think there's so many different groups and niches that, and it shouldn't all just be about monetizing. It's really just about different styles, different outlook on life, on the world. And that is, to me, is very, very interesting. I'm a huge user of Reddit. And I find it very exciting because people just join around certain interests.

• 31:18Speaker 00

  And that doesn't happen, well, it doesn't happen on other platforms really that much. So that's something that I'm excited about here as well.

• 31:25Speaker 04

  Yeah, I think from the creator perspective, one of the weird things about, and we're all kind of content creators in various ways and put out content. And one of the weird things about that, I think, is you often, you don't really know, like, you see how many impressions it gets, but you don't know if those are bots. You don't know how many people are actually, like, using the prompt you posted or watching the full video or whatever. And I think that is going to be, like, even beyond monetization, that part of lobby, where, like, you can see what someone else has done or created or accomplished or whatever with the prompt you wrote or the app you made or the thing that you developed, will be incredibly cool, not only for existing creators, for who it's really obvious they want to do this, but also for people who are not creators today, but who have really interesting ideas

• 32:08Speaker 04

  and just, like, no way to build their own mobile app, get it approved in the App Store, ship it, like, distribute it, that, that whole type of thing.

• 32:16Speaker 00

  Yeah, like what other new class of creators could be? Yeah. That's why in our style, like in some of our communications, we're also trying to, I guess we're a little bit nostalgic about that early, those early days of the internet and just being weird and staying weird. Right now, a lot of the video platforms are very polished and very commercial. You don't even see your friends anymore. You don't see that much weird content. You just see very curated, polished stuff. But with many apps, with software, I guess we're just entering this new era of just tons of really weird and fascinating new mini apps that wouldn't even, could never exist because there wouldn't be enough of a business on the App Store.

• 32:59Speaker 03

  Right, right. Well, speaking of the early days, should we talk a bit about Replica and your history in the community?

• 33:05Erik Torenberg?

  Yeah, maybe we'll just, so you were a true pioneer in this space before everyone else was doing it. You know, you mentioned 2012. Maybe just talk about your reflections of how that category has, as you helped create it and then how it's evolved.

• 33:22Speaker 00

  It definitely evolved. I've noticed. It's pretty crazy. Well, it's wild because we were thinking about recently, just talking to one of the early employees of Replica, that we had a very strong belief that it would happen, but we still were so surprised when it actually happened, I guess. This was just, it just still felt like complete magic. For me, I got into it because I, my friend worked at Google DeepMind in 2012. And so he came to me to tell me about Word2Vec and kind of the first technology to translate words into vectors and to be able to actually do something with words.

• 34:02Speaker 00

  Before that, language was just this whole separate, almost like thing that computers could not interact with. But now all of a sudden, they could. And to me, I grew up reading Wittgenstein. So for me, it was like, well, the limits of the language are the limits of my world. So I felt like, oh, well, that's insane. If the computers learn language, then they'll learn about the world. That will be, they'll be truly smart. That is the future of artificial intelligence. And so. That's also ImageNet just came out. So we saw these new models around image recognition. And we felt like, well, we got to start a company focused on language models, focused on dialogue generation.

• 34:42Speaker 00

  But of course, there were no papers around it at all and not no known algorithms or anything built models. Really, back then, there was nothing. So we just focused on building some technology to build chatbots using whatever the trying to build some language models around that. And then, of course, 2015, the first paper came out of Google by Coquelin that actually showed off the first deep learning model applied to dialogue generation. And they didn't publish any models back then. So it was all about just kind of reading the paper and seeing some of the obviously cherry picked results and trying to replicate that. And when we saw that in August 2015, we just basically put all of our

• 35:26Speaker 00

  but everything we had at the company on building those models. We said, okay, well, this is it. This is right on the corner. We need to really focus on building these language models, getting the first generative AI product out chatbot out there, which we did with Replica, but it wasn't around the corner. It was like seven years away. And then we just had to survive for long enough to actually get to the first transformer models. And then, of course, I think the next magical moment was the Mina paper also out of Google with the first transformer model. And then I remember in 2020, we got invited by OpenAI to go see GPT-3 before, you know, API

• 36:09Speaker 00

  to to partner up with them to be one of the first partners for GPT-3 API to launch. So we came to the office and Mira, who back then was actually leading partnerships. And Sam showed us GPT-3, and I remember that was just.

• 36:26Speaker 00

  I was floored. It was insane. Just before that, if you think about it, we had to train every model. We had to create the specific data set. If you wanted to train a dialogue model, you'd have to have tons of chat data and you would train the model and the model could only do dialogue. But with GPT-3, it was the first kind of zero-shot, few-shot model where it could do anything. It didn't just have to respond in a dialogue format. You can tell it, well, write a tweet like Sam Altman or write the tweet this or translate and it would do that. And so that felt absolutely magical and we were the first, one of the first partners of OpenAI GPT-3 API. It was still crazy because we still have a Slack channel where Greg Brockman is training model for us, which now feels just such a Amazing. Weird reversal.

• 37:11Speaker 00

  You still have the model?

• 37:14Speaker 00

  It was, I think it was a fine-tuned DaVinci for replica, but we were the biggest customer in terms of API calls because we were the only chatbot available on the market that actually used generative AI. And now it's weird to think about it, but back then, all the big companies were scared to put out generative AI products because there were Microsoft Ty happened and it turned into some Nazi chatbot and literally an hour. And so everyone else was too scared to put them out there. So we were sort of the only ones for so, so long until OpenAI had, you know, put out their chat GPT and kind of changed history with that, of course. But it was crazy because for before that, we literally

• 37:58Speaker 00

  owned all the keywords like AI, chatbot, artificial intelligence on every single platform. And then we also owned like hundreds of .ai domains, which I just let expire because I felt like, no one wants them. They're not even on any of the domain platforms. And then recently I went to see what .ai domains are still available that are just regular words. And the only words that are available are like vomit.ai and Iraq.

• 38:28Speaker 00

  Oh my God, this is upsetting. Naming Wabi because of that was pretty hard. So that's kind of the evolution.

• 38:37Speaker 03

  You told us a story at dinner about the time that you'd spent in the OpenAI office. Maybe talk a little bit about that when you guys were working out of there, what it was like, what the energy was like, what were the expectations of the team?

• 38:50Speaker 00

  I think that, yeah, so when when OpenAI started was kind of out of YC. It was YC research. So they were doing a few, I guess you remember, they were doing a few different research groups, one on UBI, one on AI, some other ones. And so because we were a YC company and they let us come, they were very generous with their time and they would let us come to back then Greg's apartment where they were headquartered, I would say. And they would let us come with a couple of other companies that were doing AI at YC to ask questions, learn from them and just talk, maybe exchange experience on what we're building. So we would come to that apartment and ask all the questions.

• 39:33Speaker 00

  Usually it was Ilya and Andre and some other people. And that was absolutely incredible. We were, of course, absolutely starstruck and super happy to be there, just so grateful for the opportunity. And then they moved to the to their office and we would go there as well. And very quickly, they stopped working on language models. And we were very upset because we really wanted to continue going there, but they didn't want to talk about any language models because no one was really working on them. And that made us feel very strange because we were so set on continuing and believing in language models, but they completely moved away to shifted to playing video games and

• 40:15Speaker 00

  all of these kind of agents, kind of rebuilding the worlds and agents in those worlds, reinforcement learning for that and all and all these other interesting things. And I guess the only person for if in the beginning, it was kind of Elek for continued to work on language models. So we had an opportunity to ask him some questions. But yeah, of course, that was, it's just wild to think to think that because when we were going to OpenAI, of course, they were superstars even back then, but still it felt like such a small kind of research group that is trying to do something interesting. Of course, now to see it become one of the biggest companies in the world is. Absolutely wild.

• 40:57Speaker 03

  Well, it's interesting because Andre said on the recent pod that the entire video games direction was an incorrect direction. It was incorrect research direction and they probably should have stuck with language. So you guys were right.

• 41:09Speaker 00

  It's a, well, being right is not always. You gotta be right, but also execute. I think to a degree, we were really invested with Replica in building language models. But at some point, we just required a lot more capital to do that. And after being, after working on that for so long, at that point, we just got really into just revenue maximization at some point because we a little bit got maybe scared. We're like, well, we didn't have the balls to say, okay, well, we need 20 million and we'll build that model. Even although that was our discussion internally, right after Amina paper and so on. We just need to get a lot more money. If you think about it with Replica, we only raised $11 million.

• 41:53Speaker 00

  And I guess it's still all in the bank and, you know, we went for many, many years and built a big business. But of course, this is in hindsight, a very interesting lesson. That sometimes being very nimble and very kind of scrappy and very profit oriented is great. But you can miss out on almost like a generational chance. And I'm not saying we, you know, even if we bet on it, maybe we would have not built it. I would never compare myself to the geniuses that actually did it. We probably were not the right people anyway. But still, the lesson, I think, still stands. Sometimes you need to sort of go big or go home. And not having the balls to do that, especially in this current environment.

• 42:37Speaker 00

  I think you can suffer the consequences.

• 42:43Speaker 04

  One of the things we say on the consumer team is consumer behavior, especially new behavior, cannot be predicted, it can only be observed. I think you are actually one of the few people that is not true for, because you seem to be able to predict consumer behavior. Like you've been so early to a number of these things. And I think just every time we talk to you, you seem to have an eye on not only like what's going on today, but like what the next thing should be. Is that like, how did you develop that sense? I guess I'm sure a lot of people would be curious to know.

• 43:14Speaker 00

  I don't know if I have that sense. I only have like a couple of ideas, but I really believe in them deeply. And then I go really deep down the rabbit hole. I start thinking about it. And but I do think that I do have a lot of. I do have a background in journalism and pretty much the whole. I grew up dreaming of being a journalist. My first job was 12 years old, working a newspaper. I was investigative journalist reporter for a while. And the one thing I loved about is being able to go and talk to people and to really, really try to get to know them and live their lives. And so for that, you sort of have to have a lot of empathy and just trying to real and curiosity about people. And I think today, what I'm seeing with AI especially,

• 43:56Speaker 00

  it's being built by a very specific type of person, personality. It's oftentimes these savants, this like brilliant geniuses, physicists, mathematicians, and they're insane in building algorithms and math and kind of scientific breakthroughs. But they usually lack on the human empathy side. That's just kind of how it is. Meanwhile, I'm the opposite. I'm a dumb dumb when it comes to science. Coming from a family of physicists, they were always like, oh, my God, like, why can't you be smart and also go study physics? But I couldn't. But at the same time, I'm just really interested in human condition, what people are doing.

• 44:38Speaker 00

  And just seeing my mom trying to understand how to copy paste a prompt from Reddit, it was such a foreign idea for her to her. And I realized like my mom is very savvy with computers. She's always on her phone. She's always on her laptop. But somehow she can't crack that. This is just too, this is just not user friendly enough. And kind of understanding those concepts and I think was really what let us see kind of come up with the idea for Wabi. And the same goes for Replica, just traveling around. And talking to people and seeing how much loneliness there is and how much people just wanna be able to tell someone what they're going through and how few people are able to listen.

• 45:20Speaker 00

  And I think that realization that maybe an AI is not, can't talk well today, but it could listen, that that could be a groundbreaking thing for millions in the world. So I think this is kind of what, just allows me to have a slightly different angle at the same problem.

• 45:38Erik Torenberg?

  If you wanted to speculate on the future of like hardware, like what is sort of that?

• 45:43Speaker 00

  Hardware.

• 45:44Erik Torenberg?

  Or just like, you know, five, 10 years, what is gonna be the interaction? Like, how are we going to be interacting with these applications?

• 45:53Speaker 00

  I do have a few ideas around hardware, and I'm not a hardware person at all, but I'm a hardware user like all of us. So I get to have opinions, I think. I think where there's a huge mind trap that exists among builders in the space where they somehow think that voice is the main interface. It's like the best ultimate interface. And I think that's because they are somehow thinking about the movie Her all the time, but not in the right way and kind of missing the whole point of the movie Her. That, yes, voice was amazing in that movie because it was Samantha Johansson constantly heavy breathing in his ear. And that totally worked. You didn't even need to say anyone.

• 46:37Speaker 00

  In my case, that's why that worked. But if you really think about voice interfaces, they're just so imperfect. You can't use that device if you're laying in bed with someone who's sleeping. You can't use it in a crowded space. You can't use it at the office. You can't use it, even walking around, it's a little bit weird. And so all of a sudden, you're bedding everything. There's a lot of people trying to build voice-only devices. In my case, completely wrong. Like, it can be a fantastic extra way to interact with the computer, but every single Alexa right now is like 75% of them are being shipped with a screen. Because even if I'm setting a timer when I'm cooking,

• 47:18Speaker 00

  the proverbial voice use case, even then, sorry, I need to see the timer. I'm not going to be asking, hey, how much, how long has this left every, every second? This is just strange. And so I think this is kind of the biggest mistake in my case, in my view, is trying to ship these screenless devices. I love screens. I think there's no way with voice to solve for discovery, for proactivity. I would hate if, you know, the worst thing with voice and the iPhone is just reading out push notifications, text messages that are coming. I'm like, oh, my God, please shut up. It's horrible. It's very hard to listen to turn it off.

• 47:57Erik Torenberg?

  I know, it's terrible.

• 47:59Speaker 00

  If this was just being, you want proactivity, but you don't want it to be read out loud in your ear because this is just this very slow way of getting information in your brain. So anyways, I think this is kind of the biggest mistake. I would not ever make a screenless device. In fact, I would make it very much a screen-first device. But I do believe that the AI device is not about a voice-driven thing. It's more about building this AI-first operating system, having all the models run locally as well. I think that there's a lot in that, like building truly an AI-first smartphone. And, you know, not today, kind of more CPU-driven, whatever hardware,

• 48:43Speaker 00

  but more the hardware of the future where there are models that can run locally with the operating system is super different from what it is today with no fixed apps, with being able to change and create software on the go for you with the, with the level of personalization that goes a lot deeper than what it is today. Yeah, I think that there is definitely space for a device like that. Right now, you know, AI is just an app on your phone. It should not be that way, I guess.

• 49:15Erik Torenberg?

  And it's a great note to end on. Yijin, thanks so much for coming on the podcast.

• 49:20Speaker 01

  Thanks for listening to this episode of the A16Z Podcast. If you liked this episode, be sure to like, comment, subscribe, leave us a rating or review, and share it with your friends and family. For more episodes, go to YouTube, Apple Podcasts, and Spotify. Follow us on X at A16Z and subscribe to our Substack at A16Z.substack.com. Thanks again for listening, and I'll see you in the next episode. As a reminder, the content here is for informational purposes only, should not be taken as legal, business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any A16Z fund. Please note that A16Z and its affiliates may also maintain investments in the companies discussed in this podcast.

• 50:04Speaker 01

  For more details, including a link to our investments, please see A16Z.com/disclosures.