Mastering paid growth | Jonathan Becker (Thrive Digital)

Jonathan Becker is the founder and president of Thrive Digital, where he and his team have deployed more than $3.5 billion in paid acquisition budgets for companies like Uber, Asana, Square, Tempur-Pedic, and MasterClass. He spent the first part of his career mastering SEO and is a world expert in DTC, lead generation, demand generation, and user acquisition. In today’s episode, we discuss: • Signs that your company is a good fit for paid growth • Strategies for optimizing ad creatives • The merits of different marketing channels: paid vs. organic search, TikTok and short-form • Insights on attribution and how to approach it effectively • How market conditions and AI impact paid growth • The crazy story of how Jonathan won Uber as a client — Brought to you by Braintrust—For when you needed talent, yesterday | AssemblyAI—Production-ready AI models to transcribe and understand speech | Miro—A collaborative visual platform where your best work comes to life Find the full transcript at: https://www.lennysnewsletter.com/p/mastering-paid-growth-jonathan-becker Where to find Jonathan Becker: • Twitter: https://twitter.com/jzbecker • LinkedIn: https://www.linkedin.com/in/jonathanbecker123/ • Website: https://thrivedigital.com/ Where to find Lenny: • Newsletter: https://www.lennysnewsletter.com • Twitter: https://twitter.com/lennysan • LinkedIn: https://www.linkedin.com/in/lennyrachitsky/ In this episode, we cover: (00:00) Jonathan’s background (07:25) The crazy story of how Jonathan won Uber as a client (11:56) Interchangeable terms for “paid growth” (12:31) Why you shouldn’t put all your eggs in one basket (16:48) What kind of companies should pursue paid growth (23:07) Is it possible to reach scale exclusively through paid growth? (27:07) The evolution of performance marketing (29:39) Advice for founders choosing between SEO and paid (32:18) Strategies for optimizing ad creatives (44:43) Paid vs. organic search, TikTok and short-form (49:56) Where to spend money in order to drive growth for B2B SaaS (55:06) Attribution in performance marketing (1:04:18) The impact of AI on paid growth (1:12:52) Advice for early-stage startups on hiring in-house vs. hiring an agency (1:17:09) Qualifications to look for in your hires (1:23:23) How Jonathan won Snapchat as a client (1:28:55) Lightning round Referenced: • Andrew Wilkinson: https://www.linkedin.com/in/awilkinson/ • Garrett Camp: https://www.forbes.com/profile/garrett-camp/ • TikTok: https://www.tiktok.com/ • Grammarly: https://app.grammarly.com/ • Athletic Greens: https://athleticgreens.com/en • Supermetrics: https://supermetrics.com/ • Recast: https://getrecast.com/ • Midjourney: https://www.midjourney.com/ • DALL-E: https://openai.com/product/dall-e-2 • Storyworthy: https://www.amazon.com/Storyworthy-Engage-Persuade-through-Storytelling/dp/1608685489 • Shoe Dog: A Memoir by the Creator of Nike: https://www.amazon.com/Shoe-Dog-Memoir-Creator-Nike-ebook/dp/B0176M1A44 • American Kingpin: https://www.amazon.com/American-Kingpin-Criminal-Mastermind-Behind/dp/1591848148 • The Big Short: https://www.imdb.com/title/tt1596363/ • White Lotus on HBO: https://www.hbo.com/the-white-lotus Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email [email protected]. Lenny may be an investor in the companies discussed.

Speaker names marked ? are inferred from speaking time and the show’s known hosts — they are not voice-verified.

• 0:00Speaker 00

  There's a lot of different ways that we are beginning to use AI to do more with less, basically. The effect ultimately that we've seen from a human capital point of view is displacement. We have more people now than we've ever had, but the nature of the work that they do is more strategic. It's more about modeling, validation, asking the right questions, being focused around creative levers, and less so the trench work of implementation and bid modifiers at the keyword level on Google Search and some of the really hardcore manual analysis we had to do. On our creative group, we can come up with mockups in literally like 1% of the time that it took.

• 0:41Speaker 00

  And so you still have to understand what questions to ask of the AI and be capable of iterating. But these rough drafts that you might show, like the artwork of, you know, to a client to say like, "Do we like this more? Do we like this more?" That's AI-generated. It's really interesting.

• 1:01Lenny Rachitsky?

  Welcome to Lenny's Podcast, where I interview world-class product leaders and growth experts to learn from their hard-won experiences building and growing today's most successful products. Today, my guest is Jonathan Becker. Jonathan is a legend and an OG in the world of performance marketing. On this podcast, we've done deep dives into the many aspects of growth, including SEO, sales, conversion optimization, retention, product-led growth, product-led sales. But this is the first episode where we get super deep on paid growth. For the past decade plus, Jonathan and his team have planned, built, and executed more than $3.5 billion in paid acquisition budgets for companies like Uber, Asana, Square, Masterclass, Tempur-Pedic, and many more.

• 1:43Lenny Rachitsky?

  And they've built their agency, Thrive Digital, into one of the preeminent independent digital marketing agencies. In our conversation, we get real deep into all things paid growth, including what's changed with recent privacy shifts, why focusing on creatives is the new biggest opportunity within paid growth, how to think about attribution and what's changed there, what to look for in people you hire to run paid growth for you, how AI is already changing how paid growth teams operate, and so much more. Enjoy this episode with Jonathan Becker after a short word from our sponsors.

• 2:16Lenny Rachitsky?

  This episode is brought to you by Braintrust, where the world's most innovative companies go to find talent fast so that they innovate faster. Let's be honest, it's a lot of work to build a company. And if you want to stay ahead of the game, you need to be able to hire the right talent quickly and confidently. Braintrust is the first decentralized talent network where you can find, hire, and manage high-quality contractors in engineering, design, and product for a fraction of the cost of agencies. Braintrust charges a flat rate of only 10%, unlike agency fees of up to 70%, so you can make your budget go four times further. Plus, they're the only network that takes 0% of what the talent makes, so they're able to attract and retain the world's best tech talent. Take it from DoorDash, Airbnb, Plaid,

• 3:01Lenny Rachitsky?

  and hundreds of other high-growth startups that have shaved their hiring process from months to weeks at less than a quarter of the cost by hiring through Braintrust's network of 20,000 high-quality, vetted candidates ready to work. Whether you're looking to fill in gaps, upskill your staff, or build a team for that dream project that finally got funded, contact Braintrust and you'll get matched with three candidates in just 48 hours. Visit usebraintrust.com/Lenny or find them in my show notes for today's episode. That's usebraintrust.com/Lenny for when you need talent yesterday. Today's episode is brought to you by Assembly AI. If you're looking to build AI-powered features in your audio and video products, then you need to know about Assembly AI,

• 3:44Lenny Rachitsky?

  which makes it easy to transcribe and understand speech at scale. What I love about Assembly AI is you can use their simple API to access the latest AI breakthroughs from top-tier research labs. Product teams that startups and enterprises are using Assembly AI to automatically transcribe and summarize phone calls and virtual meetings, detect topics in podcasts, pinpoint when sensitive content is spoken, and lots more. All of Assembly AI's models which are accessed through their API are production-ready. So many PMs I know are considering or already building with AI, and Assembly AI is the fastest way to build with AI for audio use cases. Now's the time to check out Assembly AI, which makes it easy to bring the highest-accuracy transcription plus valuable insights to your customers,

• 4:28Lenny Rachitsky?

  just like Spotify, Call Rail, and Writer do for theirs. Visit assemblyai.com/Lenny to try their API for free and start testing their models with their no-code playground. That's assemblyai.com/Lenny.

• 4:46Lenny Rachitsky?

  Jonathan, welcome to the podcast.

• 4:48Speaker 00

  Thank you. It's a pleasure to be here.

• 4:50Lenny Rachitsky?

  It's my pleasure. So what we're going to be doing with this episode is we're going to be digging real deep into all things paid growth, which we've never done on this podcast yet. And normally I actually skip this part, but I thought it'd be actually helpful for you to spend a little bit of time to give us a little bit of background on your experience in the space of performance marketing, AKA paid growth, AKA paid ads. You tell us what the right term is for this genre. But yeah, just tell us what you've been up to in this, in this area over the past decade and a half, I think.

• 5:19Speaker 00

  Sure. No, that's a great way to kick things off. And again, thank you for, for having me here. If I think about it, my experience goes back about 15 years into this space. I started off as a web developer. And as I built and structured websites for people, I became pretty obsessed and fascinated with the fact that you could build landing pages or homepages or whatever it was, basically the content on a website and structure it in a manner where you had the chance to surface in organic. So SEO, you know, results more prominently. And as I became kind of a practitioner of SEO, SEO really being my first love, you know, of marketing, I started, you

• 6:00Speaker 00

  know, attracting attention and people wanted to hire me on as a freelancer. And what I noticed is that as people started asking me questions like, you know, what was the ROI of our SEO campaign? Or, you know, how do I scale this or whatnot? The answers to their questions ended up being a lot more aligned with what then was the biggest driver in the paid acquisition world, which was paid search. And so I started experimenting with paid search. And what I found was that it was a tangible format and lever through which we could basically give people the types of results they were expecting from SEO, but that were obfuscated in terms of,

• 6:42Speaker 00

  you know, Google's analysis algorithm from an organic point of view, being somewhat intangible. And Google slowly kind of removing a lot of the data early on that allowed you to kind of guess and test more easily. So 10 plus years later, you know, what started off as this freelancer consultancy that I, you know, started running in a walk-in closet in my old apartment became 130 people and we manage about $500 million a year in ad spend for.

• 7:11Speaker 00

  Small and large companies, including Uber, Asana, Tempur-Pedic. We've worked with Lululemon, very exciting companies, mostly from the United States, even though we randomly happen to be based in Vancouver, Canada.

• 7:26Lenny Rachitsky?

  There's a number of threads I'm going to pull on there over the course of our chat, but you mentioned Uber and you told me that you had a crazy story about how you actually landed Uber as a customer. Could you share that?

• 7:35Speaker 00

  I had been running Thrive for a couple of years and it was a very excellent regional agency in Canada with really cool local clients. In 2013, I got invited to go down to the TED Conference, which was in Long Beach, California. And my friend, Andrew Wilkinson, asked me to join him at a dinner that night. I didn't know anybody from the TED community at the time. So we have dinner and then afterwards, as it goes, you know, at conferences, there's an after-party. And so essentially, I hop into a taxi. Everybody else kind of sped off in their cars or, you know, however which way they were getting there. And as we're talking to the driver saying, "Hey, we're going to, you know, this place, you know, can you take us?" There's a knock on the window and the person outside says, "Hey,

• 8:20Speaker 00

  I think I'm heading to the same destination. Do you mind if I hop in this car with you?" And so we're like, "Of course." And I turned to him and I'm kind of like, "I'm Jonathan. You know, I run a 10-person agency out of Vancouver." And he says, "Hey, I'm Garrett Camp. I started a company called Uber." And so ironically, I meet the founder of Uber, the company that is in the process of disrupting the entire taxi industry worldwide in the back of a taxi cab. And what happened next basically changed my career forever. We end up at this party. At the time, I was kind of spamming Uber's referral program. So kind of a long story, but essentially I was using paid search to camp out on their branded keywords.

• 9:05Speaker 00

  And as people would sign up with my confusingly similar snippet to Uber's organic snippet, I was essentially siphoning off, you know, referral credits. So I would get $20 every single time someone signed up. And I ended up making like tens of thousands of dollars doing this. And so, fast forward, you know, I'm getting a drink at the bar next to Garrett and in my head, I'm kind of like... Should I tell him about this? Maybe I can land them as a client. This would be really interesting. And essentially I tell him, I'm like, hey, I'm doing this. I'm adding zero value, but this is a loophole in your marketing system and, and you know, someone should close it. He essentially is like, I need to report this to the board, but you know, here's my card. Write me what you're doing and we'll contact you.

• 9:48Speaker 00

  And so I get contacted by a bunch of his lieutenants. If you've read the book, Super Pumped, like all the people that we dealt with at the time, you know, are in the book and

• 9:57Lenny Rachitsky?

  I watched, I watched the show.

• 9:59Speaker 00

  Yeah, exactly. And they were kind of like, hey, this is bad. You have to stop doing this, but can we hire you to solve the problem? And so what started off as me, you know, running projects for like local bars, you know, in Vancouver or clothing stores or whatever it was, turned into me landing early stage Uber as a client and really graduating us from like competent, you know, professionals to like leaders in our sector. And so it was a fascinating, you know, project and we worked with Uber for 10 years.

• 10:31Lenny Rachitsky?

  That is an incredible story. I love the arbitrage game you're running there to basically siphoning DC money out of Uber. And I guess the lesson there a little bit is just like, sometimes, you know, like it's like this interesting combination of hustle in terms of trying to just like make some money and also taking advantage of this opportunity you kind of were plopped into.

• 10:53Speaker 00

  Yeah, I think, you know, people often talk about entrepreneurs who have been successful and they, they comment that they're lucky, whereas I actually look at that situation and I think that you have to make your own luck. So I could have been like, oh, cool. I met this guy in the back of a taxi and that was it. But I decided to take a risk, you know, being that I could get embarrassed or nothing could happen, or they could shut down like this referral, you know, gimmicky thing that I was doing. I had like, you know, very little to lose, I guess ultimately, but a lot of people just don't make these moves in life because they're nervous or they're worried too much about what the downside might be. And so I very much was like, I'm going to shoot my shot here. And you put yourself in situations where everybody has luck, but you have to cap capitalize on it, basically.

• 11:37Speaker 00

  And so that was an example of, you know, being willing to take a risk and it paying off like pretty big time, I think.

• 11:45Lenny Rachitsky?

  Also, being a Ted, that seems like a good move. Networking paying off. Love that he was in a taxi. That's hilarious. I was going to ask you about that and literally he was doing some research, I mentioned.

• 11:55Speaker 00

  Yeah.

• 11:57Lenny Rachitsky?

  So let's start diving into the world of paid growth. And if you think about just like paid growth, and again, actually, what do you refer to this area as? Paid growth, performance marketing, paid ads?

• 12:07Speaker 00

  There's a lot of interchangeable terms. Performance marketing is a common term. Paid acquisition is a common term. Some people think of those two things as growth marketing, whereas I see growth marketing as a bigger practice area within which paid acquisition sits. And then, of course, there's subsets. There's social ads, there's paid search, there's programmatic. And so there's a lot of different ways of saying the same thing.

• 12:31Lenny Rachitsky?

  I'm going to use performance marketing. I kind of like that term because it really describes what it is. It's like marketing with, you can measure performance. So let's see how that goes. So as a channel, it's such an interesting mix of, on the one hand, it's this incredible growth lever that allows basically any company to spend money and, and understand the ROI in acquiring users. This thing that like never existed before. Essentially, Facebook and Google created these platforms. On the other hand, there's this like sense that it's this like drug that you start and then you get hooked on and you can never leave. And there's a lot of advice of just like avoid paid growth. That's just like not a good, healthy way of growing, especially as a startup. And so my question to you is just, how do you think about that element of it?

• 13:16Lenny Rachitsky?

  And then even more specifically, what kind of products do you find paid growth as a channel is right for and not right for?

• 13:24Speaker 00

  Yeah, it's a really great question. And so I think there's a couple of different things that need to be unpacked here. So paid acquisition or performance marketing.

• 13:33Lenny Rachitsky?

  Performance marketing.

• 13:33Speaker 00

  As we call it. Can be seen as a drug, I suppose, when you are entirely reliant on it to fuel the revenue of your business. And so the analogy that I try and use here is that it would be very dangerous if I was advising you with your life savings and I told you to put it all in a single stock in the stock market. Stocks can be volatile. Instead, and as a result of that, you know, your net worth would fluctuate quite a bit in the short term and the long term based on a lot of things that you don't control, like the external markets or like things that are happening within the performance of that, you know, particular company that you invested in. When I think about.

• 14:16Speaker 00

  All of the marketing mix, so email, direct mail, linear television, performance marketing, whatever it is, I think about it as investing capital with the expectation of a return and in the same manner that I would not take all of your life savings and dump it into a single stock. I don't recommend putting all of your money into a single, you know, performance marketing channel and then somewhat exposing you to the volatility of fluctuating CPCs or changing market conditions. And so I would agree with you that it is a drug, in a sense, if you have all of your eggs in one basket and that basket takes you on

• 14:57Speaker 00

  a very intense roller coaster in terms of performance. But when I think about the fact that Thrive manages, you know, $500 million a year, I think of myself to an extent as like a fund manager. We are managing people's money with the expectation of a return and part of the strategy is to diversify across channels. And so we decrease the reliance of any individual project on a singular channel and its performance. And similarly, I always say to people that the first rule of performance marketing is not to forget about offline marketing and the classic marketing that works for organizations. So in other words, direct mail can really work. Email marketing works beautifully. SEO can

• 15:41Speaker 00

  really work. Like, there's all of these like wonderful things at your disposal. And so I think the comments, like the real crash and burn scenarios that I've seen are these like, not fly by night brands, but brands that, you know, figured out, just like with Uber, I figured out this weird tie-in where I could like make, you know, free money from their referral, you know, system. Sometimes people find kind of like shortcuts, hacks, if you will, to scale rapidly because of one specific nuance of like the Facebook ad platform or something like that. And what they fail to see is that those loopholes come and go. And so if they scale massively and their entire, you know, business is predicated on the performance of this one loophole that they

• 16:25Speaker 00

  Found or like, you know, investing everything in a single channel and then the conditions change, they're not going to be very happy and the business will suffer dramatically. And so when I think about this, it's, you know, a responsible channel mix, diversity and, and, and understanding that you can't be overly reliant on performance marketing for the success or failure of your business.

• 16:48Lenny Rachitsky?

  What about the second part of that question of when you think about when companies come to you, what do you look for to help you understand this is going to be a really good fit for performance marketing and this is going to give them a lot of opportunity to grow versus like maybe not, maybe they're, maybe it'll be a small sliver, but it's not like going to be a massive success.

• 17:06Speaker 00

  Yeah. So I would say that, that the answer to that question is different at different stages of a company's life cycle. So early stage, you know, look at what the company is doing, look at your own company. Do you, have you established product market fit? So is this an idea that has yet to be tested and are they entirely looking to performance marketing to scale, you know, everything? So are they at risk of it becoming like an over reliance on performance marketing? At a later stage, we look at, uh, you know, certain criteria that they might or might not possess. And so typically that will come down to resourcing. So the question at a later stage is not, does it work? But to what scale can it work?

• 17:48Speaker 00

  And so we're looking at things like, do they have adequate creative resources and buy in that does, does creative resourcing tie into performance and can we create a feedback loop there around testing? I'll talk to you about that in a bit. Do they have professional marketers on staff? So are there people who have experience, you know, doing what we do that, that speak our language, so to speak, or is part of this an organizational, educational, you know, and, and creating buy in through stakeholders process that needs to take place? Do they have technical resources? If we say, hey, tracking and attribution is broken, here's how to solve that. Can you implement it? And so on and so forth. And so there's no, you know, one magic formula for what works or what type of company will be successful

• 18:33Speaker 00

  on performance marketing channels. I think like, just as evidence of this, Google, which I think had a down quarter, reported sales this week and it was $70 billion in three months and Facebook, similarly, I think just recorded yesterday evening and it was $32 billion. And so.

• 18:52Speaker 00

  That's $100 billion on just Google and Facebook in three months. And the majority of that revenue is from ads. And so like this works really well for lots of different companies. It's just a question of at what scale.

• 19:05Lenny Rachitsky?

  Just to pull on that thread a little bit more. Something I've heard from other guests is that paid ads are best for products where you get basically payback really quickly, basically to feed the flywheel of spend. So that you're not sitting around waiting for someone to buy something in the future. Or it's like a small trickle of pay. How important is that, I guess? Like, do you find that you could just do paid growth for any company? It doesn't matter their business model? Or is there something you're like, okay, this needs to exist for you to invest serious resources? And even hire that team that you just talked about?

• 19:37Speaker 00

  It's always nice when there's a quick turnaround on investment and return. And that's wonderful for like D to C or e-commerce style businesses where they're essentially taking the revenue to fuel additional inventory and operating costs. However, not all businesses work that way. And so in a B to C or B to B lead generation scenario, we have to undertake pretty sophisticated modeling around these abstract concepts like lifetime value, which is difficult because like that's, you know, most businesses are relatively new that we work with. And so the idea of lifetime value is kind of a misnomer, like they don't know what that is yet. But we have to model things like LTV to CAC.

• 20:18Speaker 00

  So cost per acquisition, costs versus lifetime value and the period within which the payback occurs. You end up getting to a pretty sophisticated place where you can build out things like a lead scoring model, which predictively can determine in a statistically significant way, the likelihood that one lead will convert to revenue over another. And so there are ways around the slower payback period that still end up being pretty accurate based on what you're bidding on today versus the latent revenue that will be accrued to those campaigns through attribution.

• 20:58Lenny Rachitsky?

  Do you have any just rules of thumb for someone listening and trying to decide like has paid a real model for us like either on LTV or CAC or payback period or something? Just like, here's what you probably should have, especially early stage for it to be worth, for you to feel like paid growth is going to be a great lever for you to use and maybe a primary lever.

• 21:17Speaker 00

  Product market fit. If you know that your business sells into audiences, let's say you are a social media influencer, or you had a really strong email marketing game, or organically your content surfaces within Google search results, or you did a lot of direct mail and linear television and billboard advertising and that worked. If other things work, it is highly likely that paid acquisition will work. The issue for most companies is in this incorrect assumption that the data that is provided through paid channels allows you to have full end-to-end understanding of like attribution, which is wrong. It's

• 22:01Speaker 00

  never been that way. And the other aspect of this is the patience to understand that every business is unique and these, these metrics that we know are important are different for every business. Lifetime value, like propensity to repurchase, ROAS, which is return on amount spent, CPA, CAC, like all of these different things are different for every business. Even if I worked with two hotels in the same city, they would have different results based on the nuances of their budget, their brand, the market that they sit within, the services that they offer, and so on and so forth. And so I think that like everything else, the main problem here is that nobody should expect an overnight

• 22:45Speaker 00

  turnaround with performance marketing. It is a very difficult channel to manage and that's why people hire experts like us to, to help them with it because it's a never-ending problem with constantly changing issues. It's always been like that. That's not a new thing since pandemic or whatever. And it's not, you know, it will take some time to work out what works.

• 23:07Lenny Rachitsky?

  I have this kind of framework of there's these four growth channels. Basically, growth engines is what I call them. There's paid slash performance marketing. There's SEO. There's virality and there's sales. And

• 23:19Lenny Rachitsky?

  Essentially, there's some companies whose growth is almost primarily paid. So a few that come to mind are Booking.com, which we know well at Airbnb. It's just like almost all paid growth driven. Credit Karma comes to mind as a classic paid performance marketing. I keep coming to paid growth as my term, so I'm just gonna stick with that. TikTok initially was very performance marketing, paid growth oriented. Wish was another one I think about. And I want to talk about how much things are changing within this realm. But before we get there, do you think there's still an opportunity for startups to emerge? Where they get to scale almost exclusively through performance marketing? And this question actually came from Twitter. Someone tweeted this randomly the other day and I was like, oh, that's a great question for Jonathan.

• 24:02Lenny Rachitsky?

  And by the way, her name is Liz Georgie, asked this question. So there you go.

• 24:06Speaker 00

  I'll put it this way, every unicorn from like the 2010s era that that scaled did performance marketing, but not everyone during that time who did performance marketing scaled. So I want to remove the bias here that just because all the successful organizations did this, didn't mean that it was like a magical channel for everyone. We had plenty of projects that we worked on that flatlined during that period. And so the sense that there was a period of time where this was easy or it worked on any project is not correct, in my opinion. With that said, we see companies that are spending millions of dollars a month

• 24:47Speaker 00

  on performance marketing channels like Google and Meta, still despite all the ups and downs that they have faced. And they do so profitably. And I think there's some really great examples of companies that have scaled in relatively recent times, almost exclusively through paid. Like Grammarly is a really good example of this. They have been good at solving for this.

• 25:11Speaker 00

  Problem that exists around like understanding the cost per acquisition versus lifetime value, like how sticky customers are predicting how much revenue can come from a customer and backing out into therefore how much we can pay, you know, per click and per lead and so on and so forth. Athletic Greens is another good example. So Athletic Greens is actually a pretty old company. I think they've been around for 10 years. I think they have retail distribution. I think they, you know, have done a lot of the like more classic marketing things that are that are important in terms of developing that channel mix. But I think the amplification of that brand really, really gained traction quite recently where now everybody knows what Athletic

• 25:52Speaker 00

  Greens is. And that's because they're buying loads of ads on TikTok. They're buying loads of ads on other social channels like Facebook. They're investing in podcasting partnerships. And but this is all digital paid acquisition, right? And so it had a wonderful effect on this like really interesting business that they had already built. So, so yes, it's still doable. We still people see people doing it. And I think that there's been a bit of a reckoning in the performance marketing industry pertaining to things like privacy and the changes that Apple made and people being very, you know, creeped out at how their data is being used, rightfully so. And then, you know, obviously, the economy in 2022, we had a terrible, you

• 26:36Speaker 00

  know, macroeconomic shift where interest rates rise and inflation's out of control. And so of course, the first thing that people cut are, you know, typically marketing budgets. And we see Facebook and Google and other, you know, ad channels directly suffering from that. So all of that said, these storms pass. And so, you know, when the economy improves, generally speaking, I imagine people will, you know, go back to trying to find as much inventory from a pay per click point of view that they can purchase as possible and figuring out the economics of how to do that.

• 27:08Lenny Rachitsky?

  I was definitely gonna ask about that. I love that you touched on it. Just like clearly a lot is changing in paid growth slash performance marketing recently. You talked about the privacy stuff. You talked about COVID kind of shifted the way people spend and kind of dropped and then came back. So my question is, who are you finding has the most success these days in performance marketing? And I will plant one seed, which from the examples you just shared, it feels like it's mostly companies that are very efficient. Like I think Grammarly, they're just like super efficient as a business. And then I think Aladdin Greens, they're a sponsor and I just like their negotiations for sponsoring. It's just like, okay, here's the number that makes sense for them financially and they're not going to go anywhere above that.

• 27:48Speaker 00

  Yeah, because they know, they understand like how many impressions they'll get and on average, what the quality of impression is, you know, and how many, how many dollars they can put behind that before it has a cliff, you know, in terms of ROI.

• 28:04Lenny Rachitsky?

  Exactly. So broadly, who do you think is having the most success now with the changes? And then generally, what should people know about what has changed in the past, say, year in the space of performance marketing?

• 28:18Speaker 00

  I'm not gonna like really be able to point to like this company is really getting it right. And I think that you can do that, but it's like saying, you know, a friend of mine recently on Twitter tweeted this funny thing where he was like, you know, this is the number that I used to win the lottery, said every successful founder ever trying to give advice to other founders, right? And so in other words, like just because they won the lottery, doesn't mean you're gonna be successful picking the same number. To that extent, there is a bit of a playbook around, you know, modern day performance marketing. And that includes everything from really stringent and rigorous creative testing and thinking about that correctly, to understanding the subjectivity of attribution

• 28:59Speaker 00

  and its strengths and weaknesses, doing a lot of work around validity of these campaigns. So really just like the measurement and whatnot. Companies that can do those things and then understand their own marketing economics. In other words, like quite, quite basically, how much can we afford to spend in acquiring a customer on any channel before that acquisition is no longer profitable? So really focusing on the profitability of the bottom line and not just break net growth, for instance. Companies that have those capabilities and see the world that way tend to be successful. In performance marketing.

• 29:39Lenny Rachitsky?

  When you were giving your intro, you talked about how you initially started doing SEO. That's where you started and then you moved to paid growth. Well, how do you think about those two investments as a founder trying to decide which direction to go? What would your advice be like spend your time here versus there if XYZ?

• 29:55Speaker 00

  When I'm asked a question of like, you know, should we put money into organic search or paid search? My response is often that they're actually not mutually exclusive to one another. So it's a great idea to do both and that backs into my strategy of diversification of channels. So don't build up exclusively in one area and create volatility within your marketing mix essentially. SEO is a wonderful, you know, marketing capability when it's built out correctly. I think the issues that you run into are cause and effect related. So one of the things that people really like about performance marketing theoretically is that we can spend a certain amount.

• 30:35Speaker 00

  And then if we're modeling things correctly, we can essentially determine how much revenue was generated from the actions that we took. Finance teams love that. C suite teams love that. They can build projections. They can budget around it. There's some degree of predictability around it if it's done properly. Search engine optimization is different in that the attribution can be tough. It's difficult to determine whether, you know, ultimately the actions that you took contributed to a rise in organic traffic. You have to essentially correlate that. And the, the reason is because when you build clusters of content, you know, and you, you, it's grouped thematically.

• 31:16Speaker 00

  And you're targeting buckets of keywords, whether they're long tail or head keywords, whatever it may be. You could publish all of that on your website. Google still has to crawl it. They run it through their analysis algorithm, which is comprised of 200 different signals of which maybe like 20 to 30 have been publicly disclosed. So it's a bit of a black box. We don't really know ultimately, you know, what ROI comes off of that unless you're very sophisticated. Like probably one of your other guests, Ethan, in terms of measurement, whereas paid. The ROI is still a difficult problem to solve, but there was a lot more of a linear relationship as it relates to attribution. And so.

• 31:59Speaker 00

  Paid being tangible was the reason why I leaned heavily into paid and ultimately away from SEO. But I do think that if you do SEO properly, the payoffs are indisputable, and it is certainly an important part of a modern media mix.

• 32:18Lenny Rachitsky?

  You mentioned this earlier, and I've heard this more and more recently, that one of the biggest levers these days in paid growth is around creatives. It's not like tooling or like smarter data. You tell me if I'm wrong, but it's just like getting creative, getting better creatives. And so I'll let you actually explain what are creatives. There's this term creative that people outside the industry don't really necessarily get. And then broadly, what should people be doing to optimize the way they approach creatives?

• 32:46Speaker 00

  Certainly. So when we say creative, we're referring to the assets that power typically visual programmatic or pay-per-click campaigns on social channels or display networks. And so literally, you know, the motion graphics ad that you see on Facebook, the user-generated content that you see on TikTok, or a static ad that you might see that has like a pretty picture in it or whatever. And so I think that when we talk about creative as a big lever around efficiency and optimization, the underlying, you know, conversation there is that over time, our industry has been heavily automated. So a lot of the levers, so to speak, around performance have been automated by Google and Facebook over the

• 33:31Speaker 00

  last, you know, seven to 10 years. That's because originally, when you ran these campaigns, you needed to have like a rocket scientist in front of them. There were so, it was so complicated, and there were so many different things that you could get wrong. And their solution, the channels, like the big tech companies' solution to this, is figuring out for you. So eventually, Google wants you to say, hey, I'm Google. Give me your credit card, and I'll take care of everything else.

• 33:57Lenny Rachitsky?

  And the URL to point people to, and then we'll do the rest.

• 33:59Speaker 00

  Yeah, yeah. I don't know if that's a great idea for consumers, by the way, but in the meantime, you know, there is certain things that have just been fully automated. In the context of creative, it's still one of these things that for now is not auto-generated in the world of AI and all the changes that we're seeing. Maybe that's something that will change. But for now, essentially, creative directors and their teams are concepting and producing different types of assets. And so there's a bunch of problems that we typically see when people come to us. So number one, performance marketing and brand marketing in a lot of organizations are two different things.

• 34:38Speaker 00

  And the designers that occupy brand teams, bandwidth and whatnot, often don't have a sense of how paid acquisition works. And so one of the pitfalls of working with certain companies or the mistake that they make is the design team will hand off like a file full of random assets for paid acquisition without any sense of like how the channel works. And what I mean by that is, these days, we're using the analogy, the classic analogy of the funnel to organize our thinking around creative assets. So you can think about this as like generating intent at the top of funnel and capturing intent at the bottom of the funnel.

• 35:22Speaker 00

  When I think about an experience that I want a consumer to have on Facebook and audience targeting and creative, I think about us beginning a conversation at the top of funnel creatively with an audience, having that conversation change as we say different things and the audience that we're targeting ultimately graduates through different behaviors on our website from one to another. And then ultimately resulting in an end to the conversation where they take an action, hopefully, that the brand that we're working with is looking for. And so there's a clear beginning, middle and end to that. And one of the major pitfalls that we see is that Certain brands just dump one homogenous message into, you know,

• 36:07Speaker 00

  all of their targeting. You see the same ad over and over again. It creates banner blindness and it's total lack of efficiency. The antidote to that is to, you know, have resources dedicated to paid and essentially iterate upon the creative assets themselves based on the data that we see coming from ad sets and campaigns, you know, in various channels. And so what that means is that you have to experiment. You have to take a bit of a scientific approach, although it's a bit of an art and a bit of a science. You have to try and isolate variables, maintain similar conditions across, you know, targeting and then determine

• 36:47Speaker 00

  which style and feature of an ad performs best at which stage of the funnel versus which audience. And the results that we see are dramatically different from brand to brand. But if you're not undertaking rigorous testing in conjunction with the, how you are driving the iteration and design of your ads, then, then you will not make progress essentially.

• 37:11Lenny Rachitsky?

  Is there a specific example that comes to mind? As here's like something we did that just dramatically changed the impact of a change to a creative. Or if you can't think of one, are there just like specific tactics that you can suggest for people to improve the way they approach creatives?

• 37:28Speaker 00

  Yeah. So I think from a, a testing point of view, let's say I was running ads on Meta. You know, beneath the campaign level, when I create a campaign, I would have the structure that my testing might take would be that I would have an audience, a single audience at the ad set level. And then I would have two nearly identical creatives within that ad set. The only thing being different across those two creative assets is a single variable. So it might be the copy, it might be an image or whatnot. That allows us to isolate a lot of variables and really test into one singular change across two creative assets. There's a lot of nuance to this. So sometimes like the ad serving algorithms, even when we set up a test

• 38:13Speaker 00

  structurally in that way. Will serve one ad, you know, a different number of impressions than the other ad, in which case we then have to say, what is a leveling factor that allows us to look at these two ads equally, even though one received dramatically more impressions than the other? This becomes where it becomes subjective in terms of how you want to determine success. But a good example is looking at like the click-through rate, which is essentially a ratio, or a metric like impressions until conversion, which is a, you know, leveling metric that allows us to determine, even though in a scenario where two ads facing the same audience within the same campaign, received different numbers of impressions,

• 38:57Speaker 00

  we can still measure the efficiency or effectiveness of one ad over the other using metrics like that. And so, from a testing point of view, I think that this is one way that we might look at trying to assess ad performance, so that we can gather learnings, send that back to a creative team, and say, hey, it turns out that when this copy is used at this stage of the funnel, it converts, you know, 50% more frequently than this other copy. So let's now take that copy, use it as our base copy, and challenge it with a different type of copy, and see if we can continually iterate and refine. So that's a very practical example of how like ad creative testing might work on a

• 39:38Speaker 00

  channel like Meta. You asked for specific examples where we've seen like an unlock. There's two that come to mind. Several years ago, we realized that highly-produced ads from brand teams, and I'm not, there's nothing wrong with brand teams. We work with them all the time. They do amazing work. I think we're just trying to work as a singular unit as opposed to being fragmented. But a lot of the brand guidelines of different companies would end up, you know, yielding these like highly polished assets. And when you launch those on like- Instagram, you know, back in the day or something like that. What we found is that they would always underperform next to user-generated assets.

• 40:23Speaker 00

  So a brand that essentially, you know, has an influencer in front of it that says, I tried this product. I love it. I'm filming this ad for my iPhone. Like, look, check it out. Here's the product. Here's me. I'm better off for it. Whatever it is that they're talking about. The unpolished, like, you know, iPhone, mobile phone creative. Suddenly, we realized massively outperformed these other channels because there was an authenticity to it. And rather than the, you know, brands themselves saying like, hey, you know, trust us. Like, our product is great. Here's like a third party essentially validating the what is so great about these brands, basically.

• 41:02Speaker 00

  So I can't speak to like specific clients because I'm not allowed to talk about like the work that we've done in large part. But that would be, you know, one example. And another example is we worked with a furniture company several years ago, which scaled dramatically. But they were having difficulty early on thinking through how to scale social ads. And so, you know, paid search worked really well for them. Social ads, again, they had these highly produced styled rooms. And one of the owners had their dog in the office all the time. And so, you know, they had these models like sitting on furniture or whatever it was. And they would take these beautiful styled shots of their furniture in a room. And one of the art directors was like, put the dog on the couch and let's take some photos of, you know, dogs on furniture, which made it more playful and approachable.

• 41:47Speaker 00

  That one change resulted in a total unlock of their performance on paid social channels. It would like double or triple, you know, the ROAS that we were seeing type thing. So it's these minute differences that you can test into that ultimately can drive performance.

• 42:04Lenny Rachitsky?

  That reminds me of Airbnb, the photography team. Found, and actually, the photography team was initially including people in the photos of listings, and that was like the hero images of listing photos. And it turns out, when there's no people in the listing photo, much higher conversion. And the theory, basically, people don't want to see other strangers in the place they're going to sleep. And that's not, I was not expecting.

• 42:29Speaker 00

  It's a really great example. And so the question becomes, as a company and as a brand, do you arrive at those learnings anecdotally, by accident? Is it the brilliance of one person on the team that the whole brand is predicated upon in terms of performance? Or do you put a very rigorous structure around testing and the iteration of assets? And how to determine whether something works over another thing? That is a process that yields the outcomes that you're looking for. And so, a lot of times with agencies, people talk to us about the obvious hard skills that we have. But the soft skills are around process that can be deployed, that can actually be the

• 43:11Speaker 00

  difference between being highly sophisticated or unsophisticated. Internal teams do this too. But that Airbnb example is a great illustration of how if you put the right testing in place, you can yield an outcome that becomes an unlock for performance.

• 43:27Lenny Rachitsky?

  Getting even more tactical with that idea of testing a bunch of creatives makes me think about a story from chatting with a guy from Wish, who's head of growth at Wish, about how they uploaded hundreds of variations. And I think Wish is the epitome of the opposite of brand, highly polished ads, or it's just the most ridiculous looking products with just banners and numbers and prices and crossouts and all kinds of stuff, just like anything that would take to get people to click. Is there a tool or process that you can point people to to help them do this testing on creatives? Or is it mostly built into the existing tools now and there's nothing really fancy about it?

• 44:04Speaker 00

  We get asked this a lot, and I think there are tools for different types of functions that we undertake in the process of running paid acquisition for different brands. But these days, most of the testing that we do is within the channels themselves. So Meta Ads, Google Ads, I keep touching on those two specifically because they're the most advanced, in my opinion. They're really powerful. And so, the good news here is that you don't necessarily need some exotic tool to do sophisticated creative testing. You can do it in platform, and you can use the structure that I just kind of outlined as a starting point.

• 44:43Lenny Rachitsky?

  You mentioned Google and Facebook. What is your take on TikTok and YouTube and maybe Snap? Do you recommend people go there and there's a big opportunity? Do you think it's overblown? Do you think people should just take Google and Facebook? Basically, at this point, what's your general advice?

• 44:59Speaker 00

  So, when I say Google and I say Facebook, I'm talking about the Google ecosystem of channels, inclusive of YouTube. And when I talk about Facebook, I'm talking about Facebook, Instagram, and probably eventually WhatsApp, which I think will probably launch ads later this year. With all that said, some interesting opportunities these days really exist on channels like Amazon and TikTok, as well as a number of other challenger channels, I think. Snap, I'll talk a little bit less about because I think, really, there's just fewer and fewer people potentially using Snap. There's no knock on Snap. I use Snap, I like it a lot. But, at the same time, most individuals or organizations tend to want to place ads

• 45:42Speaker 00

  where there's a lot of views and engagement. And the king of this right now is definitely TikTok. And so, TikTok faces its own set of challenges, and arguably, there is as much an opportunity there as a barrier at the moment. I love TikTok. I'm a consumer of content on TikTok, not a producer of content on TikTok. Their ads platform kind of reminds me of where Facebook Ads was like six, seven years ago. It's not super sophisticated, and attribution is not great yet. But, you can get cheap CPCs, because there's just fewer organizations advertising there, fewer... Companies have figured out how to make that work. And same thing with Amazon. Amazon is a bit of a bespoke channel.

• 46:27Speaker 00

  Like it doesn't work for a B two B SaaS company. It's more specific to like D to C, I would say. But essentially, you know, those channels are wonderful. They're not at the point yet where they're kind of ubiquitous. Like every single advertiser that has ever worked with us, I think in the last 10 years is for sure on Google. Like there, everybody does that. And then the question is, what else can I invest money in with the expectation of profitability? And so TikTok and, and Amazon, and even, you know, if I want to break out YouTube, they tend to be a little bit more specific and they definitely work, but not for everybody yet. And so the question becomes like, will TikTok become as prominent as like a social ads platform like, like Meta Ads? And we just don't know yet.

• 47:11Speaker 00

  What we see working very nicely on TikTok, by the way, are these like founder-led brands where the founder is the ambassador and they're doing those handheld, you know, videos with their iPhone. They're talking about the merits of, you know, the products that they make. They're talking about the problems that they solve. They are great at cultivating a following. Their, their content is highly engaging. Those types of organizations crush it. Also, companies that got really good at partnering with influencers. So we haven't talked about like partner marketing that much, but affiliate marketing companies got into this early and then influencer marketing networks, you know, are all over this. But essentially having these third parties be an ambassador, you know, for your brand

• 47:55Speaker 00

  in an authentic way, partnering with them, having them generate the content. And that's, you know, the, the nature of the partnership. Stuff like that seems to work quite well.

• 48:05Lenny Rachitsky?

  Awesome. I love those bullet points of just like what is likely to work on TikTok.

• 48:09Speaker 00

  Yeah.

• 48:09Lenny Rachitsky?

  Just broadly, would you say TikTok advertising today is underrated, overrated, or just right?

• 48:15Speaker 00

  If you are e-comm based, if you're wholesale, retail based, you know, anything like direct to consumer, you have to investigate TikTok and, and try and figure out whether there's a way of promoting your products there, basically. It's, it's a massive, highly engaged audience with somewhat specific demographics. It's

• 48:37Speaker 00

  It's a very exciting opportunity. Other brands need to pay attention to this and figure out what their entry point is going to be. And just because the innovation hasn't happened for B2B SaaS yet on TikTok doesn't mean it won't. TikTok wants that to happen. And so the question becomes how? And so someone will unlock that and they'll make, you know, a billion dollars because of it. But I wouldn't recommend that channel to everybody yet. And like at Thrive, for instance, we don't have a huge amount of people coming to us yet saying, "Hey, I'm spending $750,000 a month on TikTok. Can you help me?" type thing.

• 49:16Speaker 00

  The other problem with TikTok is that it's extraordinarily creative asset dependent and heavy. And so like you are launching net new assets several times per week. It is hard for creative teams and brands to produce that much content. It takes a machine and that's expensive. And so that all factors into the cost of not only just the ad dollars, but the, you know, creative resourcing and investment that's required to power that. So it can be done in a more nimble manner if you're spending less, but you can't really get to like a million dollars a month on TikTok without having like a huge amount of creative being pushed to that channel.

• 49:56Lenny Rachitsky?

  Awesome. That's really good advice. I want to chat about AI soon just because I imagine that could help with some of these things. But you mentioned B2B SaaS and I wanted to ask, I imagine Google is the primary channel for B2B SaaS. And if not, or if it is, where else do you find there is value in spending money to drive growth for B2B SaaS, which, which channels and networks?

• 50:20Speaker 00

  So I'm agnostic here in terms of like where people should be spending money. I see that this world in terms of impressions and clicks. And does that conform to the marketing economics of a project that needs to be achieved in order for it to grow? It's less about where to place your money and how to think about the placement of those funds. And so the common mistake that we see as people build out a funnel, so to speak, for B2B lead gen projects or B2C lead gen projects, is they'll be overly reliant on the first of a sequence of metrics that ultimately yields a sale. So typically, it's something like cost per lead, marketing qualified lead, sales accepted lead.

• 51:03Speaker 00

  There might be a couple more metrics there and then eventually a sale occurs. And so the thinking is that, okay, for sales to occur, I need more leads at the top of the funnel. The more leads I have, the more marketing qualified leads I'll get, the more sales accepted leads I'll get. And ultimately, the more opportunities there will be and the more revenue will generate. And so if I think about this world of lead generation on performance marketing platforms as a function of cost per lead in that sense that I just described, then the tendency is always to want to drive down the cost per lead, thinking that that's the efficiency. I can get more cheaper leads and that will yield more revenue.

• 51:45Speaker 00

  When in fact, it turns out that if you flip that conversation on its head and say, not all opportunities and sales are equal. And instead of focusing upfront on a cost per lead, I now want to focus on what is a high value customer. So the cost per lead is actually higher, but the ROI of targeting those people is also higher. And so to get the higher quality leads, it's not a function of CPL. And so that is a very common pitfall that we see when people come to us. The antidote to this, it's interesting. So Thrive developed an ETL tool, an extract transfer load tool called ThriveStack.

• 52:27Speaker 00

  It's not commercially available, but if you wanted a commercially available version of this, you can use something called Supermetrics. Basically, Supermetrics is a data connector. There's a world of different data connectors out there, but it allows you to pipe via an API revenue data from your CRM into a third-party database that can then be joined with data from the channel itself. You can build tables within a database and normalize them together in a manner where you can start to determine the relationship between, again, the audience that particular cohort of opportunities came from and whether a sufficient degree of revenue was derived from those opportunities.

• 53:08Speaker 00

  And then you can build upon that what is known as a lead scoring model, which allows you to bid in real time on the audiences that have a higher likelihood to convert to high revenue generating customers. And so the magic there, we talked a little bit about, you know, rates of return and instant gratification in the performance marketing world. Lead generation inherently is a slow gratification process. And so the problem is that if my pipeline is full of opportunities that yield revenue in two months, six months, sometimes 12 months, how do I determine how heavily to bid on different, you know, leads today in order to predictively have an outcome where I'm

• 53:53Speaker 00

  maximizing revenue? And a lead scoring model basically solves for that.

• 53:59Lenny Rachitsky?

  Today's episode is brought to you by Miro, an online collaborative whiteboard that's designed specifically for teams like yours. I have a quick request. Head on over to my Miro board at miro.com/leni and let me know which guests you'd want me to have on this year. I've already gotten a bunch of great suggestions, which you'll see when you go there, so just keep it coming. And while you're on the Miro board, I encourage you to play around with the tool. It's a great shared space to capture ideas, get feedback, and collaborate with your colleagues on anything that you're working on. For example, with Miro, you can plan out next quarter's entire product strategy. You can start by brainstorming using sticky notes, live reactions, a voting tool, even an estimation app to scope out your team's sprints.

• 54:41Lenny Rachitsky?

  Then your whole distributed team can come together around wireframes, draw ideas with the pen tool, and then put full mocks right into the Miro board. And with one of Miro's ready-made templates, you can go from discovery and research to product roadmaps, to customer journey flows, to final mocks, all in Miro. Head on over to miro.com/leni to leave your suggestions. That's M-I-R-O dot com slash leni.

• 55:06Lenny Rachitsky?

  You talked about attribution and I thought this would be a great time to get into that. So the way I think about this is like oftentimes the biggest challenge in driving growth isn't like the actual work you do to drive growth, it's measuring what impact your work is having and understanding where dollars are spent effectively. And things are changing heavily in attribution land with privacy shifts and ATT and iOS or 14.5.1 or maybe whatever the version was that came out that changed everything. And so my question is, what changed is one in terms of being able to do attribution? Maybe even explain what attribution means for folks that are just like, what the hell are you even talking about?

• 55:48Lenny Rachitsky?

  And then finally, just what do you recommend people do now to do attribution well? And in this new environment?

• 55:56Speaker 00

  Yeah, it's a really, really great and pertinent question in the industry and it has a lot of focus on it now, but attribution has always been a conversation that's been very important. So just to kick things off, attribution essentially is how we determine the relationship between what we did and what happened. In the context of performance marketing, this means what ads did we serve? What campaigns did we launch? And generally, what was the revenue ultimately that was derived from these campaigns? And so there's a funny quote that I love. Someone named John Wanamaker in 1919 said, I know-

• 56:32Lenny Rachitsky?

  I bet I'm gonna, I bet I'm gonna guess what it is.

• 56:34Speaker 00

  Do you want to guess?

• 56:35Lenny Rachitsky?

  It's a half my marketing dollars are wasted. I just don't know which half.

• 56:41Speaker 00

  Exactly. I love that you, I love that you knew that. He said this in 1919, you know, the world was a very different place there, but oddly enough, we still have these types of problems today and it's because the world of what I did and what happened because of what I did is very complicated. There's so many variables, some of which we know, and then some of which we don't know that we don't know type thing. And so attribution as it stands in our industry is still an incredibly subjective-

• 57:11Speaker 00

  Art and somewhat of a science. It doesn't mean that it's impossible and it doesn't mean that there there aren't varying degrees of sophistication as it relates to attribution. But but we're still in a place where we have to understand the business and its goals and then start to work on an attribution model. An attribution model is probably something that is never solved, but I'll give you a couple of examples. So number one, around attribution, it's important to determine whether an organization, a company, a client is focused on profitability or growth. Whether I use one attribution lens or another will drive those outcomes.

• 57:52Speaker 00

  And so these days, for a number of different reasons, we saw, you mentioned iOS 14.5. In addition to third-party cookie deprecation and whatnot, there's no one way necessarily of approaching attribution. The most classic and commonly held version of attribution used to be a cookie-based form of attribution called last-click attribution, meaning that the last quick click in the sequence of clicks that yielded a conversion would be attributed with all the revenue from that conversion. Other models in a cookie-based world involve first-touch attribution. So it's actually the first click. So like, I launch an ad, it's in an audience that doesn't know about my service or my

• 58:34Speaker 00

  brand, and so the first click that I get should be given all the credit for that sale. And then there's multi-touch attribution, which can take several different forms, but essentially is saying it's not one way or the other of the two first versus last-click options, it's somewhere in between. So I'm going to create a weighted attribution model where the first touch gets so much of the credit and the last touch gets so much of the credit. This is very subjective. As you can see, I am essentially looking at my business model, determining what my goals are, and then I'm backing out into an attribution methodology that I think adheres to both the economics of my business and the capabilities of these platforms. And again, we live in a world where

• 59:18Speaker 00

  A single brand might do television advertising. They might buy media in magazines. They might buy billboards. They might get impressions from Facebook. They might do paid search. And so there's a big argument over how to ultimately model this. So there was something called an IDFA that Apple allowed advertisers to use. And essentially what that was, it literally means ID for advertisers. And it allowed Facebook, Google and other advertisers, Snap, TikTok, whoever was essentially selling ads that were predicated on being displayed on an Apple mobile device or desktop device. It allowed the advertiser to provide attribution metrics

• 1:00:03Speaker 00

  and certain types of customer match metrics in their own platforms. And so when Apple ultimately launches its privacy changes, I believe in like mid 2021, overnight it allows users to say, well, I don't want to share that information. I'm not going to share my IDFA anymore. Or yes, I do want to share my IDFA. And so what you see as a result of that is less of the core data that Facebook in particular would have required to make attribution more airtight and ultimately validate its advertising.

• 1:00:42Speaker 00

  And so because we can no longer validate attribution on Facebook seamlessly, we're in a situation where we're not sure any longer which audiences to target. And we're not sure how to run all of our creative testing. And ultimately, we can't even determine the degree of revenue that's coming from particular campaigns that we've launched and whatnot. And so it created quite a stir in the world of attribution, which is obviously like this core discussion to is it working or not? People want to answer John Wanamaker's question, but the modern methodology now is through a number of different approaches to validation.

• 1:01:24Speaker 00

  So the cookie-based attribution, which had been probably the most popular version of attribution in the 2010s, really up to this point, is now one of the ways that we would look at this. But we would also include things like various forms of statistical modeling, customer surveys, population surveys. There's a number of different ways to the same place here. Statistical modeling, by the way, one thing that's very popular these days, which is, I think, was originally created in the 1950s, is a form of statistical modeling called media mix modeling. It's essentially regression analysis, and it is trying to determine the causal relationship between, again, what you did and what the effect was on revenue.

• 1:02:07Speaker 00

  That's very topical in the industry these days. If you're looking for a tool off the shelf that can help with this, Recast is something that I see people using. But a lot of organizations build these highly customized bespoke models that ultimately feed the algorithm inside of an MMM model in a customized manner.

• 1:02:27Lenny Rachitsky?

  What is it? Or is there a recommendation of just like, hey, if you're trying to do attribution today, here's what you should do? Is there a clear do this kind of piece of advice? Or is it super personalized, depending on what you're trying to do?

• 1:02:41Speaker 00

  The advice is that there's no single source of truth. Anyone who claims that they are a single source of truth, whether it's an individual, a model that they've created, or a tool that they've created, is not being accurate. I believe that the approach that works to attribution is that it's an ongoing investigation, and it never stops. And essentially, what you're doing is looking for evidence that validates the outcome of your performance marketing campaigns, one way or the other. There have been plenty of incredibly sophisticated attribution models that we've helped build and invalidated with MMM or other types of tools that have indicated that the campaigns do not work.

• 1:03:26Speaker 00

  So I will repeat that. We, a very sophisticated organization, have stood up campaigns that we measure and ultimately determine do not work. And that is an important finding in terms of an organization's determination of whether they want to continually invest, take budget out of these channels, or invest into other areas.

• 1:03:48Lenny Rachitsky?

  Awesome. You mentioned a company called Recast. I don't think you knew this, but I'm actually an investor and so obviously a big fan. So check it out. I don't know what the site is, recast.com maybe. I think if you Google Recast attribution, we'll also have a link in the show notes.

• 1:04:01Speaker 00

  Yeah, they're working with a couple of our clients right now. And it's interesting. I like their approach.

• 1:04:06Lenny Rachitsky?

  Yeah, they're basically, they're building the model as a SaaS tool to do attribution in a really clever way. Amazing. Okay, just a couple more questions. One is around AI. One is around agencies and just how to start down this road. How has AI, if in any way, impacted the work you're doing today or the work of paid growth for its marketing? And then where do you think this will go in the next few years?

• 1:04:29Speaker 00

  Interestingly, and I think I alluded to this earlier, but our industry has been influenced by AI for over a decade. So Google, Facebook, other, even Microsoft, these are some of the organizations that historically have been at the bleeding edge of artificial intelligence. And their goal was always to automate as much as possible within these platforms. And so the effect ultimately that we've seen from a human capital point of view is displacement. So we're actually, we have more people now than we've ever had. But the nature of the work that they do is more strategic. It's more about modeling, validation, asking the right questions, being focused around creative levers, like some of the things that we've talked about, and less so the trench work of implementation

• 1:05:11Speaker 00

  and bid modifiers at the keyword level on Google search and some of the really hardcore manual analysis we had to do. So I think if we are like the canary in the coal mine for other industries, what will be interesting is, I assume that if you work in an architecture office, that you'll be doing less of like the drafting. And it's kind of already been a change that's occurred in those offices. But you'll be doing less of the drafting and more of the strategic problem solving around like, what kind of building is necessary for the the client in this scenario type thing? And so on a practical level, though, some of these conversational AI like models are very interesting for us in that when I think about creative testing, for instance,

• 1:05:53Speaker 00

  we can have chat GPT come up with all kinds of variants of copy that we would not have necessarily thought of. It can do a lot of drafting of things like RFP responses. So we can feed, you know, chat GPT a hundred, you know, previous RFP responses that we've done and have it spit out, you know, net new responses to net new questions in a net new RFP. And it's like eighty percent good and still requires like ten hours of work to like massage to the point where we can send it off to a client. But that replaces like a week of work with five or six people, you know, that it would have previously taken.

• 1:06:33Lenny Rachitsky?

  And that's already happening today, you're saying?

• 1:06:35Speaker 00

  That's happening now, literally right now, type thing, all of all of what I just said. And, you know, we're, there's a lot of different ways that we are beginning to use AI to do more with less, basically. So that's kind of how I see it influencing not just our industry, but other people's businesses as well.

• 1:06:54Lenny Rachitsky?

  That's amazing. So just to repeat what you said, your team now, because of chat GPT, is able to spend more time higher level and leverage specifically chat GPT to do this kind of, and RFPs are basically proposals people are asking you to pitch to work with them, is that?

• 1:07:12Speaker 00

  Yeah.

• 1:07:12Lenny Rachitsky?

  Okay, yeah.

• 1:07:13Speaker 00

  You know, some of these like AI-driven organizations that allow you to like type in a prompt and it spits out an image. On our creative group, we can, we can come up with like mockups in, in like literally like 1% of the time that it took. So you no longer have to like draw the initial mockups for art. Suddenly, you know, what might have taken one person a week of work on a campaign takes like an afternoon type thing. And so you still have to understand what questions to ask of the AI and be capable of iterating. But like these like rough drafts that you might show like the artwork of, you know, to a client to say like, do we like this more? Do we like this more? That's like AI-generated. It's really interesting.

• 1:07:55Lenny Rachitsky?

  What's the tool your team uses for that? Is it Midjourney or Dolly or something?

• 1:07:59Speaker 00

  It's Dolly and it's Midjourney. So you got it.

• 1:08:02Lenny Rachitsky?

  Got it. And so what you use it for is you're thinking about a concept and you just come up with a mock, coming up with a prompt to kind of pitch what this could be.

• 1:08:11Speaker 00

  Yeah, the interesting thing there is that these concepts often live inside of someone's head and we do this thing as humans where we verbally discuss it. And I try and put the image in my mind's eye, in your mind's eye, which is an inherently inefficient process and actually hurts our ability to be creative leaders. Someone might just see it slightly differently than you do. Now that person theoretically can use Dolly to output what is inside their head and they can refine that easily through subsequent prompts in Dolly or Midjourney or whatever it may be. And then just say, do you like this? This is my idea. And so in a way, it's helped humans connect more easily in that context than we were capable of doing before. And then in the context of like

• 1:08:55Speaker 00

  pitching a client on ideas, we are capable of generating more ideas faster and iterating upon them live. So I can, I can, you know, have a Zoom call with you. I can present my screen. And if you don't like the output of, you know, Dolly that I just prompted, I can re-prompt based on your feedback in real time.

• 1:09:16Lenny Rachitsky?

  There's this sentiment that AI is going to take away the fun stuff of jobs, like maybe being creative and coming up with a new, you know, concept and photography, like, you know, setting up a whole photo shoot, whatever.

• 1:09:29Speaker 00

  Yeah.

• 1:09:30Lenny Rachitsky?

  Do you find that your team is excited about uploading this to Dolly? Or are they just like, god damn it, this is what I love. And I'm just sitting around and talks.

• 1:09:38Speaker 00

  Writing prompts. I am not an incredible artist, but now I can take those thoughts in my mind and output them just as well as like someone who's pretty skilled in artwork. So in a sense, I'm excited because this technology democratizes the ability to do this across everyone. Anyone who can think a thought can generate an image on a, on an AI image generator. How many scribes do you know? Uh, zero, I believe zero. Because we invented something called the printing press and the printing press, you know, took over what was a cottage industry for very specific individuals that allowed them to control the flow of information. Yet today, it's not like we have fewer writers or creative thinkers.

• 1:10:22Speaker 00

  They're just using different tools to arrive at the same place. You could say the same thing of the loom. There used to be people who would stitch your T-shirt together or your sweater together, and none of those people have work anymore. There's still people who knit, I suppose, but your, you know, your clothes are made in factories through with machines and the quality of the clothing is arguably a lot better than it was. I, maybe I'm wrong about that point, but you can make more of it and more sophisticated clothing. There's no question that AI is going to displace and replace certain industries of people, certain roles. I'm not going to pretend like I know whether that's a good or bad thing. And I'm also not a poster child, child for AI. I am really just using the technology that's available to us to run our business the best way we can.

• 1:11:06Speaker 00

  We haven't let anybody go yet because of these efficiencies. The people who used to do the artwork are, are the ones using these tools. And I think they're excited that they're more productive. Is there going to be nuance around that? Of course. Are some people going to be sad about the changes? Yes, I think human nature is that people generally don't like change. But I think over time, we've seen change has been a productive and positive thing for society, not a negative thing.

• 1:11:35Lenny Rachitsky?

  Awesome. Yeah, so it sounds like the team is excited generally. That's a good sign. And that's what I find generally. I think some people will be really upset, but most people will be like, amazing. I never wanted to do this part.

• 1:11:47Speaker 00

  This generation of people will be upset and then there will be a subsequent generation that never knew anything different. You know, so the way we think about this is that, you know, people growing up these days have always had the internet. Whereas you and I probably remember a time before the internet existed. AI is a platform like the internet. And just as when the internet was launched, you couldn't conceive of amazon.com. Or, you know, all of these wonderful or social networks or whatever it was. The permutations of what AI will become, even in the current like GPT four context or Dolly context or whatever it may be. We don't know what people are going to create with this.

• 1:12:27Speaker 00

  And so it's difficult for the generation that knew what life was like beforehand, before iPhone, before internet, before AI. But there will be people who know nothing but this eventually and to them, you know, it'll just be normal.

• 1:12:42Lenny Rachitsky?

  Until we're all just replaced by AI and then it's AI writing ads to get other AI tools to buy products from each other. And then we're just sitting around watching Netflix and that'll be great. There's always this question when you're starting to invest in paid growth, performance marketing of should we work in the agency? Should we work in house? Should we hire someone junior to figure it out? Should we hire someone senior?

• 1:13:02Speaker 00

  Yeah.

• 1:13:03Lenny Rachitsky?

  What's your general advice for say, an early stage startup, when it makes sense to work with an agency versus bringing someone in-house?

• 1:13:10Speaker 00

  Hmm. So we need people in-house to do our jobs properly. So agencies are not mutually exclusive to personal in-house. If we don't have a point of contact, for instance, at an earlier stage company and we're supposed to report to like the CEO. CEOs tend to be very busy people and we often just like can't get the information and approvals that we need to be successful. So if you think that growth marketing is an opportunity and that performance marketing is a subset of growth marketing that you want some focus on. The reality is you're going to need expertise and you probably should start in-house and then hire an agency. Again, there's different stages of companies and different examples of like what makes sense

• 1:13:54Speaker 00

  at different stages and the nature of the work that we do at different stages changes. Very, very late stage, we're kind of doing a lot of this like sophisticated, you know, production work, we're implementing sophisticated testing, we're working on attribution, we're building beautiful reporting, but in a sense, we're maintaining like this machine that already exists. Earlier stage, we're doing a lot more of net new experimentation, trying to discover what is working and what sequence of audience targeting versus creative asset display, you know, will work, what channel mix works and all of that. And so a lot of times, the body of work that's required to nail that and the inputs to like

• 1:14:36Speaker 00

  literally like out front, like what questions to be asking, isn't something that a small in-house team possesses. And so they will work with an agency to scale faster, to get where they're going quicker, to bring in more resources, you know, quickly, basically. And then later stage, sometimes it's a permutation of the same thing, or you know, we're really just managing a whole bunch of different capabilities that they have because it's very complicated and difficult to staff.

• 1:15:05Lenny Rachitsky?

  That is really interesting. So it's not like agency versus in-house full-time person, it's unique both is what you're finding.

• 1:15:11Speaker 00

  I don't think we have any projects that we're working on where there's not like a professional, you know, marketing person as our POC. And generally, the people that we report to have a background in what we do, whether they ended up doing something different and now they're like a VP or a director level and not directly managing channels themselves is one thing or another. But yeah, I mean, we, we, we work with people that have in-house expertise all day long.

• 1:15:35Lenny Rachitsky?

  I see. So sometimes it could just be a generalist marketing person that becomes your point of contact. They don't have to be experienced in paid.

• 1:15:41Speaker 00

  There's one more thing. So as agencies, we're constantly solving people's problems in the market. And as a result of that, I have a fairly large team of 130 people that think about, you know, performance marketing all day long. It's the first thing we think about when we have our morning coffee and it's the last thing we think about as we're like leaving the office kind of thing. We have very sophisticated and built out capabilities as well as all kinds of software and processes and capabilities, I guess, that we've created that most in-house teams just don't have because they're smaller or newer or someone might be really sophisticated, but they don't have the resources to implement it and stuff. And so in the same way that

• 1:16:24Speaker 00

  a really sophisticated organization might go to Boston Consulting Group or McKinsey to say, hey, like, we did this, but you do more of this all day long and we need advice on how to be more efficient. People come to Thrive saying, hey, we're top of our game. We have really strong people. They absolutely know what they're doing, which is always the case, by the way. But we're looking for extra sophistication and additional capabilities that are very difficult to create in an in-house organization. It's why we worked at Uber for 10 years. It was tough to replace us.

• 1:16:59Lenny Rachitsky?

  Yeah, that's quite the retention. 10 years going. Imagine the net dollar retention has gone up too.

• 1:17:08Speaker 00

  Yeah.

• 1:17:09Lenny Rachitsky?

  When you're looking to hire someone full-time to drive the paid growth channel and/or work with an agency, what do you recommend people look for specifically, especially things maybe they're not likely to think about when they're hiring someone that people often miss?

• 1:17:25Speaker 00

  So there's a couple of competencies that I think are very important. I found that, so I was like a nerd as a child, if you can't tell. I don't know. Super nerdy, geeky kid. I would like take apart, I would take apart my parents' computers. I'd try and rebuild them. I was fooling around with bulletin boards before websites existed, stuff like that. And then I became a web developer. And as I transitioned into a performance marketing role, I realized that being technical and having technical aptitudes was extraordinarily helpful in terms of being on the front line of what we were doing and solving problems. So if you're making your first hire, you probably want them to be, to have the ingenuity and capability to solve a lot of the problems that you're going to run into within the

• 1:18:10Speaker 00

  context of tracking, attribution, data visualization, and then campaign management. So number one, do they have a technical background? That can be multidisciplinary. At Thrive, you know, we have someone who is a nuclear physicist that left, you know, that discipline and became a performance marketer. We have people who have left mathematics and become performance marketers, people who left finance, full stack engineering, like all kinds of stuff. Those are technical fields where people tend to be good at math and good at problem solving. And so that's like a strong piece of evidence that they might have a strong aptitude for performance marketing and managing this. Another thing is just, you

• 1:18:53Speaker 00

  know, literally, do they have experience in this discipline? So like, have they managed on any level, you know, Meta Ads, Google Ads, TikTok, Amazon, some of the things we talked about? Do they have an appreciation for some of the inputs that we just discussed today that, you know, ultimately make for, create the conditions for success within a performance marketing environment? So do they understand the role of creative? Do they understand the role of proper attribution? And are they capable of understanding the mechanics of your business? And so on and so forth. So I would say just fundamentally, those are some of the areas that, you know, when we are interviewing, we're looking for. As an agency

• 1:19:34Speaker 00

  too, we are looking for the ability to work with people and be excellent at client services. And so one of the, you know, questions we might ask, I actually borrowed a Jeff Bezos question from early stage Amazon where I ask people, you know, without much warning in an interview, I'll, I'll ask them whether it's okay to do a bit of a thought experiment together and whether they are comfortable, you know, asking a logic or responding to a logic question. And I'll ask the question of how many windows are there in New York City? And so there's two things that I look for in this, in this scenario. One is can they think on their feet? So I'm not actually looking for the correct answer. It's a pretty difficult question to solve. But like, number one, do you realize that windows are not just

• 1:20:17Speaker 00

  building windows? And, you know, windows are also in cars and trucks and stuff like that. So there's more than one type of window. And then can you just do the arithmetic of saying like, you know, there's so many buildings per hectare or square mile or whatever it is, and, you know, it's division and multiplication type stuff. But also from a client services point of view, I'm trying to see whether in a scenario where I've asked them something that they obviously probably weren't prepared for, that is a strange thing to ask and probably makes them feel a little bit uncomfortable, how they react in that situation. So do they remain composed or do they lose their composure? Get frustrated or even angry, you know, that I asked them something that's pretty weird

• 1:20:57Speaker 00

  to ask. Their reaction there is often a good leading indicator of whether or not in a client scenario, working with our clients, they can, you know, compose themselves in a difficult situation.

• 1:21:10Lenny Rachitsky?

  Very tactically, what level of experience do you recommend people look for in their first performance marketing hire, like year or two, four or five years longer?

• 1:21:23Speaker 00

  I've seen people who have like 10 years of experience in the industry not be that great. And then I've seen people who have like one year of experience be absolutely phenomenal. So I would say that like, again, like, you know, the years of service under their belt is one clue or piece of evidence to their potential aptitude. But really, you know, you want someone who can clearly demonstrate to you that they can competently run the channels, I suppose. If, if, if what you're asking is like literally like at the level where someone is like managing, you know, pay per click and programmatic media buying, then, then you want to make sure that they can just do that. And I would say it's less about like the years of experience. A lot of times people only want to do those types of jobs for a

• 1:22:08Speaker 00

  couple of years before they're like, hey, what's your plan for me? Like, I'm tired of running ads and building campaigns. I want to manage the people who do that now. And so, you know, the people who tend to really do that are often somewhat earlier on in their careers. And so that's just a reality that we see.

• 1:22:25Lenny Rachitsky?

  One more very tactical question. What do you recommend the title for this role be? Growth marketer, something else?

• 1:22:30Speaker 00

  I've seen so many different, you know, names for this. So I think, again, if the intention is to grow out a growth marketing capability, which again, is not exclusive to performance marketing, then you're looking for a manager role of, you know, growth marketing manager. I've seen paid acquisition specialist for people who've just managed channels. I've seen paid acquisition manager, performance marketing manager, media, media planner and buyer. I've seen all kinds of different roles, but.

• 1:23:02Speaker 00

  When we are launching a new role these days, there's such wonderful tools like everything from Glassdoor to LinkedIn to PayScale, you know, where you can essentially just look at what other people are calling it and borrow from their role descriptions and then, you know, create your own role description and then determine what role is meaningful in the context of your own organization.

• 1:23:23Lenny Rachitsky?

  Awesome. Last question, we started with the story of how you landed Uber. And I know you also have an interesting story, which I haven't heard of how you landed Snap, Snap slash Snapchat as a client. So maybe tell that story.

• 1:23:37Speaker 00

  It's a fun story and I think it's about ultimately, you know, confidence and knowing your craft. And so I believe it was like 2015 or 2016. We're essentially contacted to participate in an RFP down in Los Angeles. And RFPs are difficult processes and essentially, you know, a department of a company is saying, we, we want performance marketing and here are all the questions that we're going to ask you and exercises you need to complete in order to vet you as to whether you're the right partner or not. And so sometimes RFPs are incredibly thoughtful and they're run by people who have either done a lot of RFPs in the context of what we do, or they know specifically, you know, what the outcome is.

• 1:24:20Speaker 00

  And then in other cases, they're very like experienced marketing departments with senior people. And an approach that they may take is like every stakeholder within that department gets to submit one or two questions, you know, to a long list of questions and the, you know, the, the respondents have to like respond to all of this. And so the, the RFP process for Snap was somewhat complex and they asked a range of different questions. And we find ourselves in LA at a hotel the night before. It's two o'clock in the morning, my business partner and I and another team member that we had brought down are sweating. And we're like, how are we going to build a presentation out of this? Like, they're asking so many well-meaning but

• 1:25:05Speaker 00

  difficult questions that are zigging and zagging and like, you know, in a pitch situation, you want to tell a story. It's important. And that story has to have a beginning, middle and end. And it was just difficult. And yet here we were and we had worked with like all these really cool organizations and I was very confident that we knew precisely what we were doing. And I kind of had This eureka moment where I was like, here's what we're gonna do. It was Brent MacArthur, my business partner and I kind of arrived at this together. But we're kind of like, here's what we're gonna do.

• 1:25:44Speaker 00

  We're gonna have a completely, you know, unique take on how to respond to this. And we're gonna build a deck, you know, that's bespoke around like X, Y, and Z. And so we worked till like six in the morning. I think we get a couple hours of sleep and then by like 10 o'clock, we're sitting in their offices. And essentially the pitch is something like this. I stand there in front of about 20 different executives from their organization. And I say, you have thoughtfully curated an RFP for us to respond to today. And you have asked us to respond to about 20 to 30 different questions. With the utmost respect, I'm not going to answer any of your questions today. I'm standing here because you are looking for a marketing partner and you need expertise in this area.

• 1:26:26Speaker 00

  And instead of telling you the answers to the questions that you asked, I'm going to tell you what I think you need to do to get where you want to go. And if you agree with me and my logic and what I talked to you about here today, then you should hire us. And if you do not agree with my logic and you think that we're out to lunch, then you should not hire us. Everybody, you could hear a pin drop in the room. My own team, I think, was a little bit surprised. We had a whole bunch of like technical difficulties that day, like someone who was supposed to zoom in like couldn't make it. And so I have to like ad lib part of the pitch that I wasn't prepared for, like lots of zig and zags. They thank us for our RFP response, lots of handshakes and smiling faces. But we don't know whether we're gonna land the client or not.

• 1:27:12Speaker 00

  And then about two hours later, I was driving to San Francisco with a friend. Immediately like leave LA for SF because I had a bunch of follow on meetings. And I get a phone call and they were like, we loved your approach. Congratulations, you're hired. And so, you know, these days, I think Snap. Is still a really interesting organization, but at the time they were kind of bringing the future of a social platform or what a social platform could be in the same way that we think about TikTok right now. TikTok, you know, wasn't on the scene yet and Facebook was very worried about Snap and there was tons of engagement on Snap. So Snap, so this was like, like, you know, the it client of the day and it felt amazing. And essentially, you know, the lesson

• 1:27:57Speaker 00

  was that you have to trust yourself and understand your strengths and weaknesses and in situations where someone is well meaning, but may not understand, you know, what they need, be brave and tell them what they need rather than just conforming to what they're asking for because sometimes inadvertently that leads you down the wrong path. And so we took a big risk and it had a wonderful payoff. And we have, in addition to this story, you know, we had a wonderful relationship with them for a couple of years.

• 1:28:28Lenny Rachitsky?

  I love that story. I love how dramatic all your new customers, your way of acquiring customers ends up being. I imagine not all of them are this dramatic.

• 1:28:38Speaker 00

  Not all of them are this dramatic, but there have been some pretty dramatic ones. And I think, you know, part of running a business and running an agency has been the curation and experience around all of these fun, crazy stories that have accumulated as we run this really interesting services business.

• 1:28:55Lenny Rachitsky?

  Awesome. Well, with that, we've reached our very exciting lightning round. I've got six questions for you. Are you ready for the lightning round?

• 1:29:03Speaker 00

  Ready. Let's do it.

• 1:29:04Lenny Rachitsky?

  Okay, great. Looking very excited. Okay, first question, what are two or three books that you've recommended most to other people?

• 1:29:12Speaker 00

  So as a marketer, Storyworthy by Matthew Dix is a wonderful book. He is like a world class storyteller. I don't know if you know him. And he wrote this book about how to structure and think about the art of storytelling. And every marketer should read Storyworthy. It was a huge contributor to how I think about, you know, what we do at Thrive. As an entrepreneur, I love startup stories. So Shoe Dog, which is the startup story of Nike, it's basically, you know, Phil Knight talking about all the ups and downs and it's, it's crazy. Like Nike shouldn't be a company at this, you know, based on all the turmoil and challenges that they overcame. And so, you know, fascinating read about taking

• 1:29:56Speaker 00

  Risk and doing what you think is right and ultimately succeeding and building Nike. And then a book by Nick Bilton called American Kingpin, which is the story of the startup of the Silk Road, which was like this dark web marketplace for some pretty bad stuff. But it is half tech story, startup story and half gangster kind of kingpin story. It honestly should be a Hollywood movie. It reads like a Hollywood thriller. So awesome. Great book.

• 1:30:29Lenny Rachitsky?

  Favorite recent movie or TV show?

• 1:30:31Speaker 00

  I don't know how recent it is, but I love The Big Short. Just love it.

• 1:30:35Lenny Rachitsky?

  Not recent at all, but it's still great.

• 1:30:37Speaker 00

  It's still great. And the reason why I like it is because someone found truth in the data they were analyzing and then capitalized on it, which is really an analog for what we do in performance marketing. And then recently I have fallen in love with White Lotus. For no particular reason, it's just raw entertainment.

• 1:30:54Lenny Rachitsky?

  What's something you've changed in the way that you all operate? That's been relatively minor in terms of how hard it was to change, but that had a tremendous impact on your ability to execute as a team or a company?

• 1:31:07Speaker 00

  The tools that we use in performance marketing change constantly. So the channels themselves change and therefore what problems exist and what SaaS companies or different types of platforms offer as solutions to problems change. And so I don't think it's one thing necessarily. This might be a bit of a roundabout answer here, but I mentioned that change itself earlier is something that humans seem to not love. Whereas in our industry, and I don't think we're alone here, but there's a culture of change. And so a welcoming of change, aptitude around change, implementing, having a playful mindset with new technology and tools, rather than being upset about the fact that AI exists

• 1:31:52Speaker 00

  or third-party cookies are being deprecated or iOS 14 removed IDFA. And trying to be creative around those types of solutions has been like a constant for us. So it's not, I'm kind of sidestepping the question a little bit, but it is the cultural willingness to adapt that I think has been a strong suit for us as a company.

• 1:32:12Lenny Rachitsky?

  Speaking of tools, final question, what is your favorite, most underrated tool for performance marketing work?

• 1:32:18Speaker 00

  It's ThriveStack. So it's a tool that we built in-house that allows us to pipe third-party data and anonymized customer-level data into a database and then ultimately visualize it in a format like Data Studio, Google Data Studio, which I think now is called Looker Studio. That has been a profoundly powerful platform from which we're capable of delivering insights that are built upon the data as opposed to just regurgitated data, if that makes sense. We have not released this, this technology, yet. It's basically a tool we use in-house with our clients, but to a certain extent, I mentioned Supermetrics,

• 1:33:00Speaker 00

  which is another ETL and has some of the same capabilities, but isn't quite as powerful.

• 1:33:05Lenny Rachitsky?

  Amazing. Jonathan, this is by far the deepest I've ever gone into the world of paid growth. I really appreciate you making time and sharing all of your wisdom with us. Two final questions. Where can folks find you online if they want to learn more, reach out, ask some questions maybe? And how can listeners be useful to you?

• 1:33:23Speaker 00

  Thank you for having me again. By the way, this was a lot of fun. So I'm available through Thrive, so thrive digital.com. You can contact us through our site by accessing the contact form. Personally, I'm on LinkedIn under my name, Jonathan Becker, or Twitter, JZ Becker. And then, you know, things that would be interesting from the audience, always looking for feedback in terms of whether people agree or disagree, you know, with thoughts and feelings that we have about what we do. And obviously, always looking for amazing people, you know, ultimately to join our team at Thrive. So if you're a practitioner of growth marketing or performance marketing and you're looking for a top place, you know, to spend some time, would love to talk to you. And also, I suppose if you

• 1:34:05Speaker 00

  need some help, you know, making this stuff work within the context of your own organization, we'd love to be at your service.

• 1:34:12Lenny Rachitsky?

  Awesome. And what is the URL again?

• 1:34:14Speaker 00

  Thrive digital.com.

• 1:34:16Lenny Rachitsky?

  Sweet. And yes, for feedback, be careful what you wish for. We get some hilarious C2 comments. We'll see what comes in on this one.

• 1:34:23Speaker 00

  Sounds good.

• 1:34:24Lenny Rachitsky?

  Jonathan, thank you so much for being here.

• 1:34:27Speaker 00

  Pleasure. Thanks, Lenny. Thanks for having me.

• 1:34:29Lenny Rachitsky?

  Bye, everyone.

• 1:34:31Lenny Rachitsky?

  Thank you so much for listening. If you found this valuable, you can subscribe to the show on Apple Podcasts, Spotify, or your favorite podcast app. Also, please consider giving us a rating or leaving a review, as that really helps other listeners find the podcast. You can find all past episodes or learn more about the show at lennyspodcast.com. See you in the next episode.