Pod Insights Voices of Search // A Search Engine Optimization (SEO) & Content Marketing Podcast SEO Testing & Optimization About this episode Ryan Jones, the expert behind SEOTesting, discusses the nuances of SEO testing and optimization. He emphasizes the importance of small businesses using smart, strategic SEO practices to compete against larger companies with more substantial budgets. By leveraging unique insights and efficient tools available at SEOTesting.com, Ryan illustrates how businesses can enhance their online presence effectively. Today, Ryan shares valuable tips on maximizing SEO efforts without breaking the bank. Show NotesConnect With: Ryan Jones: Website // LinkedInThe Voices of Search Podcast: Email // LinkedIn // TwitterBenjamin Shapiro: Website // LinkedIn // TwitterSee Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
Transcript 0:00 Speaker 00 The Voices of Search Podcast is a proud member of the I Hear Everything Podcast Network. Looking to launch or scale your podcast? I Hear Everything delivers podcast production, growth, and monetization solutions that transform your words into profit. Ready to give your brand a voice? Then visit ihereverything.com. Welcome to the Voices of Search Podcast, a member of the I Hear Everything Podcast Network. Ready to expedite your company's organic growth efforts? Sit back, relax, and get ready for your daily dose of search engine optimization wisdom. Here's today's host of the Voices of Search Podcast, Tyson Stockton.
0:43 Speaker 01 Hey, what's going on? My name's Tyson from previsible.io. And joining me today is Ryan Jones, who is the Marketing Manager at SEO Testing. SEO Testing provides innovative SEO testing solutions for businesses looking to optimize their online presence and improve search engine rankings. Specializing in cutting-edge tools and analytics, SEO Testing offers comprehensive services tailored to meet the unique needs of each client. Today, Ryan and I are going to be discussing SEO testing and optimization. So with that, here's my conversation with Ryan Jones, Marketing Manager at SEO Testing. Ryan, welcome to the podcast.
1:20 Speaker 02 Thanks for having me on. Great to be here.
1:22 Speaker 01 Yeah, so first time having you on the show. And today, I mean, as we heard from kind of like the intro and bio, it's going to be all things SEO testing. So maybe just to kind of level set with the listeners, how would you frame or kind of speak to SEO testing and where we are today in SEO?
1:42 Speaker 02 Yeah, so SEO testing, I mean, when we sort of drill down to it, we've kind of been doing SEO testing since SEO became a thing. We'd measure something on the site in terms of metrics, whether and there's something we're not happy with, whether it's a traffic to a site or click through rate for a particular term. And then we'd change something on the site to kind of target that. And then we'd measure the results in maybe something like Ahrefs, like any sort of. Like keyword tracking platform or or Google Analytics to measure traffic. And then today with the advancement of of different tools that we've that we've got, we're we're able to put a lot more data towards that now, so we can really
2:23 Speaker 02 test and optimize and work out more importantly where tests are successful and where tests fail. So we're able to learn from both sides of the coin. So we can, we can kind of test whether, or we can learn from the failures as well as learn from the mistakes. And then we can use that to optimize strategies going forward.
2:42 Speaker 01 And I I feel like to that point, like testing within the SEO kind of feels like something that's like just deeply intertwined with like the DNA of SEOs where it's like, at least we should be curious by nature, you know, there's no real kind of script as far as like what you need to do. There's, you know, the common consensus type items. But with it being such like a fast evolving landscape, obviously, it has this heavy like dependency on testing. Yet it seems like it's still a kind of like a challenging subject for a lot of SEOs out there.
3:20 Speaker 01 Can you kind of hit on some of the common mistakes or common challenges that SEOs might face? When they're looking to kind of conduct some of these tests?
3:32 Speaker 02 Yeah, I think one of the biggest challenges is is just getting buy in in the first place from stakeholders, clients, managers, whoever whoever it kind of is. Because if you haven't had a, if you haven't got a history of of doing tests, then it might be difficult to convince people who allocate budgets to to put money towards certain work based on what seems to be a guess, or maybe at the very best, you've got some other test examples from other websites. But obviously, as we know, what works for one website might not necessarily work for another. So if you're not using, if you're not sort of basing hypotheses off your own background, then it can be hard to get buy in.
4:11 Speaker 02 And then from the actual testing side, I think one of the mistakes I see quite a lot is confusing maybe a C R O based test. Which is what we would describe as a more sort of A B test type territory than actually an S E O test. I think they are, they are, they are two different things. And it's important to get the distinction right because when it comes to A B testing, it's, that's really difficult to do in S E O. Because you get, you run into all kinds of problems with maybe like cloaking and stuff like that. Showing different things to users when Google's only seeing one, one type thing. So I think it's important to stress that you can do A B testing for S E O, but it's done in a completely different way.
4:55 Speaker 02 So learning how to sort of go, go beyond that and, and do the right types of tests is, is really important as well.
5:01 Speaker 01 I want to dive into kind of the A B test because I agree, you know, there's obviously some certain like challenges or limitations that kind of come with that. But why don't we kind of hit on, you know, the other side of the coin? Because I feel like at least from my conversations, it seems to be that like, you know, A B testing is more of the, the common kind of approach to it. So if you can kind of just elaborate a little bit more on kind of like those, those options that N S E O might have.
5:30 Speaker 02 Yeah, yeah. So when it comes to A B testing, you kind of have two options. One is a more traditional A B test where you send different groups of users to different versions of the same page, which is. And there's still definitely a place for that in terms of C R O type stuff. When you're looking to optimize conversion rates or get more products added to a basket and that kind of thing. Which can then indirectly help, help S E O in the long run, when obviously conversion rates are better and that kind of thing. And there's, we can have all types of debates about whether Google use click data on a site, but I'm not necessarily going to go into that on this podcast. But we know that improving conversion rates is, is certainly going to be useful in the long run.
6:11 Speaker 02 So that there's definitely a use case for that sort of more traditional A B testing. And then coming from a purely S E O, S E O side, you can do A B testing. You just have to do it in a different way. And it's rather than showing two groups of users the same page with different things on it. It's showing. All of your user is basically split, we call it split testing. It's having two groups of pages that are similar. So if you're working on an e-commerce site, then you might have groups of product landing pages and that kind of thing, similar templates, similar content, that kind of thing. And seeing how a change on your sort of test group, where you make the change to to all of your test pages,
6:54 Speaker 02 and seeing how they perform whereas compared to your control group, when then there's nothing being changed on those. And then you can take your learnings going forward. Obviously, if sort of traffic goes up and that kind of thing on your test group, then you can, then you know that you can kind of be safe in rolling out that change to the rest of your categories.
7:13 Speaker 01 Yeah, so from a traditional sense, you'd want to have this truly randomized test control group. You're giving two different experiences to it. SEO, we have that limitation where you're not going to be showing Google two different kind of versions of the page. So, you know, to your points, you know, where it's really key of selecting like the group of pages that then we're kind of comparing against each other. What recommendations would you have for kind of the listener on how to select those groups? Like what's typically the size or like the the volume of pages or amount of kind of like traffic going to? Like what are the thresholds or kind of like checklist that maybe we need to think about?
7:57 Speaker 02 Yeah, in terms of this type of thing, it's really hard to give an exact number, but there's kind of some rules you can follow. The biggest one is you need to make sure that all of your pages in each group, whether that's the control and test group, they they kind of want to have similar levels of traffic, which is why you focus on these sort of same categories, types of pages, all like pages that are the same template, that kind of thing. So you really want to make sure they've got similar traffic levels. You don't want any sort of outliers, like maybe have sort of one page that's got sort of two thousand organic clicks, when the rest of them in that group have maybe seventy to eighty clicks, which is going to cause a bit of a sort of issue when you're analyzing the data later on. And with that being said as well.
8:40 Speaker 02 If you are a site that's got lower traffic as well, you can definitely still do these types of tests. You might just need to run tests for longer in order to get enough data to then try and make a statistically significant result. So yeah, focusing on the right type of or the right level of traffic and having similar traffic is is definitely the biggest one. And then, yeah, going back to what I said before about having similar tests, similar page templates. You don't necessarily want to try and compare landing pages to blog posts. So that because because they do different jobs and the user is going to interact completely differently. And then our kind of standard advice, what we give to our clients is try and have tests that run for kind of eight weeks.
9:24 Speaker 02 Seems to be the magic number is is what we've found. But if you're a higher traffic site, then you can shorten that timeframe if you need to. And then if if your pages are lower in traffic, then you might just need to extend that a bit. But eight weeks is about the average we try and focus on.
9:40 Speaker 01 Interesting. I I feel like that's a it's a great call out to it's like has to be the same type of page. So even if it's like, hey, well, we're updating like H ones and every page has an H one. So can we group them all? It's like, yeah, there's just way too many factors that are kind of different to kind of control. And it feels like through this, like some of the underlying like principles are being that we can't control every single factor. Control as many as we can. So then, you know, it may not be perfect or like a scientific test.
10:16 Speaker 01 And I feel like I can hear my the professor that was on my master's thesis for statistics, kind of like drilling me on this point. But like, yeah, we're not doing that. But it's also like, hey, this is, you know, we're not necessarily trying to publish like a scholarly reviewed journal like here. We're just more of trying to get the signal to then validate our assumptions to then make like a bigger like business change. Do you feel like there's any other missed assumptions or like any other elements that you feel like within the SEO industry is kind of like a false impression that we have as SEOs?
10:58 Speaker 02 Yeah, I think one of the biggest ones that I've seen recently is is that maybe you can test at any time, which is kind of maybe a book bear of mine because you can you can certainly test a lot of the year, but as we know, Google makes so many changes to their their algorithm. It's and this is why we focus on statistical significance because we want to make sure that the results that you get from any SEO tests that you're running come from the change you've made and not necessarily a sort of algorithm change that Google might have made. But one of the big ones I see is is people coming to us with results from tests and they say, oh, hey, look, we've got this really successful test because page clicks have gone up 200% based on this like tiny change that we've made. And then we go back in the data and we find that
11:42 Speaker 02 the test was run during like a core update that that Google have announced. And when stuff like that happens, it's it's really hard to analyze whether that's a Google change or it's a change that you've made, or it's a combination of both. So the advice we try and give out is if you are running any tests and then Google announces a core update, then you kind of have to disregard that and let the update run its course and and and see what happens because it's kind of impossible to take any learnings when that type of stuff happens, especially when it impacts a page that you're directly testing on.
12:18 Speaker 03 Time for a one minute break to hear from our sponsor, Previsible. So you're looking for SEO help? Then you got a couple of options. You could start replying to spam from agencies that claim they can get you to rank number one on Google. You can pay an hourly rate for a consultant who will inevitably nickel and dime you with hourly charges. Or you can work with a cookie cutter agency to quickly launch a strategy less project with low success rate. None of those sound very good, now do they? Well, that's where Previsible's integrated consulting model comes in. Previsible draws from a collective 40 years of SEO and digital marketing experience to unlock your Organic growth opportunities. They build custom solutions that combine strategy,
12:58 Speaker 03 technical expertise, content and reporting to effectively operationalize SEO for your business. Previsible's four-stage approach ensures that your SEO programs thrive by starting off with a strategy-first approach. Then they support you in your efforts to create quality content, help you identify technical issues, and most importantly, they'll work with your cross-functional teams to integrate your SEO strategies to make sure that your SEO budget actually drives results, not just your agency's bottom line. So join brands like Yelp, eBay, Canva, Atlassian, Square, all who rely on the SEO consultants at Previsible. For more information, go to previsible.io. That's previsible, P-R-E-V-I-S-I-B-L-E dot I O.
13:46 Speaker 01 That's such a great point, too, is bringing in the like ranking volatility where we know just since kind of like the most recent algorithm update, very long rollout, I believe in the ballpark of like 19 days or something around that. And then there's been kind of a little bit of these like tremors kind of coming from. So like taking those items into account. The other piece that I feel like we, or at least I kind of like skipped over in some of these questions is like the success KPIs. So we have like a few different that we can kind of look
14:25 Speaker 01 towards. Like we have impressions to, you know, given URL. We have traffic that's actually driving to the page. We could also have like rank tracking and using tools for that. What's kind of your opinion or stance on how like which KPIs that should be used to measure success?
14:46 Speaker 02 Yeah, that's kind of subjective because obviously every business is going to have have different goals with their their website. I mean, I worked agency side for a while and and we had clients that really, it seems weird to say as someone who's worked in SEO for nearly 10 years, but we had clients who like really didn't care about the levels of traffic that were coming to their site. Like, they'd be happy if if even 100 people came to their site. What they really focused on was how many organic leads they were getting. So in their particular case, it would be a successful test would be if more leads were generated from that page, following a change. But then you have obviously some clients that really want to, if it's especially if they're testing on blog posts and something like that, then they really want to go for higher rankings and more traffic, more impressions,
15:31 Speaker 02 better click through rates, that's kind of thing. So I think the the general rule to a thumb to kind of follow is if you are doing SEO tests, then you should be aware of the SEO metrics that are changing, whether that's impressions, click through rate, traffic, that kind of thing. And then you can add different things on as well as you and your business need to. So if it's a blog post that's that kind of converts well for you generally, then you might want to track conversion rates as well, or clicks to a specific call to action, that kind of thing. Especially when you're using software to do it, it's really easy to track the SEO metrics that do change. And then you can add on different KPIs that you need to on top of that.
16:11 Speaker 01 And I guess going back just a little bit earlier in the conversation, and I you mentioned, we're not going to get too much into these engagement areas. But I feel like nowadays, I mean, the DOJ trials, Google leaks, like, NAB booths is in our kind of like regular vocabulary at this point. Have you seen or are you like seeing people using more engagement metrics as like a KPI to measure like improvements on a webpage? Like, is that something that you're seeing is being brought into these tests as well, rather than kind of like the lagging response KPIs of like traffic?
16:55 Speaker 02 Yeah, yeah, definitely. That's something that we are seeing and not to talk too much about about SEO testing itself. But but one of the things that we allow customers to do is to track because like GA4 events as part of SEO tests. And I've definitely seen some examples of some of our clients directly tracking time on page and that kind of stuff with with their tests as well. So that which tells me that they're obviously making a change in the hope that it keeps users on the site longer and keeps users clicking about on their pages and that kind of stuff. And with the custom events that you can do in GA4, it's really easy to add in like a key event that you might want to say like for us.
17:36 Speaker 02 We have obviously if someone clicks to to start a free trial, then that's a key event for us. And we might do a test on a blog post and add in one of these CTAs. And we really want to focus on trying to get as many people as possible to to start trials. So yeah, we even so even ourselves, we're doing these types of tests as well. And one of our big sort of areas for that is we've been adding YouTube video embeds to our blog posts. Not necessarily for like, we think it'll make them rank better, but one of the things we have seen is it increases the time on page by knowing because obviously customers may come on and they'll watch a video rather than reading through the blog post and indirectly or directly.
18:16 Speaker 02 That's not necessarily for me to decide, but it helps the blog posts rank better as well and they perform better organically. And the only change we've made is we've added a video to the blog post.
18:26 Speaker 01 That's a that's a great call. It's like kind of those indirect ranking factors. Where it's like, yeah, we know meta descriptions alone isn't going to help like our relevancy to the page. But if we're able to influence click through rate, then that's going to influence rankings and then so on and so on. So we've kind of made the case for testing. We've talked about kind of like how to approach this. We don't control the world with an SEO. So we're trying to kind of limit that down to as few kind of variables as possible. Selection of pages are key. The last thing that I'd kind of want to to touch on here is revisiting tests.
19:11 Speaker 01 So we're living in this world that's quickly evolving. It's changing. Maybe something that we tested prior, you know, is going to shift as far as waiting or something. What's kind of your opinion or perspective on like revisiting tests? Is it a set it, forget it, great, let's move on? Or is there kind of more of a mindset of like, hey, yeah, especially on these kind of like fringe type tests? Let's go ahead and kind of like revisit them ever so often to ensure that that's still like a positive response.
19:49 Speaker 02 Yeah, for sure. It's definitely not a say and forget it type thing. And we definitely don't encourage people to sort of maybe get one successful test based on like a change. And then they'll say, okay, we know this works. Let's just do this forever because that's that's how marketers generally tend to ruin things for everyone. As it was just as as like a general rule, we see like in the past, you could like maybe buy a hundred links to a page and that shoots it up the rankings. And you go, okay, this is now going to be our strategy for for the next seventeen years until it doesn't work. But yeah, it's definitely not a say and forget it type thing. We always encourage going back to going back to tests and making the same changes that you've kind of made.
20:30 Speaker 02 Even if it's as short as like six months ago, because one of the or one of my favorite parts about SEO is is the fact that what works last week might not necessarily work this week. But but yeah, SEO testing is one of those things that you can kind of, you can use it to find out what works. And then you can, you can keep using it while it does work. And then when it inevitably doesn't work, something will change and and and strategies that you were using a year ago won't work. And then you can retest those types of things and reevaluate and use that to sort of inform on your strategy going forward.
21:03 Speaker 01 Excellent. And yeah, I completely agree with you that that sense of constantly shifting, evolving landscape that requires us to, you know, continue to also evolve and progress how we're thinking about it, what we're trying, what we're doing, is one of those like, kind of like, more fun aspects of the industry that we have here.
21:26 Speaker 02 Yeah, absolutely.
21:27 Speaker 01 And with that, that's going to wrap up this episode of the Voice of Search Podcast. Thanks again to Ryan Jones from SEO Testing for joining us in part two of this conversation, which is going to be published tomorrow. Ryan and I are going to be discussing succeeding against large companies with small budgets. If you can't wait until the next episode and you'd like to learn more about Ryan, go ahead and check out his LinkedIn profile in our show notes, or you can go ahead and contact him on X where his handle is at Ryan Jones SEO. And be sure to check out his company's website at seotesting.com.
22:04 Speaker 03 Okay. Thanks to Tyson Stockton, our guest host. If you'd like to get in touch with Tyson, you can find a link to his LinkedIn profile in our show notes. You can contact him on Twitter where his handle is Tyson underscore Stockton. Or if your team is interested in SEO consulting or organizational education, you can always head to their company's website, which is previsible.io. That's P R E V I S I B L E dot I O. Just one more link in our show notes I'd like to tell you about. If you didn't have a chance to take notes while you were listening to this podcast, head over to voicesofsearch.com where we have summaries of all of our episodes and contact information for our guests. You can also subscribe to our weekly newsletter and you can even send us your topic suggestions or your marketing questions, which we'll answer
22:45 Speaker 03 live on our show. Of course, you can always reach out on social media. Our handle is Voices of Search on LinkedIn, Twitter, Instagram, Facebook, or you can contact me directly. My handle is Ben J. Shap, B E N J S H A P. And if you haven't subscribed yet and you want a daily stream of SEO and content marketing insights in your podcast feed, we're going to publish an episode every day during the work week. So hit that subscribe button in your podcast app and we'll be back in your feed tomorrow morning. All right. That's it for today. But until next time, remember the answers are always in the data.
Previous The Increased Importance Of Video Marketing In Today's Economic Landscape Next Succeeding Against Large Companies With Smaller Budgets Page updated November 15, 2026 · transcript and summary are machine-generated