How Testing in Marketing Fuels Innovation - Harnessing Experimentation to Drive Results

Today we are discuss the art of experimentation and conversion rate optimization with AJ Davis, the founder of Experiment Zone. In our conversation, we reveal how strategic testing can deliver great results.

We emphasize the importance of tapping into the wealth of knowledge within your organization and from your customers, using experimentation as a powerful tool to navigate the often costly landscape of digital advertising.

Join us as we explore how adopting an experimental mindset can be a game-changer for resolving team conflicts and validating diverse opinions within your marketing squad. AJ and I share personal anecdotes that highlight the unexpected outcomes of testing, which often challenge our preconceived notions and deepen our understanding of customer behavior. While not every idea might be test-worthy, the nuggets of wisdom gleaned from a strategic testing approach can significantly refine your marketing strategies. To dive deeper into these concepts and gather more expert advice, be sure to check out AJ's website.

Transcript

WEBVTT

00:00:03.162 --> 00:00:04.884
Welcome to today's episode.

00:00:04.884 --> 00:00:06.947
Today, we have an exciting topic.

00:00:06.947 --> 00:00:22.310
We are talking about experimentation in marketing, conversion rate optimization and how to get the full potential out of your website, and we have the perfect guest to help us talk through this today AJ Davis.

00:00:22.310 --> 00:00:22.952
Welcome to the show.

00:00:23.879 --> 00:00:24.682
Hey everybody.

00:00:24.682 --> 00:00:25.646
Eric, thanks for having me on.

00:00:28.000 --> 00:00:31.408
Do you run a company called the Experiment Zone?

00:00:31.408 --> 00:00:34.081
It's like the Twilight Zone, but so much better, right?

00:00:35.966 --> 00:00:40.822
It took us a while, we had to experiment with some different names, but yeah, it's really that's what we do.

00:00:40.822 --> 00:00:45.912
We help people figure out what experimentation is all about and how it can drive revenue for their company.

00:00:48.801 --> 00:00:50.759
Excited to talk about experimentation.

00:00:50.759 --> 00:00:59.215
I think in my years as a marketing leader I've been amazed on the impact that experimentation can have.

00:00:59.215 --> 00:01:10.215
Some of the companies that I've led marketing teams at at any one time we were running hundreds of experiments per year and it was pretty exciting to see what the results of these things were.

00:01:10.215 --> 00:01:15.772
And, to my amazement, once or twice I was wrong when I'd bet on the Akron level test.

00:01:15.772 --> 00:01:20.289
Just once or twice, not too often, but we're ready to be inspired.

00:01:20.289 --> 00:01:22.694
Can you share a story with us?

00:01:34.564 --> 00:01:36.025
about some of the best marketing you've done.

00:01:36.025 --> 00:01:40.307
The marketing and most product related to this topic of experimentation and testing.

00:01:40.307 --> 00:01:44.368
We've been running tests for a client for a while and we were trying to improve a landing page.

00:01:44.368 --> 00:01:52.612
So this is a pretty typical marketing experience where we're running ads Somebody's running ads, not us bringing traffic to a site and we're trying to connect with that audience.

00:01:52.612 --> 00:01:54.733
So the question is what do they need?

00:01:54.733 --> 00:01:56.575
What do they need to know about the company?

00:01:56.575 --> 00:01:58.355
How much information do they need?

00:01:58.956 --> 00:02:12.043
And we decided to take what was a very lengthy, well-informed page that the team had built, that the company had built, and we decided to tear it up and do something different.

00:02:12.043 --> 00:02:12.644
So very rarely do I do this.

00:02:12.644 --> 00:02:15.110
I almost always do incremental changes, but the incremental changes didn't move the needle.

00:02:15.110 --> 00:02:24.694
So we decided to take a big swing and we went in-house and interviewed a bunch of their frontline sales team to figure out what it is that they say to close the deal.

00:02:24.694 --> 00:02:30.510
What is the final thing they say to get people to sign on the dotted line and generate revenue for the company.

00:02:30.510 --> 00:02:34.026
And then we took that word for word and put that on the landing page.

00:02:34.026 --> 00:02:36.032
So like, why us and why now?

00:02:36.032 --> 00:02:41.883
And so it turned out, the things that closed the sale were also the things that got people interested in it in the first place.

00:02:43.987 --> 00:02:46.432
Wow, I love this story for so many reasons.

00:02:46.432 --> 00:03:00.332
You know, marketing, taking some messaging tips from sales is always a good strategy, but particularly putting it on the landing pages is brilliant.

00:03:00.332 --> 00:03:25.924
It reminds me of one time when I actually had the salespeople sit next to the online marketing people, and so the online marketing people could overhear the discussions of the inbound leads as they were coming in, and they then worked together through kibitz, talking to each other and overhearing each other's conversations, to improve the pages, and this is very similar to that.

00:03:25.924 --> 00:03:38.042
So I've seen this work really well and I think that's great, and the impact of doubling the conversion rate that's really the dream of these tasks related to landing pages, right.

00:03:39.224 --> 00:03:40.247
A dream, yeah, I mean.

00:03:40.247 --> 00:03:44.282
I'm always proud when anything's a 30% lift, let alone doubling.

00:03:44.282 --> 00:04:02.830
So it is something that it's often an incremental journey to learn what works and what doesn't with people and to just overnight, like one big switch, change how we're connecting with people and then layer back in what additionally might have mattered and have that be what's iterative, then iteratively removing or reorganizing information.

00:04:02.830 --> 00:04:27.490
So I feel really proud of this particular test because my background's in qualitative research and I always think you can learn from the experts you have in-house who are maybe your customer representatives or just directly your customers, if you can access them, and our best tests come from pulling in those insights and learning from it and not just guessing come from pulling in those insights and learning from it and not just guessing.

00:04:27.529 --> 00:04:42.088
More important today than ever before, when advertising on sites like Google is more expensive than ever, like some of the campaigns that I've been working on in recent times $40 a click for competitive keywords.

00:04:42.088 --> 00:04:50.435
So when you're paying that much just to get people to a landing page, converting everyone who gets there, or as many of them as you can, it's money, right.

00:04:50.435 --> 00:04:56.766
Like it's, you're wasting money if you don't do things like this to try to increase the conversion rate right.

00:04:57.507 --> 00:05:01.490
Yeah, I always tell people they say when is it time to start testing, Like, well, how much traffic do I need?

00:05:01.490 --> 00:05:02.173
What's important?

00:05:02.173 --> 00:05:15.480
And I say, if you're not considering your conversion strategy, if you're like, if you're paying for ads or you're paying for SEO and you're not having an equivalent investment and in CRO, you're losing out on all that potential revenue.

00:05:15.480 --> 00:05:22.939
Right, If you connect with one percent of people or we can bump that up to one and a half percent of people that makes a huge difference to businesses.

00:05:24.985 --> 00:05:31.038
Yeah, it's almost like you're wasting money if you're not doing these experiments right to get better results.

00:05:31.038 --> 00:05:38.386
It's almost like you're laying money on fire is the way that people have talked to me about this in the past.

00:05:38.386 --> 00:05:51.600
So tell us, when you are helping clients do this sort of experimentation, what are some of the keys to running good tests and experiments?

00:06:28.185 --> 00:06:38.911
no-transcript version and a paid version that had some extra stuff on it.

00:06:38.911 --> 00:06:51.713
And we had their trust to run a test where we got rid of the middle option, because a lot of psychological research says three is better, and so we said that could be true, but let's see if it's true for your audience.

00:06:51.713 --> 00:06:56.367
And in removing an option, we simplified the decision and more people signed up.

00:06:56.367 --> 00:07:09.456
And so it's this evolution of not just saying here's what the best practice should be for this business problem or here's like what the books say, but actually going into the wild and testing what actually happens with your visitors.

00:07:09.456 --> 00:07:12.651
And so to come back to your question, like what is it?

00:07:12.651 --> 00:07:14.641
Where should you be doing testing?

00:07:14.641 --> 00:07:18.836
It should be everything, but it should absolutely be your most important business decisions.

00:07:20.805 --> 00:07:31.937
Yeah, that makes a lot of sense, and this whole conversion rate optimization optimization theme is a science right.

00:07:31.937 --> 00:07:37.002
What is the hardest thing about doing this with clients?

00:07:39.168 --> 00:07:43.997
I think it's a science and an art, and where the art is is what's maybe harder, right?

00:07:43.997 --> 00:07:47.591
So it's easy to measure the variance between the two.

00:07:47.591 --> 00:07:50.550
Things so like did this thing do better than this thing, yes or no?

00:07:50.550 --> 00:07:51.875
Pretty straightforward.

00:07:51.875 --> 00:07:52.519
You can dig into the details.

00:07:52.519 --> 00:07:54.004
Things so like did this thing do better than this thing, yes or no?

00:07:54.004 --> 00:07:56.107
Pretty straightforward.

00:07:56.107 --> 00:07:57.011
You can dig into the details you can take.

00:07:57.011 --> 00:08:00.004
You can have a deeper understanding of what happened, and there's some complexity there, but it's not hard.

00:08:00.805 --> 00:08:03.555
I think the stuff that's hard is knowing that you're testing the right thing.

00:08:04.404 --> 00:08:21.014
So what I like to think about is like if you know what your business goal is like a higher conversion rate or to have a bigger basket size, or to get more signups and you know what the problems are, we can be very confident in what your problems are by doing user research and digging into the data.

00:08:21.014 --> 00:08:26.913
The actual solutions of how you solve those problems are better if you take a couple swings at it.

00:08:26.913 --> 00:08:29.694
So I'm not gonna tell you a red button's better than blue.

00:08:29.694 --> 00:08:43.395
I'm not gonna tell you that three options is better than two or vice versa, or that your product should be a super dense version or give us lots of detail Because in reality, like it's not going to really move the needle on us if we don't know what problem it's solving.

00:08:43.395 --> 00:08:46.326
So the hardest thing is to get clients to focus on.

00:08:46.326 --> 00:08:50.307
Let's stop and think about the problem instead of like what the solution will look like.

00:08:50.307 --> 00:08:54.208
We need to know what we're solving for in order to make a big revenue difference.

00:08:54.208 --> 00:08:56.049
It's a world.

00:08:57.691 --> 00:09:09.485
Top couple things that you recommend to anybody who wants to run these sorts of experiments to get better results from their advertising and from their website.

00:09:09.485 --> 00:09:14.840
You're sitting down with coffee and just telling people the two or three things you've got to do.

00:09:14.840 --> 00:09:16.403
Yeah, what would this be?

00:09:17.571 --> 00:09:19.575
Give it enough time, get enough data.

00:09:19.575 --> 00:09:29.719
A lot of people pull the plug because they see some early data that shows like this is such an exciting result, but you only have like 20 people in it, so it's not actually pointing you in a clear direction.

00:09:29.719 --> 00:09:35.519
So give it time, make sure you have enough data in the data set to make it a confident decision.

00:09:35.519 --> 00:09:47.511
I like to recommend thinking about changes that are visible, so things above the fold, especially mobile, is a good direction to look Like.

00:09:47.511 --> 00:09:49.395
What should be on your screen on mobile before you do anything else.

00:09:49.395 --> 00:09:51.600
It's a good question Is it too complicated or is there a way to simplify it?

00:09:53.143 --> 00:10:00.479
And then I think, like thinking through the journey and what information might get lost from the beginning to the end is another piece.

00:10:00.479 --> 00:10:08.714
So very often you'll see a website where on the homepage you'll say here's what we do, here's the problem we solve, but then they forget to tell people that later on.

00:10:08.714 --> 00:10:16.080
So something we'll often do is say like let's make sure everybody knows about your free shipping policy and your free returns everywhere they go.

00:10:16.080 --> 00:10:17.611
So what is that thing?

00:10:17.611 --> 00:10:21.982
Everyone needs to know continuously in the funnel to feel confident in converting.

00:10:28.309 --> 00:10:30.014
So those would be like the three types of things I'd point people to love.

00:10:30.014 --> 00:10:43.504
These ideas and experimentation really applies to your, your website, but broadly all of the channels of of advertising right landing pages, google advertising, but also other marketing channels too, right.

00:10:44.509 --> 00:10:47.417
Yeah, absolutely my favorite partner.

00:10:47.417 --> 00:11:06.320
So we don't do any advertising or email testing or anything like that, but we have partners who do, who work with our clients, and my favorite thing is when we get to share with those partners the data we get and the data they get, because the more experimentation a company is doing or a marketing team is doing across the board, the more those things should layer together and be informative.

00:11:06.320 --> 00:11:09.875
So the copy that works in your email to get a click should also be copied.

00:11:09.875 --> 00:11:18.014
That might work on your landing page to get a click, and so making sure you're getting thematic takeaways as well as like specific here's what worked in, here it's what didn't.

00:11:19.519 --> 00:11:27.493
That's great If people want to learn more about how to be a great experimenter.

00:11:27.493 --> 00:11:30.240
What resources do you recommend?

00:11:30.942 --> 00:11:40.114
I think there's a lot of ways to learn about being an experimenter right, there's lots of books you could read, but I think the most important thing is to like start thinking of things as an experiment.

00:11:40.114 --> 00:11:48.974
So I would actually point people to this philosophy I take across my business, which is to think about everything as an experiment and to write it down.

00:11:48.974 --> 00:11:55.818
Here's the hypothesis If this thing works, this is what results we'll see, and if it doesn't work, then this is like.

00:11:55.818 --> 00:12:11.320
Then we won't see that, and then pull the plug on stuff if it doesn't work, because a lot of times, marketing teams, ceos, entrepreneurs all sorts of people start just layering stuff in on top of each other and they don't have a mechanism for evaluating did it work or not?

00:12:11.320 --> 00:12:25.985
So rather than saying like go read this book or go install this tool, I would say start thinking about any choice you have to make in the future as an opportunity to collect data and define what data you'll need to collect to know if it worked or not.

00:12:27.225 --> 00:12:34.000
I like that and actually some of the most controversial things in marketing that I've dealt with.

00:12:34.000 --> 00:12:54.620
Over the years, the way to solve the conflict has been let's test it, let's test things and everything to your point doesn't make sense as a test, but a lot of things do, and it's often a great way, if people have differing opinions, gather data and prove it.

00:12:54.620 --> 00:13:02.100
I think there are some tests that I'm like that's a ridiculous test and some there are ridiculous tests that you probably shouldn't run.

00:13:02.100 --> 00:13:18.736
But I think there are many, many good tests and I've been shocked more than once when my hypothesis was completely wrong, because the buyers just thought about things differently and I was just like I can't believe it.

00:13:18.736 --> 00:13:20.115
But it happens, right.

00:13:20.115 --> 00:13:30.284
I like the mantra of have thought process around experimentation and have a hypothesis and measure the data.

00:13:30.284 --> 00:13:32.116
I think that's really great.

00:13:32.116 --> 00:13:40.224
I'm going to link to your website so people can check it out and get in touch with you if they'd love to learn more about this topic.

00:13:40.224 --> 00:13:42.591
Really appreciate you being with us today.

00:13:42.591 --> 00:13:43.472
Thank you so much.

00:13:44.214 --> 00:13:45.154
Thanks, eric, it was a lot of fun.

How Testing in Marketing Fuels Innovation - Harnessing Experimentation to Drive Results

Listen On

Recent Episodes

Business Episodes

Marketing Episodes

Branding Episodes

Product Marketing Episodes

Apple Episodes

Product Management Episodes

Canada Episodes

Digital Marketing Episodes

Advertising Episodes

Online Advertising Episodes

First Party Data Episodes

Social Media Episodes

Facebook Advertising Episodes

SEO Episodes

Australia Episodes

Email Marketing Episodes

Personal Branding Episodes

Executive Branding Episodes

Customer Marketing Episodes

Customer Loyalty Episodes

Browse episodes by category