Search incrementality: How paid and organic work together for better performance

“When people tell me they can pause SEM and be fine with their performance on the holistic level on their site with just the organic listings, how do I react?” Jonathan Kagan, VP of search at 9Rooftops said at SMX Next, “First of all, no, absolutely not — unless your name is eBay, which is one of the few brands that have proven that they can do it without that, it’s not going to work for you.”

When the assumption is that your organic rankings are strong enough to keep traffic stable, some brands may be tempted to cut back on paid campaigns to save money. As Kagan mentioned, that can be true for brands that are household names, but for most queries, the search results page will show a variety of domains and paid search ads can increase the amount of real estate a brand takes up on the page.

“So, it’s essentially the concept of if you see it enough times, you’re more likely to go to one [brand] than the other,” he explained. To help brands better understand what’s driving their search marketing, Kagan shared a case study about search incrementality and the steps he uses to evaluate the impact of paid campaigns working in tandem with organic efforts.

Paid and organic: More than the sum of their parts

“Assume your organic listings are operating by themselves,” Kagan said as an example, “There is no paid search present and it produces 100 visitors to your website.” 

“Now, assume that you have paid search — SEM is running by itself for various keywords and you have absolutely zero organic presence and that drives 100 visitors,” he continued, noting that this scenario is more realistic for non-brand keywords.

“Theoretically, when the two of them are together, paid search and organic together should deliver 100 visitors because they’re both present for the same queries. What we actually see, however, is a degree of incrementality where it will actually exceed the original expected 100 visitors,” he said, pointing to studies by Melissa Mackey and Anindya Ghose and Sha Yang that show degrees of incrementality.

Image: Jon Kagan.

Kagan followed up this hypothetical scenario with his own case study, in which his client, a mid-sized DTC brand, inadvertently had its Google Ads account abruptly halted.

smx_next_jon_kagan_s31-800x450-1 Search incrementality: How paid and organic work together for better performance
Image: Jon Kagan.

“What theoretically should have happened is if everything that we trigger for on paid search was the same that we trigger for on organic — we have really good organic rankings — then the 23% of visits that were on the organic side should rise to 42% to 46%,” he said, “What happened in reality? Instead, it only reached 36%.” 

smx_next_jon_kagan_s33-800x450-1 Search incrementality: How paid and organic work together for better performance
Image: Jon Kagan.

“Basically what happened was organic Google could not pick up all the visits to the site — it could not pick up all the transactions simultaneously,” he said. However, upon relaunching his client’s paid search efforts, the data returned to near-identical, pre-test levels.

How to assess your paid search incrementality

Kagan presented a straightforward approach to understanding the value of your paid search incrementality.

First, marketers must establish a benchmark by reviewing relevant KPIs (such as users, sessions or conversions) according to channel (paid or organic). “I recommend doing Bing/Yahoo organic plus Bing SEM as one entity or Google SEM and Google organic as an entity,” he said, referring to the breakdown of metrics by channel and source.

The next step is to begin the test by pausing your paid search efforts. You’ll want to suspend your SEM campaigns for one to three weeks, Kagan recommended.

smx_next_jon_kagan_s43-800x450-1 Search incrementality: How paid and organic work together for better performance
Image: Jon Kagan.

During the test, it’s important to continue tracking all of the same metrics, both for organic and paid. Even though SEM metrics will likely be gone, keeping an eye on them can ensure the quality of your test results. Note any substantial changes to your metrics relative to the pre-test baseline.

After your test period, return to your normal operations by resuming your paid campaigns. Allow your organic and paid efforts to continue as usual for the same amount of time as the test period before evaluating your results: “So if you run this test for three weeks, then don’t evaluate your data until three weeks post-test,” Kagan said.

Finally, you’re ready to compare your test and post-test metrics with your benchmarks to get an overview of what performance is like without paid ads, along with the proportion of your clicks and conversions, for example, that your paid efforts are actually responsible for.

smx_next_jon_kagan_s50-800x450-1 Search incrementality: How paid and organic work together for better performance
Image: Jon Kagan.

For brands that don’t see a significant decrease in their important business metrics after pausing paid campaigns, it may be worthwhile to scale back and let organic do the heavy lifting. However, that’s just simply not the case for the majority of businesses, “So there is a definite need to run organic and SEM in conjunction together for a degree of incrementality and a degree of protection,” Kagan said.

Watch the full SMX Next presentation here (free registration required).

New on Search Engine Land

About The Author

GeorgeNguyen-lg-6 Search incrementality: How paid and organic work together for better performance

George Nguyen is an editor for Search Engine Land, covering organic search, podcasting and e-commerce. His background is in journalism and content marketing. Prior to entering the industry, he worked as a radio personality, writer, podcast host and public school teacher.

RECOMMENDED POSTS

Find Out More

Marketing Tips You Need

Keep In Touch

Quick Subscribe

Client Reviews Tell The Tale.

Jillissa CooperOctober 31, 2024
Paul GrewSeptember 25, 2024
Nicole NoblesApril 18, 2024
Dan was a delight to work with. I needed a few headshots taken for my LinkedIn profile and Dan provided the easiest and most comfortable experience using state-of-the art equipment in a very professional setting. Also, the turn-around time on results was quick and I felt completely engaged and satisfied during the entire process. I highly recommend his services.Donny RitcharoenDecember 19, 2023
I got headshots taken and they turned out so well! The lighting was amazing.Tessa ChanMay 30, 2023
We used Appture to build a lodging website, and they were awesome! Dan went above and beyond to show us the functions and make all of our changes. Appture is our go to for web design from now on!Abigail HaleOctober 26, 2022
Appture knows their business and will go the extra mile for their customers. They do high quality work and provide great ongoing support.Chris McCorkindaleMay 24, 2022
Anita CauthornMay 24, 2022
It’s so rare in these times to find one man with so much wow factor and more rare to find men with similar interest and passion in their life journey as myself . Dan Elliott has been introduced to many in what is now considered as the Terror Dome , a place where many dreams are not deferred they are detoured to routes that lead to dead ends , he comes in full of optimism so infectious that he, maybe with out knowing is energizing those who have ventured where others would fear going with just the right jolt to forge on in the way of helping fallen humanity … His various fields of expertise has helped many in my region and I can only imagine the number he has effected beyond those I know … from day one I knew “ this was a man of kindred spirit “ Dan Elliott is a Gem and adds glimmer to things he touches … I’m a Witness ….and eternally grateful….L.Rashaan RichMay 21, 2022
Dan and his group are highly capable and knowledgeable. They work fast and get the job done. I highly recommend Appture.Justin FrankMarch 26, 2022
They are highly specialized in their work and constantly seek innovation.Ismail YenigulMarch 14, 2022
Dan is a marketing wizard. Honest, Experienced and a read deal. I am blessed to have him in my journey online :) Highly recommended.Sabbir HasanMarch 7, 2022
So much to say. Creative, Intelligent, Talented, Limitless, Affordable. It's amazing what these guys can do.Hack mackMay 17, 2019
We'd used some other agencies before, but man, they simply knocked us all over. After being in business for 30 years, I wonder how much more business we'd be doing if we'd hired them earlier.Rebecca HoneaMay 17, 2019