Search Cookie

Search vs Cookie Based Experiment Campaigns: What’s The Difference?2 min read

You’ve decided to go ahead with an A/B test and launch an experiment campaign on Google Ads.

After following Google’s latest experiment campaign changes, you’ll almost be ready to launch your experiment, until….

You’re faced with a choice of ONE experiment split option; Search-based, or Cookie-based.

In this editorial, we’ll briefly explain each option, as well as which is right for your campaigns.

What is a Search-based experiment split?

A Search-based split will randomly show the ads of one version of the campaign each time a search occurs.

This means that if a user makes the same search more than once, they could see ads for both versions of the campaign.

Search-based splits tend to see statistically significant results faster than a cookie-based split.

What is a Cookie-based experiment split?

A Cookie-based split will randomly assign users to one version of the campaign.

This means a user will only ever see ads from one version of the campaign, regardless of how many times they repeat the search.

This can help give more accurate results, making it Google’s recommended (and default) experiment split option.

Which campaign experiment split should I choose?

Both Search-based and Cookie-based experiment splits have their uses.

If you’re looking for significant results faster, opt for a Search-based split.

Search-based splits tend to gather more data in a shorter amount of time, due to their ability to show both types of ads to the same user who has searched more than once.

This is great for those who wish to see results sooner, but it results in the split being less accurate. 

Search-based splits are acceptable for some experiments, such as testing different bid strategies.

However, if you’re looking for a more controlled, accurate experiment, opt for the Cookie-based split.

Cookie-based splits will ensure that your split is as fair as possible, by only showing one variation to each user (made possible by the technology cookies provide).

If you’re running an experiment to test different landing pages or offers, you’ll want to choose cookie-based.

This will ensure the same user isn’t exposed to both offers/landing pages.

Sam Pilgrim

A one-man marketing machine, Sam is a heavenly combination of natural PPC skills and street smarts. Known beyond the world of pay per click for his impeccable taste in fashion, and his friendship with the world’s biggest rappers…