Google Search Needs A/B Testing Guidelines

Mar 29, 2018 - 7:45 am 1 by

Google Ab Testing

For years we've been covering questions around how to deal with A/B testing and Google indexing/crawling. Is it cloaking? Can it mess up your indexing? Will it hurt your rankings? All valid questions when you show multiple variations of your web pages to your users (including GoogleBot) just to see which variation has a better conversion rate.

John Mueller of Google addressed the question once again in the AMA he did at Reddit. Here is a summary of his recommendations, including understanding that Google needs to write up a document on this topic.

  • We need to write up some A/B testing guidelines
  • Treat Googlebot the same as any other user-group that you deal with in your testing
  • You shouldn't special-case Googlebot on its own, that would be considered cloaking
  • Sometimes it does fall into one bucket (eg, if you test by locale, or by user-agent hash, or whatnot), that's fine
  • A/B testing should have a limited lifetime
  • The pages should be equivalent (eg, you wouldn't have "A" be an insurance affiliate, and the "B" a cartoon series)
  • If you have separate URLs, make sure to set the canonical to your primary URLs
  • Googlebot doesn't store & replay cookies, so make sure you have a fallback for users without cookies.

Forum discussion at Reddit.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 16, 2025

May 16, 2025 - 10:00 am
Google Ads

Google's Pichai: Search Ads With AI Overviews Earn Same As Ads Without

May 16, 2025 - 8:50 am
Search Video Recaps

Search News Buzz Video Recap: Google Rethinking Search, Replacing Reddit, Search Console Annotations & So Much More

May 16, 2025 - 8:01 am
Google Maps

Google Maps 2024: 999 Million Reviews & 752 Million Photos / Videos Published

May 16, 2025 - 7:51 am
Apple App Store

Apple Maps Adds Insights, Ratings & Reviews From More Sources

May 16, 2025 - 7:41 am
Google

Google Working To Make It Easier To Share AI Overviews & AI Mode

May 16, 2025 - 7:31 am
Previous Story: Google Shows Summaries Of Top Stories In Search