Matt Cutts: Split Testing Is Approved By Google

May 7, 2012 - 8:32 am 1 by

Google testingA thread at HackerNews has Google's Matt Cutts defending itself over accusations that a split A/B test has allegedly caused Google to delist a site from the search engine.

The site claimed that when it added a split test, Google issued a warning that the site has been compromised and removed the site from the index. The truth is, the split test had nothing to do with it - the site was indeed compromised and because of that, Google had to secure the search results and remove the site from the index.

Google's Matt Cutts over the weekend replied to the thread saying:

There's a simpler explanation, which is that the site really was hacked as we claimed. Here's an example cached page that we crawled on May 2nd.

I count the name of one drug repeated over 100+ times.

I've been quite clear that there's nothing wrong with A/B testing. In fact, less than a month ago I tweeted that "A/B testing can be really helpful" and included a link to best practices: https://twitter.com/#!/mattcutts/statuses/191658511149711360

After more questions, Cutts even gave more details:

- some pages on the domain were definitely hacked across multiple pages for weeks.

- we detected hacked pages on the site both manually and algorithmically based on our hacked site classifier.

- we sent a message via the webmaster console on May 5th to alert the site owner so they'd have a heads-up.

- it looks like this has nothing at all to do with A/B testing (which as I've said before is perfectly fine to do).

So A/B or split testing or other forms of testing web sites is okay by Google as long as you don't test GoogleBot or don't treat GoogleBot differently.

Forum discussion at HackerNews.

Image credit to ShutterStock for testing images

 

Popular Categories

The Pulse of the search community

Google Search Volatility

More Details

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: June 4, 2026

Jun 4, 2026 - 10:00 am
Google Ads

Merchant Center Expands Attribute Rules To Automatically Found Products

Jun 4, 2026 - 7:51 am
Google Search Engine Optimization

June 2026 Google Webmaster Report

Jun 4, 2026 - 7:41 am
Bing SEO

Microsoft: Bing Webmaster Tools AI Reporting To Gain New Features Soon

Jun 4, 2026 - 7:31 am
Google Ads

Google Merchant Center Mass Product Page Unavailable Notices Last Night?

Jun 4, 2026 - 7:21 am
Bing Ads

Bing Tests Larger Favicons For Top Sponsored Ads

Jun 4, 2026 - 7:11 am
 
Previous Story: Google's Next Update To Be Named Panther?