Google: We Tests By Redirecting A Small Percentage Of Traffic, Not Setting Up Test Sites

Apr 8, 2016 - 8:15 am 12 by
Filed Under Google

google test tubes

In a live Google hangout with John Mueller this morning on Google+, John said that Google doesn't set up test sites for the most part to test and experiment with the search results. Instead, they test on a small percentage of live users, like 1% or so, so they can collect the data in a real world experiment.

Truth is, most of you know this is how Google works.

The question came in at the 10:15 minute mark:

Googlers regularly talk about experimenting with algorithm changes on live. Is there a test set of sites used, who does the testing (real serps observed, testers, bots?) and what is the impact on sites involved in testing?

John said:

In general, we don’t have a limited set of test sites for something like this. It is because the web is evolving all the time. So we try to do things like 1% launches to see what happens when we redirect a small portion of the traffic to a specific change. We try to run experiments across pretty much all users to see how the general reaction is to these changes.

So it is not really limited to a number of sites because I think that would artificially skew a little bit if there was this kind of fixed set of sites that everything is judged against.

Again, this isn't really new but maybe, just maybe what we saw earlier this week with a potential Penguin launch was just a small limited test.

You can watch the video here:

Forum discussion at Google+.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 7, 2025

Jul 7, 2025 - 10:00 am
Google

Google Says AI Mode Rolling Out To Workspace Accounts

Jul 7, 2025 - 7:51 am
Google Search Engine Optimization

Cloudflare: We Will Get Google To Provide A Way To Block AI Overviews

Jul 7, 2025 - 7:45 am
Google Ads

Google Keyword Planner Update Gives Breakdown By By City, Region & Device/Platform

Jul 7, 2025 - 7:41 am
Google

Google Tests Low, Typical, High Price Labels In Search Result Snippets

Jul 7, 2025 - 7:31 am
Google Maps

Google Business Profiles Reverification After Suspensions Increasing?

Jul 7, 2025 - 7:21 am
Previous Story: Google Removes My Business iOS App From App Store After Serious Bug