Google Shares Information About its Human Search Evaluators

Sep 16, 2008 - 10:18 am 4 by
Filed Under Google

As we know, algorithms are very powerful in influencing the search results. However, we also know that Google has human evaluators -- thousands, in fact. In a recent blog post on the Official Google Blog, one of Google's engineering directors shed some light into the role of human evaluators. The relevant piece of information is here:

Google makes use of evaluators in many countries and languages. These evaluators are carefully trained and are asked to evaluate the quality of search results in several different ways. We sometimes show evaluators whole result sets by themselves or "side by side" with alternatives; in other cases, we show evaluators a single result at a time for a query and ask them to rate its quality along various dimensions.

Tedster at WebmasterWorld is pretty interested in these results; the fact that human evaluators actually look at results side by side to help improve the quality of its search results is pretty reassuring.

Forum discussion continues at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 8, 2025

Jul 8, 2025 - 10:00 am
Google

Google AI Mode Shows Different Sources For The Same Query

Jul 8, 2025 - 7:51 am
Google Ads

Google Ads To Update Its Political Content Policy

Jul 8, 2025 - 7:41 am
Google Ads

Google Ads Editor Version 2.10 Is Out With 20 New Features

Jul 8, 2025 - 7:31 am
Google

Google AI Mode Follow Up Questions With Suggestions

Jul 8, 2025 - 7:21 am
Google

Google Search Rolls Out AI Mode In India Without Labs

Jul 8, 2025 - 7:11 am
Previous Story: The Various Personalities at Sphinn