Google Has 10,000 Human Evaluators?

Jul 10, 2007 - 7:44 am 9 by

In the Seattle Conference on Scalability, Google's Marissa Mayer was asked a question where she revealed that Google has 10,000 human evaluators that manually go through the search results and rate them.

You can find coverage of this keynote at Dare Obasanjo's blog.

Q: How do they tell if they have bad results?

A: They have a bunch of watchdog services that track uptime for various servers to make sure a bad one isn't causing problems. In addition, they have 10,000 human evaluators who are always manually checking the relevance of various results.

We have reported about Google's Human Touch and people finding trails of these humans reviewing their sites in the past. But to have 10,000 human evaluators! That seems a bit large.

Most people agree that the 10,000 number sounds large. The question is, does this include internal Google staff that have this rater hub evaluation software installed on their machines?

Forum discussion at WebmasterWorld.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Core Update Coming, Ranking Volatility, Bye Search Notes, AI Overviews, Ads & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 19, 2024

Jul 19, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Core Update Coming, Ranking Volatility, Bye Search Notes, AI Overviews, Ads & More

Jul 19, 2024 - 8:01 am
Google Search Engine Optimization

Billions Of Google URLs Will No Longer Work

Jul 19, 2024 - 7:51 am
Google Search Engine Optimization

Google: ccTLDs & Language Do Help You Rank A Little Better In Local Country Region

Jul 19, 2024 - 7:41 am
Google Search Engine Optimization

Google's On Knowing If Your SEO Team Is Doing Their Job

Jul 19, 2024 - 7:31 am
Google Ads

Google Merchant Center Next Gains Support For Supplemental Feeds

Jul 19, 2024 - 7:21 am
Previous Story: Search Marketing Commercial Airs on CNBC