A Google Quality Rater Interviewed

Jan 23, 2012 - 8:32 am 4 by

Google Quality RatersMatt McGee published An Interview With A Google Search Quality Rater this past Friday, it is the most detailed write up on a quality rater I have seen to date.

It goes through the various tasks, how they got the job, what interaction at all they have with Google and so on. Matt also posted the short version at Marketing Land:

  • Raters are only hired after passing two tests, the second of which includes rating more than 140 different Google search results and demands a 90 percent score in order to pass.
  • Each rating task is completed by multiple raters and, if they disagree in their ratings of Google’s search results, there’s a formal discussion and debate process that may involve higher-level moderators making the final decision on who’s correct.
  • Raters don’t only look at Google’s organic results, they may rate Google’s paid search results as well as search results from News, Maps and other Google “universal search” products.
  • Raters may also have tasks that involve grading the design and layout of specific web pages.
  • One of the key considerations in those tasks involves the balance between content and ads on a page. (That’s reminiscent of Google’s new page layout algorithm that was just announced on Thursday.)
  • Tasks are not tailored to the Rater’s skills or interests.

There is discussion on this interview on Matt McGee's Google+ page where some SEOs are diving into what they learned.

Forum discussion at Google+.

Image credit: Maxx-Studio / ShutterStock.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: March 26, 2025

Mar 26, 2025 - 10:00 am
Google Updates

Google March 2025 Core Update Volatility Heats Up At Tail End Of Update

Mar 26, 2025 - 7:55 am
Google Ads

Google Ads Different Auctions Locations May Impact CTR & Impression Rates

Mar 26, 2025 - 7:51 am
Google Search Engine Optimization

Google: Poor Pingdom Score Does Not Affect Your SEO

Mar 26, 2025 - 7:41 am
Google

Google Expands AI Overviews To More EU Regions

Mar 26, 2025 - 7:31 am
Google Ads

Google Ads Support New Get A Call Option & Text Help

Mar 26, 2025 - 7:21 am
Previous Story: New Improved Download Options For Google Webmaster Tools