A Google Quality Rater Interviewed

Jan 23, 2012 - 8:32 am 4 by

Google Quality RatersMatt McGee published An Interview With A Google Search Quality Rater this past Friday, it is the most detailed write up on a quality rater I have seen to date.

It goes through the various tasks, how they got the job, what interaction at all they have with Google and so on. Matt also posted the short version at Marketing Land:

  • Raters are only hired after passing two tests, the second of which includes rating more than 140 different Google search results and demands a 90 percent score in order to pass.
  • Each rating task is completed by multiple raters and, if they disagree in their ratings of Google’s search results, there’s a formal discussion and debate process that may involve higher-level moderators making the final decision on who’s correct.
  • Raters don’t only look at Google’s organic results, they may rate Google’s paid search results as well as search results from News, Maps and other Google “universal search” products.
  • Raters may also have tasks that involve grading the design and layout of specific web pages.
  • One of the key considerations in those tasks involves the balance between content and ads on a page. (That’s reminiscent of Google’s new page layout algorithm that was just announced on Thursday.)
  • Tasks are not tailored to the Rater’s skills or interests.

There is discussion on this interview on Matt McGee's Google+ page where some SEOs are diving into what they learned.

Forum discussion at Google+.

Image credit: Maxx-Studio / ShutterStock.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google AI Overviews, Ranking Volatility, Web Filter, Google Ads AI Summaries & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 22, 2024

May 22, 2024 - 10:00 am
Google Updates

Google Search Ranking Volatility Spike Around May 22

May 22, 2024 - 8:01 am
Google Ads

Google Ads In AI Overviews, AI Shopping Ads, Brand Profile Ads & More AI Ad Tools

May 22, 2024 - 7:51 am
Google Search Engine Optimization

Google & Bing Say Upgrade To WordPress 6.5 To Gain Lastmod Sitemap Support

May 22, 2024 - 7:41 am
Google Search Engine Optimization

Unusual Surge In Google Search Console Product Snippets Search Performance

May 22, 2024 - 7:31 am
Bing Search

Bing Search Testing Tag Filters

May 22, 2024 - 7:21 am
Previous Story: New Improved Download Options For Google Webmaster Tools