Google Can Drill Into Search Quality Raters Results To Learn More

Mar 18, 2016 - 7:54 am 2 by

Google Drill

At SMX West a few weeks ago, during Paul Haahr's awesome presentation and Q&A, someone asked if Google can actually dig into the search quality rater's results. I believe Paul explained that when a quality rater result set shows a certain search result as being quality or not but the engineers don't necessarily believe it, they can dig deeper and see the details.

For example, let's say Google is testing a new ranking signal and overall it shows that the new ranking signal is working well. Google can then dig into the experiments run, see the queries they entered, check the results the raters rated and verify it was done correctly.

So they can not just see the macro level results but also dig deeper into the micro actions to see how the overall analysis came about.

Sometimes, Paul said, it makes you reconsider launching the new ranking signal because the quality raters were not exactly right.

Here are some tweets covering that part:

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 8, 2025

Jul 8, 2025 - 10:00 am
Google

Google AI Mode Shows Different Sources For The Same Query

Jul 8, 2025 - 7:51 am
Google Ads

Google Ads To Update Its Political Content Policy

Jul 8, 2025 - 7:41 am
Google Ads

Google Ads Editor Version 2.10 Is Out With 20 New Features

Jul 8, 2025 - 7:31 am
Google

Google AI Mode Follow Up Questions With Suggestions

Jul 8, 2025 - 7:21 am
Google

Google Search Rolls Out AI Mode In India Without Labs

Jul 8, 2025 - 7:11 am
Previous Story: Opt Out Of Google Feature Snippets With nosnippet Tag