Google Can Drill Into Search Quality Raters Results To Learn More

Mar 18, 2016 - 7:54 am 2 by

Google Drill

At SMX West a few weeks ago, during Paul Haahr's awesome presentation and Q&A, someone asked if Google can actually dig into the search quality rater's results. I believe Paul explained that when a quality rater result set shows a certain search result as being quality or not but the engineers don't necessarily believe it, they can dig deeper and see the details.

For example, let's say Google is testing a new ranking signal and overall it shows that the new ranking signal is working well. Google can then dig into the experiments run, see the queries they entered, check the results the raters rated and verify it was done correctly.

So they can not just see the macro level results but also dig deeper into the micro actions to see how the overall analysis came about.

Sometimes, Paul said, it makes you reconsider launching the new ranking signal because the quality raters were not exactly right.

Here are some tweets covering that part:

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: October 4, 2024

Oct 5, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Ranking Volatility Record, Forbes Advisor Slapped, Bing Generative Search Experience & More

Oct 4, 2024 - 8:01 am
Google

Google AI Overview Ads, New Link Format, AI Organized Search Results & More

Oct 4, 2024 - 7:55 am
Bing Search

Bing Testing Bing Button

Oct 4, 2024 - 7:51 am
Google Ads

Google Ads Send Message On WhatsApp Tests

Oct 4, 2024 - 7:41 am
Google Ads

Google Tests Local Services Ads Without Attorney Photos

Oct 4, 2024 - 7:31 am
Previous Story: Opt Out Of Google Feature Snippets With nosnippet Tag