Google Can Drill Into Search Quality Raters Results To Learn More

Mar 18, 2016 - 7:54 am 2 by

Google Drill

At SMX West a few weeks ago, during Paul Haahr's awesome presentation and Q&A, someone asked if Google can actually dig into the search quality rater's results. I believe Paul explained that when a quality rater result set shows a certain search result as being quality or not but the engineers don't necessarily believe it, they can dig deeper and see the details.

For example, let's say Google is testing a new ranking signal and overall it shows that the new ranking signal is working well. Google can then dig into the experiments run, see the queries they entered, check the results the raters rated and verify it was done correctly.

So they can not just see the macro level results but also dig deeper into the micro actions to see how the overall analysis came about.

Sometimes, Paul said, it makes you reconsider launching the new ranking signal because the quality raters were not exactly right.

Here are some tweets covering that part:

Forum discussion at Twitter.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Weekend Volatility, Google On Search Leak, Elizabeth Tucker Interview & Apple Intelligence - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: June 17, 2024

Jun 17, 2024 - 10:00 am
Google Search Engine Optimization

The Maddening Adventure Of Tracking AI Overviews In Google Search Console

Jun 17, 2024 - 7:51 am
Google Ads

Google Ads Forcing Some Advertisers Off Credit Card Payments

Jun 17, 2024 - 7:41 am
Apple App Store

Apple Updates Applebot Docs With Applebot-Extended, Reverse DNS & More

Jun 17, 2024 - 7:31 am
Google Maps

Google Maps Updates Fake Engagement Policy With More Detail

Jun 17, 2024 - 7:21 am
Google Search Engine Optimization

Google Updates hreflang Documentation While I Was Offline

Jun 17, 2024 - 7:11 am
Previous Story: Opt Out Of Google Feature Snippets With nosnippet Tag