Google Can Drill Into Search Quality Raters Results To Learn More

Mar 18, 2016 - 7:54 am 2 by

Google Drill

At SMX West a few weeks ago, during Paul Haahr's awesome presentation and Q&A, someone asked if Google can actually dig into the search quality rater's results. I believe Paul explained that when a quality rater result set shows a certain search result as being quality or not but the engineers don't necessarily believe it, they can dig deeper and see the details.

For example, let's say Google is testing a new ranking signal and overall it shows that the new ranking signal is working well. Google can then dig into the experiments run, see the queries they entered, check the results the raters rated and verify it was done correctly.

So they can not just see the macro level results but also dig deeper into the micro actions to see how the overall analysis came about.

Sometimes, Paul said, it makes you reconsider launching the new ranking signal because the quality raters were not exactly right.

Here are some tweets covering that part:

Forum discussion at Twitter.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Core Update Flux, AdSense Ad Intent, California Link Tax & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Link Building

Google: Ignore Link Spam Especially To 404 Pages

Apr 23, 2024 - 7:51 am
Google Search Engine Optimization

Google: We Have Taken Action On Some Parasite SEO In Recent Update

Apr 23, 2024 - 7:41 am
Bing Search

Mikhail Parakhin Breaks Silence On Mustafa Suleyman Of Microsoft (Kinda...)

Apr 23, 2024 - 7:31 am
Google Maps

Google Business Profiles Gains Select Preferred Menu Source

Apr 23, 2024 - 7:21 am
Google Search Engine Optimization

Google: Crawl Budget Goes Across All Googlebot Crawling, Not Just Web Search

Apr 23, 2024 - 7:11 am
Blog Administration

Programming Note: Offline For Passover

Apr 22, 2024 - 4:05 pm
Previous Story: Opt Out Of Google Feature Snippets With nosnippet Tag