Relevance Defined by the Scientists

May 11, 2005 - 8:46 am 0 by

Most of you know about my little project, The Search Engine Relevancy Challenge. Outside of user's perceived relevance of a search response, how do the PhDs and scientists define relevancy. I particularly like the way Orion clearly described three ways to measure relevancy in a thread started by another researcher named nanocontext, the thread was titled The relevance of "relevance". Orion said that "relevancy has a lot to do with perception" and then he pulls out three types of "perception".

1. Which content is relevant according to user's perception?
2. Which content is relevant according to scoring functions used by a machine (IR system or search engine)?
3. Which list of content (documents) scored and already prequalified as relevant by a search engine algorithm are actually relevant according to user's perception and to the query that has been used?

Orion says that we are trying to measure number three, with RustySearch (by the way, please make this your default browser for the next two weeks to help the study). Nanocontext believes that "#3 is the most critical question, because thats where the money is." In addition, I am told that I should refresh my memory on the topic of "precision versus recall", which I promise to do and write a brief entry on it here. This thread, of course, sprung my interest.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Search Engine Optimization

The Great Decoupling Explained By A Googler

Jun 18, 2025 - 7:51 am
Google Updates

Google Search Ranking Volatility Heats Up June 18th

Jun 18, 2025 - 7:45 am
Google Ads

Google Ads Tests Design With Horizontal Lines Filled Halfway

Jun 18, 2025 - 7:41 am
Other Search Engines

Google: No AI System Currently Uses LLMs.txt

Jun 18, 2025 - 7:31 am
Google Ads

Google Merchant Center New Website-Reported Autofeeds

Jun 18, 2025 - 7:21 am
Bing Search

Bing Tests Bold & Colored Hover Styles On Snippets & Related Searches

Jun 18, 2025 - 7:11 am
Previous Story: Contextual Video Ad Network VidSense