Thoughts on Index Size Debate

Aug 17, 2005 - 8:13 am 0 by

I have, for the most part, stayed out of the debate with the recent controversy over if Yahoo!'s index size is inflated or not. All I did was link to forum threads and articles on the topic.

I sat down with Gary Price, News Editor at Search Engine Watch, at the last SES conference and one of the many topics we discussed was this one. Forget the controversy over index size, I have no way of knowing if the 19.2 billion count is accurate or not. That is not the point...

To measure index size by conducting queries, in my humble opinion, is not a valid testing method. Why? Because search engines have an indexer component and a query component. Both of those are pretty much standalone. So for someone to do a query, no matter what it is, at one engine and compare the "total results" to an other search engine, to me, it seems very flawed.

Some of the reasoning on this can be found by a blog entry at sethf.com. The query processor can be limiting the results based on its matching and filter algorithms. One can not measure index size, when it goes through a query processor. In my opinion, it really doesn't matter that Yahoo! claims to be more then twice the size of Google and still doesn't show, for any of those queries, more total results. I know many people argue with me, but this is how I felt from day two - after speaking with Gary about the methodologies being used to measure Yahoo!'s claim.

Update: Jeremy Z just posted a few minutes ago his via on Of Course Size Matters! Got of love the blog-o-sphere.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google

Google Search Faster By About 60 Milliseconds

Feb 13, 2025 - 7:51 am
Google Ads

Google Ads Customer Match Lists To Have 540 Days Expiration Date

Feb 13, 2025 - 7:41 am
Google Search Engine Optimization

Reddit Blames Google Algorithm Change For Weaker Than Expected Growth

Feb 13, 2025 - 7:31 am
Yahoo Search Engine

Yahoo Search AI Answers Now Showing Link Sources

Feb 13, 2025 - 7:21 am
Google

Google Search Snippet Showing Future Date: Bug Or Feature?

Feb 13, 2025 - 7:11 am
Search Forum Recap

Daily Search Forum Recap: February 12, 2025

Feb 12, 2025 - 10:00 am
Previous Story: Inside AdSense Blog Launches