Thoughts on Index Size Debate

Aug 17, 2005 - 8:13 am 0 by

I have, for the most part, stayed out of the debate with the recent controversy over if Yahoo!'s index size is inflated or not. All I did was link to forum threads and articles on the topic.

I sat down with Gary Price, News Editor at Search Engine Watch, at the last SES conference and one of the many topics we discussed was this one. Forget the controversy over index size, I have no way of knowing if the 19.2 billion count is accurate or not. That is not the point...

To measure index size by conducting queries, in my humble opinion, is not a valid testing method. Why? Because search engines have an indexer component and a query component. Both of those are pretty much standalone. So for someone to do a query, no matter what it is, at one engine and compare the "total results" to an other search engine, to me, it seems very flawed.

Some of the reasoning on this can be found by a blog entry at sethf.com. The query processor can be limiting the results based on its matching and filter algorithms. One can not measure index size, when it goes through a query processor. In my opinion, it really doesn't matter that Yahoo! claims to be more then twice the size of Google and still doesn't show, for any of those queries, more total results. I know many people argue with me, but this is how I felt from day two - after speaking with Gary about the methodologies being used to measure Yahoo!'s claim.

Update: Jeremy Z just posted a few minutes ago his via on Of Course Size Matters! Got of love the blog-o-sphere.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Rumbling, Manual Actions FAQs, Core Web Vitals Updates, AI, Bing, Ads & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: March 18, 2024

Mar 18, 2024 - 4:00 pm
Google Updates

Google Urges Patience As The March 2024 Core Update Continues To Rollout

Mar 18, 2024 - 7:51 am
Google

Official: Google Replaces Perspective Filter With Forums Filter

Mar 18, 2024 - 7:41 am
Google Maps

Google Business Profiles Now Offers Additional Review After Appeal Is Denied

Mar 18, 2024 - 7:31 am
Google Maps

EU Searchers Complaining About Google Maps Features Changes Related To DMA

Mar 18, 2024 - 7:21 am
Google

Google Showing Fewer Sitelinks Within Search

Mar 18, 2024 - 7:11 am
Previous Story: Inside AdSense Blog Launches