Thoughts on Index Size Debate

Aug 17, 2005 - 8:13 am 0 by

I have, for the most part, stayed out of the debate with the recent controversy over if Yahoo!'s index size is inflated or not. All I did was link to forum threads and articles on the topic.

I sat down with Gary Price, News Editor at Search Engine Watch, at the last SES conference and one of the many topics we discussed was this one. Forget the controversy over index size, I have no way of knowing if the 19.2 billion count is accurate or not. That is not the point...

To measure index size by conducting queries, in my humble opinion, is not a valid testing method. Why? Because search engines have an indexer component and a query component. Both of those are pretty much standalone. So for someone to do a query, no matter what it is, at one engine and compare the "total results" to an other search engine, to me, it seems very flawed.

Some of the reasoning on this can be found by a blog entry at The query processor can be limiting the results based on its matching and filter algorithms. One can not measure index size, when it goes through a query processor. In my opinion, it really doesn't matter that Yahoo! claims to be more then twice the size of Google and still doesn't show, for any of those queries, more total results. I know many people argue with me, but this is how I felt from day two - after speaking with Gary about the methodologies being used to measure Yahoo!'s claim.

Update: Jeremy Z just posted a few minutes ago his via on Of Course Size Matters! Got of love the blog-o-sphere.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Core Update Coming, Ranking Volatility, Bye Search Notes, AI Overviews, Ads & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 23, 2024

Jul 23, 2024 - 10:00 am

Google Search AI Overviews Video Descriptions

Jul 23, 2024 - 7:51 am
Google Ads

Google Won't Deprecate Third-Party Cookies In Chrome

Jul 23, 2024 - 7:41 am

Google Tests Larger Sitename & Favicons

Jul 23, 2024 - 7:31 am
Google Ads

New Google Ads Sitelinks Interface

Jul 23, 2024 - 7:21 am
Google Ads

Google Ads Editor Version 2.7 Is Now Out

Jul 23, 2024 - 7:11 am
Previous Story: Inside AdSense Blog Launches