Entries from Search Engine Roundtable tagged with 'index'

Why Does The Site Command Show More Indexed Pages Then Google's Sitemap Report?

A WebmasterWorld thread asks why does the site command in Google not match up in the number of "indexed" URLs reported in Google Webmaster Tools. A very valid question, let me show you. A simple site command in Google for...

Google Keeps Losing in Germany: This Time Over Google Images

Google lost their Gmail dispute in Germany and they had to remove redtube.com (and the like) from Google.de, plus other cases I am missing right now. This week, Bloomberg reports that Google "lost two copyright lawsuits in Germany over displaying...

Make Sure Your Robots.txt File is UTF-8

A Google Groups thread shows the tail of a webmaster who had issues with his robots.txt file. The robots.txt file was uploaded in what is called byte-order mark (BOM) encoding, which threw off Google, when trying to retrieve and understand...

Will Google Crawl Your Site Without a Robots.txt File? It Depends

I found a very interesting tidbit from a Google Groups thread on unreachable robots.txt files. I always believed that a site does not need a robots.txt file. In fact, this site does not have a robots.txt file and yet we...

Should Google Not Index Robots.txt Files in Search Results?

An interesting discussion is taking place at WebmasterWorld on the topic of the robots.txt file. One webmaster did not want his robots.txt file to be indexed by Google, but has no way of delisting in in Google. The only ways...

Hitwise Shows Consequences of Being Banned by Google

Yesterday, Hitwise released a report about what happens when your site gets banned from Google's index. Using charts and graphs, Hitwise illustrates how the market share of searches declined due to the company's blacklisting, and how the competition moved up....

Does Google Prevent Some Sites from Displaying Fresh Content?

A Sphinn thread has interesting discussion that asks if there is such a thing as a "fresh content penalty." Is there such a thing as Google preventing some sites from being indexed quickly and showing up in the Google results...

Premium Sponsors + advertise

To subscribe to the Search Engine Roundtable, click here