Entries from Search Engine Roundtable tagged with 'index'

I found a very interesting tidbit from a Google Groups thread on unreachable robots.txt files. I always believed that a site does not need a robots.txt file. In fact, this site does not have a robots.txt file and yet we...

Posted on June 18, 2008 7:26 AM

An interesting discussion is taking place at WebmasterWorld on the topic of the robots.txt file. One webmaster did not want his robots.txt file to be indexed by Google, but has no way of delisting in in Google. The only ways...

Posted on May 15, 2008 8:02 AM

Yesterday, Hitwise released a report about what happens when your site gets banned from Google's index. Using charts and graphs, Hitwise illustrates how the market share of searches declined due to the company's blacklisting, and how the competition moved up....

Posted on February 14, 2008 6:58 AM

A Sphinn thread has interesting discussion that asks if there is such a thing as a "fresh content penalty." Is there such a thing as Google preventing some sites from being indexed quickly and showing up in the Google results...

Posted on February 11, 2008 7:58 AM