I found a very interesting tidbit from a Google Groups thread on unreachable robots.txt files. I always believed that a site does not need a robots.txt file. In fact, this site does not have a robots.txt file and yet we...
I found a very interesting tidbit from a Google Groups thread on unreachable robots.txt files. I always believed that a site does not need a robots.txt file. In fact, this site does not have a robots.txt file and yet we...
An interesting discussion is taking place at WebmasterWorld on the topic of the robots.txt file. One webmaster did not want his robots.txt file to be indexed by Google, but has no way of delisting in in Google. The only ways...
A Sphinn thread has interesting discussion that asks if there is such a thing as a "fresh content penalty." Is there such a thing as Google preventing some sites from being indexed quickly and showing up in the Google results...
Friday we reported that Google to Begin Treating Subdomains as Folders: Max 2 Results Per Search based on a post from Tedster at WebmasterWorld. Soon after, Matt Cutts of Google commented saying: This isn't a correct characterization of what Google...
A WebmasterWorld thread has dozens of reports from SEOs and Webmasters that Google has dropped the number of pages they indexed of their sites. Here is one such report: On all the searchees I look at a regular basis I...
A WebmasterWorld thread has dozens of reports that Google's page index counts of sites have been bouncing up and down like a rollercoaster. By page index site, I assume they mean the number of pages Google reports when you conduct...
Danny called out Google for indexing their own product search results on April 30th. Since then Google updated their robots.txt file to include an exclusion of /products?. A German forum, ABAKUS Forum (remember Alan Webb?) spotted Google displaying Google Product...
To subscribe to the Search Engine Roundtable, click here