Entries from Search Engine Roundtable tagged with 'google index'

Will Google Crawl Your Site Without a Robots.txt File? It Depends

I found a very interesting tidbit from a Google Groups thread on unreachable robots.txt files. I always believed that a site does not need a robots.txt file. In fact, this site does not have a robots.txt file and yet we...

Should Google Not Index Robots.txt Files in Search Results?

An interesting discussion is taking place at WebmasterWorld on the topic of the robots.txt file. One webmaster did not want his robots.txt file to be indexed by Google, but has no way of delisting in in Google. The only ways...

Does Google Prevent Some Sites from Displaying Fresh Content?

A Sphinn thread has interesting discussion that asks if there is such a thing as a "fresh content penalty." Is there such a thing as Google preventing some sites from being indexed quickly and showing up in the Google results...

Clarification on Sub Domains in Google: Google to Make It Harder But Not Impossible

Friday we reported that Google to Begin Treating Subdomains as Folders: Max 2 Results Per Search based on a post from Tedster at WebmasterWorld. Soon after, Matt Cutts of Google commented saying: This isn't a correct characterization of what Google...

Google Index Count Dropping? Is Your Google Index Count Less?

A WebmasterWorld thread has dozens of reports from SEOs and Webmasters that Google has dropped the number of pages they indexed of their sites. Here is one such report: On all the searchees I look at a regular basis I...

Google's Index Page Counts Like a "Rollercoaster"?

A WebmasterWorld thread has dozens of reports that Google's page index counts of sites have been bouncing up and down like a rollercoaster. By page index site, I assume they mean the number of pages Google reports when you conduct...

Google Still Displaying Their Own Search Results in Google.com

Danny called out Google for indexing their own product search results on April 30th. Since then Google updated their robots.txt file to include an exclusion of /products?. A German forum, ABAKUS Forum (remember Alan Webb?) spotted Google displaying Google Product...


To subscribe to the Search Engine Roundtable, click here