Google Robots.txt File Updated & Google Stops Indexing Itself

Sep 11, 2014 • 7:46 am | comments (4) by twitter mastodon | Filed Under Google Search Engine

GoogleBot All Tied UpYesterday we reported Google was indexing itself and Google caught wind of it and Gary from Google commented on my Google+ post telling me they are looking into it.

Last night at around 6pm EDT, Google updated their robots.txt file to block the search results from being indexed.

Hacker News picked up on it as well, and yesterday before 6pm, it looked like this:

Now it looks like this:

Even Google makes mistakes I guess.

Forum discussion at Hacker News and Google+.

Previous story: Daily Search Forum Recap: September 10, 2014
blog comments powered by Disqus