GoogleBot Stop Crawling Your Site On June 15th?

Jun 16, 2010 - 9:00 am 17 by

There are several webmasters complaining in Google Webmaster Help and WebmasterWorld that Google has stopped crawling their site's as of yesterday morning.

Some say the crawling has not stopped completely, but rather dipped to a tiny fraction of the crawl rate they normally see.

Even senior member, Walkman, agreed and said:

I got 50 googlebot visits, down from over 1000 normally

There was some speculation that this was only impacting European web sites, but it seems to be larger.

Another senior member said:

Same here, daily average for the last 7 days was 20,000 gbot hits. Yesterday was 150 total gbot hits. Site is a US based site so I don't think this is a European only event.

Is this related to the Google Caffeine launch? I highly doubt it, being that Google Caffeine has been rolling out slowly and slowly over time, so I doubt it is specific to that.

Maybe it has to do with some sort of malware misclassification issue where Google will stop crawling sites until they are de flagged? Maybe it is something completely different. I am not sure.

Forum discussion at Google Webmaster Help and WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Updates

Google March 2024 Core Update Finished April 19th (A Week Ago)

Apr 26, 2024 - 4:40 pm
Search Forum Recap

Daily Search Forum Recap: April 26, 2024

Apr 26, 2024 - 4:00 pm
Search Video Recaps

Search News Buzz Video Recap: Google Core Update Updates, Site Reputation Abuse Coming, Links, Ads & More

Apr 26, 2024 - 8:01 am
Google Search Engine Optimization

Google Publisher Center No Longer Allows Adding Publications

Apr 26, 2024 - 7:51 am
Google

Google Tests Placing The Snippet Date Next To URL

Apr 26, 2024 - 7:41 am
Google

Google Breaks Out Googlebot IP Ranges For User-Triggered Fetchers

Apr 26, 2024 - 7:31 am
Previous Story: Reciprocal Links: Do They Still Work?