Google Crawl Rate Drops: Google Responds?

May 2, 2008 - 8:00 am 9 — by

Yesterday I reported that GoogleBot is crawling less pages then they once were, based on a large WebmasterWorld thread. Now, I spotted a response from a Googler at a Google Groups thread with similar complaints.

This time, I decided to login to Google Webmaster Tools and check my crawl stats, which can be found under Tools and then at "Set crawl rate." I noticed the same thing for this site, as well as my other sites. Here is a graph from this site:

Google Crawl Rate Dropping

John, the Google representative, blamed the Google Groups thread specific example on a slow site:

Looking at your graphs, it looks like the number of pages that we're crawling has gone down because it's taking so long for us to get each page. In general, there could be any number of reasons why that could be and I think that it may make sense to diagnose it properly, as the others have suggested. Having a slow site is not only bad for search engine crawlers who can't crawl as much as they would like, it's also something your visitors won't be happy about.

But the issue seems way more wide spread then what is in that thread alone and maybe we really do need a response from Google? My traffic referrals from Google seems to be about the same as it was throughout the crawl patterns. But SEOs and webmasters become concern that slow crawl rates and mean slow traffic from that engine in the future.

Forum discussion at WebmasterWorld and Google Groups.

 

Popular Categories

The Pulse of the search community

Google Search Volatility

More Details

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google

Google Tests Sign In Protections After First Search To Block Scrapers

Nov 17, 2026 - 6:00 am
Google Maps

Google Business Profiles Now Lets You Add Facebook Messenger Number

Nov 16, 2026 - 4:12 pm
Search Forum Recap

Daily Search Forum Recap: November 16, 2026

Nov 16, 2026 - 10:00 am
Google Search Engine Optimization

Google Search Analytics API Adds Branded Queries, Multimodal & Country/Devices Filters

Nov 16, 2026 - 9:40 am
Google Updates

Google November 2026 Core Update Ranking Flux - What We're Seeing

Nov 16, 2026 - 7:55 am
Google

Google AI Mode Drops Gemini Label & Rolls Out Gemini 4 Carbon To Pro Subs

Nov 16, 2026 - 7:51 am
Previous Story: Daily Search Forum Recap: May 1, 2008