Google Crawl Rate Drops: Google Responds?

May 2, 2008 - 8:00 am 9 by

Yesterday I reported that GoogleBot is crawling less pages then they once were, based on a large WebmasterWorld thread. Now, I spotted a response from a Googler at a Google Groups thread with similar complaints.

This time, I decided to login to Google Webmaster Tools and check my crawl stats, which can be found under Tools and then at "Set crawl rate." I noticed the same thing for this site, as well as my other sites. Here is a graph from this site:

Google Crawl Rate Dropping

John, the Google representative, blamed the Google Groups thread specific example on a slow site:

Looking at your graphs, it looks like the number of pages that we're crawling has gone down because it's taking so long for us to get each page. In general, there could be any number of reasons why that could be and I think that it may make sense to diagnose it properly, as the others have suggested. Having a slow site is not only bad for search engine crawlers who can't crawl as much as they would like, it's also something your visitors won't be happy about.

But the issue seems way more wide spread then what is in that thread alone and maybe we really do need a response from Google? My traffic referrals from Google seems to be about the same as it was throughout the crawl patterns. But SEOs and webmasters become concern that slow crawl rates and mean slow traffic from that engine in the future.

Forum discussion at WebmasterWorld and Google Groups.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: November 8, 2024

Nov 8, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Election Day Volatility, Helpful Content Update Status, Creators vs SEOs, AI, Ads & More

Nov 8, 2024 - 8:01 am
Google Search Engine Optimization

Google-Selected Canonical Showing Third-Party's Domain Name

Nov 8, 2024 - 7:51 am
Google Ads

Google Local Service Ads App To Stop Working In Two Months

Nov 8, 2024 - 7:41 am
Google

Google Continuous Conversational Search In Google App

Nov 8, 2024 - 7:31 am
Search Engine Optimization

Google & Bing In Dublin For IETF Event To Improve Crawling & AI Controls

Nov 8, 2024 - 7:21 am
Previous Story: Daily Search Forum Recap: May 1, 2008