Googlebot Slow Crawling The Web From November 11 - November 17?

Nov 23, 2021 - 7:21 am 1 by

Googlebot Slow Google Crawl

Olivier Papon from Seolyzer, a log analysis toolset, reported the other week that Google seemed to slow or stop crawling most of the web between around November 11 and November 17th. I did ask Google about this but have yet to hear back. It seems Googlebot is back at the crawling business now but we are not sure what went wrong or if something did go wrong. Update, Google confirmed the issue - saying it was not widespread - see below for more details.

Olivier posted on Twitter on November 15th about this saying "Googlebot is on strike! Googlebot has drastically reduced its crawl activity on many large sites since November 11 at 6PM (GMT)." Many others said they noticed the same thing. I emailed Google about it and they said they would get back to me but I didn't really hear back.

John Mueller of Google did tweet that "We've been looking into it." But I have not heard anything else from Google, yet.

Then on November 18th, Olivier said "Googlebot is back! Googlebot came back as he left, at a specific time: November 17 at 8PM." He shared this chart showing how Googlebot went away and came back:

click for full size

I personally went through tons of crawl stats reports in Google Search Console to verify it throughout the week. I'd say 90% or more of those who I checked, showed zero dip in crawl activity. That is with the exception of some but I am not sure if there was a pattern. Here is one sample chart showing the dip in crawl activity.

click for full size

Some others noticed this as well:

Again, I have zero confirmation from Google yet on what this issue was, how many sites were impacted and how they may have been impacted.

You can click through to these tweet below to see more details:

Forum discussion at Twitter.

Update: Here is John Mueller of Google confirming the issue:

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: October 15, 2024

Oct 15, 2024 - 10:00 am
Google Ads

Google Ads Tests Expandable & Collapsible Carousel Ads & Refinements

Oct 15, 2024 - 7:51 am
Bing Search

Bing Search Recipes Cheat Publishers?

Oct 15, 2024 - 7:41 am
Google Ads

Google Ads To Remove Data Older Than 11 Years Ago

Oct 15, 2024 - 7:31 am
Google Ads

Google Ads To Release New Penalties For Agencies & Third Parties

Oct 15, 2024 - 7:21 am
Google

Google Search Tests Angled & Off-Centered Design Elements

Oct 15, 2024 - 7:11 am
Previous Story: Google Local Business Photos Lead To Blank Images On Desktop Search