Googlebot Slow Crawling The Web From November 11 - November 17?

Nov 23, 2021 - 7:21 am 1 by

Googlebot Slow Google Crawl

Olivier Papon from Seolyzer, a log analysis toolset, reported the other week that Google seemed to slow or stop crawling most of the web between around November 11 and November 17th. I did ask Google about this but have yet to hear back. It seems Googlebot is back at the crawling business now but we are not sure what went wrong or if something did go wrong. Update, Google confirmed the issue - saying it was not widespread - see below for more details.

Olivier posted on Twitter on November 15th about this saying "Googlebot is on strike! Googlebot has drastically reduced its crawl activity on many large sites since November 11 at 6PM (GMT)." Many others said they noticed the same thing. I emailed Google about it and they said they would get back to me but I didn't really hear back.

John Mueller of Google did tweet that "We've been looking into it." But I have not heard anything else from Google, yet.

Then on November 18th, Olivier said "Googlebot is back! Googlebot came back as he left, at a specific time: November 17 at 8PM." He shared this chart showing how Googlebot went away and came back:

click for full size

I personally went through tons of crawl stats reports in Google Search Console to verify it throughout the week. I'd say 90% or more of those who I checked, showed zero dip in crawl activity. That is with the exception of some but I am not sure if there was a pattern. Here is one sample chart showing the dip in crawl activity.

click for full size

Some others noticed this as well:

Again, I have zero confirmation from Google yet on what this issue was, how many sites were impacted and how they may have been impacted.

You can click through to these tweet below to see more details:

Forum discussion at Twitter.

Update: Here is John Mueller of Google confirming the issue:

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: March 28, 2024

Mar 28, 2024 - 4:00 pm
Google Ads

Google Ads Suspended 90% More Advertisers This Year & Removed 5.5 Billion Ads

Mar 28, 2024 - 7:51 am
Google Ads

Google Updates Its Definition Of Top Ads; They May Not Be At The Top

Mar 28, 2024 - 7:41 am
Google Ads

Google Ads Adds Share Ad Preview For Performance Max

Mar 28, 2024 - 7:31 am
Google

Google Can Search For Your Blockchain Wallet Addresses (Bitcoin & More)

Mar 28, 2024 - 7:21 am
Google Maps

New Google Shopping & Maps Search Features

Mar 28, 2024 - 7:11 am
Previous Story: Google Local Business Photos Lead To Blank Images On Desktop Search