Googlebot Slow Crawling The Web From November 11 - November 17?

Nov 23, 2021 - 7:21 am 1 by

Googlebot Slow Google Crawl

Olivier Papon from Seolyzer, a log analysis toolset, reported the other week that Google seemed to slow or stop crawling most of the web between around November 11 and November 17th. I did ask Google about this but have yet to hear back. It seems Googlebot is back at the crawling business now but we are not sure what went wrong or if something did go wrong. Update, Google confirmed the issue - saying it was not widespread - see below for more details.

Olivier posted on Twitter on November 15th about this saying "Googlebot is on strike! Googlebot has drastically reduced its crawl activity on many large sites since November 11 at 6PM (GMT)." Many others said they noticed the same thing. I emailed Google about it and they said they would get back to me but I didn't really hear back.

John Mueller of Google did tweet that "We've been looking into it." But I have not heard anything else from Google, yet.

Then on November 18th, Olivier said "Googlebot is back! Googlebot came back as he left, at a specific time: November 17 at 8PM." He shared this chart showing how Googlebot went away and came back:

click for full size

I personally went through tons of crawl stats reports in Google Search Console to verify it throughout the week. I'd say 90% or more of those who I checked, showed zero dip in crawl activity. That is with the exception of some but I am not sure if there was a pattern. Here is one sample chart showing the dip in crawl activity.

click for full size

Some others noticed this as well:

Again, I have zero confirmation from Google yet on what this issue was, how many sites were impacted and how they may have been impacted.

You can click through to these tweet below to see more details:

Forum discussion at Twitter.

Update: Here is John Mueller of Google confirming the issue:

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Weekend Volatility, Google On Search Leak, Elizabeth Tucker Interview & Apple Intelligence - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: June 14, 2024

Jun 14, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Weekend Volatility, Google On Search Leak, Elizabeth Tucker Interview, Apple Intelligence & More

Jun 14, 2024 - 8:01 am
Google

Google Tests Multiple Featured Snippets Under From Sources Across The Web

Jun 14, 2024 - 7:51 am
Google Search Engine Optimization

Google: Sometimes Search Experiments Conflict Causing Issues

Jun 14, 2024 - 7:41 am
Google Maps

Google Business Profiles Websites No Longer Load - 404

Jun 14, 2024 - 7:31 am
Google Ads

Google Tests New Call & Location Extension Ad Format

Jun 14, 2024 - 7:21 am
Previous Story: Google Local Business Photos Lead To Blank Images On Desktop Search