Google Looking For Examples Of GoogleBot Refresh Crawl Surges

Aug 16, 2021 - 7:31 am 0 by

Google Refresh Crawl

Gary Illyes from Google posted on Reddit that he is looking for examples of where GoogleBot might not be behaving. Specifically he wants examples of "cases where refresh crawls are going nuts." I assume this means where Googlebot is recrawling pages in a very aggressive manner.

There is a complaint on Reddit about Googlebot pinging an old article URL over and over again way too much. Now, it is very likely someone pretending to be Googlebot, but there is a chance it is an issue with Google. The complaint was:

I'm looking into the logs events from a news site, and i got an spike in one specific day in an article published on 2020.

Anyone have an idea on why would Googlebot access so many time in one particular article?

Gary Illyes from Google replied: "Wanna dm me the URL if you could confirm it's indeed Googlebot? I'm looking for cases where refresh crawls are going nuts and would appreciate this example."

He also shared how to verify Googlebot to ensure it is really Google accessing those pages.

So I guess if you have examples, share them with Gary on Reddit.

Forum discussion at Reddit.

Update: Later today, Google posted this on Twitter:

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search News

The Industry Mourns The Loss Of Jill Whalen - Content SEO Hero & Legend

Jun 22, 2025 - 1:20 pm
Search Forum Recap

Daily Search Forum Recap: June 20, 2025

Jun 20, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Search Volatility, AI Mode in Search Console, Audio Overviews and ChatGPT Search Quality

Jun 20, 2025 - 8:01 am
Google Search Engine Optimization

Google: Larger & Longer Issues Can Take Longer To Reverse In Google Search

Jun 20, 2025 - 7:51 am
Google Search Engine Optimization

Google Troubleshooting On Blocking Content From AI Mode & AI Overviews

Jun 20, 2025 - 7:41 am
Google

Google Video Search Tests Speaker Icon With Language Label

Jun 20, 2025 - 7:31 am
Previous Story: Google: Most Google Updates Are Not In Response To Search Spam