Google Crawl Stats Report Can Handle Additional Types Of Crawls

Jan 19, 2021 • 7:05 am | comments (0) by | Filed Under Google Search Engine Optimization

Google Rc Crawler

Google has noted that it has updated the already updated Crawl Stats report to handle "additional types of crawls." Google wrote "the crawl stats report has increased its reporting coverage for additional types of crawls."

As I said, the crawl stats report was updated in November 2020 but now, Google has said it added additional types of crawls to this report. What types? That is not 100% clear, the new report breaks down crawl requests by response type, file type, by purpose and by Googlebot type.

I am guessing, based on looking at older screen shots that Google expanded the Googlebot types to support Googlebot for Image, AdBot, Video and Other agent type. But I am not 100% sure. Also, Google may have added more to the "by response" category.

Google said "as a result, you may see a jump in the number of crawls reported for your site. This does not reflect additional crawling of your site, only improved reporting."

This upgrade may have been possible because of the coverage report upgrade but again, that is also not clear.

Here is a screen shot of the crawl stats report from @Aussermayr:

click for full size

Forum discussion at Twitter.

Previous story: Daily Search Forum Recap: January 18, 2021
Ninja Banner
blog comments powered by Disqus