Google: Large Sites Should Not Use The Google Crawl Setting

Oct 4, 2019 - 7:42 am 7 by

Google Big

Google's John Mueller said "really large sites" should not use the crawl setting because "setting maximum value is probably too small for what your need." Larger sites need to go beyond that max value in Google Search Console and it is not possible to do that with the crawl setting.

So instead, just let Google figure it out by itself, said John Mueller of Google.

He said this at the 22:01 mark in this week's video hangout "Especially for really large sites, if you use the crawl rate setting, the setting maximum value is probably too small for what your need."

You can access this feature over here and here is the help doc on this topic.

Forum discussion at YouTube.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: October 27, 2025

Oct 27, 2025 - 10:00 am
Google Ads

Google Ads Campaign Level Audience Exclusions To Performance Max

Oct 27, 2025 - 7:51 am
Google Ads

Google Ads New Investment Strategy Recommendation Page

Oct 27, 2025 - 7:41 am
Google Maps

Reviews Disappearing Within Google - Google Fixing

Oct 27, 2025 - 7:31 am
Google Maps

Schedule Google Posts In Google Business Profiles Tests

Oct 27, 2025 - 7:21 am
Google Ads

Google Launching Merchant Center For Agencies

Oct 27, 2025 - 7:11 am
 
Previous Story: Timely: Google Posts H1 Tag Video After H1 SEO Controversy