Google: Adding Individual Pages Does Not Impact How We Crawl Your Site

Feb 18, 2022 - 7:41 am 0 by

Google Individual Crawl Budget

Google's John Mueller said that simply adding individual pages won't impact how Google crawls your site. Crawl budget generally is only impacted by hundreds of thousands, if not millions of pages - not individual pages here or there.

If you have a site in the low hundreds of thousands of pages, I doubt you need to worry much about crawl budget. In fact, I think most sites on the internet do not need to worry about crawl budget. If you run Amazon, sure, you should - but I site like this, the one you are reading, with less than a 100,000 pages, I don't lose sleep over crawl budget.

John said this on Twitter, saying "Adding individual pages isn't going to affect how we crawl your site." He then linked to Google's help document on crawl budget management for large sites. That help document was introduced in December 2020.

Here are those tweets:

Forum discussion at Twitter.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google AI Overviews, Ranking Volatility, Web Filter, Google Ads AI Summaries & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 20, 2024

May 20, 2024 - 4:00 pm
Google Search Engine Optimization

Google Working On Surfacing More Content That Comes From The Heart

May 20, 2024 - 7:51 am
Google Search Engine Optimization

Danny Sullivan: We Speak Directly To Engineers Working On Google Ranking Systems

May 20, 2024 - 7:41 am
Google Search Engine Optimization

Comments To Notes In Google Search?

May 20, 2024 - 7:31 am

Google Says Notes On Search Now Ends Soon

May 20, 2024 - 7:21 am
Bing Search

Bing Lets You Turn Off AI Responses But Google Doesn't Let You Turn Off AI Overviews

May 20, 2024 - 7:11 am
Previous Story: Questions and Answers In The Google Maps Interface