Google: Adding Individual Pages Does Not Impact How We Crawl Your Site

Feb 18, 2022 - 7:41 am 0 by

Google Individual Crawl Budget

Google's John Mueller said that simply adding individual pages won't impact how Google crawls your site. Crawl budget generally is only impacted by hundreds of thousands, if not millions of pages - not individual pages here or there.

If you have a site in the low hundreds of thousands of pages, I doubt you need to worry much about crawl budget. In fact, I think most sites on the internet do not need to worry about crawl budget. If you run Amazon, sure, you should - but I site like this, the one you are reading, with less than a 100,000 pages, I don't lose sleep over crawl budget.

John said this on Twitter, saying "Adding individual pages isn't going to affect how we crawl your site." He then linked to Google's help document on crawl budget management for large sites. That help document was introduced in December 2020.

Here are those tweets:

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Gvolatility, Bing Generative Search, Reddit Blocks Bing, Sticky Cookies, AI Overview Ads & SearchGPT - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 26, 2024

Jul 26, 2024 - 10:00 am
Search Video Recaps

Google Volatility, Bing Generative Search, Reddit Blocks Bing, Sticky Cookies, AI Overview Ads & SearchGPT

Jul 26, 2024 - 8:01 am
Google

Google Gemini Adds Related Content & Verification Links

Jul 26, 2024 - 7:51 am
Other Search Engines

SearchGPT - OpenAI's AI Search Tool

Jul 26, 2024 - 7:41 am
Search Engine Optimization

Google's John Mueller: Don't Use LLMs For SEO Advice

Jul 26, 2024 - 7:31 am
Google

Google Search With Related Images Carousel Below Image Box

Jul 26, 2024 - 7:21 am
Previous Story: Questions and Answers In The Google Maps Interface