Google: Blocked URL Count Updates Slowly

Apr 4, 2013 - 8:24 am 3 by

Google Blocked URLsA Google Webmaster Help thread has a webmaster who is looking to lower the number of blocked URLs being reported within Google Webmaster Tools Index Status report.

To make a long story short, they used the robots.txt to block hundreds of thousands of pages. Then eventually they just removed the pages and removed the lines in the robots.txt to block them. But Google still shows them as being blocked in the Index Status report.

Google's John Mueller explained that it can take a long time for Google to recrawl and notice the pages are no longer there. He wrote:

It's likely going to take quite some time for those URLs to either drop out of the index or be recrawled again, so I would not expect to see that number significantly drop in the near future (and that's not a bad thing, it's just technically how it works out).

We also know the index status report is delayed by about a week or so.

Forum discussion at Google Webmaster Help.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 26, 2024

Jul 26, 2024 - 10:00 am
Search Video Recaps

Google Volatility, Bing Generative Search, Reddit Blocks Bing, Sticky Cookies, AI Overview Ads & SearchGPT

Jul 26, 2024 - 8:01 am
Google

Google Gemini Adds Related Content & Verification Links

Jul 26, 2024 - 7:51 am
Other Search Engines

SearchGPT - OpenAI's AI Search Tool

Jul 26, 2024 - 7:41 am
Search Engine Optimization

Google's John Mueller: Don't Use LLMs For SEO Advice

Jul 26, 2024 - 7:31 am
Google

Google Search With Related Images Carousel Below Image Box

Jul 26, 2024 - 7:21 am
Previous Story: When Google Completes You Wrong