Does Google Still Crawl 404 Not Found Pages?

Mar 9, 2007 - 7:54 am 3 by

A WebmasterWorld thread asks how long does Google send out their crawlers to a page that has been removed (i.e. a 404 error not found status)?

The simple answer, as mentioned in the thread is, forever.

Google will continue to try to see if the 404ed page has ever been reinstated as a live page.

Google even provides these errors in Google Webmaster Central, where you can see web crawl errors including 404 not found errors. (note to Vanessa, fix the link on here for the 404 link to go to here).

Why does Google continue to try to access these pages? As g1smd said:

Say you bought a domain name from someone and put up a new site. Say that Google refused to pick up your /about.html and /contact.html pages, and that eventually you found that it was all because once a page went 404 Google refused to ever look at that URL again.

You would think that was a bad policy. That is why it doesn't work like that.

Forum discussion at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: November 1, 2024

Nov 1, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Update Coming Soon, Downgrading Content, AI Overviews Expands, ChatGPT Search, Volatility Continues & Unauthorized Ad Rep Changes

Nov 1, 2024 - 8:01 am
Google Updates

Halloween 2024 Google Search Ranking Update 👻

Nov 1, 2024 - 7:51 am
Other Search Engines

OpenAI Releases ChatGPT Search: Citations, Robots.txt Controls & More

Nov 1, 2024 - 7:41 am
Google Maps

Google AI Answers In Google Maps: Things To Do, Review Summaries & About This Place

Nov 1, 2024 - 7:31 am
Google Maps

Google Tests Discover More Places & Explore Places Nearby

Nov 1, 2024 - 7:21 am
Previous Story: Google Shows Search Volumes Temporarily in AdWords Keyword Tool