Is Google Crawling & Indexing All of My Pages?

Sep 11, 2008 - 9:23 am 1 by

Michael Gray has composed a post that helps SEOs find out which pages of their site haven't been crawled, which becomes increasingly more important due to Google's removal of the supplemental index. He explains that you should put a timestamp on every single page, after which you wait about 2 months. At that point, you can perform a search for the article plus the date and you should get your results.

Michael then explains how you can optimize those pages to have them become crawled and provides other informative insights as well.

Is it worth the hassle? It depends on how important this is to you. The goal should be to integrate code into the page so that you don't have to manually add timestamps to every single page. Still, if it is important to you and you want to know (but don't have the resources available to code it in the footer), it may be worth the effort to do it.

Forum discussion continues at Sphinn.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Gvolatility, Bing Generative Search, Reddit Blocks Bing, Sticky Cookies, AI Overview Ads & SearchGPT - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 26, 2024

Jul 26, 2024 - 10:00 am
Search Video Recaps

Google Volatility, Bing Generative Search, Reddit Blocks Bing, Sticky Cookies, AI Overview Ads & SearchGPT

Jul 26, 2024 - 8:01 am
Google

Google Gemini Adds Related Content & Verification Links

Jul 26, 2024 - 7:51 am
Other Search Engines

SearchGPT - OpenAI's AI Search Tool

Jul 26, 2024 - 7:41 am
Search Engine Optimization

Google's John Mueller: Don't Use LLMs For SEO Advice

Jul 26, 2024 - 7:31 am
Google

Google Search With Related Images Carousel Below Image Box

Jul 26, 2024 - 7:21 am
Previous Story: "The SEO Squares" - Are SEO's Squares?