Sitemaps Adds Robots.txt Analysis and More Stats

Feb 8, 2006 - 9:26 am 0 by

The last time stats was added to sitemaps was back in November 2005. Early this week, Google announced More stats and analysis of robots.txt files which did just that. Danny asked me why I didn't post this information here. He explained that he loves what he is seeing from this; not once but twice. The reason I held out, was because I couldn't find any forum buzz on the topic, until now. There is a small thread at WebmasterWorld with six posts currently, on the topic.

But seriously, even though the forums are not buzzing about it, this is still pretty major.

Hey, they even show you "the most common words used on pages within your web site and the most common words anchor text pointing at your site." If that isn't huge, what is?

Forum discussion at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: November 14, 2025

Nov 14, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Movemeber Google Update, Opal AI Spam, Discover Spam Fix, Copilot Search, Google Image Ads & More

Nov 14, 2025 - 8:01 am
Google Ads

Google Ads Advertiser Suspension Improvements: Faster & More Accurate

Nov 14, 2025 - 7:51 am
Google Ads

Google: Don't Close Your Google Ads Account To Make LSAs Work

Nov 14, 2025 - 7:41 am
Google

Google Shopping With AI Mode Comparisons, Call Store, Track Price & Agentic Checkout

Nov 14, 2025 - 7:31 am
Google Ads

Google Ads Brings Brand Inclusions To Standard Shopping Campaigns (NOPE)

Nov 14, 2025 - 7:21 am
 
Previous Story: Google Hires Amazon's Head Search Guru; Udi Manber