Users Report Abnormal Google Webmaster Tools Activity with Robots.txt

Oct 10, 2007 - 9:46 am 0 by

A number of WebmasterWorld members who use Google's Blogspot application are reporting that when they log into Google Webmaster Tools, they're getting a lot of errors that many URLs are being restricted by robots.txt. However, users have no control over the robots.txt file (and as far as anyone is aware, such a file cannot be created).

One example of this problem is explained:

I've noticed that if there's a 301 redirect from Page A to Page B and Page A is disallowed in robots.txt then Page B will be reported as Restricted in robots.txt in GWT.

Nobody knows of a fix at this point, and the negative impact, if any, is undetermined.

Forum discussion continues at WebmasterWorld.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google AI Overviews, Ranking Volatility, Web Filter, Google Ads AI Summaries & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 22, 2024

May 22, 2024 - 10:00 am
Google Updates

Google Search Ranking Volatility Spike Around May 22

May 22, 2024 - 8:01 am
Google Ads

Google Ads In AI Overviews, AI Shopping Ads, Brand Profile Ads & More AI Ad Tools

May 22, 2024 - 7:51 am
Google Search Engine Optimization

Google & Bing Say Upgrade To WordPress 6.5 To Gain Lastmod Sitemap Support

May 22, 2024 - 7:41 am
Google Search Engine Optimization

Unusual Surge In Google Search Console Product Snippets Search Performance

May 22, 2024 - 7:31 am
Bing Search

Bing Search Testing Tag Filters

May 22, 2024 - 7:21 am
Previous Story: Do Site Analytics Log Cached Page Views?