Why is Google not obeying the <meta name="robots" content="noindex, nofollow"> line in this site's pages? Take a look at http://www.google.com/search?q=site:www.seroundtable.com&num=100, you will see that all of these redirect URLs, which are used to discourage comment spam at this blog, are being indexed. For example, this page www.seroundtable.com/mt-comments.cgi?__mode=red&id=1879, redirects to Nacho, who left a comment at this blog.
If you look at the header information for www.seroundtable.com/mt-comments.cgi?__mode=red&id=1879 you will see:
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html><head><title>Redirecting...</title>
<meta name="robots" content="noindex, nofollow">
<script type="text/javascript">
window.onload = function() { document.location = document.links[0].href; };
</script></head>
<body>
<p><a href="http://www.ihispanic.com">Click here</a> if you are not redirected</p>
</body>
</html>
So why is Google indexing these pages?
