Is Google Sending GoogleBot CSS Hunting: Google Crawling CSS Files?

Jan 5, 2007 - 7:51 am 5 by

A Cre8asite Forums thread links to a blog post named GoogleBot Requested a CSS File. This is not the first time I heard threads where people suspect GoogleBot is crawling their CSS files. But this one has the most discussion I have seen so far.

Some people in the thread think a manual review sparked the crawl. But I am not too sure about that.

The request in the log file looks like this:

66.249.72.52 - - [24/Oct/2006:17:17:35 -0500] “GET /global/x.css HTTP/1.1″ 200 8382 “-” “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

So it looks like Google crawled his CSS. But he never discusses if he disallowed the directory in his robots.txt file.

Anyway, for past articles on Google and CSS see:

Forum discussion at Cre8asite Forums.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 8, 2025

Jul 8, 2025 - 10:00 am
Google

Google AI Mode Shows Different Sources For The Same Query

Jul 8, 2025 - 7:51 am
Google Ads

Google Ads To Update Its Political Content Policy

Jul 8, 2025 - 7:41 am
Google Ads

Google Ads Editor Version 2.10 Is Out With 20 New Features

Jul 8, 2025 - 7:31 am
Google

Google AI Mode Follow Up Questions With Suggestions

Jul 8, 2025 - 7:21 am
Google

Google Search Rolls Out AI Mode In India Without Labs

Jul 8, 2025 - 7:11 am
Previous Story: More Tidbits on Google's Duplicate Content Filter