Is Google Sending GoogleBot CSS Hunting: Google Crawling CSS Files?

Jan 5, 2007 - 7:51 am 5 by

A Cre8asite Forums thread links to a blog post named GoogleBot Requested a CSS File. This is not the first time I heard threads where people suspect GoogleBot is crawling their CSS files. But this one has the most discussion I have seen so far.

Some people in the thread think a manual review sparked the crawl. But I am not too sure about that.

The request in the log file looks like this:

66.249.72.52 - - [24/Oct/2006:17:17:35 -0500] “GET /global/x.css HTTP/1.1″ 200 8382 “-” “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

So it looks like Google crawled his CSS. But he never discusses if he disallowed the directory in his robots.txt file.

Anyway, for past articles on Google and CSS see:

Forum discussion at Cre8asite Forums.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Ads

Google Ads Search Google Maps For Location Assets

Sep 2, 2025 - 7:21 am
Google

Google Search Mini Game Encourages Searchers To Search More

Sep 2, 2025 - 7:11 am
Bing Ads

Microsoft Advertising: Here's Why Your Bid May Be Over The Max CPC

Sep 2, 2025 - 7:05 am
Search Forum Recap

Daily Search Forum Recap: September 1, 2025

Sep 1, 2025 - 10:00 am
Google

Google Tests AI Overview With Knowledge Panel

Sep 1, 2025 - 7:51 am
Google Search Engine Optimization

Google: Crawl Changes Are Independent Of Big Google Updates

Sep 1, 2025 - 7:41 am
 
Previous Story: More Tidbits on Google's Duplicate Content Filter