Google Crawling URLs with Double Slashes

Dec 19, 2005 • 9:06 am | comments (3) by twitter Google+ | Filed Under Google Search Engine Optimization
 

A WebmasterWorld Thread reports that Google has been crawling double slashed URLs. For example, instead of crawling www.mysite/products.htm it would crawl www.mysite//products.htm. Apparently, this has been an "issue" since the summer. An other member reported this back in late November, as well. Plus there is Google Group Discussion from late October on the topic.

Update: Martin sent me an example of Google indexing double slashes. If you do a search on the "?id=" at Google, the bottom result shows you;

google-double-slashes.gif

301ing those URLs to the standard slash, may help.

Forum discussion at WebmasterWorld.

Previous story: Google to Boost AOL's Content in SERPs?
 

Comments:

Milly

12/20/2005 02:56 am

The OP at WebmasterWorld reports that he "went to check google to see if their pages could be accessed with the double slashes and they could, sometime over the past 4-6 weeks they have done something so that double slashes no longer work in google urls", but I don't think that's entirely correct. In early October I posted some double slashed Google URLs at Google Blogoscoped (re some speculation about their phishing or spamming potential) :- http://blog.outer-court.com/forum/10977.html All but a couple of those URLs still work, so Google seems to be 301'ing their own servers very sparingly.

Sameer

12/20/2005 03:12 am

Well, its just string processing. seed_URL = "www.xyz.com/" fetch_URL = seed_URL + "/" + there u go....

iPhone App Development

12/02/2010 11:41 am

Thanks for this article, Anyone got any more info about it? I am now your blog’ s rss follower. you are now in my bookmarks.

blog comments powered by Disqus