URLs in Yahoo & MSN Are Not Complete...

Feb 24, 2004 - 9:39 pm 0 by
Filed Under Yahoo News

While working on a little project that made a site completely database driven, I realized that Yahoo and MSN incorrectly strip off trailing slashes in URLs (because I started seeing 404 page not found errors in my web logs).

For example, the URL http://www.domain.com/directory/ is linked to as http://www.domain.com/directory from both MSN and Yahoo.

This is bad for two reasons... first of all, it's just plain wrong, the two URLs could in theory be separate documents. Second, it's a waste of bandwidth. Most web servers are configured to add a slash to the end of a URL if there is no file that matches the name, and there *is* a directory with that name via a HTTP redirect. So now, the end user's browser needs to make two requests to the server to get one document.

The reason I figured it out is I *had* directories at one point, but moved to dynamic, database driven content. So the web server wasn't redirecting them with the wrong URL because there was not a directory with that name any longer.

Bad MSN, bad Yahoo... Naughty, boys.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Flux, AdSense Ad Intent, California Link Tax & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: April 23, 2024

Apr 23, 2024 - 4:00 pm
Link Building

Google: Ignore Link Spam Especially To 404 Pages

Apr 23, 2024 - 7:51 am
Google Search Engine Optimization

Google: We Have Taken Action On Some Parasite SEO In Recent Update

Apr 23, 2024 - 7:41 am
Bing Search

Mikhail Parakhin Breaks Silence On Mustafa Suleyman Of Microsoft (Kinda...)

Apr 23, 2024 - 7:31 am
Google Maps

Google Business Profiles Gains Select Preferred Menu Source

Apr 23, 2024 - 7:21 am
Google Search Engine Optimization

Google: Crawl Budget Goes Across All Googlebot Crawling, Not Just Web Search

Apr 23, 2024 - 7:11 am
Previous Story: Coming Soon at the Search Engine Roundtable