Microsoft adCenter Takes Step Back on Trademark Disputes | Main | JohnMu is Google's Next Webmaster Trends Analyst

Webmasters Not Happy with Yahoo's New Crawl Behavior

Last week we reported on a Yahoo update and a new method of crawling. The new crawl behavior is supposed to help the Yahoo bot, Slurp, be more efficient on your site.

It seems that many SEOs and Webmasters are not happy with this change.

A WebmasterWorld thread has several negative comments:

OK, this is completely bogus and helps nobody. The number of IPs that Slurp uses? WHO CARES...

The fact that Yahoo has multiple crawlers for every division that crawl independently and don't share the common cache, now THAT's a problem that needs to be fixed.

We get 50% of our pages crawled every day.
Well Yahoo is a waste of bandwidth on one of my sites (a large directory). It hammers it almost every day and has only sent about 975 referrers this month. That is so low that I wonder if people even use Yahoo in Ireland for anything other than e-mail. I am strongly considering blocking it.

Forum discussion at WebmasterWorld.



Like The Story? Vote For It On Yahoo Buzz! Or On Sphinn!

posted rustybrick in Yahoo! Search Engine at August 27, 2007 8:05 AM Comments (1)

Comments

More people crying about crawling bandwidth. Maybe they will allow a feature similar to Google in which you can tune down the crawling level of the spider(s)

 

Post a comment (Note: Can Take 120 Seconds For Your Comment To Show Up)

Do you want us to save your personal Information?

Premium Sponsors + advertise

To subscribe to the Search Engine Roundtable, click here