Entries from Search Engine Roundtable tagged with 'yahoo slurp'

It seems like some webmasters are becoming fed up with the activity of Yahoo's crawl, Yahoo Slurp, relative to the amount of traffic Yahoo Search is sending the web site. In fact, some webmasters have taken the plunge and banned...

Posted on June 30, 2008 7:35 AM

WebmasterWorld members report that Yahoo has announced its new crawler, Slurp 3.0. Now, when you analyze your weblogs, you'll be seeing Slurp 3.0, though it recognizes the same user-agent and robots.txt as before. More importantly, they are invalidating all other...

Posted on April 15, 2008 10:38 AM

A DigitalPoint Forums thread has dozens of reports that Yahoo Search's crawler, Yahoo Slurp, took some bad medicine recently. Many are reporting that they see the crawler spidering their sites like never before. Some times they have seen the spider...

Posted on March 31, 2008 7:48 AM

In August, Yahoo announced a new crawl behavior for Slurp, Yahoo's web crawler. The new crawl behavior was suppose to tame the crawler to go through your site in a more relaxed and efficient manner for both the crawler and...

Posted on October 17, 2007 6:38 AM

Last week we reported on a Yahoo update and a new method of crawling. The new crawl behavior is supposed to help the Yahoo bot, Slurp, be more efficient on your site. It seems that many SEOs and Webmasters are...

Posted on August 27, 2007 8:05 AM

WebmasterWorld and DigitalPoint Forums thread report a spike in activity with Yahoo Search's web crawler, Slurp. People have noticed a large increase in page hits and bandwidth usage, caused by Yahoo! Slurp recently. I run several sites and I have...

Posted on July 2, 2007 8:20 AM

A WebmasterWorld and Search Engine Watch Forums threads are both reporting issues with Yahoo! Slurp (Yahoo!'s Crawler) indexing pages they should not be, and in quantities that may be harmful. It appears that only specific bots are not obeying the...

Posted on January 17, 2007 7:57 AM