Yahoo Slurp, Yahoo Search Crawler, Suffering From ADHD?

Mar 31, 2008 - 7:48 am 3 by
Filed Under Yahoo SEO

A DigitalPoint Forums thread has dozens of reports that Yahoo Search's crawler, Yahoo Slurp, took some bad medicine recently. Many are reporting that they see the crawler spidering their sites like never before. Some times they have seen the spider multiple to over a 1,000 crawls at one time.

The first report claimed about 500 Yahoo spiders:

I have a forum and I get 500+ (sometimes 800+) Yahoo spiders daily. Why is there so many? I only get 1 or 2 Google spiders.

Others reported similar cases with much more Yahoo spider activity then Google spider activity. These reports seemed to have died down recently.

The initial report came at Friday afternoon and then died out Saturday afternoon. So maybe it was just a temporary Yahoo glitch?

Forum discussion at DigitalPoint Forums.

Update: Yahoo sent me a statement update this behavior:

On March 29th and 30th, some of you have noticed Yahoo! Slurp spidering your website more than usual – this temporary blip was inadvertently caused by a major crawl infrastructure upgrade we have been doing for last 1 month.

While the Yahoo! Slurp should be stable now, if you continue to notice unreasonable traffic from Yahoo! spiders, please provide feedback at the Site Explorer Suggestion Board.

Thanks,

Yahoo! Search Team

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 27, 2024

May 27, 2024 - 10:00 am
Google

In Face Of AI Overview Backlash, Google Updates Docs With How To Show Web Only Results & How To Give Feedback

May 27, 2024 - 7:51 am
Google Search Engine Optimization

Google's John Mueller Blasts The Concept Of Toxic Links, Again

May 27, 2024 - 7:41 am
Google Search Engine Optimization

Some Reporting Fewer Links Reported In Google Search Console

May 27, 2024 - 7:31 am
Google

Google Images "See Exact Matches" Helps You Find Who Stole Your Images

May 27, 2024 - 7:21 am
Google

Google Mobile Tests Large Blue Visit Button On Search Results

May 27, 2024 - 7:11 am
Previous Story: Microsoft ContentAds Publisher Program Pilot Sign Up Form