Rackspace Hosting Blocks Yahoo! Spiders

Google Backlink Update Underway | Main | Ask Jeeves Acquires Bloglines

February 4, 2005

Rackspace Hosting Blocks Yahoo! Spiders

Tim Mayer from Yahoo! at a thread at Search Engine Watch Forums named Rackspace hates Yahoo? Or Vice Versa? said:

We did some further testing and our crawler IPs are in fact blocked from Rackspace.

Tim said this happens quote often with hosting companies. He continues by explaining, "A customer of a hosting company like rackspace may have a customer that is being hit by our crawler and not realize who it is so they report the IP to rackspace or another provider and they block the IP at the router level."

And to think that a few years ago, I actually had a few clients sign up with RackSpace, good thing they canceled soon after.

Like The Story? Vote For It On Yahoo Buzz! Or On Sphinn!

posted rustybrick in Yahoo! Search Optimization at February 4, 2005 3:38 PM Comments (3)

Comments

Why say this as though it was true? Rackspace is a managed hosting company. They no more block anything systemwide than they all eat peanut butter for lunch. If a client wants an IP blocked they'll do it. My servers have been at Rackspace for over 5 years, and I've been happily spidered by Yahoo the whole time.

What claptrap.

Posted by David Lawrence at February 4, 2005 20:44

robots.txt anyone?

Posted by TDavid at February 5, 2005 12:54

Thanks David for your input. As you know, this site reports on fact found within forums. Tim Mayer from Yahoo! said that Rackspace blocks Yahoo! spiders, we report it. I will make sure to go into the thread and tell them what you have to say, if you have not done so already.

Thank you for the true word!

Posted by Barry Schwartz at February 5, 2005 18:37

Premium Sponsors + advertise

All Out on the Table

Recent Table Activity

SEM Forum Threads

To subscribe to the Search Engine Roundtable, click here