(3)
Tim Mayer from Yahoo! at a thread at Search Engine Watch Forums named Rackspace hates Yahoo? Or Vice Versa? said:
We did some further testing and our crawler IPs are in fact blocked from Rackspace.
Tim said this happens quote often with hosting companies. He continues by explaining, "A customer of a hosting company like rackspace may have a customer that is being hit by our crawler and not realize who it is so they report the IP to rackspace or another provider and they block the IP at the router level."
And to think that a few years ago, I actually had a few clients sign up with RackSpace, good thing they canceled soon after.
Comments:
David Lawrence
02/05/2005 01:44 am
Why say this as though it was true? Rackspace is a managed hosting company. They no more block anything systemwide than they all eat peanut butter for lunch. If a client wants an IP blocked they'll do it. My servers have been at Rackspace for over 5 years, and I've been happily spidered by Yahoo the whole time. What claptrap.
TDavid
02/05/2005 05:54 pm
robots.txt anyone?
Barry Schwartz
02/05/2005 11:37 pm
Thanks David for your input. As you know, this site reports on fact found within forums. Tim Mayer from Yahoo! said that Rackspace blocks Yahoo! spiders, we report it. I will make sure to go into the thread and tell them what you have to say, if you have not done so already. Thank you for the true word!