SEM as a Business Decision | Main | Collapse and Expand Right Column

May 10, 2004

MSNBot acting like the old Googlebot?

Once upon a time, Google's spider ran rampant on the web, and webmasters all over took extreme measures in response.

According to a recent post at Best Practices, it seems that MSN's spider is having similar growing pains. Yikes - if I were getting hammered like that, I wouldn't rely on robots.txt, I'd block every known MSNbot IP address.



Like The Story? Vote For It On Yahoo Buzz! Or On Sphinn!

posted DanThies in Microsoft MSN Search at May 10, 2004 10:13 PM Comments (0)

Sphinn sphinn-favicon.png • Tweet This! Twitter-16x16.png • Digg digg-favicon.jpg • Delicious delicious-favicon.png • StumbleUpon delicious-favicon.png • Google Co-op google-favicon-16.png Cartoon Barry Says Socialize

Post a comment (Note: Can Take 120 Seconds For Your Comment To Show Up)

Do you want us to save your personal Information?

Premium Sponsors + advertise

To subscribe to the Search Engine Roundtable, click here