MSNBot acting like the old Googlebot?

May 10, 2004 - 10:13 pm 0 by
Filed Under Bing Search

Once upon a time, Google's spider ran rampant on the web, and webmasters all over took extreme measures in response.

According to a recent post at Best Practices, it seems that MSN's spider is having similar growing pains. Yikes - if I were getting hammered like that, I wouldn't rely on robots.txt, I'd block every known MSNbot IP address.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: September 17, 2025

Sep 17, 2025 - 10:00 am
Google

Google Discover Tests Showing X Posts From Just Your Followers?

Sep 17, 2025 - 7:51 am
Other Search Engines

OpenAI Updates Search In ChatGPT: Factuality, Shopping & Formatting

Sep 17, 2025 - 7:41 am
Google

Google: Searchers Want AI Summaries Over Links

Sep 17, 2025 - 7:31 am
Google Maps

Google Business API Q&A Feature Going Away November 3 (Changes Coming?)

Sep 17, 2025 - 7:21 am
Google Ads

New Google Merchant Center Suspension Video Verification

Sep 17, 2025 - 7:11 am
 
Previous Story: SEM as a Business Decision