Once upon a time, Google's spider ran rampant on the web, and webmasters all over took extreme measures in response.
According to a recent post at Best Practices, it seems that MSN's spider is having similar growing pains. Yikes - if I were getting hammered like that, I wouldn't rely on robots.txt, I'd block every known MSNbot IP address.
