Ideas IP Web Web developers 
SoCal Delicious
JANUARY 15, 2010
Actually, handling short URIs in your error handler is a pretty good idea when you suffer from a mainstream CMS. requestHandler.php [L] Please note that the code above kinda disables the Web server’s error handling. Here are a few ideas how to block rogue (crappy, not behaving, …) Web robots.
SoCal Delicious
JANUARY 15, 2010
Most of these bots don’t obey robots.txt , that means you can’t even block them applying Web standards ( learn how to block rogue bots ). Their developers are just too fucking lazy to understand such protocols that every respected service on the Web (search engines…) obeys. ″, “somebot/2.0″,
Expert insights. Personalized for you.
37 
Let's personalize your content