Remove IP Remove RSS Remove Web Remove Web Development
article thumbnail

How brain-amputated developers created the social media plague

SoCal Delicious

Most of these bots don’t obey robots.txt , that means you can’t even block them applying Web standards ( learn how to block rogue bots ). Their developers are just too fucking lazy to understand such protocols that every respected service on the Web (search engines…) obeys. ″, “somebot/2.0″,

article thumbnail

How to cleverly integrate your own URI shortener

SoCal Delicious

requestHandler.php [L] Please note that the code above kinda disables the Web server’s error handling. Here are a few ideas how to block rogue (crappy, not behaving, …) Web robots. from the IP address range 65.52.0.0 Other rogue bots identify themselves by IP addy, user agent, and/or referrer.

SEO 37