How brain-amputated developers created the social media plague
SoCal Delicious
JANUARY 15, 2010
Most of these bots don’t obey robots.txt , that means you can’t even block them applying Web standards ( learn how to block rogue bots ). Their developers are just too fucking lazy to understand such protocols that every respected service on the Web (search engines…) obeys.
Let's personalize your content