Remove 2005 Remove Google Remove HTML Remove IP
article thumbnail

How brain-amputated developers created the social media plague

SoCal Delicious

Topsy , for example, does respect the content producer — so morons using “Python-urllib/1.17″ or “AppEngine-Google; (+[link] appid: mapthislink)&# could obey the Robots Exclusion Protocol (REP), too. ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. googlebot.com&#.