IP Patents RSS Tool 
SoCal Delicious
JANUARY 15, 2010
While handling bots, you should detect search engine crawlers, too: /* lookup your crawler IP database to populate $isCrawler; then, if the IP wasnt identified as search engine crawler: */ if ($isCrawler !== from the IP address range 65.52.0.0 Other rogue bots identify themselves by IP addy, user agent, and/or referrer.
SoCal Delicious
JANUARY 15, 2010
For example Twitter , where gazillions of bots [type A] follow other equally superfluous but nevertheless very busy bots [type B] that automatically generate 27% valuable content (links to penis enlargement tools) and 73% not exactly exciting girly chatter (breeding demand for cheap viagra). It can get worse when a URI gets retweeted often.
Expert insights. Personalized for you.
37 
Let's personalize your content