SoCal Delicious

JANUARY 15, 2010

ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. A method to verify the bot All IP addresses used by a bot should resolve to server names having a unique pattern. For example Googlebot comes only from servers named "crawl" + "-" + replace($IP, ".", "-") + ".googlebot.com"

Social Media 41

Social Media Develop Development Media 41

SoCal Delicious

JANUARY 15, 2010

While handling bots, you should detect search engine crawlers, too: /* lookup your crawler IP database to populate $isCrawler; then, if the IP wasnt identified as search engine crawler: */ if ($isCrawler !== from the IP address range 65.52.0.0 Other rogue bots identify themselves by IP addy, user agent, and/or referrer.

SEO 37

SEO IP PHP Blogging 37

SoCal Delicious

SEPTEMBER 22, 2008

Where it might look something like: 1000, profile.photo.update, 1, 9:30AM 3/14/2008. For example, there might be a series of flows in how users come into the site, starting with ads, SEO, or otherwise. September 18th, 2008 at 8:00 am. Virtual Goods Summit 2008 + last week’s Twitter links » Add New Comment.

Startup 29

Startup IP Email Report 29