SoCal Delicious

JANUARY 15, 2010

How to Identify the Bot You Want to Block Before you can block a bot, you will need to know at least one of two things: the IP address where the bot is coming from or the"User Agent string" that the bot is using. Once youve located the entries that belong to the bot, look for the IP address and the user agent string. htaccess ".

IP 38

IP PHP Web RSS 38

SoCal Delicious

SEPTEMBER 22, 2008

This likely means something like Google Analytics , although there is a very large universe of equivalent tools out there as well. Google analytics can’t really tell you much - it’s not very actionable. Where it might look something like: 1000, profile.photo.update, 1, 9:30AM 3/14/2008. Make sense? as you go.

Startup 29

Startup IP Email Report 29

SoCal Delicious

JANUARY 15, 2010

Topsy , for example, does respect the content producer — so morons using “Python-urllib/1.17″ or “AppEngine-Google; (+[link] appid: mapthislink)&# could obey the Robots Exclusion Protocol (REP), too. ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. googlebot.com&#.

Social Media 41

Social Media Develop Development Media 41