SoCal Delicious

JANUARY 15, 2010

ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. A method to verify the bot All IP addresses used by a bot should resolve to server names having a unique pattern. For example Googlebot comes only from servers named "crawl" + "-" + replace($IP, ".", "-") + ".googlebot.com" Sad but true.

Social Media 41

Social Media Develop Development Media 41

SoCal Delicious

JANUARY 15, 2010

Actually, handling short URIs in your error handler is a pretty good idea when you suffer from a mainstream CMS. Here are a few ideas how to block rogue (crappy, not behaving, …) Web robots. from the IP address range 65.52.0.0 Other rogue bots identify themselves by IP addy, user agent, and/or referrer.

SEO 37

SEO IP PHP Blogging 37

SoCal Delicious

SEPTEMBER 22, 2008

In it, I cover some more general philosophical ideas about how to approach what to measure and what not to measure. As you create prototypes of your product, you should throw up some free, simple analytics to get you some rough ideas of what’s happening inside the functionality. &# This blog is to address these questions.

Startup 29

Startup IP Email Report 29