2005 IP RSS Sites 
SoCal Delicious
JANUARY 15, 2010
Here’s how you can (could) integrate a URI shortener into your site’s architecture. Your site’s architecture may require a different approach. By integrating a URI shortener into your site architecture you gain the abilitiy to perform way more than URI shortening. from the IP address range 65.52.0.0
SoCal Delicious
JANUARY 15, 2010
ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. A method to verify the bot All IP addresses used by a bot should resolve to server names having a unique pattern. For example Googlebot comes only from servers named "crawl" + "-" + replace($IP, ".", "-") + ".googlebot.com"
Expert insights. Personalized for you.
37 
Let's personalize your content