FAQ Sites Web Web Development 
SoCal Delicious
JANUARY 15, 2010
Most of these bots don’t obey robots.txt , that means you can’t even block them applying Web standards ( learn how to block rogue bots ). Their developers are just too fucking lazy to understand such protocols that every respected service on the Web (search engines…) obeys. ″, “somebot/2.0″,
SoCal Delicious
JANUARY 15, 2010
Here’s how you can (could) integrate a URI shortener into your site’s architecture. Your site’s architecture may require a different approach. By integrating a URI shortener into your site architecture you gain the abilitiy to perform way more than URI shortening. You need to take care of errors yourself.
Expert insights. Personalized for you.
41 
Let's personalize your content