SoCal Delicious
JANUARY 15, 2010
all you have is the web statistics provided by your web host or a free web statistics and analytics service you wont be able to get the information you need to block the bot. Once youve located the entries that belong to the bot, look for the IP address and the user agent string. You need to have a specific bot that you wish to block.
Both Sides of the Table
SEPTEMBER 10, 2010
The start of the argument is that you need to separate using the Internet into “infrastructure & cloud services&# (basically the protocols of the Internet such as HTTP, TCP/IP, SMTP, etc. + web storage, elastic computing) from how you consume the Internet as a user (the front end – HTML).
SoCal Delicious
JANUARY 15, 2010
Their developers are just too fucking lazy to understand such protocols that every respected service on the Web (search engines…) obeys. It’s hosted by Rackspace, which is a hosting service that obviously doesn’t care much about its reputation. It can get worse when a URI gets retweeted often.
Expert insights. Personalized for you.
38 
Let's personalize your content