SoCal Delicious

JANUARY 15, 2010

this is not the case, you wont be able to do anything mentioned here without bringing your site down. You need to be able to check your sites raw web logs. Once youve located the entries that belong to the bot, look for the IP address and the user agent string. The IP address is a series of 4 numbers separated by dots.

IP 38

IP PHP Web RSS 38

SoCal Delicious

JANUARY 15, 2010

Here’s how you can (could) integrate a URI shortener into your site’s architecture. Your site’s architecture may require a different approach. By integrating a URI shortener into your site architecture you gain the abilitiy to perform way more than URI shortening. from the IP address range 65.52.0.0

SEO 37

SEO IP PHP Blogging 37

SoCal Delicious

JANUARY 15, 2010

ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. A method to verify the bot All IP addresses used by a bot should resolve to server names having a unique pattern. For example Googlebot comes only from servers named "crawl" + "-" + replace($IP, ".", "-") + ".googlebot.com"

Social Media 41

Social Media Develop Development Media 41