How to Block Unwanted Bots from Your Website with.htaccess
SoCal Delicious
JANUARY 15, 2010
This doesnt mean that you cant try, of course. U; en)" (among others) while the Google search engine bot goes by"Googlebot/2.1 (+[link] (among others). You should of course change the numbers "127.0.0.1" You should of course change "SpammerRobot" to the actual user agent you want to block. For example, version 9.51
Let's personalize your content