SoCal Delicious

JANUARY 15, 2010

Those bots retrieve a copyof your web page so that they can include relevant terms from that page in their search index. Not all bots are benign however.Some bots go through your website looking for web forms and email addresses to send you spam. You need to be able to check your sites raw web logs.

IP 38

IP PHP Web RSS 38

SoCal Delicious

JANUARY 15, 2010

Here’s how you can (could) integrate a URI shortener into your site’s architecture. Your site’s architecture may require a different approach. By integrating a URI shortener into your site architecture you gain the abilitiy to perform way more than URI shortening. You need to take care of errors yourself.

SEO 37

SEO IP PHP Blogging 37

SoCal Delicious

JANUARY 15, 2010

Most of these bots don’t obey robots.txt , that means you can’t even block them applying Web standards ( learn how to block rogue bots ). Their developers are just too fucking lazy to understand such protocols that every respected service on the Web (search engines…) obeys. ″, “somebot/2.0″,

Social Media 41

Social Media Develop Development Media 41