HTML IP SEO Web 
SoCal Delicious
JANUARY 15, 2010
Most of these bots don’t obey robots.txt , that means you can’t even block them applying Web standards ( learn how to block rogue bots ). Their developers are just too fucking lazy to understand such protocols that every respected service on the Web (search engines…) obeys. ″, “somebot/2.0″,
SoCal Delicious
SEPTEMBER 22, 2008
Every web product ultimately has a bunch of user flows contained within it. For example, there might be a series of flows in how users come into the site, starting with ads, SEO, or otherwise. Typically I would start out with a series of pretty plain HTML pages using tables that just print out SQL queries. Block IP address.
Expert insights. Personalized for you.
41 
Let's personalize your content