Remove 2005 Remove HTML Remove Sites Remove Technical Review
article thumbnail

How brain-amputated developers created the social media plague

SoCal Delicious

The technically savvy reader, familiar with my attitude, has already figured out that I’ve read way too many raw logs. A Web robot should fetch a site’s /robots.txt file before it launches a request for content, when it doesn’t have a cached version from the same day. As always, it’s the user’s fault.