This site uses cookies to improve your experience. By viewing our content, you are accepting the use of cookies. To help us insure we adhere to various privacy regulations, please select your country/region of residence. If you do not select a country we will assume you are from the United States. View our privacy policy and terms of use.

Remove 2005 Remove Google Remove IP Remove SEO
article thumbnail

How brain-amputated developers created the social media plague

SoCal Delicious

JANUARY 15, 2010

Topsy , for example, does respect the content producer — so morons using “Python-urllib/1.17″ or “AppEngine-Google; (+[link] appid: mapthislink)&# could obey the Robots Exclusion Protocol (REP), too. ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. googlebot.com&#.

Social Media 41
Social Media Develop Development Media 41
article thumbnail

How to cleverly integrate your own URI shortener

SoCal Delicious

JANUARY 15, 2010

While handling bots, you should detect search engine crawlers, too: /* lookup your crawler IP database to populate $isCrawler; then, if the IP wasnt identified as search engine crawler: */ if ($isCrawler !== from the IP address range 65.52.0.0 Other rogue bots identify themselves by IP addy, user agent, and/or referrer.

SEO 37
SEO IP PHP Blogging 37
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

 

Stay Connected

Join 5,000+ Insiders by signing up for our newsletter

About
About
Editions
Editions
Topics
Powered by Aggregage | Terms and Conditions | Your California Rights and Privacy Policy
© Aggregage 2024