Startup Business Model Considerations
SoCal CTO
FEBRUARY 25, 2009
Now, given our current economic crisis and VC ‘challenges’, the barriers to funding have gone up significantly as well.
SoCal CTO
FEBRUARY 25, 2009
Now, given our current economic crisis and VC ‘challenges’, the barriers to funding have gone up significantly as well.
SoCal Delicious
JANUARY 15, 2010
While handling bots, you should detect search engine crawlers, too: /* lookup your crawler IP database to populate $isCrawler; then, if the IP wasnt identified as search engine crawler: */ if ($isCrawler !== from the IP address range 65.52.0.0 Other rogue bots identify themselves by IP addy, user agent, and/or referrer.
SoCal Delicious
JANUARY 15, 2010
ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. A method to verify the bot All IP addresses used by a bot should resolve to server names having a unique pattern. For example Googlebot comes only from servers named "crawl" + "-" + replace($IP, ".", "-") + ".googlebot.com" SEO Mofo ! )
Let's personalize your content