If you're like me and get spammed and scraped by unquestionables that are certainly not up to any good then this article may help you decide which search engine robots to allow and which ones to ban.
I always have trouble deciding which IP addresses to block on my blog and once of twice I've probably even blocked a ligitimate robot.
The article is titled : How to Identify Legitimate Search Robots and hopefully it will give you a few pointers on which IP addresses to kick into touch!
Isn't it a shame that the internet is full of so many delinquents that normal Webmasters trying to improve their sites and provide good, quality content are disrupted and waste so much time trying to contact the slugs of the 'net.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment