Do you have a question? Post it now! No Registration Necessary. Now with pictures!
- Posted on
October 8, 2006, 10:36 am
rate this thread
My web sites queries on Google are full of dangerous referrals.
The problem is this when I ask for the my web site name query are
displayed lot of refferrals full of advertising. Some of them suck all
my RAM and block my PC. I think all these gives to my web site users a
bad idea of my site.
What can I do?
Are they bad search engines?
Can I ban their IP from crawling my web site pages?
How canna do?
Re: my web sites queries on google full of dangerous referrals
Here is mine http://www.coreybryant.org/robots.txt that I created a
long time ago - I am sure some of them are gone and there are new ones.
Check out http://www.robotstxt.org/wc/exclusion.html also for some more
information as well as http://www.clockwatchers.com/robots_bad.html
Hopefully that is a start - and remember with them being bad, chances
are they probably won't follow that protocol