Do you have a question? Post it now! No Registration Necessary. Now with pictures!
- Posted on
- Do I need a robots.txt?
October 15, 2003, 6:28 pm
rate this thread
1) Do I need the file?
2) If I do not have the file, will the bots ignore my site?
3) Will havig a robot.txt actually attract bots and spiders?
If I need a file, is there a generic robot.txt which can be downloaded, or
do I need to create one from scratch?
Thanks for your help!
- rfgdxm/Robert F. Golaszewski
October 15, 2003, 6:40 pm
Re: Do I need a robots.txt?
If you can't figure out a good reason for having a robots.txt file,
For information about the psychedelic drug DXM, including dangers.
Yet another murder by someone on Coricidin: