|
Posted by Tonnie Lubbers on February 21, 2008, 12:52 pm
Please log in for more thread options John Bokma schreef:
>
>> I don't want certain humans (only a few hundred in number but all on
>> dynamic IPs in several countries) to be able to read the robots.txt that
>> I'm giving search engines because I don't want them to know what pages I
>> am telling SE's "disallow"
>
> Maybe it helps if you explain the why. Which is not: I don't want them to
> read. What do you want to achieve? Why should those people not be able to
> read your robots.txt
>
>> What's so wrong with this?
>
> To me it sounds pointless. I see no gain in it, but maybe you can explain
> better the *why*?
He doesn't want real people to know which files he is hiding and were to
find them.
I agree John, it is pointless.
> BTW: I disagree with others that Google et al should have a problem with
> this. Although it's cloaking, it's not something (in this case) Google
> should care about. It's like getting upset about a site that shows a flag
> on its page based on the country you connect from, and feeds Google a flag
> of the USA :-)
If i were a bot, i would get very upset. Eating flags all day long seems
to me not the best meal one can get. :)
--
Webdesign: http://vision2form.nl/webontwerp/
Korte handleiding zoekmachine optimalisatie / gevonden worden:
http://vision2form.nl/webontwerp/gevonden-worden.html
Lifestyle - wonen reizen en genieten : http://vision4living.com
| 
XML Sitemap