|
Posted by Joe Fox on February 21, 2008, 5:09 pm
Please log in for more thread options
> John Bokma schreef:
>>
>>> I don't want certain humans (only a few hundred in number but all on
>>> dynamic IPs in several countries) to be able to read the robots.txt
>>> that I'm giving search engines because I don't want them to know
>>> what pages I am telling SE's "disallow"
>>
>> Maybe it helps if you explain the why. Which is not: I don't want
>> them to read. What do you want to achieve? Why should those people
>> not be able to read your robots.txt
>>
>>> What's so wrong with this?
>>
>> To me it sounds pointless. I see no gain in it, but maybe you can
>> explain better the *why*?
>
> He doesn't want real people to know which files he is hiding and were
> to find them.
Exactly.
> I agree John, it is pointless.
Perhaps, but if pointless it is also harmless. I'm sure that
google & others don't give a fork whether human users are able to
determine what I allow or disallow to be indexed. I'm not hiding
content, I'm wanting to keep to myself what is or is not indexed.
| 
XML Sitemap