Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View
I've had this web site up for years and I don't know maybe a couple
years ago i added a more advanced php driven system under
many of the images are annotated or at least the title gives an
indication of the location and date. I just did a test and was able to
find a keyword under the new /1 section but google images doesn't see it
at all. The problem I think is the galleries are set up as subfolders
and the php files format the gallery so I've got all these indexless
folders which are basically garbage for a web browser:

What should look like this:
Is indexed like this:

On my other baynatives site I added a line in the longest irrelevant
page to prevent indexing that like such:
<meta name='googlebot' content='noarchive, noindex'>
and that works like a charm but the site as far as I know
does not directly point to these nested content folder except in the php
address [?SC=go.php&DIR=]

I'm not opposed to people viewing raw directories, sometimes that's
useful to point to an image or file without all the formatting but I
don't want them indexed in search engines.

Any Advice?

Paul Furman
Bay Natives Nursery
(415) 722-6037

Re: robots.txt

Seems to be a .htaccess issue, I added this line:

Options -Indexes

Although I'd prefer to simply prevent search engines from indexing. I
probably have some folders in there which are now inacessible.

Paul Furman wrote:

Quoted text here. Click to load it
Quoted text here. Click to load it

Re: robots.txt

Paul Furman wrote:
Quoted text here. Click to load it

Your subject line indicates you are asking about robots.txt, but you
haven't mentioned it in either of your messages.


Re: robots.txt

Bergamot wrote:

Quoted text here. Click to load it

I used a googlebot metadata in the one instance.

The best I can figure robots.txt requires you to list each directory
that's forbidden and I've got a huge list or directories that grows
weekly. I was hoping for a robot command that forbids indexing indexless

Do you know if robots.txt is effected by php calls? All the pages appear
to be located in but they are really in many deeply
nested subdirectories.

Site Timeline