Do you have a question? Post it now! No Registration Necessary. Now with pictures!
April 3, 2005, 4:38 pm
rate this thread
I was wondering if it's possible to configure robots.txt or to add
onpage googlebot meta data to allow the image googlebot to index a
subdirectory but block it from indexing the parent?
For example, I want googlebot-images to index .jpg files in:
but I don't want it to index .jpg files in
Is this possible?
Re: Subdirectory indexing
Somebody please correct me if I'm wrong, but isn't this a simple exercise in
robots.txt? You just deny access to /thumbnails/ and allow access to
/thumbnails/pics/. The robots should honour that. I don't know if
/thumbnail/pics/ will then be reachable by a spider, but deep linking might
help. Perhaps I misunderstood what you meant exactly.
Roy S. Schestowitz