Do you have a question? Post it now! No Registration Necessary. Now with pictures!
- Posted on
March 8, 2006, 12:43 pm
rate this thread
Is it usual for the googlebot to spider orphan folders which have
no references to them anywhere?
For example, last night I put up a proposed new index page for a
client to look at, in a newly made entirely unreferenced folder on a
website that google spiders fairly regularly. I recently did a similar
thing for another proposed page.
In both cases, the googlebot spidered them on its next visit. How
does it find such folders? Is it normal?
How do you do?
If that were true (no references) then it's unlikely, but ...
... do you have the google tool-bar loaded? or perhaps a version of
Opera that still displays context sensitive ads? or maybe your client
perhaps you have a dynamic site-map script?
Check your logs - you'll see some access you don't recognise right there
between your browsing the pages and the goog-bot slurping it up.
whither a trophy?