googlebot - how deep it can index website?

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View
I set up a website and I think that googebot comes only two or three steps
down through my links. Is there any rule for it?
Why crawler doesn't follow to the last link?

Re: googlebot - how deep it can index website?

On Tue, 01 Jun 2004 10:16:59 +0200, Ryszard Myrkocz wrote:

Quoted text here. Click to load it

Googlebot often takes a long time to crawl sites with few inbound links.

To get Googlebot to index faster, get more inbound linking to your site.

Of course, your site may have problems which prevent crawling.  There's no
way for us to tell unless you post your URL.

You can test yourself by navigating your site in the Lynx web browser.  If
Lynx can navigate your site, then it is very likely that Googlebot can.


Site Timeline