crawling :(

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View
i have 3 sites all with PR of 4, one is spidered on an almost daily basis
with the others remaining unspidered for almost 2 months now

anyone know a tip to get the new content indexed?

Re: crawling :(

On Thu, 06 May 2004 13:08:07 +0100, mark | r wrote:

Quoted text here. Click to load it

1. Make sure your site is crawlable.

a. Test your site in a stick-dumb web browser such as Lynx, to make sure
that Googlebot (which can also be stick-dumb) can navigate it.

2. Get inbound links.

Nothing will get Googlebot to crawl your site faster than inbond links.


Re: crawling :(

Quoted text here. Click to load it

If it helps any, Mark, I am experiencing the same problem.

The only pages being spidered are those with new/recent inbound links.


Site Timeline