Click here to get back home

Googlebot
 Home | NewsGroups | Search | About
Login Password
Register Now!
 alt.internet.search-engines    Post an article   get this group's latest topics as an RSS feed add this group's latest topics to your My MSN content add this group's latest topics to your My Yahoo content
Subject Author Date
Googlebot dnswebpro 06-06-2008
|--> Re: Googlebot Adrienne Boswel...06-06-2008
Posted by Andrew Heenan on June 10, 2008, 5:54 am
Please log in for more thread options
> Yet GoogleBot is complaining because they cannot access my PHP files....

No.

Googlebot does not complain, though they may go seek a more friendly site
to spider. With all the trillions of pages that want spidereing, Googlebot
is probably quite grateful to find one that closes the door - time for a tea
break and a cigarette, before the next 400 million pages ...

And if your site is not being thoroughly spidered, best to be sure what
sends them away, rather than guess at the problem.

That's assuming you want Googlebot to visit.
If you do not, then noindex and robots.txt saves everyone's time and effort.

--

Andrew
seo2seo.com
sick-site-syndrome.com

UK Residents:
STOP THE "10p Tax Ripoff"
Sign the petition to stop the government stealing from the
very poorest tell your friends about this petition:
http://petitions.pm.gov.uk/10penceband/



Posted by dnswebpro on June 10, 2008, 8:44 am
Please log in for more thread options
> Googlebot does not complain, though they may go seek a more friendly site
> to spider. With all the trillions of pages that want spidereing, Googlebot
> is probably quite grateful to find one that closes the door - time for a tea

> Andrew
> seo2seo.com
> sick-site-syndrome.com

Hmm! Yes bad choice in wording "complain".
So YOu are agreeing that without access to the .php files directly
they will not read the Domain URL and follow the links from the HTML
page code ???
As you state the doors would be closed..

At this point I will agree with you GoogleBot considers the site
closed off with out direct access to my php files..

Thank for all the help and comments,
Vannessa

Posted by Andrew Heenan on June 10, 2008, 10:41 am
Please log in for more thread options
>
>> Googlebot does not complain, though they may go seek a more friendly
>> site
>> to spider. With all the trillions of pages that want spidereing,
>> Googlebot
>> is probably quite grateful to find one that closes the door - time for a
>> tea

> So YOu are agreeing that without access to the .php files directly
> they will not read the Domain URL and follow the links from the HTML
> page code ???
> As you state the doors would be closed..
> At this point I will agree with you GoogleBot considers the site
> closed off with out direct access to my php files..

Um, no, I didn't make any specific comment about your files; but if there's
a navigation problem, then Googlebot would certainly give up after a while.

That does NOT necessarily mean the problem is PHP files.

It may be something else.

I'd suggest you use xenu to check your site's navigation; also that you
register with Google's webmaster tools and see what Google has to say on the
matter.

If your website is as consistent as your email address, anything's possible
;o)


--

Andrew
seo2seo.com
sick-site-syndrome.com

UK Residents:
STOP THE "10p Tax Ripoff"
Sign the petition to stop the government stealing from the
very poorest tell your friends about this petition:
http://petitions.pm.gov.uk/10penceband/



Posted by Big Bill on June 6, 2008, 3:39 am
Please log in for more thread options
On Thu, 5 Jun 2008 21:49:29 -0700 (PDT), dnswebpro

>Googlebot can it read html or does it perfer php code? I really would
>like someone from google to answer this question. I've had many sites,
>one i just recently moved to my hosting services got place under php
>code, (shameful i know) I've blocked the php code pages with
>Robots.txt

Ahem; Vanessa, might we see your robots.txt please?

BB :-)

--

http://www.kruse.co.uk/
http://www.fat-odin.com/
http://www.here-be-posters.co.uk/

Posted by +mrcakey on June 6, 2008, 4:37 am
Please log in for more thread options
> Googlebot can it read html or does it perfer php code? I really would

Googlebot can no more see your PHP code than any of us can. It reads
whatever the PHP code outputs to the UA. If you're struggling to get your
pages indexed, it's likely to be broken links, or maybe Google doesn't see
your deeper pages as important enough to index.

One simple thing you can do to get them to notice your pages is to add a
sitemaps.xml.

+mrcakey



Similar ThreadsPosted
How often did Googlebot come December 4, 2005, 1:51 am
Googlebot went nuts! July 14, 2005, 11:01 am
Googlebot Gone Crazy August 26, 2005, 6:49 am
Googlebot-Mobile/2.1? September 17, 2005, 2:15 am
googlebot visit October 4, 2005, 5:26 am
Googlebot becoming obnoxious October 14, 2005, 4:31 am
New website and googlebot March 28, 2006, 6:37 am
googlebot looks for css files! July 11, 2006, 2:48 pm
googlebot hasn't visited July 21, 2006, 8:30 am
Googlebot and new sites November 7, 2006, 11:12 am

Our other projects:

Art Dolls, Fairies and Mermaids - Sunnyfaces.net

Roy's Linux, Programming and Search Engines messages

1-Script XML SitemapXML Sitemap