Googlebot acting strange

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View

Anyone know why googlebot would be looking up words in my online
dictionary?  There are no links to the words anywhere that I can find
and it's making no sense to me.  It's performing a steady stream of
lookups with no rhyme nor reason to the words that I can see (it's not
alphabetically going through every word in the dictionary, it's doing
acronyms too like NNTP, and it's been going on for days now).

This is the dictionary interface:

And here are some examples of what I have seen: - - [24/Jun/2005:12:53:14 -0400] "GET /cgi-bin/Dict?
Form=Dict2&Database=*&Query=Bridle HTTP/1.1" 200 48481 "-" "Mozilla/5.0
(compatible; Googlebot/2.1; +"

and it has even done phrases: - - [24/Jun/2005:13:18:16 -0400] "GET /cgi-bin/Dict?
Form=Dict2&Database=*&Query=To+hear+a+bird+sing HTTP/1.1" 200 45149 "-"
"Mozilla/5.0 (compatible; Googlebot/2.1;

It's not hurting my server performance and I know I could do a
robots.txt entry to stop them, but I'm more curious as to why it is
happening, mainly because I don't see how it could be happening.

Free Privacy Resources

Re: Googlebot acting strange says...
Quoted text here. Click to load it
I think I figured it out.  I'll bet someone running googlebar uses my
online dictionaries regularly.  I know that pages visited by someone
running googlebar are added to the spiders "to be indexed" database and
that is how some "never linked anywhere" pages end up in google.  That
is probably this case too.

Free Privacy Resources

Re: Googlebot acting strange

Writing in news:alt.www.webmaster
 From the safety of the Packetderm, LLC cafeteria

Quoted text here. Click to load it

or Opera, the Free version configured for context sensitive advertising

William Tasso

Site Timeline