Click here to get back home

re google bot

 HomeNewsGroups | Search | About
 comp.infosystems.www.authoring.html    Post an article   get this group's latest topics as an RSS feed add this group's latest topics to your My MSN content add this group's latest topics to your My Yahoo content
Subject Author Date
re google bot David Starr 04-26-2006
`--> Re: re google bot www.1-script.co...05-02-2006
Get Chitika Premium
Posted by David Starr on April 26, 2006, 2:21 am
Please log in for more thread options


Well their bot is BANNED on my domain together with the yahoo,msn and
other idiots who have bots and i haven't seen the google bot for a few
weeks now,thank goodness.i hope it is something to do with the court
case that google lost.Yet those other looser bots from yahoo and msn
just keep on coming back even they they get a 403 error

Posted by Neredbojias on April 26, 2006, 2:31 am
Please log in for more thread options


vouchsafed:

> Well their bot is BANNED on my domain together with the yahoo,msn and
> other idiots who have bots and i haven't seen the google bot for a few
> weeks now,thank goodness.i hope it is something to do with the court
> case that google lost.Yet those other looser bots from yahoo and msn
> just keep on coming back even they they get a 403 error

That's nice. Is there a reason for this or did you just decide to go on a
bot-banning spree?

--
Neredbojias
Infinity has its limits.

Posted by www.1-script.com on May 2, 2006, 11:38 am
Please log in for more thread options


David Starr wrote:


> Well their bot is BANNED on my domain together with the yahoo,msn and
> other idiots who have bots and i haven't seen the google bot for a few
> weeks now,thank goodness.


Was is much harder than adding

User-agent: *
Disallow: /

To your robots.txt ?

It's funny though but you might have just disabled the ones that actually
obey robot.txt and gave your site off to rogue bots exclusively. Smooth!

--
Cheers,
Dmitri
See Site Sig Below
-------------------------------------


--
##-----------------------------------------------##
Article posted with Web
Developer's USENET Archive
http://www.1-script.com/forums/
Web and RSS gateway
to your favorite newsgroup -
comp.infosystems.www.authoring.html - 19933
messages and counting!
##-----------------------------------------------##

Similar ThreadsPosted
'google' 2 October 20, 2007, 3:42 pm
Why has Google sent me to Coventry? January 28, 2005, 4:54 pm
Google Bot problems? March 9, 2005, 3:03 pm
google satellite map June 28, 2005, 5:06 pm
ALT attribute at Google January 4, 2006, 5:57 pm
Google broke itself September 23, 2006, 4:46 pm
Google incremental September 28, 2008, 4:55 pm
google.com javascript October 17, 2008, 8:59 am
Google Adsense problem August 15, 2005, 5:55 am
Google HTML -> WAP converter January 15, 2006, 12:36 am

Our other projects:

Art Dolls, Fairies and Mermaids - Sunnyfaces.net

Roy's Linux, Programming and Search Engines messages

1-Script XML SitemapXML Sitemap