Do you have a question? Post it now! No Registration Necessary. Now with pictures!
- Alfred Molon
May 27, 2006, 8:01 pm
rate this thread
4 out of 5
4 out of 5
This bot keeps accessing disallowed directories on my site:
User agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Google
The IP address belongs to Google (I checked with whois). What is this
bot and why does it access disallowed directories?
http://www.molon.de - Photos of Asia, Africa and Europe
Re: Google Wireless Transcoder
keyboard and typed:
It isn't a bot. It's a proxy, and is simply returning pages requested
by the end user. It can access anything that an ordinary human user
can access, because it's being driven by a human on the other side of
the proxy - it doesn't obey robots.txt, because it isn't a robot.
When someone uses Google Mobile to search the web, they are given the
option of browsing the site via Google's proxy designed to make sites
accessible on phone screens, and that shows up in your logs as Google
Wireless Transcoder. You can see how it works from a user viewpoint by
going to http://www.google.com/xhtml and entering some search terms,
or directly to the proxy front end at http://www.google.com/gwt/n and
entering the URL of your site.
Visit: http://www.GoogleFun.info - fun and games with Google!
Listen: http://www.goodge.co.uk/files/dweeb.mp3 - you'll love it!