help with syntax of robots.txt pls?

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View

I'd like a robots.txt file which blocks all the search engines from any
files which have a .php extension. Does anyone know how to do this

Kind Regards,
                    Pete Bennett

Re: help with syntax of robots.txt pls?

Quoted text here. Click to load it

Only well-behaving bots honor the rules set in the robots.txt file (and the
META tags). Also, the robots.txt file doesn't support the blocking of search
engines directly. Read up on the syntax of the robots.txt file here:

If your server runs on Apache, you can follow the documentation on "Access
control", which comes in handy using .htaccess files:

Most servers can deny access based on IP address and/or hostname; check your
server's documentation.

Kim André Akerø
- ICQ: 92708098

Site Timeline