Do you have a question? Post it now! No Registration Necessary. Now with pictures!
March 6, 2007, 1:48 pm
rate this thread
Thanking Jim for his reponse, I'd like to ask the NG the question that I'm
afraid is obvious, but nor for me.
Usually a search engine robot or spider, OPENS the web sites like a user
would do with a browser, or is able to READ in some way "offline" the
website files, without requesting them with a browser?
I have clues for both ways and don't know how it really happens. I need this
info to better understand how to realize a website and give it better
Re: spider job
The first way -- it requests files from the site like a normal user would.
Except that the "browser" is built into the spider itself. And normally
Toby A Inkster BSc (Hons) ARCS
Contact Me ~ http://tobyinkster.co.uk/contact
Geek of ~ HTML/SQL/Perl/PHP/Python*/Apache/Linux
* = I'm getting there!
- » Recommend a good broadband provider (in the UK) for a webmaster ?
- — Previous thread in » Webmaster Forum