Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View
What is the difference between these two crawlers?

ia_archiver (+http://www.alexa.com/site/help/webmasters ;

One must be the crawler of www.archive.org, but what is the other one?

Alfred Molon
http://www.molon.de - Photos of Asia, Africa and Europe

Re: IA-Archiver

Alfred Molon wrote:
Quoted text here. Click to load it


"The Alexa Web Information Service (AWIS) makes Alexa Internet's data on
Web sites available to researchers and website developers. The various
operations offered as a part of AWIS include URL Information, Web
Search, Browse Category, and Crawl Meta Data. These operations can
enable software developers with the skills to build applications or
services based on XML to do a number of things."

"As a service to future historians, scholars, and other interested
parties, Alexa Internet donates a copy of each crawl of the Web to the
Internet Archive"


Site Timeline