Web Crawler Engineer with a Leading Web Ranking Company

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View
Job Description

A leading web information company is looking for an experienced
software engineer to develop and manage their industry-leading web
crawler technology. Their Crawl Engineering team is responsible for
retrieving the highest quality content from the web, engineering
scalable storage solutions for large content repositories, and building
data interfaces that allow the company to make sense of the retrieved
content. You will work with highly motivated engineers to design
reliable, high performance systems capable of collecting and managing
massive amounts of web content. This position calls for an innovative
C++ programmer to apply strong analytical skills to problems such as
distributed system design and performance analysis, system monitors and
control interfaces, storage management for hundred-plus Terabyte data
sets, and software infrastructure development.


2+ years C++
2+ years Python or Perl
Comfortable in a Linux/UNIX environment
Highly motivated and capable of independent research and development
MA/MS degree in CS, Engineering, or equivalent field
Knowledge of distributed systems development and large scale data
management a definite plus

Hiring Model

The company is actively recruiting smart individuals who are eager to
work on the most challenging problems in the internet domain. Their
Crawl Engineering team routinely breaks new ground in the areas of
algorithm design, schedulers, data gathering and analysis, and
distributed software architectures. To augment their growing team, they
are looking for engineers who thrive on these types of problems. They
value aptitude, creative thinking, and a strong potential to contribute
to the team's success above all else. If you think this is the right
environment for you, send us your resume and join one of the most
innovative companies in San Francisco.

Details: nhttp://www.datashaping.com/jobs13802.shtml

Re: Web Crawler Engineer with a Leading Web Ranking Company

Quoted text here. Click to load it

Yes, but it has been some time ago :-)

Quoted text here. Click to load it

12+ years Perl, currently learning Python

Quoted text here. Click to load it



MSc in CS, BSc in Engineering :-)

Quoted text here. Click to load it


They can hire me freelance :-D.

John                Experienced Perl programmer: http://castleamber.com/

Firefox Fast Search http://johnbokma.com/firefox/keymarks-explained.html

Site Timeline