Web Crawler Engineer with a Leading Web Ranking Company

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Job Description
A leading web information company is looking for an experienced
software engineer to develop and manage their industry-leading web
crawler technology. Their Crawl Engineering team is responsible for
retrieving the highest quality content from the web, engineering
scalable storage solutions for large content repositories, and building
data interfaces that allow the company to make sense of the retrieved
content. You will work with highly motivated engineers to design
reliable, high performance systems capable of collecting and managing
massive amounts of web content. This position calls for an innovative
C++ programmer to apply strong analytical skills to problems such as
distributed system design and performance analysis, system monitors and
control interfaces, storage management for hundred-plus Terabyte data
sets, and software infrastructure development.


2+ years C++
2+ years Python or Perl
Comfortable in a Linux/UNIX environment
Highly motivated and capable of independent research and development
MA/MS degree in CS, Engineering, or equivalent field
Knowledge of distributed systems development and large scale data
management a definite plus
Hiring Model
The company is actively recruiting smart individuals who are eager to
work on the most challenging problems in the internet domain. Their
Crawl Engineering team routinely breaks new ground in the areas of
algorithm design, schedulers, data gathering and analysis, and
distributed software architectures. To augment their growing team, they
are looking for engineers who thrive on these types of problems. They
value aptitude, creative thinking, and a strong potential to contribute
to the team's success above all else. If you think this is the right
environment for you, send us your resume and join one of the most
innovative companies in San Francisco.

Contact: http://www.datashaping.com/jobs13802.shtml

Site Timeline