I gang

Web crawler

We need a web crawler that will go through 8 specific websites that contain directories of American manufacturers (e.g. [url removed, login to view]) to pull information on the companies listed in the directories. The company listings should be stored in a database that can be easily exported into an Excel / CSV / Tab delimited text file.

At a minimum, for each company, we would need to store: Product Category/Subcategory, Company Name, Hyperlink to Company Website, Street Address, City, State, Phone Number, Fax Number. We do not need all information from the website, just information on all the Companies listed (per specific instructions that will be distributed once the project is assigned).

Script should be performance-based and not be taxing on the directory servers. Immediate need is to run the crawler on 8 specific websites. Request could be expanded to further websites and therefore script may need to be adaptable.

Evner: Dataindførsel, Datasøgning, Web Skrabning

Se mere: crawler street address web, www manufacturers com, web-crawler, script to pull data from a website, scraping data from web database, pull data from website into excel, manufacturers listings, distributed data entry, directory web scraping, directory of manufacturers, adaptable, web fax, american manufacturers, website crawler, web scraping from websites, web performance, web directories, web contain, scraping crawler, database crawler, data crawler, crawler, web data crawler, scraping data directory, tab delimited text

Om arbejdsgiveren:
( 1 bedømmelse ) New York, United States

Projekt ID: #977541

Tildelt til:


Pls Check PM

$250 USD på 1 dag
(221 bedømmelser)

3 freelancere byder i gennemsnit $250 på dette job


I can do this job for you. See PM for details.

$250 USD in 3 dage
(103 bedømmelser)

As my first attempt at bidding on a job, I would like to say I believe I can complete this quickly and properly.

$250 USD på 1 dag
(0 bedømmelser)