Write some Software

I need a PHP crawler/scraper, that will traverse 1 site (that's it, no other sites), to gather the contents of that site, and export all that data to a CSV file. The site in question has about 10K-17K products.

Crawler needs to be able to:

1. Get all product/category links on that site

2. On the category page, get the content of that page and product links attached to that page

3. Gather the image URL, title, content, price, specifications of that product page

4. Either save that data to a database and then export to a CSV file, or export directly to CSV (your choice)

Like this:

+ Main Site with links

++ Category

+++ Product Listing

+++ Product Listing

++ Category

+++ Product Listing

Evner: MySQL, PHP, Software Arkitektur, Web Skrabning

Se mere: write the contents, write content price, price crawler, hybride, 10k url, traverse, scraper crawler php, image content scraper php, price site scraper, image scraper php, php crawler product, product listing sites, php write csv, price scraper crawler, data image scraper, gather product data, crawler price, image crawler, csv file scraper, product category database csv, php url scraper, image crawler php, title crawler, site crawler file, product category csv

Om arbejdsgiveren:
( 27 bedømmelser ) Park Ridge, United States

Projekt ID: #6047201

3 freelancere byder i gennemsnit $240 på dette job


Hello,it's nice to meet you. I am top 8th in freelancer. I have built projects related to (C++,C#,VC,VB,Java,.NET,Web(wordpress,joomla,codiegnitor,magento and so on). I have 260 good reviews and My customer always Flere

$257 USD in 4 dage
(171 bedømmelser)

A proposal has not yet been provided

$333 USD in 5 dage
(21 bedømmelser)

A proposal has not yet been provided

$233 USD in 5 dage
(5 bedømmelser)

Hi, I am a dynamic problem solver,I have seen your details and assured you to do it best for you exactly as you expecting with great quality and faster complete rate. I am started new on freelancer but doing Php( Flere

$129 USD in 5 dage
(4 bedømmelser)