Lukket

Scrape Alexa Directory (PHP, Curl MySQL)

I am interested in a program which can scrape the Alexa directory (yes, the entire thing) and either store it in a directory-based structure or MySQL (preferable).

I would prefer the programmer to us PHP, as I can reasonably understand this programming language and make minor edits later on if necessary.

This program must explore the entire Alexa directory.

For example:

Top > Shopping > Consumer Electronics > Video > Television

(can be found at [url removed, login to view];CategoryID=220503&mode=general&Start=1&SortBy=Popularity)

The program would scrape all 5 result pages, and store the title, description, site URL, and a link to "more info" (why I think MySQL would be preferable for this, though it could be possible to name each directory in a files system the name of the category, and make each file stored therein the title)

It should be able to scrape every directory, subdirectory, and subsubdirectory (etc.) and return all the results pages in an organized fashion.

If you need help in getting started with programming this, I would consult: [url removed, login to view]

I understand this could be timely to produce and will consider all fair bids, such as based on an hourly rate and expected time frame. This is a very serious project and I am willing to pay well.

Feel free to contact me with any questions! Thank you in advance.

Færdigheder: Databehandling, PHP

Se mere: curl mysql, top programming language, thank later, television programming, start php programming, questions data structure, programming language popularity, processing programming language, php programming questions, php description, need data structure programmer, need help php programming, getting started programming, frame store, electronics programmer, data structure questions, data structure programming questions, alexa i, alexa curl, mysql data files, top fashion, php programming language, us consumer, shopping directory, php program language

Om arbejdsgiveren:
( 0 bedømmelser ) okemos, United States

Projekt-ID: #263661

5 freelancere byder i gennemsnit $440 for dette job

andreiandrei

please check PM.

$650 USD in 7 dage
(4 bedømmelser)
4.5
stephhw03

A VERY IMPORTANT OFFER IS WAITING FOR YOU IN YOUR PM !

$250 USD in 4 dage
(0 bedømmelser)
0.0
cmsstudios

Please check pm

$500 USD in 14 dage
(0 bedømmelser)
0.0
dudeswebservice

I have worked on such directory extracting and used CURL and RegEx for this.

$350 USD in 9 dage
(0 bedømmelser)
0.0
dinchu

Dear Sir: I already scraped alexa (about 25.000 website rankings and other info per each domain) please check pm i have enough experience with sscrapers and I can develop your scraper working an entire week

$450 USD in 5 dage
(0 bedømmelser)
0.0