We are looking for a competent web scrapper programmer. You will be working directly with our head developer.
The program will need to scrape a single website. The URL system is numerical and sequential. Example: [login to view URL], [login to view URL], [login to view URL] The program only needs to scrape meta data. As well as download a single image and rename it.
Data will need to be scraped and stored in our database (mysql) for future retrieval from our website.
Web scraping will be two parts:
1. Initial scrape of website (300,000 pages)
2. Continued automatic weekly scrape of new content (<1000 pages)
You will have access to our server and database for testing and implementation. Please respond with the keyword "Books" at the beginning of your proposal. Only those with the keyword will be viewed. Please also include what language you will programming with.
55 freelancere byder i gennemsnit $532 på dette job
Books Hi I propose to provide a Multi-threading desktop application that can scrape sites and export the scraped data(< meta data> ) into mysql. Can work on a demo if you like Thanks
Books :) Python :)) Can you share the URL of the site. I want to make rough estimation about process workflow. Anyway, let's discuss and do the business!
"Books" Hi, i'm interested, could you give me more details please? what is the site to scrape? what meta data do you need? could you send me a sample? regards [login to view URL]