Good day Freelancers,
I am in need of a freelancer who is capable of writing a Scrapy or Puppet script to scrape whole sale diamond prices and related diamond features. The following requirements are needed.
1) Scrapy or Puppet script to automate the web scraping for the desired data.
2) Scraped data presented in a database (json, mysql, or mongodb) with the relevant features populated for each entry.
A note on 2): Features that must be present for all entries include price, carat, clarity, color, cut. Some websites will provide additional features such as fluorescence which, if available, must also be included for that diamond.
The data fields that need to be extracted can be found in the attached document.
Looking for roughly 500K entries but more is always better and I am willing to pay for more entries.
If I like your work then there is a chance for repeat work.