We provide a price comparison website and part of the scope if to always keep the website having all up to date products that are listed in marketplaces to be featured in our website.
The scope of the project is as follows:
- Develop 15 parsers for 15 different online marketplaces (details of the stores will be sent upon agreement)
- These parsers will run frequently (daily / weekly)
- The parsers will extract the following data from the marketplaces:
- Market place name, Category name, product name, URL, price
- The extracted data will be input in an online database MySQL that has the same structure as the extracted data in addition to extraction date (a field that shows when were these products added to the database)
- There should also be an additional flag that states either YES or NO for whether this product is present in our price comparison website or not