I need a scalable solution that will enable me to retrieve large quantities of amazon product information, for my soon-to-be product comparison site.
For each of over 100,000 products, (preferably in batch) I will need this program to use AWS to retrieve product information such as price, comments, quality (Open-box, new etc), whether its from amazon or a reseller, and a few other key items.
+Use of AWS and not simply webscraping
+Done efficiently and scaleably, so the 100k items can be updated in as little time as possible
+Python coding strongly prefered
+If there are Amazon-set throttle limits, these need to be clearly stated.