We need to scrape Amazon and build a big list of author names from some specific book categories we want.
**** DO NOT APPLY UNLESS you can scrap Amazon products using their API/XML product feeds they provide to developers!
We ALREADY built Zenno bots to scrape front-end results pages using proxies, captcha-solving etc and it is NOT enough.
We are NOT interested in front-end webpage scraping. *****
We need to scrape data of all the English language books published in certain categories filtered by:
1. books published in last 30 days.
2. "new releases" - books published from current date descending till 2015
3. "coming soon" books
We do NOT want to scrape listings of books published from 3 years ago or older!
You need to scrape through all the available listings.
Front-end scraping is strictly limited by Amazon, so you MUST do it via their API [Amazon Products Feed API /associate XML]. We tried front-end scraping [and we know to build Zenno bots] but this will not provide ALL the data needed.
We need only the following data from scraping:
1. Author name
2. Author Amazon page url (if available. If the book's author has an Author page on Amazon, his name will be linked to his page.)
3. Book publication date
4. Main category name (such as "Romance" not sub-categories like: "Romance>Historical>Paranormal>Contemporary")
5. Book format (Kindle or Paperback/Hardcover etc.)
No need for any other info such as images, book title, pricing, reviews etc.
Just real basic light data.
DB must be made Clear of Duplicates (no matter the book names, we ONLY need UNIQUE Author Names).
All the delivered excel files need to be sorted by publication date descending.
Delivery needs to be in excel file format with the following deliverables:
[a] 1 big Excel file with ALL the scraped data, sorted by publication date descending.
[b] 3 Excel files per genre/category:
One excel for "coming soon"
One excel for books published in last 30 days
One Excel for all the books published from 2015 to current date.
Example: "Romance_Coming Soon", Romance_last 30 days", "Romance_2015-2017".
We're not some big merchant/company, just starting our little service for authors and need a list of leads.
We may need ongoing gigs for scraping newly published books each month.
We need this big list ASAP. Is it possible within 1 week?
How much will scraping Amazon cost?
We may also want to scrape Barnes & Noble to find additional author names.
How much will scraping Barnes & Noble cost?
You need to know how to use the Amazon Advertising Product API.
19 freelancers are bidding on average $564 for this job
Dear. i am a developer in china . i have a great of experience amazon api. i can do your job as top as you want. Please let's start with me. I have good reviews over 750. Thanks.
I already developed several scrappers for different ecommerces, including [url removed, login to view], [url removed, login to view] and Walmart.com.br. I would be happy to help you with your task. Relevant Skills and Experience I already devel Mere