I need a software to scrape product names from [url removed, login to view]
I want list of names of all the products in a text file, like this -
Kindle Wireless Reading Device, Wi-Fi, Graphite, 6" Display with New E Ink Pearl Technology
Kindle 3G Wireless Reading Device, Free 3G + Wi-Fi, 3G Works Globally, Graphite, 6" Display with New E Ink Pearl Technology
OtterBox Defender Case for iPhone 4 (White and Black, Fits AT&T iPhone)
1 product name per line.
I will enter the url eg: http://www.amazon.com/s/ref=nb_sb_noss?url=search-alias%3Dautomotive&field-keywords=&x=21&y=22
Software will scrape all product names till the last page.
Software must work fast, will be good if it's multi-threaded.
Software will work for all categories.
There is 2-3 cateogy that list product in different format, eg: mp3 downloads category - http://www.amazon.com/s/ref=nb_sb_noss?url=search-alias%3Ddigital-music&field-keywords=&x=19&y=27
For mp3 downloads category, software will scrape song name and artist, like this -
Kiss Me I'm Irish - Gaelic Storm
This is an easy project for the right person.
I want the software in 1-2 hour, I don't want to waste time.
I have alredy created this software but there is a problem, it creates too many [url removed, login to view] some category, there is only 50,000 products, and I get millions of names.I want only 50,000 names if there is 50,000 after I run the software.