To write SSIS Task Script or Application that crawl to all related links and pages on the websites (Online Store). The extracted data to be split by every 100k records per file and per eCommerce website. \r\n\r\nSome of the information that will be extract are: Product name, description, price, currency, detail description, images links, the seller information, product location, and etc.\r\n\r\nThe scripts should be written in a very effective way, as everyday, millions of records will be required to be extracted .\r\n\r\nIn total the number of website to be extracted is 13 websites.\r\n\r\nThe detail of the requirement will be provided if candidate is shortlisted.\r\n\r\nThe scripts or application will run on auto pilot mode. Triggered by scheduler, and automatically export to csv or excel.
The website to be scrap from:
9 freelancers are bidding on average $248 for this job
I have already done same kind of work. So I can complete the work in very short time period. I am having more than 17 years of experience in Software(mobile & web development). Please let me know. Thanks