I need to extract data from 30 different websites and structure them into table format and store them onto MS Access database.
Must follow a set of rules for extraction - if the data qualifies then grab the data and store it.
The websites may have all the information in home page or spread across 2 or 3 different pages. You need to crawl each one of them to grab the data. There are possibilities to have attachments (only pdf) that you will have to download and parse them with data extraction rules.
The process must log all activities from connecting to Database, crawling websites, reading data and printing summary of data collected per website. The program will be scheduled to run everyday so prefer an exe with full source code and docs.
I will need someone who has done similar work...nice pay out for right skill.