I need a custom web data parser windows application or script for a dating website that needs the following:
The dating site that only supports searches by zip code (5 zip codes at a time)
Note: Will probably need to load all U.S. zip codes in db que to automate input
The site uses CAPTCHA so will need to bypass via OCR, resend session ID
or manual input
The site shows results page for each zipcode. This results need to be parsed and saved. Also each, record has link to an external profile page with photo and several fields we need to save i.e. address, zip, short description
Note: Each State has a slightly different record format because its pulling data from external site and pulling into iframe.
Let me know if you have done similar project like this and give me your proposed solution.