please read thoughly as this job is tricky.
Ok. I need a very talented scraper to scrape the following website:[url removed, login to view]
I need the site scraped starting at license number 850213 and then work backwards down to license zero. Some license number will not have any data as they do not exist. Should be a totl around 600k that actually has data for it.
Now this site is tricky. It has a anti-scraping protocol that will block IP's based on to many requests in one day, as well as it blocks on too many requests too fast. Previous scrapers have done this project and ended up getting blocked by trying to get too much info per day. Some were able to get a lot of info initially and other were blocked after a few hundred. Some used proxy services, but the end result was they were not able to complete this job.
So what I am looking for is someone that can get this job done.