I need a program that will perform a web scrape of Loopnet based on certain search criteria. The program should take limited search parameters from the user and then download all of the attribute data fields for the results into a MS Access database table. I have attached an image of the search page for Loopnet which can be found at the following web address:
[url removed, login to view]
The search query only needs to take limited input from the user. Based on the attached image titled SearchPage, these are the requirements for the search:
Box 1 - MAX Acres - Needs to be set to 2000 for the search
Box 2 - MIN Acres - Needs to be set to 10 for the search
Box 3 - State - Needs to be set to CALIFORNIA
Box 4 - County - Needs to take input from the user
Once the search is conducted, there will be detail pages that need to be scraped for data. Loopnet's detail pages have varying fields, so when the scrape is performed, some records will have data fields that will be empty. I have attached an image of a detail page that has all of the fields that need to be scraped.
Please visit Loopnet prior to bidding to ensure that the scrape can be performed as I have requested. Loopnet does require a free basic registration in order to search.
As I said, I understand that because Loopnet's records do not display every field, there will be instances when the fields will be empty in the database.
I do not have a database set up for this purpose yet.
Also, it is very important that the program works for a long time and is not discovered by the site as a bot/spider. I have had problems with other scrape programs being blocked by the site.
Thanks for bidding. Please PM if you have any questions.
My budget for this project is $100-$200.