Web Grabber Requirements
We need a windows program that does the following.
We have a database with 20,000 minimum web url's of specific company’s. The program has to crawl through the websites and grab all text content in the sites and bring me the following data in a mdb file.
The data it should grab are:
(A rough idea about the data structure of the database)
Base url (the url that was originally given to grab)
Email addresses found
Tel numbers found
Fax numbers found
Url where the data was found
All text found in the url separated by a space
I need to be able to add extra addresses with url's
The grabber has to go in an automation mode and be able to run continuous and also the data in the mdb file has to be updated like every half hour. Off course the grabbing has to be done on multiple threads so the time to get all information will be as fast as possible. It should recogize blackholes.
The whole program will be in a client-server architecture. Please read the associated file for more details.
17 freelancers are bidding on average $243 for this job
We will doing all that you want (and more... :-))). Quickly, Professional, Quality - our answer you and your organization. We work more than 10 years.. There are questions?
hi, i have read your requirement and i am confident to deliver to you the result within the time. Looking forward to work with you on this project. Thank you
I have 7 Years Experience in Web Development and Software Development and i am ready for this project. I have done previously many projects of data extraction.
We already have some Http grabber. Moust of the wanted feauters are already implemented. THe in/output have to be castomized for your needs, and a client/server structire have to be estimated.