We need about 40 crawlers/scrapers for different web sites to be written and maintained
$30-250 USD
Betalt ved levering
We need about 40 crawlers/scrapers for different web sites to be written and maintained for at least 12 months.
Crawlers/Scrapers should be written in .NET (With Source Code presented) and have the following setup fields and control functions/buttons
• Web Site crawled
• Current URL
• Mode (Detailed/List)
• Number of URLs crawled
• Number of Products Crawled
• Start/Stop/Exit/Restart
• Crawling Time
• Proxy List File Path (in csv format)
• Load new Proxy List
• User Agent setting Configuration
• Random Delay between URLs setting (From/To sec)
All Bids should be done as per 1 Crawler/Scraper.
All crawlers/scrapers should internally use SQLSever2008 or MySQL database and have 2 crawling modes:
1. Detailed with the following information extracted from Product Details Page and output in SQLSever2008 or MySQL Database and XML file Format
2. List With the following information extracted from Product List and output in SQLSever2008 or MySQL Database and XML file Format:
Projekt ID: #3984233
Om projektet
Tildelt til:
11 freelancere byder i gennemsnit $118 timen for dette job
Hi, You can find a lot of simular crawler services done in my allready done works list. Please provide sample url that need to be crawled, and let me know if you want to see demo before accepting bid
The requirements are pretty clear so I don't have any questions.I'll probably have some though once the sites list is provided so if you can answer within 24 hours that'd help a lot in development, thanks.
Dear sir, I have implemented web and application about crawler/index/SE before. So with my experiences, I can finish that for you and may make long term relationship with your side. Thanks,
Hi, I have over 8 years of experience in .NET C#. Please, can you give me more details about this job?
