Website Crawler to identify phrases in html source code
$30-250 USD
Annulleret
Slået op over 15 år siden
$30-250 USD
Betales ved levering
I need a crawler to identify phrases in the html of websites, for example "google analytics". There will be about 10 phrases in total, i want this to be an input that i can control. I want to be able to control the depth of the crawl in terms of how many levels "deep" the crawler goes into the website (e.g., home page --> about us --> management would be 3 layers deep). Also, i want to be able to control the total number of pages crawled per site, e.g., cut-off search after 100 pages crawled.
Finally, the crawler needs to be able to crawl 20,000 sites in about a week. Therefore, the winner bidder needs to be able to build a "fast" crawler--e.g., utilizing multi-threading etc. Also, i will need to be able to upload the urls of the websites I want to crawl.
Finally, this crawler needs to be completed in a couple days.
This crawler should be straightforward for a skilled programmer.
Dear sir,
Thank you very much for giving us opportunity to participate your project. We possess 5 years of Experience in such operation. Please check the PM for more details.
We provide 100% perfect result. We look forward to hearing from you. Thank you for your consideration.
Thanking you
Wasimul Haque
We have similar project and we can offer you the professional services, the team with over 10+ years working experiences, established in Jul, 2004. please kindly check PMB for details, thank you.
Concoct Information Technology is a global technology solutions provider to enterprises, consumers & technology companies. Concoct follows a support-
centric model to all its services that help its clients leverage IT to align business objectives.