Build a simple web crawler to mine data.
The developer may use either Java, C# or Python to program the crawler and use any library of their choice.
Code should be object orientated and well commented.
There is just one website to mine data from.
The brief steps are outlined below
1. Connect to starting url
1.1 Scrape HTML and filter out a specific class
1.2 Visit all the 'a' link tags in the class
2 In the visited page take out the people class
2.1 Visit the link in the people class
2.2 Scrape the photo url, and some text data in the p tags in the new url
67 freelancere byder i gennemsnit $129 på dette job
I have developed crawlers before. I am very interested in your project. I have 10+ years experience. I am the BEST programmer on this platform. Ready to start immediately. Plz share complete details.
Hi there, I have read the project & would like to discuss.. I can scrape data from websites using Python or C# scripts.. I have good web scraping reviews for my past projects.. Hope to hear from you..