Develop a custom scraping tool to scrape from some specific websites. A general existing scraping tool does not work for this case.
This is a long term project because there are many websites to be scraped, but for this first part you must build the scraping general tool, chrome extension scraping control and scraping instructions for two websites (see details below). So your bid will be for this first part, and you may ignore that this is a micro-project low bid range. Note: the websites to be scraped may contain adult images, so you must be ok with that.
The tool must be run via a Chrome extension because some of the websites require a human performing a CAPTCHA. The Chrome extension gives some simple control to the human, like start and stop scraping, selecting which of the predefined websites that should be scraped now and perhaps some other function too (or not), and some statistics (how many have been scraped and perhaps some more details about the process).
The scraping tool must be made in a way that the actual scraping part for a specific website is defined in a separate js module or json file. All the functionality that is common for the scraping of all websites is in the main script, so only the minimal functions (js module) or instructions (json file) for a specific website is to be stored in the separate module. You must come up with the best way to do this (is the specific website defined in a js module and/or in a json file?).
What is needed to be scraped are some ads: some text with one or more pictures. As mentioned, some websites may require a human doing CAPTCHAs (so the script would have to wait until the human has successfully done the verification and the page to be scraped has been loaded).
I'm a developer myself, and you would make this tool in detailed supervision from me.
11 freelancere byder i gennemsnit $74 på dette job
Hi, I can design the logo you are looking for. have 6+ years of experience in Graphic Design, Illustrator, Logo Design, Photoshop. please enable chat so that we can get started. Regards Sarita
Hi there Ready to make scripts for you as I have many experience in script making and We can work on a long term project. Look forward to work with you. Thank you