I am looking for a developer to create a scraping tool for Google AdWords ads. I'd like to start it as a basic tool, it can even operate from CLI - I do not require anything fancy, however somewhere down the road, I'd like it to be a mature tool. Therefore I am outlining below features that I'd like to have as a must, and then some additional features which can be introduced later, for additional payment - just to show to interested people what am I aiming for and that you can make some more money.
Must have features for v.1.0.:
* scrape AdWords ads from specified Google domain against keywords included in a CSV and/or text file.
* on the output, create files containing ad copies for each keyword (4 lines of ad copy + sitelinks if present) and ad's target url (by target URL I mean not the Google's redirect URL but the actual landing page)
* script must be able to handle queries via proxies, and proxies must be configured in an easy way (config file for example)
* script should have rotating user agents, as well as be able to create and save at least several cookie jars - one jar for several queries
Should have features for future dev:
* web UI for users to be able to specific scraping projects and manage proxy servers
* database to save all scraping with future reporting from such database, based on given parameters
* a way to do screenshots of each ad's landing page with addition of saving the source code of each landing page (with versioning if given landing page changed since last scrape)
I don't have prefered platform - this can be coded in anything that runs on Linux - no Windows servers please.
I'm happy to answer any questions if you happen to have them.
If you happen to stumble on this project and actually read the description, please note that none of the 10+ people who already bid won't get it awarded, because they do not read what I need and posted some spammy general offers. I am looking for someone who actually will read this, so indicate that in your bid comment and just bid :). Thanks.
17 freelancere byder i gennemsnit $1608 på dette job
Please send the full details of project to proceed [login to view URL] can discuss about this on skype after your positive kind response. Thanks and Regards.
These last 3 years I have devoted only to develop projects in PHP, I can help you develop your project with quality. You are the boss and just tell me to do I will.
hello, I am experienced in data scraping from website, and would like to offer my help in your project and the nexting development project. please contact me through your PM.Thanks.
Hi! I'm a Duke University graduate with degrees in Computer Science and Neuroscience. I can have this project done in no time! Thanks for your consideration