I am looking for a scrapy expert to deliver web scraping of a series of websites. The content will be price data from exchanges, auctions, industry organizations, statistics bureau, and others.
The project has to be solved using python and scrapy.
From each website, I will require the following:
- a scrapy spider, that imports all available items, deployed to scrapinghub
- a scrapy spider that imports only new items (not already scraped), deployed to scrapinghub
- a copy of repository with all relevant code for the spiders (including relevant comments)
For each source, detailed guidelines will describe what content to scrape, at which frequency (will be once per day or once per week depending on source) and which additional identifiers to include.
This project is expected to continue for months, but initially selected candidates will deliver a paid test for only one website, before moving on to other websites.
53 freelancere byder i gennemsnit €526 på dette job
Hello sir I am a senior python developer with 9 years of experience about web scraping. I am familiar with Scrapy and scripinghub. I am suitable for this role and ready to start the work. Best Regards, Yongtao
Hello How are you I have read your job description in detail . I am Xu It is a piece of cake Please contact me and Let's discuss more thanks for your posting . hope to hear from you .