I gang

Rebuild web-scraper using SCRAPY + Data transformation - Long term project w/ monthly support

I am looking for developers with significant experience in web scraping to help:

1. Rebuild my phython/php scraper in SCRAPY - compatible with [login to view URL]

2. Manipulate data and prices

3. Export to new CSV/XLS templates - Data transformation

This is a long-term project which will include building and refining the scraper (you are expected to utilize the existing PHP/python code to fast-track the development).

My requirements are extremely clear and detailed, the project will be divided into fixed price tasks and milestones.

This is the entire project with 5 stages: https://h0rfrh.axshare.com/#g=1&p=sailfish_alpha - GREEN/AMBER features are developed and available in the source code

Source code: [login to view URL]

You are expected to quote a fixed price for two tasks (please provide a technical approach and breakdown of efforts/costs/timelines)

1. Building the scraper for CWH - https://h0rfrh.axshare.com/#g=1&p=cwh_scraper - Code for reference is available in the link

2. Transform the CSV to Shopify Excelify - [login to view URL]

All products are simple products with no variations and up to 10 images. The Shopify format requires two things from a data transformation perspective:

a) creation of slugs - simple regex or python-slugify

b) if a product has multiple images, it will have multiple rows (n-images, n-rows)

As you can see from the overall roadmap - this is a long-term project with several scrapers that need to be added to this solution.

I prefer someone who is available to start work right away.

Evner: Datasøgning, PHP, Python, Software Arkitektur, Web Skrabning

Se mere: Data entry long term project, long term project, long term project in academic work, how to use scrapy, data crawling tools, python web crawler, web scraping, python web scraping library, web scraping api, how to scrap a website, scrapinghub, php, python, scrapy, data entry long term, python web scraper using keywords, using scrapy data mining, web scraper using mozenda, short term long term project, seo expert long term project

Om arbejdsgiveren:
( 14 bedømmelser ) Parramatta, Australia

Projekt ID: #17202341

Tildelt til:


Hello, I have vast experiences in web scraping with Python Scrapy and BeautifulSoup. So I was so interested in this project description and submitting a proposal with the confident that I can bring the project comp Flere

$155 AUD in 3 dage
(2 bedømmelser)

13 freelancere byder i gennemsnit $148 på dette job


hi I am really interested in your project I have full experience of web scraping with python and c# I could modify your scrape code as you want I could satisfy you Everything will be done well if you work with me Flere

$155 AUD in 3 dage
(97 bedømmelser)

Hi there. Nice to meet you. I'm a Web scrap expert and FULL Time Developer. I have checked your requirements carefully. I have rich experience in Python, PHP, Micro, Web scrap, etc. I can start work immediately n Flere

$155 AUD in 3 dage
(116 bedømmelser)
$177 AUD in 3 dage
(24 bedømmelser)

Hi!. I am available right now, how are you? I am interested in your project and would like to discuss the project with you. I always deliver on time and on budget feel free to check my feedbacks and portfolio. I unde Flere

$190 AUD in 5 dage
(36 bedømmelser)
$155 AUD in 3 dage
(41 bedømmelser)

Dear I am an expert in web scraping. In before, I developed many spiders using scrapy. For example, I scraped data for CEOs(ebay, welivv, [login to view URL], [login to view URL] and so on). Thanks.

$122 AUD in 3 dage
(40 bedømmelser)

Ready to start the work to work for stopping scrapper to rebuild the python scrapper ,please check my recent similar work ,we can discuss more over chat,thanks regards Arjun S.

$111 AUD in 3 dage
(10 bedømmelser)

I can give support for development in python these are my skill related to web scraping and web crawling Have done scraping in Nodejs, CasperJS Phantomjs, python. Have done testing and automation with selenium Flere

$155 AUD in 3 dage
(13 bedømmelser)

Hi, I hope you are doing good. I am Skilled in Web Development, App, IOS, iPhone, IPAD Development for past 7 years. I am skilled includes in HTML5, CSS, CSS3 & LESS, JS ( AngularJS, React JS, node.js, express JS Flere

$190 AUD in 3 dage
(1 bedømmelse)

Hi !! Nice to E-meet you We have a team of experienced python, django developers. We have developed a sophisticated trading platform ([login to view URL]) using python, django, postgresql. Our python/django de Flere

$150 AUD in 3 dage
(6 bedømmelser)

Dear Project Owner, This is Priyanka able to do your job, As we have number of software engineers at our development center on all the developement platforms for more about us please visit [login to view URL] or f Flere

$56 AUD in 3 dage
(3 bedømmelser)

I can help you! I am computer engineer graduate and do a lots of programming like java, html, phython and etc.

$155 AUD in 3 dage
(0 bedømmelser)