Lukket

Web Scraping/API Parsing Project (NodeJS, Javascript ES6)

We need someone to build a NodeJS app that iterates through a database of Firebase objects, looks up the appropriate link and grabs the price of the product to keep our database in sync with the prices being offered on these websites. The key skills required are:

- Firebase knowledge

- NodeJS

- Javascript

- Web scraping (Regex exp is a must)

- API knowledge (Ability to research + provide us the best implementation is key)

- Slack integration

- Basic *nix knowledge, need to understand how to set up crons, create log files from console output + send emails if/when a service comes down.

This is a fixed price, initial project to get us working with our initial set of affiliate shops but in the future could lead to continuous work as we regularly scale up the operation.

Note: Good English is vital; preference is given to individual freelancers and not teams.

We have around 1000 product links to parse every 15 minutes or so. Right now about 50% of these are on Amazon and are covered by our existing code. We need this code refactored, unit tests added, and the remaining 50% of the product links parseable. Please adjust your bids accordingly given that 50% of the data is already being successfully parsed. Some example product links:

http://www.sephora.fr/Maquillage/Levres/Gloss/Terracotta-Kiss-Delight-Baume-en-Gloss/P3221005
https://www.nyxcosmetics.es/es_ES/ojos--/máscaras-de-pestañas/worth-the-hype-volumizing-%26-lengthening-mascara/NYX_590.html
https://www.lookfantastic.es/bobbi-brown-illuminating-bronzing-powder-various-shades/11519321.html
https://www.prozis.com/es/es/prozis/omega-3-90-softgels

THE KEY REQUIREMENT FOR THIS is strong Unit Testing ability. I want to have a suite of tests that guarantee the Regex written for all URLs + potential DOM parsing work.

Evner: Javascript, node.js, NoSQL Couch & Mongo, Python, Web Skrabning

Se mere: web scraping api, web scraping api java, java web scraping api, python web scraping javascript, web scraping javascript net, web scraping project report, xml parsing project javascript, web scraping project desktop freelancing, web scraping javascript interpreter, sample project web scraping asp net, estimation web scraping project, javascript web scraping, java web scraping javascript, web scraping project payment amount, web scraping project, web scraping javascript

Om arbejdsgiveren:
( 0 bedømmelser ) Barcelona, Spain

Projekt ID: #16469728

34 freelancere byder i gennemsnit €543 på dette job

Shattenjagger

Hello. Can you share some examples of sites you want to sync with? How many of them? Anyway, let's talk and do the business!

€750 EUR in 5 dage
(45 bedømmelser)
6.7
hawkscodeaus

Hi, Hope you are doing good I have 8+ years in web designing & development with good experience in following skills ... 1. HTML5 2. CSS,CSS 3 & LESS 3. JS (Angular JS, Backbone JS,React JS, node.js, expre Flere

€500 EUR in 10 dage
(53 bedømmelser)
6.9
sapotacorp

Dear cdmpicker! Im a full stack developer, i can help you do this task fast. i have already charged a reasonable price. Our node.js's projects: [url removed, login to view] Our latest Spain's projects: http:/ Flere

€573 EUR in 16 dage
(39 bedømmelser)
6.2
tudiptechnology

Hi there, We have been developing/maintaining various web applications in NodeJS (both Express and Sails). Mostly these applications are hosted on clouds (AWS/Linode) and have SASS, CoffeeScript, AngularJS/JQuery, B Flere

€750 EUR in 30 dage
(14 bedømmelser)
6.9
stefkev

Hi, I am experienced nodejs developer, with over 6 years of development. I have read your description and I can make a small bot that scrapes links from your firabase db, and keep it in sync. Will integrate it als Flere

€750 EUR in 5 dage
(36 bedømmelser)
6.4
mmadi

Dear cdmpicker, I have 10 years experince in Javascript, node.js, NoSQL Couch & Mongo, Python, Web Scraping. I do have comparative experience accomplishing something like yours "Web Scraping/API Parsing Project (No Flere

€525 EUR in 12 dage
(9 bedømmelser)
6.0
hiretechexperts

Hello, I Have checked the project details specified , but need to clear few points. So can you please click Chat button to send me a text message when you are available to discuss about the project. At present I am pl Flere

€556 EUR in 10 dage
(1 bedømmelse)
5.6
super2lao

You think , I will do it with full of your IDEA! hello,sir. I'm a professional programmer with 6 years of experience. I've already done this kind of project before. If you award me, I'll implement all of your requireme Flere

€555 EUR in 4 dage
(16 bedømmelser)
5.6
Shopify

hello, Please share your Ideas and Business details for your website so we can suggest you a best platorm as per your requirements I would like to introduce our team of expert Designers and Developer who can provide Flere

€555 EUR in 10 dage
(6 bedømmelser)
5.2
david1050

Hi, I have rich experience in building webscrapping feature using NodeJS. I can connect Firebase using nodejs. I can work for this project for long term. Ready to start

€611 EUR in 10 dage
(2 bedømmelser)
5.4
sun0815

Hello. I am senior developer especially have strong skills in angular, node.js ,firebase git :) (which you menthoned above). Recentlly I make project using firebase. I have more than 10 years of experience in web de Flere

€555 EUR in 10 dage
(8 bedømmelser)
5.2
nguyenvocaominh

Hello, I have experiences with all of the technology which you mentioned. I can do this job. Ready to start now. Please tell me the detail then we can move forward. Thank you.

€250 EUR in 5 dage
(28 bedømmelser)
4.8
€555 EUR in 10 dage
(27 bedømmelser)
4.9
hoisticdeveloper

Hello SIr, How are you doing , As I have seen your project I would love to work on this project for web scraping , I am expert developer, I have previous skills on working on web scraping . So i would like to offer Flere

€555 EUR in 10 dage
(2 bedømmelser)
4.5
unikinfoways1

I have read your requirement and understood that you like to hire Skilled Node.js developer to build an App. We are ready to more discuss with you. I am pleased to inform you that we have skilled developer team in N Flere

€472 EUR in 15 dage
(3 bedømmelser)
4.1
hexiaoyun

Hello , How are you? I have good experience in scraping with nodejs. and so we can discuss more details via chatting. may i wait for you? best regards.

€555 EUR in 10 dage
(10 bedømmelser)
4.2
deepakdiwan

Hello, I am a skilled JavaScript developer knowing with all the concepts of software engineering. My areas of expertise are:PHP,zend,cakephp,Laravel,Shopify,drupal,joomla and MSSQL. On client side I am very keen wo Flere

€515 EUR in 10 dage
(8 bedømmelser)
4.7
linbenrong

Dear Client. I read your post project carefully. And I pick up the fact , you are looking for individual freelancers about firebase and node.js , scraping. -I am a individual freelancer. -I have been used firebase Flere

€444 EUR in 3 dage
(9 bedømmelser)
3.9
kkc1985612

Hello, How are you? I’ve carefully gone through your job post. I am very much interested in your project with all of your requirements. I feel very confident on your project and You will get the "Best Result" if you Flere

€555 EUR in 10 dage
(12 bedømmelser)
4.1
DarkKnight2206

I am a python developer. I have great experience in web scraping and I am an expert in it. I have all necessary skills to scrape almost any website. I have even scraped sites like google, whatsapp web, instagram which Flere

€525 EUR in 2 dage
(13 bedømmelser)
3.9