Web Scraping/API Parsing Project (NodeJS, Javascript ES6)

We need someone to build a NodeJS app that iterates through a database of Firebase objects, looks up the appropriate link and grabs the price of the product to keep our database in sync with the prices being offered on these websites. The key skills required are:

- Firebase knowledge

- NodeJS

- Javascript

- Web scraping (Regex exp is a must)

- API knowledge (Ability to research + provide us the best implementation is key)

- Slack integration

- Basic *nix knowledge, need to understand how to set up crons, create log files from console output + send emails if/when a service comes down.

This is a fixed price, initial project to get us working with our initial set of affiliate shops but in the future could lead to continuous work as we regularly scale up the operation.

Note: Good English is vital; preference is given to individual freelancers and not teams.

We have around 1000 product links to parse every 15 minutes or so. Right now about 50% of these are on Amazon and are covered by our existing code. We need this code refactored, unit tests added, and the remaining 50% of the product links parseable. Please adjust your bids accordingly given that 50% of the data is already being successfully parsed. Some example product links:áscaras-de-pestañas/worth-the-hype-volumizing-%26-lengthening-mascara/NYX_590.html

THE KEY REQUIREMENT FOR THIS is strong Unit Testing ability. I want to have a suite of tests that guarantee the Regex written for all URLs + potential DOM parsing work.

Evner: Javascript, node.js, NoSQL Couch & Mongo, Python, Web Skrabning

Se mere: node js web crawler, npm web scraper, cheerio web scraping, javascript web scraping example, node.js web scraping, node js dom manipulation, web scraping javascript tutorial, node js web scraping login, web scraping api, web scraping api java, java web scraping api, python web scraping javascript, web scraping javascript net, web scraping project report, xml parsing project javascript, web scraping project desktop freelancing, web scraping javascript interpreter, sample project web scraping asp net, estimation web scraping project, javascript web scraping

Om arbejdsgiveren:
( 0 bedømmelser ) Barcelona, Spain

Projekt ID: #16469728

28 freelancere byder i gennemsnit €529 på dette job


Hello. Can you share some examples of sites you want to sync with? How many of them? Anyway, let's talk and do the business!

€750 EUR in 5 dage
(48 bedømmelser)

Hi, Hope you are doing good I have 8+ years in web designing & development with good experience in following skills ... 1. HTML5 2. CSS,CSS 3 & LESS 3. JS (Angular JS, Backbone JS,React JS, node.js, expre Flere

€500 EUR in 10 dage
(64 bedømmelser)

Hello, I Have checked the project details specified , but need to clear few points. So can you please click Chat button to send me a text message when you are available to discuss about the project. At present I am pl Flere

€556 EUR in 10 dage
(8 bedømmelser)
€555 EUR in 10 dage
(18 bedømmelser)

Dear cdmpicker! Im a full stack developer, i can help you do this task fast. i have already charged a reasonable price. Our node.js's projects: [login to view URL] Our latest Spain's projects: http:/ Flere

€573 EUR in 16 dage
(62 bedømmelser)

Hello SIr, How are you doing , As I have seen your project I would love to work on this project for web scraping , I am expert developer, I have previous skills on working on web scraping . So i would like to offer Flere

€555 EUR in 10 dage
(21 bedømmelser)

Hi, I am experienced nodejs developer, with over 6 years of development. I have read your description and I can make a small bot that scrapes links from your firabase db, and keep it in sync. Will integrate it als Flere

€750 EUR in 5 dage
(43 bedømmelser)

Dear cdmpicker, I have 10 years experince in Javascript, node.js, NoSQL Couch & Mongo, Python, Web Scraping. I do have comparative experience accomplishing something like yours "Web Scraping/API Parsing Project (No Flere

€525 EUR in 12 dage
(11 bedømmelser)
€555 EUR in 10 dage
(69 bedømmelser)

Dear Client. I read your post project carefully. And I pick up the fact , you are looking for individual freelancers about firebase and node.js , scraping. -I am a individual freelancer. -I have been used firebase Flere

€444 EUR in 3 dage
(16 bedømmelser)

You think , I will do it with full of your IDEA! hello,sir. I'm a professional programmer with 6 years of experience. I've already done this kind of project before. If you award me, I'll implement all of your requireme Flere

€555 EUR in 4 dage
(17 bedømmelser)

hello, Please share your Ideas and Business details for your website so we can suggest you a best platorm as per your requirements I would like to introduce our team of expert Designers and Developer who can provide Flere

€555 EUR in 10 dage
(6 bedømmelser)

I am a python developer. I have great experience in web scraping and I am an expert in it. I have all necessary skills to scrape almost any website. I have even scraped sites like google, whatsapp web, instagram which Flere

€525 EUR in 2 dage
(35 bedømmelser)

Hello, How are you? I’ve carefully gone through your job post. I am very much interested in your project with all of your requirements. I feel very confident on your project and You will get the "Best Result" if you Flere

€555 EUR in 10 dage
(27 bedømmelser)

Hi dear, I've just checked your requirements. I am very interested in that sort of thing and have a lot of experiences of the field like that. If you hire me, I will be able to finish your project earlier ahead the a Flere

€555 EUR in 3 dage
(5 bedømmelser)

Hello, I have experiences with all of the technology which you mentioned. I can do this job. Ready to start now. Please tell me the detail then we can move forward. Thank you.

€250 EUR in 5 dage
(30 bedømmelser)

Hello, I am a skilled JavaScript developer knowing with all the concepts of software engineering. My areas of expertise are:PHP,zend,cakephp,Laravel,Shopify,drupal,joomla and MSSQL. On client side I am very keen wo Flere

€515 EUR in 10 dage
(10 bedømmelser)

I have read your requirement and understood that you like to hire Skilled Node.js developer to build an App. We are ready to more discuss with you. I am pleased to inform you that we have skilled developer team in N Flere

€472 EUR in 15 dage
(3 bedømmelser)

i can help you with this. Please check my projects. I have more than 5 years experience in full stack development.

€750 EUR in 10 dage
(4 bedømmelser)

Dear, we are Team of French + US. I checked your project description, I can scrap your data. I will focus on user friendly interface. As you can see I have very good rate, you can be sure I am serious. Regards, Fa Flere

€263 EUR in 10 dage
(3 bedømmelser)