Scrape a URL (http request) a specific website searches (need in javascript - nodejs)

Well, I had a working version to scrape the URL I am looking for with phantomJS (using async, await), but the website changed the backend and I got stuck...

Here is the story:

When I access a specific website address, it makes an HTTPS Request to another website using a specific key. Each time the first website is accessed it changes the key randomly, and thus the HTTPS Request.

I need to grab this HTTPS Request URL with NodeJS.

I can get easily get the desired URL via Chrome DevTools (Network/XHR).


. I will need a printscreen of the website (to make sure you got the new version, that I got stuck with);

. I will need a simple [login to view URL] that I can run and outputs me ([login to view URL]) this specific URL.

Evner: Express JS, Javascript, node.js, Web Skrabning

Se mere: Re-design this website: We need a full-width layout Same logo in top left of header, We are setting up our website and need a design for this., We are setting up our website and need a design for this. We need a clean, fresh, smart 2017 looking webs, node js web crawler, npm web scraper, node js cheerio, web scraping javascript tutorial, javascript web scraping library, javascript web scraping example, node js web scraping login, cheerio web scraping, we need website development with complete responsive designing please open this url : http://collegeduniacom/ we need same to s, http request credentials url, access specific website need information scrapped, http request website, need request quote website, javascript http request, website design need coding, program http request, development http request

Om arbejdsgiveren:
( 0 bedømmelser ) Brazil

Projekt ID: #16475595

Tildelt til:


I have experience with both nodejs and web scraping so I can surely help you with this project. I have solved a similar problem before where a site was trying to prevent automation.

R$45 BRL på 1 dag
(0 bedømmelser)

5 freelancere byder i gennemsnit R$72 på dette job


Hi, I have very good experience in web scraping using Python and Node.js. I have gone through your requirements and can quickly create a script in node.js to return that https url. Looking forward to hear from Flere

R$112 BRL på 1 dag
(34 bedømmelser)
R$75 BRL på 1 dag
(3 bedømmelser)

Hello, I can analyse the website and all it's requests and follow each request till i get the source of the random key .

R$55 BRL på 1 dag
(0 bedømmelser)
R$75 BRL på 1 dag
(0 bedømmelser)