Well, I had a working version to scrape the URL I am looking for with phantomJS (using async, await), but the website changed the backend and I got stuck...
Here is the story:
When I access a specific website address, it makes an HTTPS Request to another website using a specific key. Each time the first website is accessed it changes the key randomly, and thus the HTTPS Request.
I need to grab this HTTPS Request URL with NodeJS.
I can get easily get the desired URL via Chrome DevTools (Network/XHR).
. I will need a printscreen of the website (to make sure you got the new version, that I got stuck with);
. I will need a simple [login to view URL] that I can run and outputs me ([login to view URL]) this specific URL.
I have experience with both nodejs and web scraping so I can surely help you with this project. I have solved a similar problem before where a site was trying to prevent automation.