I have a website that shows me products, and each product is auctioned. When a bidding has ended, the next product automatically is displayed. I would need that the details of the product, and the final going price for each product is saved, and apprended to a CSV with the date, description of the product, and the final price. The crawler also needs to take care of authenticating with the website.
The flow of events is that the crawler needs to refresh the page each second, and extracts the title of the product, the description, and the price. The bidding price may increase, but when the bidding ends - the product is not shown any longer and a new product is displayed. The program or script needs to be built in a way that if it notices a change of product, it automatically stores the last state of the previous product in the CSV.
The crawler can be developed in any script, but the requirements and installation process needs to be properly documented.
Hi i have seen your requirements and i will love to do this for you, lets connect to share more details on chat Relevant Skills and Experience Python, Selenium Proposed Milestones €111 EUR - complete project