Current spider is a python script to fetch all live matches id and specified details with its id from jabet.com.
I am looking for web scraping and Mongo DB expert who has been familiar with Python.
1. get a list from all live matches (IMPORTANT: it has to check all the time if there is a new match or if the match has been ended)
2. connect to the websocket of [url removed, login to view]
3. get odds from all markets
4. update the odds from all markets
Please read all requirements carefully.
All requirements mean new scraper should check periodically and constantly for new events all the time and delete threads where the events finished, in real time.
And details of all live matches automatically should are shown with real-time changes on cmd prompt.
Currently our scraper fetches one event per one time by means of switch parameter on command prompt. Therefore, It doesn't update mongo db in real time while it runs. This is not what we want.
And real-time changes of all matches are not shown on the prompt.
That's why we need to update our old scraper.