I need the games section of the metacritic site scraped. The script should be written using Python (free use of packages) and supplied at the end of the project.
[login to view URL]
Results seem to be limited too 100 per page and so I would need the webscrape to be broken down for each platform on a rolling 3 month basis or something. I need to capture 100% of the database and so if the scrape detected 100 pages return it would have to increase the filtering (or start with an advanced filtering so only a few pages are returned).
Here is an example of an advanced search:
[login to view URL]
The fields I would need are (provided in csv format):
- Release date
- Number of critic reviews
- User Score
- Number of user reviews
- Also on (will help us link games across platforms)
- Rating (M, PG etc)
- Game website
- Game art filename/location
I also need to have the game art (usually in the search result for each game). This can be saved to a folder with a column in the csv with the filename/location. Alternatively happy to setup an S3 bucket for someone if they are worried about space.
- Game front cover/picture
Finally the csv would have to have the url/search terms included in each row of data (i.e. [login to view URL]) would be included in all results from the first page.
After the scrape has finished the python file would also need to be provided.
I'd ideally like this done before Monday so any proposals that reflect that will likely get priority. Accuracy is a must!
14 freelancere byder i gennemsnit £169 timen for dette job
Dear Employer, I will complete your work by Monday. The only thing is I will write the scraping tool on C#. If that works for you, please message me and I am ready to start. Thanks, Ashish
Hi sir, I have scraped movies data from metacritic in a similar fashion before , I can do the same for games as well within a couple of days. Please initiate chat so that we can discuss further
I have an experience in scraping gaming website. I use python and Scrapy to develop my crawler. I can assist you to install the crawler and automate the Data extraction phase.
Dear client,I here by challenge my ability over this project since i have got good skills on how to use python. promise not to let you down, May my bid be considered. Thanks