Færdiggjort

Build a web scraper to retrieve specific website information on a regular basis

Overview

For this project several bits of information must be gathered from a website and saved into a MySQL database. The information type is always the same but the parameters are different.

In most cases the website has APIs for retrieving the data and this should be the preferred way of getting the data.

Please see attached PDF for the exact data required.

Requirements

- Project needs to be created in Java.

- Application needs to use the Selenium Framework and Chrome/Firefox in either window mode or headless mode.

- All calls must be parameterised and should work for all Leagues, Teams, Players, Matches.

- APIs from the target website must be used only, no scraping of HTML. In some cases the data is embedded in the code using JSON, it is acceptable to retrieve the data from Javascript variables or using Javascript calls if APIs are not available.

- API endpoints seem to be available only after visiting the main pages, so some protection exists, possibly based on cookies. So this needs to be circumvented.

- Data will be saved in a MySQL database with tables per each dataset. Eg. Players, Teams, Leagues, Matches.

- IDs must be used and preferred as opposed to Strings. IDs from the target website must be used as opposed to locally created auto-increment IDs.

- For each ID stored in the database an associated table must exist with the String value. Eg. Player ID – Player Name.

- So tables need to be normalised.

Evner: Java, Javascript, MySQL, Web Skrabning, Hjemmeside Testning

Se mere: best web admin php manage website, build content management system newspaper website using dreamwaever, web develop booking calendar website, python 3 web scraping, web scraping using python tutorial, html scraping, web scraping python beautifulsoup, web scraping tutorial, web scraping with python pdf, web scraping with python amazon, python web scraping library, create web scraper, build web site badoo, extracting information website using regular expression php, javascript rollover embedded html wont work web, web scraper regular expression sample, build basic web scraper java, build dotnet web scraper, php code build web based scraper, regular expressions url web scraper

Om arbejdsgiveren:
( 0 bedømmelser ) London, United Kingdom

Projekt ID: #18194755

Tildelt til:

p4logics

Hello Sir, We are expert in web scrapping using java and Python. we will write automation script which you I will setup at you local system or server. or you can run it manually on daily/weekly basis. please ping me Flere

£80 GBP in 20 dage
(27 bedømmelser)
4.9

9 freelancere byder i gennemsnit £89 på dette job

Yknox

Good Day Sir! I read your post. But I have something to ask you. Your idea is amazing and it will change the world! I am a magic talented developer in your skill. If you wanna be the success, hire me I am looking Flere

£50 GBP in 10 dage
(563 bedømmelser)
8.8
stead121

Dear Client. I have fully read the job description and I am interested in your project. I am Li G from China. I would like to help you with my skill and experience. As you can see my profile, I am a talented we Flere

£80 GBP in 10 dage
(26 bedømmelser)
5.6
ByteSols

Hi There, This is S Mills From ByteSols LLC located at CA. I have gone through your requirement of wordpress website designing and I can assure you that I can help you out with a custom website, template developm Flere

£250 GBP in 10 dage
(10 bedømmelser)
5.2
catamarin

Hi there, I see you're looking for an automation engineer, with excellent skills in selenium and java, to help you with your website scraper project. Do you already have the MYSQL database created? Have you already Flere

£77 GBP in 15 dage
(19 bedømmelser)
4.4
SmithZhang

Dear, employer. My name is Xungxiao, I am an experienced web developer, and web scraping expert. I am a new freelancer here, but I have good experiences in web scraping using PHP, Python, Java and so on. I read yo Flere

£50 GBP på 1 dag
(14 bedømmelser)
4.1
bluesea1990

Hi sir I am an expert in web scrapping with high technology. I am good at java, Javascript, MySQL, Web Scraping, Website Testing. I think you can get a good result with this project. please chat in detail. Thank y Flere

£50 GBP in 10 dage
(9 bedømmelser)
3.6
lysilab

Hi Sir, I am Lavish Karankar having vast experience in Automation of jobs using Python and JAVA language. I have gone through your provided description, I would like to help you on this as I have done this task in my Flere

£88 GBP in 10 dage
(3 bedømmelser)
2.8
rgcet6022

I have 6 years experience in automation testing. please get in touch

£72 GBP in 2 dage
(0 bedømmelser)
0.0