Modifications on a Postgresql database using Scala and Spark
$10-30 USD
Betalt ved levering
The project is about making modifications on a table on a postgresql database using Scala and Spark. The following functions are required:
1- Connect to a Postgresql database.
2- Update a column based on the existence of certain words on another column and write the new table on the database.
3- Filter non-relevant tweets: define the filtering criteria (removing retweets, remove spams :
tweets containing squads, removing tweets containing only urls or mentions, etc.
4- call a function that compute a score for each tweet : score = number of suicide, depression terms.
5- integrate these steps as a generic function, try to use something scalable, so that we can modify the criteria easily without touching the whole pipeline.
Projekt ID: #16936018
Om projektet
Tildelt til:
Have 10 years of IT experience with more than 4.5 years of experience in hadoop technologies like hive,pig,spark,sqoop,map reduce and [login to view URL] have very good experience in Java,scala,Python and shell scripting. Work Flere
5 freelancere byder i gennemsnit $61 timen for dette job
Hi I am interested in this job. I believe that the skills and experiences I have gained at this position make me an ideal candidate for this position. I have extensive experience in implementing Spark-core, Spark-s Flere