Spark Jobs

We need an Instagram filter that has a roulette style selection of different workouts for our gym company.

I need to generate test data using spark code in HDFS path. If storing in AWS will be also more useful Requirments : We need to give the column names that needs to be created Number of rows to be generated Output format can be csv,parquet,txt,json For the columns created we need to provide the data from another file

Looking for someone who has a great knowledge in Spark Scala and Big data Technologies such as hadoop, hive etc

It’s pyspark code, we need to optimise it

I have documents regarding many Azure data products and project scenarios and I need someone familiar with these technologies and who also has excellent written American English skills to take this documentation and edit it, extend it, and provide some technical diagrams, preferably in Visio. This project will be to take 50 slides that already have information and reformat and rewrite it, but by basically repeating the content in a new format. I need these slides to be re-written and to have specific changes made to the wording.