Apache Spark performance tuning required(High proficiency required)

Job Description:

Currently I have a job which does some aggregations and takes a day or two but I have seen the same job completed within 30 mins with some unknown set of resource allocations.

Since I've been playing with Spark for few years, I am only looking for someone who is highly proficient with Spark resource allocation and fixing the data skew issues when encountered wide transformations/aggregations(apart from salting techniques)

Færdigheder: Apache Spark, Amazon S3, Python, Scala

Om klienten:
( 0 bedømmelser ) Phoenix, United States

Projekt ID: #35403543

1 freelancer byder i gennemsnit $50 på dette job


Hey there ! Good day. I am Pankaj Ranga I would like to work with your project and I can surely provide the details you have specified on the project description. I can confidently say that I am knowledgeable enough to Flere

$50 USD / time
(1 bedømmelse)