Pyspark job - 1000 gz files with 1m json objs of 6KB each to 1B files in s3

₹600-1500 INR

Igangværende

Slået op

over 2 år siden

₹600-1500 INR

Betales ved levering

Hi, I need help to execute a pyspark job. I need to process them. I have 1000 gz files with 1m json objs of 6KB each which we need to convert to 1B json files and save in s3

PySpark

Projekt-ID: 32284277

Om projektet

2 forslag

Projekt på afstand

Aktiv 2 år siden

Leder du efter muligheder for at tjene penge?

Emailadresse

Fordele ved budafgivning på Freelancer

Fastsæt dit budget og din tidsramme

Bliv betalt for dit arbejde

Oprids dit forslag

Det er gratis at skrive sig op og byde på jobs

Tildel til:

@ashishdudeja1994

I have done work in pyspark extensively. Alternatively we can use multithreading or multiprocessing also in python to achieve this. Let me know. I am really interested in this job. I am currently working as a Senior Data Engineer in an IT Company. I'm offering best quality and highest performance at a price we are both comfortable with. I can complete your project on time and your will experience great satisfaction with me. I'm well versed in Python,SQL,Unix Scripting, Excel VBA etc I have rich experienced in Word, PDF, Data Processing, Data Entry, Web Scraping. For more information about me, please refer to my portfolios. I'm ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details Thank you! Ashish Dudeja

₹1.300 INR på 7 dage