
Open
Posted
•
Ends in 6 days
I need a two-part setup for data processing tasks: 1. Jupyter Notebook: - Use PySpark with SQL and Pandas. - Tasks:run and get counts - Purpose: Testing, exploration, and debugging. 2. Python Script (.py): - Automate data loading tasks. - Run with spark-submit job.py. - Schedule via Airflow. Ideal Skills & Experience: - Proficiency in PySpark, SQL, and Pandas. - Strong Python scripting skills. - Experience with Airflow for task scheduling. - Background in data engineering or related fields.
Project ID: 39737647
Open for bidding
Remote project
Active 56 yrs ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

Hyderabad, India
Member since Aug 27, 2025
$8-15 CAD / hour
$10-30 CAD
$10-30 AUD
₹100-400 INR / hour
₹600-1500 INR
$250-750 USD
₹600-1500 INR
$30-250 USD
$250-750 USD
$10-30 USD
₹1500-12500 INR
₹600-1500 INR
₹12500-37500 INR
₹600-1500 INR
₹37500-75000 INR
₹600-1500 INR
$750-1500 USD
$8-15 USD / hour
₹6000-9000 INR
$10-20 USD / hour