• 5~ years of experience concentrated on implementing BI, Analytics on Big data platforms including large scale data lake systems.
• Experienced in Real Time Data Ingestions, Processing and Data Analytics.
• Hands on development experience in Spark and Scala, Hadoop, Hive, Sqoop, HBase, Kafka and Zookeeper. Workflow scheduling using Control-M and Oozie.
• Resolving on-going maintenance issues and bug fixes, optimizing code and performance tuning.
• Performed the data migration (ETL) from legacy system like DB2, Teradata to Hadoop.
• Involved in assessing business rules, designing in data migrating source system to Hadoop.
• Perform data cleansing and data modeling for Data science team.
• Done 3 End to end project on Hadoop and spark ecosystem with complete life cycle.
• Have executed various projects from Proof of Concept to Client Production environments.
• Working experience on Unix, shell and Python Scripting.
• Well versed with development methodologies like Agile.