Looking AWS lambda , netCDF to Json, SQS trigger , Athena Quicksight, Python experienced developer

Hello Everyone

Following are requiremnts

1. Files are loaded in public S3 bucket daily every 15-20 mins. Location of the bucket is aws s3 ls s3://aws-earth-mo-atmospheric-ukv-prd/ --no-sign-request

2. I need to process the file and see visualize in Quicksight. To do that:

2.1 I need to create lambda function to convert this file in csv or json

2.2 I need to create SQS and SNS to trigger the lambda

2.3 Lambda loads file in my private S3 folder s3://tushar-bigdata-lambda-csv

2.4 Create Glue job that read metadata for these files and create catalog

2.5 Hook up athena on that s3 folder s3://tushar-bigdata-lambda-csv

2.6 Run Quicksight on athena

Timeline is 6 hours

budget is 100 ~ 150

Place " I know netCDF" in header of your bid.

Thanks

Python Software Arkitektur Amazon Web Services AWS Lambda Amazon S3

Projekt ID: #28508957

Om projektet