Looking AWS lambda , SQS/SNS trigger , Athena Quicksight, Python

Hello Everyone

Following are requiremnts

1. Files are loaded in public S3 bucket daily every 15-20 mins. Location of the bucket is aws s3 ls s3://aws-earth-mo-atmospheric-ukv-prd/ --no-sign-request

2. I need to process the file and see visualize in Quicksight. To do that:

2.1 I need to create lambda function to convert this file in csv or json

2.2 I need to create SQS and SNS to trigger the lambda

2.3 Lambda loads file in my private S3 folder s3://tushar-bigdata-lambda-csv

2.4 Create Glue job that read metadata for these files and create catalog

2.5 Hook up athena on that s3 folder s3://tushar-bigdata-lambda-csv

2.6 Run Quicksight on athena

Timeline is 6 hours

budget is 100 ~ 150

Place " I know netCDF" in header of your bid.


Evner: Python, Software Arkitektur, Amazon Web Services, Aws Lambda, Amazon S3

Se mere: aws email bounce sns php, I am looking for a job which is related to Treasury settlement as I had a experience of 10 month with BNY Mellon..., aws lambda sqs example python, aws lambda sqs example java, aws lambda + sqs example, aws glue job parameters, aws pinpoint vs sns, aws glue job tutorial, lambda sqs batch size, aws lambda sqs policy, aws lambda sqs c#, aws cli sqs command, aws cli sqs receive messages, aws lambda trigger glue job, trigger glue job from lambda, trigger glue job from s3, aws ses vs sns, aws cognito post confirmation trigger, aws cost and usage report athena, aws lambda sqs trigger java

Om arbejdsgiveren:
( 17 bedømmelser ) Phnom Penh, Cambodia

Projekt ID: #28519419

5 freelancere byder i gennemsnit $221 timen for dette job

(9 bedømmelser)

Hi there, I have read the brief details on the job listing. You can check my experience, customer feed backs and my portfolio. I believe its a doable job I have great experience doing projects with Aws Lambda, Python, Flere

$150 USD in 28 dage
(5 bedømmelser)

I know netCDF I am a professional Python programming language and I worked on this type of project. I am a state engineer in meteorology. I work a lot on such projects. Just submit and I will complete the project for Flere

$125 USD in 7 dage
(0 bedømmelser)

Hi, I am certified aws data engineer (python and preparing).I am having experience in below services- lambda, Glue, Step function, S3, Athena, red shift, sagemaker, cloud watch etc I have worked on similar project an Flere

$156 USD in 2 dage
(0 bedømmelser)

Hi there, Hope you're doing well! I have done exactly the same setup for a project recently at work and will be glad to help you. I would breakdown it in three milestones: 1, developing lambda which at end stores fil Flere

$175 USD in 2 dage
(0 bedømmelser)