Looking AWS lambda , netCDF to Json, SQS trigger , Athena Quicksight, Python

Hello Everyone

Following are requiremnts

1. Files are loaded in public S3 bucket daily every 15-20 mins. Location of the bucket is aws s3 ls s3://aws-earth-mo-atmospheric-ukv-prd/ --no-sign-request

2. I need to process the file and see visualize in Quicksight. To do that:

2.1 I need to create lambda function to convert this file in csv or json

2.2 I need to create SQS and SNS to trigger the lambda

2.3 Lambda loads file in my private S3 folder s3://tushar-bigdata-lambda-csv

2.4 Create Glue job that read metadata for these files and create catalog

2.5 Hook up athena on that s3 folder s3://tushar-bigdata-lambda-csv

2.6 Run Quicksight on athena

Timeline is 6 hours

budget is 100 ~ 150

Place " I know netCDF" in header of your bid.

Thanks

Beceriler: Python, Yazılım Mimarisi, Amazon Web Services, Aws Lambda, Amazon S3

Daha fazlasını gör: python script convert excel json, cron job read json, i am looking for a unique and creative design of a logo for a prison themed game the name of the game is lockdown i want it to b, we are looking to create a tri fold brochure to advertise, im looking for a job that suits to my skills, python call rest api json, how to store json data in mysql using python, python extract data from json file, aws glue job parameters, python replace string in json object, aws glue job tutorial, transferring files to aws ec2 instance, package.json copy files to dist, python send and receive json, convert multiple json files to csv, aws lambda trigger glue job, trigger glue job from lambda, fargate sqs trigger, aws cognito post sign-up trigger, aws lambda sqs trigger java

Proje NO: #28513202