Looking AWS lambda , netCDF to Json, SQS trigger , Athena Quicksight, Python

Hello Everyone

Following are requiremnts

1. Files are loaded in public S3 bucket daily every 15-20 mins. Location of the bucket is aws s3 ls s3://aws-earth-mo-atmospheric-ukv-prd/ --no-sign-request

2. I need to process the file and see visualize in Quicksight. To do that:

2.1 I need to create lambda function to convert this file in csv or json

2.2 I need to create SQS and SNS to trigger the lambda

2.3 Lambda loads file in my private S3 folder s3://tushar-bigdata-lambda-csv

2.4 Create Glue job that read metadata for these files and create catalog

2.5 Hook up athena on that s3 folder s3://tushar-bigdata-lambda-csv

2.6 Run Quicksight on athena

Timeline is 6 hours

budget is 100 ~ 150

Place " I know netCDF" in header of your bid.


Beceriler: Python, Yazılım Mimarisi, Amazon Web Services, Aws Lambda, Amazon S3

Daha fazlasını gör: python script convert excel json, cron job read json, i am looking for a unique and creative design of a logo for a prison themed game the name of the game is lockdown i want it to b, we are looking to create a tri fold brochure to advertise, im looking for a job that suits to my skills, python call rest api json, how to store json data in mysql using python, python extract data from json file, aws glue job parameters, python replace string in json object, aws glue job tutorial, transferring files to aws ec2 instance, package.json copy files to dist, python send and receive json, convert multiple json files to csv, aws lambda trigger glue job, trigger glue job from lambda, fargate sqs trigger, aws cognito post sign-up trigger, aws lambda sqs trigger java

İşveren Hakkında:
( 17 değerlendirme ) Phnom Penh, Cambodia

Proje NO: #28513202

Bu iş için 3 freelancer ortalamada $136 teklif veriyor


I know netCDF Hello, sir. How are you? I have just read your project description and I can help you as my rich experiences. I have rich experiences in python and netCDF I will give you the perfect result you are satisf Daha Fazla

$125 USD in 3 gün içinde
(8 Değerlendirme)

I had MSc degree in Applied Mathematics and Informatics (gpa 4.8). Also undertaken postgraduate studies in Information and Navigation Systems (a candidate to PhD). I had solid experience in Software Engineering backgro Daha Fazla

$150 USD in 7 gün içinde
(0 Değerlendirme)

Hey Sir I hope you are doing well. I will deploy the the requirements on Aws server as you have mentioned. Thank You sir.

$133 USD in 5 gün içinde
(0 Değerlendirme)