I have kafka cluster ready in aws EKS using strimzi . I need to capture CDC using Debezium. These data need to be stored in the s3 bucket. and then the data file from the s3 bucket needs to move to Snowflake.
Bu iş için 4 freelancer ortalamada ₹37125 teklif veriyor
Hello there I'm a software engineer and I have 6 years of experience in data engineering using CDC, snowflake s3 postgres and spark. Let's discuss more in details thanks
Hi, i have seen your requirements of data pipeline, I have previously worked with this kafka, i will build it so that you can capture cdc and data will be stored in s3 bucket and you can move it to snowflake.
I have experience in setting up debezium cluster which is the key in this project. Then doing the rest of data movement becomes comparatively easy.