Pyspark job - 1000 gz files with 1m json objs of 6KB each to 1B files in s3

₹600-1500 INR

Sürüyor

İlan edilme:

2 yıldan fazla önce

₹600-1500 INR

Teslimde ödenir

Hi, I need help to execute a pyspark job. I need to process them. I have 1000 gz files with 1m json objs of 6KB each which we need to convert to 1B json files and save in s3

PySpark

Proje No: 32284277

Proje hakkında

2 teklif

Uzaktan proje

Son aktiviteden bu yana geçen zaman 2 yıl önce

Biraz para mı kazanmak istiyorsunuz?

E-posta adresi

Freelancer'da teklif vermenin faydaları

Bütçenizi ve zaman çerçevenizi belirleyin

Çalışmanız için ödeme alın

Teklifinizin ana hatlarını belirleyin

Kaydolmak ve işlere teklif vermek ücretsizdir

Seçilen:

@ashishdudeja1994

I have done work in pyspark extensively. Alternatively we can use multithreading or multiprocessing also in python to achieve this. Let me know. I am really interested in this job. I am currently working as a Senior Data Engineer in an IT Company. I'm offering best quality and highest performance at a price we are both comfortable with. I can complete your project on time and your will experience great satisfaction with me. I'm well versed in Python,SQL,Unix Scripting, Excel VBA etc I have rich experienced in Word, PDF, Data Processing, Data Entry, Web Scraping. For more information about me, please refer to my portfolios. I'm ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details Thank you! Ashish Dudeja

₹1.300 INR 7 gün içinde