İptal Edildi

PySpark execution using Python Scripts on emr lab

I have created python functions to execute jobs.I have also added functions to run spark-sumit commands thr my python orchestration.

I am able to run pyspark jobs [login to view URL] I need is :

[login to view URL] spark configuration to execute spark jobs(You can integrate only for a single job)

2. I have also created audit tables, somehow not able to log proper error in case of failure.

3. We might need to rewrite spark-submit execution function

[login to view URL] want to implement simple aes_encrypt function using scala and use it on csv fields inpyspark

Beceriler: Python, Linux, Spark, Ölçek

Daha fazlasını gör: ftp files using perl scripts, read csv file using python script, using external scripts procmail, emr jupyterhub configuration, emr pyspark python 3, aws emr install python packages, pyspark emr, pyspark tutorial, launch emr cluster using python, run python script on emr, emr notebook no module named 'pyspark', integration database testing tools using python, web bots using python, visio automation using python, remote process execution using, simple login script ajax php using login scripts, remote execution using, using tcl scripts recordings, python scripts creating custom services, guidance sql query execution using loadrunner

İşveren Hakkında:
( 3 değerlendirme ) Pune, United States

Proje NO: #26442745

Bu iş için 1 freelancer ortalamada ₹1500 teklif veriyor

Sanki5

I am 4+ years of experienced data scientist and had very good automation experience in present. I have done few automation using python , AWS s3 , AWS Athena and SQL. I am looking forward more similar automation kind Daha Fazla

1 gün içinde %bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% INR
(0 Değerlendirme)
0.0