Kapalı

Need a scala spark job to read csv from S3 and load into cassandra

scala object main def should have 6 arguments as below.

val awsAccessKeyId: String = args(0)

val awsSecretAccessKey: String = args(1)

val csvFilePath: String = args(2)

val host: String = args(3)

val username: String = args(4)

val password: String = args(5)

*based on the args, the job should read csv file from s3 and load into cassandra.

*you can use any csv file say 2 fields, and cassandra table has 3 columns..

* need complete project codes, dependency jars, tools used and all versions etc.

Beceriler: Java, Hadoop, Python, Ölçek, Spark

Daha fazlasını gör: spark 2.0 read csv, spark read csv, spark read csv from s3, spark.read.csv documentation, spark.read.load csv, pyspark read csv schema, spark read csv header true, spark read csv column names, ksh read csv file, read csv file using ksh, read csv file using python script, python read csv file, read csv file using adonet, asp read csv ado, net 2005 read csv file internet, read csv file 2005, read csv vb6, read csv file visual basic, perl read csv file mysql select, need powerpoint presentation job

İşveren Hakkında:
( 0 değerlendirme ) United States

Proje NO: #20426564

Bu iş için 20 freelancer ortalamada $186 teklif veriyor

susanna2018

⭐⭐⭐ Hi, Dear client. ⭐⭐⭐ I'm very interested your project. I read your description carefully. I'm very talented Scala/Spark developer. You can see my work history about Scala following url. [login to view URL] Daha Fazla

$300 USD in 7 gün içinde
(35 Değerlendirme)
5.6
tumakha

Dear Customer, My name is Yuriy Tumakha. I am interested in your project. I am Senior Scala/Java Developer with 14 years of experience. You can see my code examples on GitHub [login to view URL]

$350 USD in 7 gün içinde
(19 Değerlendirme)
5.5
dineshrajputit

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with ha Daha Fazla

$277 USD in 3 gün içinde
(5 Değerlendirme)
3.6
AmolZinjadeP

Hi, I have more than 5+ years of experience in hadoop ecosystems like HDFS, MapReduce, Hive, Spark etc. I can complete your project. Please contact me for more details.

$200 USD in 2 gün içinde
(6 Değerlendirme)
4.0
TechnicalGeeks

Hi, I am a bigdata developer and a module lead in reputed MNC.i an into the IT industry for more then 12 years. I have tonnes of experience in developing projects using Java,Apache Spark,Hive,Kafka,Scoop,Pig,Scala,aws Daha Fazla

$200 USD in 7 gün içinde
(1 Yorum)
2.8
gurumail10

Hi i am a Data Scientist working in machine learning from past 3 years. i have done many projects like recommendation system, anomaly detection, fraud detection etc. i can do your task in Python very efficiently.

$140 USD in 7 gün içinde
(4 Değerlendirme)
2.6
DataLamp

Hi, I am writing to you today as I would like to draw your attention towards my company Data Lamp. Our company is into Big Data, Spark, Flow Designing/Optimizations, Research & Development, Algorithms (Graph Theory, D Daha Fazla

$130 USD in 10 gün içinde
(2 Değerlendirme)
2.7
Regalone

Hi, I worked with same set before(Scala,s3 and cassandra) and can easily deliver solution within next day.

$200 USD in 2 gün içinde
(3 Değerlendirme)
2.5
vrshu112

Hi, I have over 5 years of experinece in scala java spark strom hdfs. I have written may live streaming and batch mode projects. I can complete this work in 5 days. Thanks Devesh Kumar

$120 USD in 7 gün içinde
(1 Yorum)
2.3
khangulzar

Hi, I am interested in this project. I've more than 5 yrs of experience in big data related tools and technologies. I've already implemented the spark scala related pipelines on aws for my company.

$180 USD in 7 gün içinde
(1 Yorum)
0.7
JonnathanSCM

Hello Sr. I feel that I have the relevant skills to develop your application, I have worked as an Spark developer by 3 years using the most commons Hadoop applications in the ecosystem. Please find attached a copy of Daha Fazla

$140 USD in 7 gün içinde
(0 Değerlendirme)
0.0
JavaInDJ

Hi, I can help you in this project as I have good expertise in Spark jobs to read CSV and export data to NoSQL dbs. Thanks

$250 USD in 7 gün içinde
(0 Değerlendirme)
1.0
techlinesols6

"Hi, Hope you are doing well! Thanks for sharing your project requirement with us. It will be our great pleasure to work on your project. I have checked your requirement, yes we can do it, because we already work on si Daha Fazla

$140 USD in 7 gün içinde
(3 Değerlendirme)
0.0
thanq4all

Our team of experts can write the Spark Scala code with industrial standard. Would like to know more about the work.

$175 USD in 7 gün içinde
(0 Değerlendirme)
0.0
duttat

I have been working for more than 3 years in Hadoop/Big Data stack. It will be my pleasure if you give me an opportunity to work on your project. Please connect me for further details to start working on this.

$175 USD in 7 gün içinde
(0 Değerlendirme)
0.0
Asif4213

I have read your project requirements and i understood it clearly. I am Scala Spark developer with 3 year of experience. I have worked on lot of Machine learning and Data Sciences projects. Some of them are listed belo Daha Fazla

$200 USD in 7 gün içinde
(0 Değerlendirme)
0.0
Srijita5

I have been doing the data processing using the spark and Scala for last 4 yrs - so this is suiting me very much. Deliverable: Application code and packaged jar along with a tutorial about how to maintain the code in Daha Fazla

$60 USD in 4 gün içinde
(0 Değerlendirme)
0.0
Yusuf009

Hi It is straight forward requirement and would like to take up the project. Please reach out to me for further discussion. Thanks.

$261 USD in 15 gün içinde
(1 Yorum)
0.0
baskarfelix

I am having 4 years experience Scala spark technologies with real time experience and you can check my linked in profile

$100 USD in 7 gün içinde
(0 Değerlendirme)
0.0
arohit91

I have more than 4 years of experience writing spark code with scala and python. I have also been working with AWS projects since 1 year. There are two ways to go about solving this problem: 1. Using spark dataframe's Daha Fazla

$120 USD in 4 gün içinde
(0 Değerlendirme)
0.0