Data Engineer


● Review and understand business requirements ensuring that development tasks are

completed within the timeline provided and that issues are fully tested with minimal defects

● Partner with software development team to implement best practices and optimize

performance of Data applications.

● Collaborate across the company and interact with our customers to define, design and

showcase new concepts and solutions

● Research on new Big Data technologies, assessing maturity and alignment of technology to

business and technology strategy.

● Collaborate with other developers to ensure that client needs are met at all times

● Work in a rapid and agile development process to enable increased speed to market against

a backdrop of appropriate controls.

● Implement good development and testing standards to ensure quality of deliverables

● Rapidly understand and translate clients’ business challenges and concerns into a solution

oriented discussion.

Must Have:

● At least 6+ years of total IT experience

● At least 4+ years of experience in design and development using Hadoop technology stack

and programming languages

● Hands-on experience in 2 or more areas:

o Hadoop, HDFS, MR

o Spark Streaming, Spark SQL, Spark ML

o Kafka/Flume.

o Apache NiFi

o Worked with Hortonworks Data Platform

o Hive / Pig / Sqoop

o NoSQL Databases HBase/Cassandra/Neo4j/MongoDB

o Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau,


o Scrapy for crawling websites

o Good to have knowledge of Elastic Search

o Good to have understanding of Google Analytics data streaming.

o Data security (Kerberos/Open LDAP/Knox/Ranger)

● Should have a very good overview of the current landscape and ability to visualise

technology and industry trends

● Working knowledge of Big Data Integration with Third party / in house built Metadata

Management, Data Quality, Master Data Management Solutions,Structured/Unstructured


● Have been active in the community in terms of articles / blogs / speaking engagements at


Beceriler: Python, Hadoop

Müşteri Hakkında:
( 0 değerlendirme ) Pune, India

Proje NO: #34277644

Bu iş için 6 freelancer ortalamada ₹2313/saat teklif veriyor

(1 Yorum)
(2 Değerlendirme)

Welcome to Futuristic Acknowledged Bits Consultancy Services My capabilities are not limited to the following: ✔ Python Programming ✔ Hadoop ✔ PHP ✔ JavaScript ✔ NodeJS ✔ HTML5 ✔ CSS ✔ React.js ✔ Web Scraping, Data Ex Daha Fazla

₹2200 INR / saat tutarından itibaren
(1 Yorum)

Hello, I have 10+ years of experience in building bi solutions and data engineering solutions. I mostly worked with Tableau, PowerBI, Pentaho, AWS, Python programming. You can consider my profile your requirement. I Daha Fazla

₹1500 INR / saat tutarından itibaren
(0 Değerlendirme)

Hello. I am an expert in Big Data analytics and have 3 years of experiences in this field. And I have been worked as a data analyst in big data project team and mastered data sources(Strucutred and undstructured data), Daha Fazla

₹1750 INR / saat tutarından itibaren
(0 Değerlendirme)

Hi I am BigData Engineer with 5+ years of relevant experience and 7+ years of overall experience. I have worked on Hadoop Hive, SparkSQL, SQL, HDFS, MapR, Sqoop and Tableau.

₹1250 INR / saat tutarından itibaren
(0 Değerlendirme)