● Review and understand business requirements ensuring that development tasks are
completed within the timeline provided and that issues are fully tested with minimal defects
● Partner with software development team to implement best practices and optimize
performance of Data applications.
● Collaborate across the company and interact with our customers to define, design and
showcase new concepts and solutions
● Research on new Big Data technologies, assessing maturity and alignment of technology to
business and technology strategy.
● Collaborate with other developers to ensure that client needs are met at all times
● Work in a rapid and agile development process to enable increased speed to market against
a backdrop of appropriate controls.
● Implement good development and testing standards to ensure quality of deliverables
● Rapidly understand and translate clients’ business challenges and concerns into a solution
● At least 6+ years of total IT experience
● At least 4+ years of experience in design and development using Hadoop technology stack
and programming languages
● Hands-on experience in 2 or more areas:
o Hadoop, HDFS, MR
o Spark Streaming, Spark SQL, Spark ML
o Apache NiFi
o Worked with Hortonworks Data Platform
o Hive / Pig / Sqoop
o NoSQL Databases HBase/Cassandra/Neo4j/MongoDB
o Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau,
o Scrapy for crawling websites
o Good to have knowledge of Elastic Search
o Good to have understanding of Google Analytics data streaming.
o Data security (Kerberos/Open LDAP/Knox/Ranger)
● Should have a very good overview of the current landscape and ability to visualise
technology and industry trends
● Working knowledge of Big Data Integration with Third party / in house built Metadata
Management, Data Quality, Master Data Management Solutions,Structured/Unstructured
● Have been active in the community in terms of articles / blogs / speaking engagements at
Bu iş için 6 freelancer ortalamada ₹2313/saat teklif veriyor
Hello. I am an expert in Big Data analytics and have 3 years of experiences in this field. And I have been worked as a data analyst in big data project team and mastered data sources(Strucutred and undstructured data), Daha Fazla
Hi I am BigData Engineer with 5+ years of relevant experience and 7+ years of overall experience. I have worked on Hadoop Hive, SparkSQL, SQL, HDFS, MapR, Sqoop and Tableau.