
Closed
Posted
I'm in need of a seasoned data engineer who has extensive experience with Azure, AWS, and Databricks. The primary focus of this project is data pipeline development. Key Requirements: - Proficiency in Python, Spark, and SQL - In-depth knowledge of data engineering tools and platforms such as Databricks, Azure, and AWS - Experience in developing robust data pipelines - Experience with ETL processes for data extraction, transformation, and loading - Experience in data migration between databases and data warehouses - Expertise in SQL query optimization for performance improvements Ideal Skills: - Data analysis - Familiarity with Hadoop - Data cleaning and preprocessing expertise Please provide your credentials and examples of similar projects you've completed in the past.
Project ID: 38877735
13 proposals
Remote project
Active 1 yr ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
13 freelancers are bidding on average $58 USD/hour for this job

⭐⭐⭐⭐⭐ CnELIndia, under the leadership of Raman Ladhani, is perfectly equipped to deliver a high-quality data engineering solution for this project. With deep expertise in Azure, AWS, and Databricks, we excel at designing, building, and optimizing data pipelines tailored to your specific requirements. Our team has a proven track record of handling complex ETL processes, data migration, and SQL query optimization for enhanced performance. Steps for successful completion: Initial consultation to understand data sources, pipeline requirements, and goals. Architect and develop scalable data pipelines using Python, Spark, and SQL in Databricks, Azure, and AWS environments. Implement robust ETL processes ensuring efficient data extraction, transformation, and loading. Conduct data cleaning and preprocessing to ensure high-quality datasets. Optimize SQL queries and improve pipeline performance. Ensure seamless data migration across platforms and comprehensive testing for reliability. We are committed to providing timely, scalable, and efficient solutions.
$63 USD in 40 days
8.2
8.2

As a seasoned data engineer with a rich understanding of Azure, AWS, and Databricks, I believe I am an ideal fit for your project. My proficiency in Python, Spark, and SQL along with my familiarity with Hadoop will make data pipeline development a breeze. We have 35+ experts on our team, meaning we have extensive knowledge of all the tools and platforms you mentioned. Our company has always focused on delivering high-quality services that are time-efficient but without compromising on effectiveness. With our strategy of working in milestones and release phases, we ensure that the project is on track and meets the expectations of the client at every stage of development. Our experience with 50% repeat business means we maintain client recommendations & satisfaction. Our expertise in ETL processes including data extraction, transformation, and loading combined with our knowledge in SQL query optimization will not only streamline your existing data operations but also enable smooth data migration between databases and warehouses. In conclusion, if you choose to work with me you'll be getting more than just a single freelancer working on one project – you'll have access to an entire team of skilled engineers who are already well-versed in the skills needed. Let's get started-and rest assured your data management is in safe hands!
$70 USD in 40 days
7.0
7.0

Hello, We can take up this role since we are expert Data Engineers with more than 10 years of experience in Data Engineering, DevOps and ETL. Also we have been working with EY & Deloitte India as their corporate trainer along with Bristlecone, Brillio, Alois, A5E as their remote service provider. Here you can find our recently completed similar project & feedback from this following link : https://www.freelancer.com/projects/azure/Azure-DevOps-Support-for-Microservices/reviews Do let me know you availability to discuss here ? We are very much positive and eager to discuss with you more in detail about this engagement. Feel free to drop us a message here. Look forward to hearing from you. Regards Solutionzhere
$50 USD in 40 days
5.9
5.9

With 5+ years of end-to-end experience as a full-stack developer, I can say without hesitation that my team and I are the best choice for your data engineering project. Having extensive skills in AWS, Azure, and Databricks along with Python, Spark, and SQL, we excel at developing robust data pipelines and employing ETL processes for smooth data migration. As an additional bonus, I have significant expertise in SQL query optimization which will ensure superior performance for your data processing. One of our key strengths as a team is adapting to the client's needs. We have worked on a variety of similar projects before, leveraging our knowledge in Hadoop for data analysis and proficiency in other big-data platforms as well. For us, thorough data cleaning and preprocessing before pipeline development is as integral a process as the pipeline development itself. To validate our competence, we've successfully completed projects involving cloud computing and Database management on platforms like AWS, Azure, MySQL etc. Our meticulous approach combined with knack for problem solving makes choosing us a no-brainer. So expand yöur horizon of possibilities and allow me to deliver top-notch quality that simplifies your complex data engineering challenges.
$50 USD in 40 days
5.9
5.9

With my in-depth knowledge of the entire data engineering stack based on Azure, AWS and Databricks, I believe I am uniquely positioned to deliver exceptional results for your project. My wealth of experience in building robust data pipelines, employing ETL processes, and carrying out optimized data migrations make me a valuable asset. Furthermore, my skills in Python, Spark, and SQL accentuated by a strong background in query optimization perfectly align with your prerequisites. In addition to having an analytical mindset and adept problem-solving skills working with Big Data, I offer thorough competency in Hadoop -extensively used for distributed storage and processing of large datasets- which fulfills one of your 'Ideal Skills' requirement. Equally important, my expertise in data cleaning and preprocessing ensures the quality of the information that will be involved in your pipeline system. To cap it all off, my proficiency in Power BI and Tableau nicely complements the work we will do together by enabling me to present actionable insights visually. Please feel free to explore my impressive portfolio that includes various projects similar to yours. Let's combine our knowledge and create impactful solutions for optimizing your operations!
$63 USD in 40 days
6.1
6.1

Hi there, I’m an experienced ML engineer and can start working on your project right away. I’ll ensure timely delivery and meet the deadline. Let’s have a quick conversation to discuss your requirements in detail. Once I have all the necessary information, I can provide a more tailored approach to execute the project effectively. Looking forward to collaborating with you!
$63 USD in 40 days
5.5
5.5

Drawing from my extensive experience of over 10 years in the IT industry, with a sharp focus on data engineering, I believe I'm the ideal fit for your Azure, AWS, and Databricks project. My experience includes proficient usage of Python, Spark, and SQL - all central skills for for this project. I have also demonstrated a solid understanding of data warehouse architecture by crafting robust data pipelines. Having worked in several complex IT settings before, I possess a unique ability to optimize SQL queries for performance improvement - an essential skillset for data engineers. Further, I have hands-on experience in ETL processes; from extracting and transforming to loading data, ensuring swift and accurate transfer between databases and warehouses. In addition to my vast experience within Azure, AWS, and Databricks ecosystems, my skills in Hadoop, strong familiarity with Data cleaning techniques and preprocessing expertise add significant value to the role. You can trust that with me on board, your project will achieve not just technical excellence but also secure and efficient data management that'll elevate your business to greater heights. Lets connect and discuss together. Regards, Deb K
$50 USD in 40 days
4.4
4.4

As a veteran data scientist and program manager, fluent in Python and well-versed in Google Cloud Platform, Vertex AI, BigQuery, I can verify that I have justifiably earned my stripes in the very fields of interest for your project. Your requirement for an expert with a deep understanding of GCP and Databricks aligns completely with my extensive expertise in cloud-based data engineering. Over the past two decades, I have developed a knack for implementing robust data pipelines such as the one you seek - focusing specifically on ETL processes to ensure seamless extraction, transformation and loading across various databases and warehouses. Moreover, I firmly believe in the power of optimized SQL queries for enhanced input-output performance,
$50 USD in 40 days
0.0
0.0

Pune, India
Member since Dec 10, 2024
$15-25 USD / hour
₹12500-37500 INR
₹37500-75000 INR
₹600-7000 INR
₹12500-37500 INR
₹600-1500 INR
₹12500-37500 INR
₹1500-12500 INR
£1500-3000 GBP
₹400-750 INR / hour
₹10000-30000 INR
$5-30 USD / hour
$10-30 USD
₹37500-75000 INR
min ₹2500 INR / hour
₹600-1500 INR
₹1500-12500 INR
$8-15 USD / hour
min ₹2500 INR / hour
₹12500-37500 INR
₹75000-150000 INR