Data Engineer

@tangramua

Hello,   We carefully studied the description of your project and we can confirm that we understand your needs and are also interested in your project. Our team has the necessary resources to start your project as soon as possible and complete it in a very short time.   We are 25 years in this business and our technical specialists have strong experience in Python, SQL, MySQL, Amazon Web Services, Hadoop, Data Warehousing, ETL, Database Management and other technologies relevant to your project.   Please, review our profile https://www.freelancer.com/u/tangramua where you can find detailed information about our company, our portfolio, and the client's recent reviews.   Please contact us via Freelancer Chat to discuss your project in details.    Best regards, Sales department Tangram Canada Inc.     

@starttechno

I’d start by profiling the provided MySQL records and mapping each raw-to-analytics transformation before choosing indexes, keys, and query plans. I’ll build clean, testable Python and SQL pipelines, then package the repeatable run for AWS Lambda or ECS based on execution time and dependency needs. Within 7 days, you’ll have an end-to-end AWS pipeline, version-controlled transformations runnable from one command, health monitoring with failure alerts, and a concise README covering setup, scheduling, and rollback. I’ll also review existing MySQL views, stored procedures, and tables so the new flow improves reliability rather than adding another layer of technical debt. Should the first deployment target Lambda, or are you already leaning toward ECS for the pipeline runs? Muhammad Saad

@extreamcode

Hello, The hidden challenge here is not merely moving records, it is making every transformation reproducible, observable, and safe to operate when MySQL workloads grow. I can take ownership of the full flow by building clean, testable Python ETL/ELT processes with SQL transformations, reliable schema and indexing decisions, and analytics-ready MySQL tables. I’ll package repeatable execution on AWS using the most suitable option among Lambda, ECS, or a comparable service, then add health monitoring, alerting, version control, and clear rollback documentation. MySQL, SQL, Python, and Analytics will remain central to the implementation so your team can reproduce each pipeline from one command and validate it against the provided test data. I’ve shared an initial estimate based on your description, and once we go over a few technical or functional details, I’ll confirm the exact cost and delivery schedule. We can begin by reviewing the source schemas, expected volumes, scheduling needs, and AWS conventions, then define the first pipeline and acceptance checks. Could you share the source-system schemas, expected record volumes, refresh frequency, and whether your AWS environment already includes preferred orchestration, logging, and alerting services? Thanks, Asad

@rohitpatidar001

Hi, I’m interested in helping build and maintain your ETL/data pipelines and AWS-based data processing workflows. I have 11+ years of professional software development experience, with strong experience in backend systems, SQL/MySQL, database design and optimization, Python, AWS, API integrations, automation, testing and production troubleshooting. I can contribute to: * Designing reliable ETL/ELT pipelines * Python-based data extraction and transformation * MySQL schema design, indexes, queries, views and optimization * Data validation and transformation rules * AWS deployment using services such as Lambda or container-based workloads * Automated and repeatable pipeline execution * Logging, monitoring and failure/alert handling * Transaction/error handling and safe retry strategies * Git-based version control and reproducible deployments * README documentation covering setup, scheduling and rollback My deepest production experience is as a Java/Spring Boot backend engineer, but I also work with Python, SQL/MySQL, AWS and data-processing workflows. I want to be transparent that I am not positioning myself as a dedicated Hadoop specialist; my strength is building reliable backend/data systems and integrating them into production environments. I’m available for remote work and can start immediately.

@AITSoft

Hi, I understand that you need someone to own the complete data flow, from extracting structured records to loading reliable analytics-ready tables. I will build clean and testable Python and SQL pipelines, improve MySQL schema design, indexes, views, stored procedures, and query performance, then package the runs for AWS using the most suitable option such as Lambda or ECS. I will also add pipeline monitoring and alerts, keep all transformations version-controlled, and provide a clear README covering setup, scheduling, one-command execution, and rollback steps. I will first review the source data, current MySQL structure, expected outputs, and AWS setup before building the pipeline in small testable stages. Which AWS services, source data format, expected run schedule, and current MySQL schema should the first pipeline support? I can validate the complete flow with your test data and make sure it is repeatable and ready for future maintenance. Best regards

@sumitsthakur

I can take full ownership of your data flow and build reliable ETL and ELT pipelines for your structured data. With strong expertise in Python, SQL, MySQL, and AWS infrastructure, I will design robust data extraction, transformation, and loading processes tailored to your specific requirements. To deliver this, I will write clean, testable Python code and optimized SQL queries, focusing on schema design and indexing strategies for efficient query planning. I will package the pipelines for automated execution on AWS using services like Lambda or ECS, set up pipeline monitoring and alerting, and maintain your MySQL tables, views, and stored procedures. All transformations will be version-controlled and reproducible from a single command, ensuring the pipelines run smoothly end-to-end using your test data. I will also provide a concise README detailing setup, scheduling, and rollback procedures, along with complete documentation for your team. Let's discuss how we can get started on your data engineering needs.

@topcreator100

Hi There , Good morning! I’ve carefully checked your requirements and really interested in this job. I’m full stack node.js developer working at large-scale apps as a lead developer with U.S. and European teams. I’m offering best quality and highest performance at lowest price. I can complete your project on time and your will experience great satisfaction with me. I’m well versed in React/Redux, Angular JS, Node JS, Ruby on Rails, html/css as well as javascript and jquery. I have rich experienced in Database Management, Amazon Web Services, Data Warehousing, Hadoop, Python, ETL, MySQL and SQL. For more information about me, please refer to my portfolios. I’m ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details.. Please respond at your earliest convenience

@Hubready

Hello!, This is James from Hollywood... I’d love to take full ownership of your data flow and clean this up end to end. The main pain point here is usually not just extracting raw data, but making sure it lands reliably, transforms correctly, and keeps working as the source systems grow. I can help you turn that into a stable pipeline, not a fragile script. My approach: 1. Review your sources, schema, and current failure points 2. Build or fix extraction and ETL logic in Python/SQL 3. Store data cleanly in MySQL or the right warehouse layer 4. Add validation, logging, and monitoring so issues are caught early 5. Optimize for speed, maintainability, and easy handoff I work with data pipelines, AWS, ETL, database management, and production systems where accuracy matters. I’m very careful with requirements and I always ask the right questions before touching the code. Quick questions: 1. What are the exact data sources and target storage setup today? 2. Is this a one-time pipeline build or ongoing scheduled syncs? 3. Do you already have an AWS setup, or should I suggest the best structure? Relevant work examples: - Internal sales ETL dashboard for a niche retail brand - AWS-based inventory sync pipeline for a small e-commerce operator - Python/MySQL reporting system for a logistics startup If you want, I can quickly outline the best first phase before coding anything.

@onkarkulkarni8

Hello, I can help you with "Data Engineer" as per your given project description. We can discuss more in detail during a chat conversation when you are available. I've worked on many PHP projects in recent times. So I am confident on achieving your expected Goals. Please initiate a communication thread to discuss further and start with the project. ⭐ 5.0/5 from a recent client: "Good work delievered thank you for your patience" Final timeline and cost will be confirmed in chat after a complete understanding and documentation of the project expectations in detail.

@DeveloperStation

Hi, I've delivered AWS and MySQL work on Freelancer and Upwork with 5 star reviews, including an Amazon AWS web programming contract where a client said they'd hire again. 15 years of full-stack experience, strong on Python, SQL, and AWS. One question on the deploy target: do you lean toward Lambda for lighter batch jobs or ECS for longer running transforms? That choice shapes packaging, cold start behaviour, and how we schedule reproducible runs from one command. We've also built an AI listing platform on MySQL and AWS with reproducible pipelines behind it, so schema design and query planning are familiar ground. Since hours are flexible, I'd start by reviewing your test data and existing schema, then propose an indexing and ETL plan before writing code. Want me to look at the schema first? Adil

@AZTURK1

I can take full ownership of your end-to-end data pipelines, MySQL schema optimization, and automated AWS deployments. Here is how I will execute this: ✅ Build clean, modular Python ETL/ELT pipelines with robust error handling, schema validations, and idempotent batch runs. ✅ Optimize MySQL performance by profiling slow queries via EXPLAIN, refining composite indexing, tuning buffer pools, and refactoring stored procedures. ✅ Containerize execution via Docker on AWS ECS (Fargate) or serverless Lambda tasks scheduled through EventBridge, integrated with CloudWatch alerting for failed runs. ✅ Implement dry-run flags and database transaction rollbacks so failed pipeline runs never corrupt downstream analytical tables. ✅ Deliver version-controlled infrastructure (Git-ready) with a reproducible single-command run and comprehensive operational README. ✅ 10+ years production experience | 400+ completed projects | 320+ five-star reviews ✅ Microsoft® Certified: MCSA | MCSE | MCT & cPanel Certified (CWSA-2) What is your typical batch data volume per run, and are we loading directly into an RDS MySQL instance or staging through S3 first? My rate is 21 USD/hour and I can start immediately.

@sufyanasmat38

I understand, we can take ownership of the full data flow from extraction and transformation through reliable loading into analytics ready MySQL tables. We’ll build clean, testable Python and SQL pipelines, optimise schemas, indexes, queries, views, and stored procedures, then package them for repeatable AWS execution using Lambda, ECS, or the option that best fits the workload. We’ll also add monitoring, alerts, version control, rollback handling, and clear documentation so the pipelines remain easy to maintain. 1. How large are the current datasets and how frequently do the pipelines need to run? 2. Are the existing MySQL tables and stored procedures already in production, or should we review and optimise the current schema as part of the first phase? 3. Do you already have an AWS environment and preferred orchestration or scheduling approach, or should we design that around the pipeline workloads?

@HamparProd

Hello, I can take ownership of the data flow from source extraction through tested, analytics-ready MySQL tables. I’d start by tracing one representative pipeline and reviewing the schemas, existing procedures, and AWS environment, then establish a repeatable pattern for transformations, validation, logging, and failure recovery. I’ll keep the Python and SQL version-controlled and reproducible, optimize queries and indexes against the actual data, and document deployment, scheduling, monitoring, and rollback steps. We can begin with the highest-priority pipeline, validate it end to end using your test data, and then extend the same approach to the remaining flows. My rate is $22/hour, and I’m ready to begin after access and priorities are confirmed.

@kumarashish99

With over 5 years in backend development and an AWS certification to my name, I’m confident that I can handle your end-to-end data flow with utmost efficiency and precision. My experience revolves around architecting scalable, secure, and efficient cloud infrastructures that align perfectly with your project's needs. I have also built serverless and containerized applications using various frameworks similar to what you require to run on AWS. My expertise in DevOps engineering, including CI/CD pipelines, Infrastructure as Code (Terraform, etc.), and automated deployment workflows solidifies my suitability for your project. Ensuring the reliability of your data flow by writing clean, testable Python and SQL code is something I excel at. This includes not just extracting raw records, but also proactively maintaining and optimizing the tables, views, and stored procedures within the MySQL environment. Moreover, I am well-versed in schema design, indexing strategy, and query planning due to my extensive experience handling structured data. In addition to demonstrating an understanding of the project goals, I prioritize documenting my work for future references—making your onboarding process much easier. If you select me as your data engineer, I assure you dedication, efficiency and a top-tier deliverable that meets all specified criteria—making this the start of a successful partnership!

@mayr81

I can take ownership of your structured-data workflows from extraction through analytics-ready delivery. I’ll build clean, testable Python and SQL pipelines around MySQL, with careful attention to schema design, indexing, query performance, and reproducibility. For AWS deployment, I can package the workloads appropriately for Lambda, ECS, or a comparable service based on execution time, scale, and operational requirements. I’ll also include monitoring, actionable alerting, version-controlled transformations, and documentation covering setup, scheduling, and rollback. My approach is to first understand the current data sources, target models, and operational constraints, then establish a reliable pipeline foundation before optimizing performance and observability. The result will be an end-to-end workflow that runs against your test data, can be reproduced from a single command, and remains maintainable for the wider team. I’m comfortable working remotely with flexible hours and communicating progress clearly through well-documented, reviewable deliverables.

@razmiks2

Hi, I’ve built reliable ETL/ELT pipelines in Python that load into MySQL and deliver analytics-ready tables. You need end-to-end data flows with deterministic transformations, AWS-based automation, and version-controlled, reproducible runs. I will implement clean, testable Python and SQL with automated scheduling, health monitoring, and a rollback-ready README based on your test data. Best, Razmik

@naminghn

Hi there, I see that you need someone to take ownership of your data flow, specifically focusing on ETL/ELT pipelines and data preparation in MySQL. Given my background in designing and maintaining databases in MySQL, I’m confident in my ability to both optimize existing tables and create reliable pipelines for your analytics needs. I have extensive experience with Python and SQL, and I'm familiar with AWS deployment strategies including Lambda and ECS for automation. Additionally, I focus on schema design and indexing to ensure optimal performance. I can also set up monitoring and alerting for the pipelines to ensure they run smoothly. Let's discuss how I can contribute to your project. Regards, Ali

@Tanmoy236

Hi, I can own your data flow. With 9+ years in Python, SQL, and AWS, I understand you need reliable ETL and MySQL performance. Here's how I can help: ● Build ETL/ELT pipelines in Python and SQL for MySQL ● Optimize tables, views, and stored procedures with indexing and query planning ● Deploy on AWS Lambda, ECS, or similar with automated runs ● Add monitoring, alerting, and clear documentation ● Ensure version control and single-command reproducibility Which AWS service do you prefer for orchestration, and what test data volume should I expect? Let's connect in chat to align on scope and timeline.

@billybryan98

Could you clarify any specific data sources you want to integrate into the ETL pipelines? I recommend focusing on optimizing the indexing strategy in MySQL to enhance query performance, especially as data scales. With over 6 years of experience in Python and SQL, I am confident in building robust ETL pipelines and managing data efficiently using AWS. I will design and implement the ETL processes by extracting data, transforming it using Python, and loading it into MySQL tables, ensuring thorough documentation and monitoring throughout. Please feel free to reach out to me. I look forward to working with you. Best regards, Billy Bryan