ETL Jobs

I need to turn raw treasury-trading deal data into clear, decision-ready performance reports. The core of the job is to build a repeatable process that reads my daily deal files, analyses them, and produces a set of Performance Reports covering three key metrics: • Return on Investment • Trading Volume • Profit & Loss Statement . RATES AND MORE The source files arrive in CSV/Excel straight from our treasury platform. I am comfortable sharing a sample dataset so you can map the fields, clean anomalies, and transform the numbers. Ideally the workflow is automated—SQL or Python for the heavy lifting and Excel, Power BI or Tableau for the final dashboards and printable summaries—but I am open to whichever stack you can justify as robust and maintainable....

Title: Senior dMRV / Carbon Data Engineer (Verra + – Palm Oil / Biochar) Scope: We are an agentic + Web3 dMRV platform. We need a freelancer to assist prepare our data and calculations. Your tasks: Review historical data of POME SCADA exports. Map SCADA fields to Verra VCS POME/biogas methodology requirements and, at a high level, to biochar requirements. Build Python/SQL ETL scripts to clean and structure the data (handle gaps, outliers, units). Implement preliminary carbon calculations (CH₄ avoided / destroyed, EFB→biochar tCO₂e stored) using standard factors. Deliver a short technical memo (10–15 pages) describing data, assumptions, and methods that we can later refine with VVB. Must‑have experience: Hands‑on data work (Python + SQL) with time‑series / SCADA ...

The Workday technical consultant will design and implement scalable Workday data ingestion pipelines and provide recommendations on best practices for extracting and integrating Workday data across hyperscaler environments (Azure, AWS, or GCP). Integration Approaches Under Evaluation REST API SOAP API RaaS (Report as a Service) WQL (Workday Query Language) RaaS has been the traditional approach but is not preferred for future implementations. Key Requirements 5+ years of Workday technical experience (integrations, reporting, or data extraction). Proven experience implementing Workday data ingestion to cloud data platforms. Strong understanding of REST/SOAP APIs, RaaS, and WQL. Experience working with modern data platforms and ETL/ELT pipelines. Ability to recommend optimal ingestion strate...

I need an experienced AWS data engineer to design and build production-ready ETL pipelines in AWS Glue. The work centres on moving and transforming data from several source systems—relational databases (e.g., PostgreSQL, MySQL), NoSQL stores, real-time streams coming through Kafka/Kinesis, and a handful of internal/external REST APIs—into a clean, query-friendly layout in S3 and, ultimately, Redshift. Requirements: Strong AWS data engineering experiences with various aws services Experience building end-to-end data pipelines (schema discovery, ingestion, transformation, orchestration, monitoring) Experience working with relational databases like Oracle, MySQL, and SQL Server etc Experience with data ingestion from on-prem systems to cloud Experience with streaming platforms...

Title Build Comprehensive Global Movie & TV Metadata Database for Recommendation Engine Project Overview I am building a personal recommendation engine that predicts my rating for movies and TV shows based on a large history of titles I have already rated. To support accurate predictions, I need a global media metadata database that contains rich structured information for movies and TV series. The dataset should combine multiple trusted sources and be designed for machine-learning comparison against my rating history. Scope of Work Build a master dataset containing global movie and TV metadata. This will serve as the candidate pool for prediction models. The database should include titles from: • IMDb official dataset • The Movie Database API • Optional enri...

Database Migration Specialist: MySQL to Supabase/PostgreSQL We're looking for a data migration expert who doesn't just move data — you ensure it arrives clean, complete, and production-ready. You have deep experience migrating large-scale databases and understand the nuances of moving from MySQL to PostgreSQL in Supabase environments. What You'll Do: - Plan and execute end-to-end migration of large MySQL databases to PostgreSQL on Supabase - Audit source data for inconsistencies, duplicates, and schema incompatibilities before migration - Design and implement migration scripts, transformation logic, and validation checks - Handle data type mapping, constraint differences, and stored procedure conversions between MySQL and PostgreSQL - Perform dry runs, staged migrati...

For the next round of hiring I want an accomplished Senior Data Engineer to sit in on our technical interviews for roughly two hours each day. The role is purely evaluative: you will craft probing questions, join live video calls, and quickly score each candidate’s depth of knowledge across Python, Scala and SQL. Our stack centres on Azure and Databricks, so practical insight into large-scale Spark/PySpark jobs, data-model design, ETL orchestration and cloud performance tuning is essential. Candidates frequently discuss streaming, optimisation strategies and modern AI/ML add-ons, so any hands-on exposure to libraries such as PyTorch, NumPy, SciPy or TensorFlow will help you challenge them at the right level, though it is not mandatory. Availability is limited to two focused hou...