Data Engineer

New Yesterday

eSC Cleared Data Engineer Bristol or London (Mostly working from home) Up to £745 per day (Umbrella, Inside IR35) Must hold live and transferrable Enhanced SC Security Clearance About the Role We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll be instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems. If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact. Key Responsibilities Design & Optimise Pipelines - Build and refine ETL/ELT workflows using Apache Airflow for orchestration. Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services. Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift). Data Quality & Governance - Implement automated validation, testing, and monitoring for data integrity. Performance & Troubleshooting - Monitor workflows, enhance logging/alerting, and fine-tune performance. Data Modelling - Handle schema evolution, partitioning strategies, and efficien...
Location:
London
Salary:
£650 - £745 per day + Umbrella, inside IR£35
Category:
IT & Computers

We found some similar jobs based on your search