Senior Data Engineer - McGregor Boyall
New Yesterday
Job Description
Senior Data Engineer
Up to £95,000 + benefits | Hybrid (3 days a week in City of London)
A global financial services firm is hiring a Senior Data Engineer to join their Brokerage technology team.
You'll be building and maintaining the data pipelines that underpin their £1bn+ broking business - with a strong focus on improving brokerage data quality, optimising commercial analysis, and supporting complex client agreements.
This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability.
Key responsibilities
Design and build robust ETL pipelines using Python and AWS services
Own and maintain Airflow workflows
Ensure high data quality through rigorous testing and validation
Analyse and understand complex data sets before pipeline design
Collaborate with stakeholders to translate business requirements into data solutions
Monitor and improve pipeline performance and reliability
Maintain documentation of systems, workflows, and configs
Tech environment
Python, SQL/PLSQL (MS SQL + Oracle), PySpark
Apache Airflow (MWAA), AWS Glue, Athena
AWS services (CDK, S3, data lake architectures)
Git, JIRA
You should apply if you have:
Strong Python and SQL skills
Proven experience designing data pipelines in cloud environments
Hands-on experience with Airflow (ideally MWAA)
Background working with large, complex datasets
Experience in finance or similar high-volume, regulated industries (preferred but not essential)
High attention to detail and a clear commitment to data quality
McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.
- Location:
- London
- Category:
- Technology