Data Engineer

New Today

Overview

Location: London (hybrid working 3 office days per week)

Employment Type: Full time / Permanent

Application Closing Date: Friday 17th October 2025

Thought The AA only provide roadside assistance? Think again. For over 100 years, we’ve evolved and today, as the nation’s number one motoring organisation, we offer a range of products and services from roadside assistance to home and motor insurance as well as driving technologies. As we continue to expand, diversify, and modernise, joining us as our Data Engineer, you’ll play a key part to our success and join us on this exciting motoring journey.

What will I be doing?

  • Shape the future of data by designing and building robust pipelines that ingest, transform, and deliver underwriting insights from a variety of sources.
  • Harness Azure to develop and maintain cloud-native data architectures using services such as Azure Data Factory, Synapse, and Databricks.
  • Collaborate with stakeholders to translate complex data needs into scalable technical solutions.
  • Champion data integrity by ensuring systems meet quality, governance, and regulatory compliance.
  • Drive performance by optimising data systems for real-time and batch processing, ensuring speed and scalability.
  • Monitor pipelines, troubleshoot issues, and keep data flowing smoothly.
  • Build intelligence into underwriting datasets through data modelling and metadata management.
  • Support users by responding to data incidents and assisting the team with triage and resolution.
  • Work within the technical architecture, documentation standards, governance policies, and procedures to deliver excellence.

What do I need?

  • Proven experience as a Data Engineer or in a similar role, with hands-on Python, ETL, SQL, and cloud-based environments.
  • Strong proficiency in Python for data processing and automation tasks.
  • Experience with ETL tools/frameworks such as Apache Airflow, Talend, or Informatica.
  • Deep understanding of cloud platforms, ideally Microsoft Azure, and services like Azure Data Factory, Azure Databricks, and Azure SQL Database.
  • Experience working with end users to gather requirements and deliver user-centric data solutions.
  • Hands-on experience with Databricks for big data processing and analytics.
  • Familiarity with big data technologies like Apache Spark.
  • Experience in real-time data processing and handling XML files.

Benefits

  • 25 days annual leave plus bank holidays + holiday buying scheme
  • Worksave pension scheme with up to 7% employer contribution
  • Free AA breakdown membership from Day 1 plus 50% discount for family and friends
  • Discounts on AA products including car and home insurance
  • Employee discount scheme including car salary sacrifice and discounts on healthcare, shopping, holidays and more
  • Company funded life assurance
  • Diverse learning and development opportunities
  • Dedicated Employee Assistance Programme and 24/7 remote GP service for you and your family

We’re an equal opportunities employer and welcome applications from everyone. The AA values diversity and the difference this brings to our culture and our customers. We actively seek people from diverse backgrounds to join us and become part of an inclusive company where you can be yourself, be empowered to be your best and feel like you truly belong. We have five communities to bring together people with shared characteristics and backgrounds and drive positive change.

#J-18808-Ljbffr
Location:
City Of London
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search