Manager - Lead Data Engineer

New Today

Overview

We are looking for a skilled and proactive Data Engineer with strong expertise in the Microsoft Azure data ecosystem, including Microsoft Fabric, Synapse Analytics, and Delta Lake. This role requires hands-on experience in building and optimising data pipelines and notebooks, transforming large datasets, and enabling data-driven decision-making across the organisation. The successful candidate will play a key role in designing and implementing scalable data solutions, collaborating with both technical and non-technical stakeholders, and helping shape our modern data architecture.

Responsibilities

  • Support clients in generating business value from digital solutions powered by SAP and Cloud technologies.
  • Manage projects and workstreams on complex data cleanse and migration programs from strategy to execution.
  • Support senior client stakeholders (CFO, CDO, CIO) to cultivate relationships as a trusted partner through articulating and realizing the value of data.
  • Design, develop, and maintain robust data pipelines and notebooks using Synapse Analytics and Microsoft Fabric.
  • Build and optimise complex data transformation and ingestion logic to support enterprise-level reporting and analytics.
  • Leverage Delta Lake architecture to support both batch and streaming data processes.
  • Develop high-quality, reusable code in Python and PySpark, following best practices and ensuring maintainability.
  • Create insightful, interactive reports and dashboards using Power BI.
  • Use Git and Azure DevOps (ADO) for version control and deployment workflows.
  • Continuously improve the performance, reliability, and scalability of data systems.
  • Advocate for best practices in data governance, data quality, and documentation.

Requirements

  • In depth experience working with the Microsoft Azure Data Technology Stack, including services such as Azure Data Factory, Synapse Analytics, Azure Data Lake Storage, and related tools.
  • Microsoft Fabric - experience with dataflows, lakehouses, notebooks, and workspace management.
  • Azure Synapse Analytics - pipeline and notebook creation, performance tuning, and data transformation logic.
  • Power BI - data modelling, DAX, and visualisation development.
  • Delta Lake - supporting structured streaming and batch data workloads.
  • Python & PySpark - used for scalable data engineering solutions.
  • Git / Azure DevOps (ADO) - version control, CI/CD, and collaboration in team-based environments.

Certifications / Extras

  • Microsoft Certified: Azure Data Fundamentals
  • Microsoft Certified: Azure Data Engineer Associate
  • Microsoft Certified: Microsoft Fabric Analytics Engineer Associate
  • Familiarity with real-time data processing using Azure Event Hubs or similar technologies.
  • Exposure to data science or machine learning pipelines.
  • Understanding of data security, GDPR, and compliance best practices.

Locations

  • London, Canada Square
  • Birmingham
  • Manchester
  • Leeds

With 20 sites across the UK, we can potentially facilitate office work, working from home, flexible hours, and part-time options. If you have a need for flexibility, please register and discuss this with our team.

The KPMG Technology + Data function is a cornerstone of our business. We do work that matters to our local business and communities - supporting technical innovation and adoption of cutting-edge solutions across the United Kingdom. Working on complex engagements including working closely with clients to design, implement, and manage scalable data solutions, this team is responsible for the delivery of cutting-edge technical solutions and trusted to get it right first time. KPMG is one of the world's largest and most respected consultancy businesses, we\'ve supported the UK through times of war and peace, prosperity and recession, political and regulatory upheaval. We\'ve proudly stood beside the institutions and businesses which make the UK what it is.

#J-18808-Ljbffr
Location:
Birmingham
Job Type:
PartTime
Category:
IT & Technology

We found some similar jobs based on your search