Overview

Location: London  Salary: 60000  Posted Date: 19 Sep 2025  Closing Date: 05 Oct 2025

Join Elexon as a Data Engineer. The ideal candidate will bring experience in building, maintaining, and optimising data pipelines to support the data needs of multiple cross-functional teams. Hybrid working & Excellent Benefits available.

Team Overview

The Data Engineering team is dedicated to building and maintaining a robust, scalable cloud-based data platform that empowers internal users to perform advanced analytics on a self service basis. Our mission is to streamline data operations, ensure data integrity and enhance data accessibility across the organisation. By supporting the development of our next generation of data products, we aim to drive innovation and support cutting-edge solutions that meet the evolving needs of our customers and stakeholders.

Job Purpose

The candidate will be experienced in building, maintaining, and optimising data pipelines to meet the data needs of multiple cross-functional teams. Their expertise in data engineering will enable them to contribute to Elexon’s digital strategy by leveraging data to drive actionable insights, enhance decision-making processes, and fuel innovation across various business domains. Additionally, the candidate will be responsible for implementing robust data governance and security measures, ensuring compliance with regulatory requirements and protecting the confidentiality, integrity and availability of data assets.

Key Responsibilities

• Develop Azure based Data Platforms using selected tools based on the Microsoft Azure Well Architected Framework
• Build, orchestrate & monitor ETL/ELT jobs/pipelines
• Collaborate with Elexon Data Architects to implement Data Models for Analytical Workloads
• Collaborate with Data Analysts/Scientists & Analytics Engineers to develop data processing pipelines using Python / Spark to serve Machine Learning models
• Maintain metadata about the data residing within the Data Lake
• Explore ways to enhance data quality and reliability
• Identify opportunities for data acquisition
• Align architecture with business requirements
• Knowledge transfer within the Data Engineering team

Capabilities and Competencies

• Experience building and maintaining Azure cloud based Data Lakes
• Strong analytic skills related to working with large, structured and unstructured datasets
• Experience building ETL/ELT pipelines
• Advanced knowledge of SQL including query optimisation
• Strong Programming background specifically in Python/PySpark
• Experience with big data tools (Hadoop, Spark, Kafka, etc.)
• Background in MS Azure platform and services (Data Factory, Synapse, Databricks etc.)
• Version controlling and CI/CD pipelines
• Experience with database technologies (relational, NoSQL, graph)
• Infrastructure as code such as Terraform
• Experience in energy industry, particularly the electricity industry
• Experience using MLOps tools such as MLflow in Databricks
• Experience of project methodologies including Agile
• Background in application development

Potential next role(s) / Career path

• Senior Data Engineer: As a proficient Data Engineer, there is the potential to continue developing your technical skills and expertise, paving the way for advancement into Senior Data Engineering roles
• Lead Data Engineer: Develop line management skills to lead a team and projects, shaping the direction of data engineering efforts
• More analytically focused roles supporting Machine Learning model development
• Solutions Architect: Apply technical expertise to design end-to-end data solutions
• Data Architect: Lead the design and development of data architectures

27 days annual holiday + Bank Holidays

• Discretionary annual incentive scheme
• Life assurance
• Pension
• Private medical (Bupa)

Employee Wellbeing

• Hybrid working – 2 days per week at our London office
• Employee Assistance Programme
• Eye care voucher scheme
• Subsidised gym membership
• Cycle to Work Scheme
• Buying & selling holiday scheme
• Corporate Social Responsibility (CSR) days
• Season ticket loan

We believe a diverse and inclusive culture allows innovation and creativity to flourish. We are committed to continuously improving our culture for our colleagues and stakeholders. Through our hugely successful Diversity Forum, Mental Health First Aid network and regular programme of activities and events, we celebrate difference and recognise the value of employee wellbeing, which is a consistent outcome from annual employee surveys that we conduct. Likewise, as a community, we like to support each other, and all agree Elexon is a great place to work with a great workspace too!

Equal Opportunity

At Elexon, we want to:

• Provide true equality of opportunity
• Attract and retain diverse talent
• Listen to all voices
• Be representative of the communities we work in
• Be a role model for Diversity and Inclusion in the industry

Elexon together, embracing differences, listening to all voices