Lead Data Engineer

New Today

Overview

TalkTalk’s vision is to be the most recommended Wi-Fi provider in the UK by 2028 with a growing, profitable base. Our aim is to deliver simplified & customer delighting Wi-Fi products and a more digital customer & employee experience, enabled by a technology platform that drives data-driven decision-making and automation.

The Data Engineering team is part of the Delivery business unit of the IT function within the Data & Automation department, alongside the Report Engineering, Data Governance, Data Migrations and Automation teams. Data Engineering combines data engineers and QA engineers who are forward-thinking, collaborative, and growth-oriented.

Be Yourself. Make an Impact. Join Us.

As a recognised Top 50 Inclusive Employer in the UK, TalkTalk is committed to building a diverse workplace that reflects the communities and customers we serve. Inclusion is part of our DNA – we’re all 100% human.

What We Offer

  • Flexible hybrid working – minimum 50% office presence
  • Collaborative office spaces designed for creative thinking and innovation
  • Free on-site parking at our offices
  • Generous holiday package – 25 days annual leave, wellbeing days, and your birthday off (plus option to buy up to 10 more days)
  • Private healthcare for all employees
  • Competitive pension scheme and performance-related bonus opportunities
  • Free broadband for all employees
  • Life event gifts and inclusive employee networks
  • Salary sacrifice scheme for dental, gym, and more
  • Big retail and leisure discounts
  • 3 paid volunteering days per year

We’re not your traditional 9-5. We’re a dynamic, flexible workplace and we’d love to hear how you like to work.

Responsibilities

  • Leading by example through hands-on development and review of a quality Python and SQL codebase.
  • Contributing to a productive team culture with automated CI/CD and testing practices.
  • Inputting into planning and estimating work and delivery roadmap.
  • Keeping up to date with Databricks platform developments and maintaining tech currency of internal systems.
  • Ensuring accurate documentation and system resilience is maintained.
  • Collaborating with cross-functional teams to contribute toward TalkTalk data strategy.
  • Identifying and implementing cost optimization ideas.
  • Coaching and mentoring a distributed team of data engineers across multiple delivery projects.
  • Establishing data governance frameworks for secure handling of delivery information.
  • Identifying opportunities for improvement across data engineering projects.
  • Managing relationships with stakeholders across operations, technology, and business units to understand requirements and ensure delivery.

Must Have

  • 8+ years’ experience in data engineering and 1+ year as Lead Data Engineer
  • Proven expertise with Microsoft Azure
  • Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark
  • Expertise in Databricks for large-scale data engineering and analytics workloads; experience with Unity Catalog, Delta Lake, and Apache Spark
  • Experience with advanced Delta Lake features (time travel, vacuum, Z-ordering)
  • Develop custom solutions using Databricks APIs and integrate with external systems
  • Solid understanding of SQL and relational databases
  • Experience with CI/CD, Git and modern DevOps practices for data solutions
  • Strong problem-solving, communication, and client-facing collaboration skills
  • Exposure to machine learning or data science workflows is a plus but not required
  • Hands-on with Azure DevOps pipelines (YAML, agents, service connections)
  • Strong problem-solving and troubleshooting skills
  • Excellent communication skills with the ability to collaborate with cross-functional teams
  • Experience with data migration projects and legacy system modernization
  • Desirable: Databricks Data Engineer and/or Azure Data Engineer certifications

Seniority

  • Mid-Senior level

Employment Type

  • Full-time

Industry

  • Telecommunications

We’re unlocking community knowledge in a new way. Experts add insights directly into each article with AI assistance.

#J-18808-Ljbffr
Location:
Manchester, England, United Kingdom
Salary:
£80,000 - £100,000
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search