Lead Data Engineer
New Today
What you will deliver
- Lead and Mentor: Lead, manage, and mentor a team of 3-6 data engineers, fostering a collaborative and high-performing environment.
- Technical Vision & Ownership: Own and define the technical vision, providing architectural guidance and best practices for data modelling, ETL/ELT processes, data warehousing, and data lake solutions.
- Collaboration & Stakeholder Management: Work closely with Product Owners, Business Analysts, and other stakeholders to understand requirements, translate them into technical specifications, and ensure successful delivery of data solutions.
- Hands-on Development: Be a hands-on contributor to the design, development, and maintenance of scalable data pipelines and platforms, leveraging a modern data stack.
- Data Quality & Testing: Implement and champion robust testing strategies for data pipelines, including unit testing, integration testing, and data quality checks, to ensure accuracy, reliability, and completeness of data.
Your Skills and Experience
Essential
- Extensive Data Engineering Experience: Proven experience as a Senior or Lead Data Engineer, with a strong track record of designing, building, and maintaining complex data pipelines and platforms.
- Technical Expertise:
- Languages: Strong proficiency in Python and SQL.
- Cloud Platform: Hands-on experience with AWS services (EMR, Athena, Lambda, S3, Glue, Step Functions).
- Data Warehousing: In-depth experience with Snowflake.
- Big Data Processing: Experience with Spark and familiarity with Scala (even if limited).
- Orchestration: Solid experience with Airflow for workflow orchestration.
- Data Transformation: Hands-on experience with DBT (Data Build Tool).
- Version Control: Proficient with Git and GitHub, including experience with GitHub Actions for CI/CD.
- Leadership & Management:
- Demonstrated experience in leading, mentoring, and managing a team of data engineers.
- Ability to motivate and inspire a team, fostering a culture of continuous learning and excellence.
- Strong communication and interpersonal skills, with the ability to effectively collaborate with technical and non-technical stakeholders.
Desirable
- Real-time data processing
- Data governance and data quality frameworks
- Data operations and observability
We work with Textio to make our job design and hiring inclusive.
Status: Permanent
- Location:
- City Of London
- Job Type:
- FullTime
- Category:
- IT & Technology
We found some similar jobs based on your search
-
New Today
Technical Lead / Senior Data Engineer
-
United Kingdom
OverviewAs a Data & Application Engineer, you are responsible for the engineering team and the technology that the team owns. You will coach your team and act as a technical leader, ensuring the right technical decisions are made when building our da...
More Details -
-
New Today
Lead Data Engineer
-
City Of London, England, United Kingdom
OverviewJoin Kainos and Shape the Future. At Kainos, we're problem solvers, innovators, and collaborators - driven by a shared mission to create real impact. Whether we're transforming digital services for millions, delivering cutting-edge Workday so...
More Details -
-
New Today
Lead Data Engineer in London - Kainos
-
City Of London, England, United Kingdom
OverviewThis is a job posted by our partner JoobleBelow is a snippet of the job description. To read the full text, please click on the "Apply Now" link.Development and Operational ReadinessProficient software development experience in one of:JavaSca...
More Details -
-
New Today
Senior/Lead Data/ML Engineer
-
City Of London, England, United Kingdom
OverviewOur client at very well known Retail Giant is currently looking to hire a Senior/Lead Technical Engineer (Data/ML) based from their offices in London.Job Title: Senior/Lead Tech Engineer (Data/ML)Location: London / Hybrid - Once a Week (Thurs...
More Details -
-
New Today
Lead Data Engineer
-
City Of London, England, United Kingdom
Company descriptionPublicis Production harnesses the power of Publicis Groupe's entire global production capabilities. Through our family of production brands, we access best-in-class production talent, models and technology worldwide. Our purpose is...
More Details -
-
New Today
Lead Data Engineer
-
City Of London, England, United Kingdom
What you will deliverLead and Mentor: Lead, manage, and mentor a team of 3-6 data engineers, fostering a collaborative and high-performing environment.Technical Vision & Ownership: Own and define the technical vision, providing architectural guidance...
More Details -