Lead Data Engineer (Databricks) - Leeds

1 Days Old

Overview

Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship.

Responsibilities

  • Lead client delivery and work with architects to create automated tests, instill a culture of continuous improvement, and set standards for the team.
  • Build a greenfield modern data platform using cutting-edge technologies; architect big data solutions and develop complex enterprise data ETL and ML pipelines and projections.
  • Utilise strong Python, PySpark and SQL skills; demonstrate clear understanding of Databricks; contribute to Data Science initiatives (R, Machine Learning, AI).
  • Maintain database experience with SQL and No-SQL technologies (e.g., Aurora, MS SQL Server, MySQL) and apply Agile and Scrum practices along with SOLID principles.
  • Apply Continuous Integration, Infrastructure as Code, and cloud platform knowledge (ideally AWS) in delivery.

Qualifications

  • Strong experience with Python, PySpark, SQL and Databricks; passion for Data Science, Machine Learning and AI.
  • Database experience with SQL and No-SQL technologies (Aurora, MS SQL Server, MySQL).
  • Significant experience with Agile and Scrum, SOLID principles, and CI/CD tooling; infrastructure as code; cloud platforms (ideally AWS).
  • Proven ability to lead data engineering teams and delivery of data platforms and pipelines.

Seniority and Employment

  • Seniority level: Mid-Senior level
  • Employment type: Full-time
  • Job function: Engineering and Information Technology
  • Industries: IT Services and IT Consulting, Software Development, and Data Infrastructure and Analytics

To apply for this position please send your CV to Nathan Warner at Noir Consulting. NOIRUKTECHREC NOIRUKREC

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
Apply
Location:
Leeds
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search