Overview

Lead Data Engineer — Leeds / Hybrid • 3 months with strong likelihood of extension • Outside IR35, competitive daily rate

Responsibilities

• Lead a POC project to determine the most effective approach for enabling data analysis from an Azure Data Lake.
• Explore and implement solutions using Databricks, Synapse, and other big data technologies.
• Design processes to filter, extract, and export Parquet files for business user investigation.
• Collaborate with architects, project managers, and business stakeholders as the data subject matter expert.
• Provide accurate technical input into project updates and status reporting.

Qualifications & Experience

• Proven experience as a Lead Data Engineer on enterprise-scale cloud data projects.
• Strong hands-on knowledge of Azure Data Lake environments.
• Expertise in Databricks and/or Synapse, with additional exposure to Apache Spark and Hadoop.
• Solid experience with Parquet file formats and data engineering best practices.
• Proficiency in SQL, Python, and PySpark.
• Excellent analytical skills with the ability to design pragmatic solutions in evolving environments.
• Strong communication and stakeholder engagement skills, with the confidence to act as the data SME.

We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age.

Job Details

• Seniority level: Mid-Senior level
• Employment type: Contract
• Job function: Information Technology
• Industries: Technology, Information and Internet