Lead Data Engineer

New Yesterday

Overview Lead Data Engineer — Leeds / Hybrid • 3 months with strong likelihood of extension • Outside IR35, competitive daily rate Responsibilities
Lead a POC project to determine the most effective approach for enabling data analysis from an Azure Data Lake. Explore and implement solutions using Databricks, Synapse, and other big data technologies. Design processes to filter, extract, and export Parquet files for business user investigation. Collaborate with architects, project managers, and business stakeholders as the data subject matter expert. Provide accurate technical input into project updates and status reporting.
Qualifications & Experience
Proven experience as a Lead Data Engineer on enterprise-scale cloud data projects. Strong hands-on knowledge of Azure Data Lake environments. Expertise in Databricks and/or Synapse, with additional exposure to Apache Spark and Hadoop. Solid experience with Parquet file formats and data engineering best practices. Proficiency in SQL, Python, and PySpark. Excellent analytical skills with the ability to design pragmatic solutions in evolving environments. Strong communication and stakeholder engagement skills, with the confidence to act as the data SME.
We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age. Job Details
Seniority level: Mid-Senior level Employment type: Contract Job function: Information Technology Industries: Technology, Information and Internet
#J-18808-Ljbffr
Apply
Location:
Leeds, England, United Kingdom
Job Type:
FullTime

We found some similar jobs based on your search