Overview

As Data Engineer, you will design, develop, and implement high-performance data pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT, and Streaming and Event Based Architectures. You will collaborate with data scientists, analysts and other engineers to translate data requirements into technical solutions.

Responsibilities

• Design, develop, and implement high-performance data pipelines with Azure Data Factory, Databricks, and other Azure data services.
• Architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT, streaming and event-based architectures.
• Collaborate with data scientists, analysts and engineers to translate data requirements into technical solutions.

About You / Qualifications

• Extensive experience with Azure data platform services: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics.
• Strong SQL and Python programming skills (Scala is a strong advantage).
• Solid understanding of data governance, quality, and security principles.
• Excellent communication skills; some exposure to Infrastructure as Code and CI/CD deployments.
• Desirable: experience with real-time data streaming technologies, CI/CD pipelines for data solutions, or containerisation.

Location

Remote

Compensation

£500 per day outside of IR35

How to apply

If you are a Data Engineer and would like to apply, click Apply and send your resume. If you have questions about this job, please contact initi8 HQ.