We’re looking for an experienced contract Data Engineer to join our innovative, fast-growing data team as a Data Engineer and help build the next generation of cloud data architecture on Microsoft Azure. You'll be at the forefront of designing scalable, secure, and modern data platforms using cutting-edge Azure services and the Databricks unified analytics platform. This is a hands-on engineering role perfect for passionate data professionals who thrive on creating high-performance data infrastructure and solving complex big data challenges in cloud-native environments.  Role will be remote based but may need occasional site visits and work must be conducted from the UK.

What You'll Be Doing Data Architecture & Engineering

Design and implement enterprise-scale, robust data solutions using Azure and Databricks Architect scalable ELT/ETL pipelines using Azure Data Factory, Azure Synapse Analytics, and Databricks Build automated data ingestion processes from various sources including streaming and batch data Develop and maintain data transformation workflows using PySpark, Scala, and SQL on Databricks Data Platform & Optimization

Design and optimize Databricks clusters for performance, cost management, and resource utilization Implement medallion architecture (Bronze, Silver, Gold) for data processing and transformation Optimize Spark jobs and queries for maximum performance and cost efficiency Monitor and...