Overview

We are seeking a skilled Azure Data Engineer to join my clients team in Manchester or London within the Housing Association sector. This role offers an exciting opportunity to deliver cutting-edge data solutions using the Microsoft Azure technology stack, supporting data-driven decision-making processes across the organisation. The successful candidate will be responsible for designing and implementing cloud-based data solutions while ensuring data accuracy, security, and accessibility.

Location: Manchester or London

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures using Microsoft Azure technologies.
• Work closely with stakeholders to translate business requirements into technical specifications and data solutions.
• Utilise Azure components such as Data Factory, Data Lake, Data Bricks, Synapse, Logic Apps, and Functions to build robust ETL processes.
• Ensure best practices in data modelling using Kimball methodology within enterprise data warehouse environments.
• Support data quality initiatives, master data management, profiling, cleansing, and reporting using tools like Microsoft Purview and Master Data Services.
• Develop and maintain analytics and business intelligence solutions with Power BI and related tools.
• Implement security and governance measures to maintain high standards for data integrity and compliance.
• Collaborate with cross-functional teams within an Agile framework, including product owners, architects, and analysts.

Essential Skills and Experience:

• Proven experience with relational databases (e.g. SQL Server), Big Data, and warehousing concepts.
• Strong experience with Azure Data Lake, Data Factory, Synapse, Data Bricks, Logic Apps and Functions.
• Thorough understanding of ETL and BI platforms, data modelling using Kimball methodology, and data warehouse strategy.
• Experience with master data management, data quality frameworks, Microsoft Purview, and related tooling.
• Proficiency in Python, Scala, or PySpark for data engineering tasks.
• Solid understanding of Microsoft technology stack including SharePoint, PowerPivot, and Power BI.
• Experience in data integration, external data loading mechanisms, and information repository development.
• Exposure to PowerShell scripting.
• Familiarity with DevOps, CI/CD, IaaS, PaaS, SaaS, and containerisation tools.
• Experience in developing pilots, proofs of concept, or technical prototypes.
• Knowledge of Semarchy for master data management.
• Experience with NEC Housing Management System and PL/SQL.
• Familiarity with Total Mobile, Total Repairs, and Total Connect Repairs solutions.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• Non-profit Organizations

This is an excellent opportunity for a motivated and experienced Azure Data Engineer to make a meaningful impact on the delivery and evolution of data capabilities in the housing sector. If you are passionate about data and technology, and enjoy working in a collaborative and forward-thinking environment, we would love to hear from you.