Overview

Senior Data Engineers wanted by a Remote Scale-Up Software Company, that is transforming risk management software through incredible data, technology, expertise and innovation.

Their data-driven approach fuses broad-spectrum open-source data, AI technology and world-leading analysis to deliver instant situational intelligence which in turn allows their clients to make dynamic, well-informed decisions about their risks as they emerge and change. You’d be joining a company who has achieved a lot in their six years, having a number of B2B / SaaS based products which calculate risk. The team is established and you’d join a Scale-Up, with all the excitement but with the financial stability too, which is often lacking.

You’ll play a critical role in building and evolving the cloud-native data platform, taking responsibility for designing and developing scalable, secure, and high-quality data pipelines that ingest, transform, and serve data to both internal teams and external clients. Remote working but you would need to be UK based, the team comes together every 4 months for some collaboration. This is normally in London and will normally involve a fun day / event.

Responsibilities

• Design and develop scalable, secure data pipelines that ingest, transform, and serve data to internal teams and external clients.
• Contribute to the evolution of a cloud-native data platform, ensuring reliability and performance.
• Collaborate with cross-functional teams to translate business requirements into robust data solutions.

Technical Qualifications

• Background in building robust, scalable data pipelines on Microsoft Azure.
• Proficient in using Python for automating data workflows and developing serverless solutions with Azure Functions.
• Expertise across key Azure tools including Data Factory, SQL Managed Instance, and Azure Data Lake Storage (ADLS).
• Knowledge of modern data architecture patterns, particularly layered/medallion models that support scalable analytics.
• Skilled in creating metadata-driven ETL pipelines designed for flexibility and reusability.
• Well-versed in data governance, quality, and observability tools such as Microsoft Purview, Monte Carlo, and Soda for ensuring trust in data.
• Knowledgeable in implementing data security best practices—RBAC, encryption, and multi-tenant data separation.
• Advanced SQL skills with experience working across both structured (relational) and semi-structured data formats.

Salary and Benefits

The successful Senior Data Engineer will earn up to £80,000 and in addition there are exceptional benefits which come as part of the overall package including: Bonus, Pension contribution, training fund and numerous soft leisurely benefits.

Employment details

• Seniority level: Mid-Senior level
• Employment type: Full-time
• Job function: Engineering and Information Technology
• Industries: IT System Custom Software Development, Software Development, and Technology, Information and Media

Notice: Spencer Scott Ltd is an equal opportunity Recruitment Agency, which means we do not discriminate on the basis of race, colour, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression. We celebrate diversity and are committed to creating inclusive working environments for all our clients.

Get notified about new Data Engineer jobs in London Area, United Kingdom.

Expiry status: Job posting content previously listed. This description does not indicate that the role is closed.