SENIOR DATA ENGINEER

PERMANENT

CITY OF LONDON

£90,000 - £100,000

HYBRID work available - City of London office/Home

As a key member of this team, you will play a pivotal role in designing and implementing data warehousing solutions using Snowflake and AWS.

You will help drive the evolution of data architecture as we move from Redshift to Snowflake.

Hands-on experience with AWS services such as Glue (Spark), Lambda, Step Functions, ECS, Redshift, and SageMaker.

Conducting code reviews, mentoring through pair programming.

Building APIs, integrating with microservices, or contributing to backend systems — not just data pipelines or data modelling.

Tools like GitHub Actions, Jenkins, AWS CDK, CloudFormation, Terraform.

Key Responsibilities:

• Design and implement scalable, secure, and cost-efficient data solutions on AWS, leveraging services such as Glue, Lambda, S3, Redshift, and Step Functions.
• Lead the development of robust data pipelines and analytics platforms, ensuring high availability, performance, and maintainability.
• Demonstrate proficiency in software engineering principles, contributing to the development of reusable libraries, APIs, and infrastructure-as-code components that support the broader data and analytics ecosystem.
• Contribute to the evolution of the team’s data engineering standards and best practices, including documentation, testing, and architectural decisions.
• Develop and maintain data models and data marts that support self-service analytics and enterprise reporting.
• Drive automation and CI/CD practices for data workflows, ensuring reliable deployment and monitoring of data infrastructure.
• Ensure data quality, security, and compliance with internal policies and external regulations.
• Continuously optimize data processing workflows for performance and cost, using observability tools and performance metrics.
• Collaborate cross-functionally with DevOps, analytical engineers, data analysts, and business stakeholders to align data solutions with product and business goals.
• Mentor and support team members through code reviews, pair programming, and knowledge sharing, fostering a culture of continuous learning and engineering excellence.

Skills and Experience:

• Bachelor’s degree or higher in a technical discipline
• Extensive experience in AWS services
• Solid foundation in software engineering principles
• Advanced SQL skills
• Python strongly preferred