Mid/Senior Data Engineer

New Today

Overview

Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanent basis. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.

What You'll Be Doing as a Data Engineer

  • Lead technical aspects of data engineering projects, providing direction and mentorship to junior and mid-level engineers
  • Design and architect modern data solutions that align with business objectives and technical requirements
  • Design and implement advanced ETL/ELT pipelines
  • Build highly scalable and performant data solutions leveraging cloud platforms and open-source software
  • Develop data models to handle enterprise-level analytical needs
  • Make critical technical decisions on tools, frameworks, and approaches for complex data challenges
  • Optimise large-scale data processing systems for performance and cost-efficiency
  • Implement robust data quality frameworks and monitoring solutions
  • Evaluate new technologies to enhance our data engineering capabilities
  • Collaborate with stakeholders to translate business requirements into technical specifications
  • Present technical solutions to leadership and non-technical stakeholders
  • Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice

Your Impact

  • Enable business leaders to make informed decisions with timely, accurate data insights
  • Drive adoption of modern data architectures and platforms
  • Deliver seamless data solutions that enhance user experience
  • Elevate the technical capabilities of the entire data engineering team
  • Help cultivate a data-driven culture within the organisation
  • Establish technical standards and patterns that ensure quality and maintainability

Requirements

You Will Demonstrate

  • Proven experience leading technical aspects of data projects
  • Strong data architecture and modelling skills with the ability to design scalable data solutions
  • Experience mentoring junior engineers and providing technical guidance
  • Deep understanding of data warehouse design principles and methodologies
  • Advanced knowledge of optimisation techniques for large-scale data processing
  • Strong proficiency in SQL and Python for handling complex data problems
  • Hands-on experience with Apache Spark (PySpark or Spark SQL)
  • Experience with the Azure data stack
  • Knowledge of workflow orchestration tools like Azure Data Factory or Apache Airflow
  • Experience with containerisation technologies like Docker
  • Proficiency in dimensional modelling techniques
  • Experience with CI/CD pipelines for data solutions
  • Experience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks
  • Strong communication skills for translating complex technical concepts
  • Track record of successful project delivery in a technical leadership capacity

Desirable Skills

  • Experience designing and implementing data mesh or data fabric architectures
  • Knowledge of cost optimisation strategies for cloud data platforms
  • Experience with data quality frameworks and implementation
  • Understanding of data lineage and metadata management
  • Experience with technical project management
  • Experience with data visualization tools like Power BI or Apache Superset
  • Experience with other cloud data platforms like AWS, GCP or Oracle
  • Experience with modern unified data platforms like Databricks or Microsoft Fabric
  • Experience with Kubernetes for container orchestration
  • Understanding of streaming technologies (Apache Kafka, event-based architectures)
  • Software engineering background with SOLID principles understanding
  • Experience with high-performance, large-scale data systems
  • Knowledge of recent innovations in AI/ML and GenAI
  • Defence/Public Sector consultant experience

Security Clearance

UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process. Some roles/projects may require Developed Vetting (DV) clearance; while not mandatory, a willingness to obtain DV clearance would be beneficial. As part of the onboarding process candidates will be asked to complete a Baseline Personnel Security Standard (BPSS); details of the evidence required to apply may be found on GOV.UK – Government baseline personnel security standard. If you are unable to meet this and any associated criteria, then your employment may be delayed, or rejected. Details of this will be discussed with you at interview.

Hiring Process

  • Internal Application Review
  • Initial Phone Screen
  • Technical Interview
  • Pair Programming Exercise
  • Final Interview
  • Offer

Benefits

Working at MA

Methods Analytics (MA) exists to improve society by helping people make better decisions with data. We use a collaborative, creative and user-centric approach to data and value discussion, ethics, privacy and quality. We offer a supportive and collaborative environment with opportunities for growth and development.

  • Autonomy to develop and grow your skills and experience
  • Be part of exciting project work that is making a difference in society
  • Strong, inspiring, and thought-provoking leadership
  • A supportive and collaborative environment
  • Annual two-day technical hackathon
  • Monthly Engineering & Architecture Community of Practice
  • Bi-annual whole company teambuilding events
  • Development access to Pluralsight and LinkedIn Learning
  • Volunteering - 2 paid days per year
  • Private Medical Insurance for you and dependents
  • Worldwide Travel Insurance for you and dependents
  • Discretionary Company Bonus
  • Life Assurance of 4x base salary
  • 25 days annual leave + bank holidays, with option to buy 5 extra days
  • Pension Salary Exchange Scheme
  • Wellness 24/7 confidential employee assistance
  • Social events and charitable involvement

Seniority level

  • Mid-Senior level

Employment type

  • Full-time

Job function

  • Information Technology

Industries

  • IT Services and IT Consulting

Referrals increase your chances of interviewing at Methods by 2x

#J-18808-Ljbffr
Location:
Sheffield
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search