Mid/Senior Data Engineer

New Today

Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanent basis.

This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.

What You'll Be Doing as a Data Engineer:

  • Lead technical aspects of data engineering projects, providing direction and mentorship to junior and mid-level engineers
  • Design and architect modern data solutions that align with business objectives and technical requirements
  • Design and implement advanced ETL/ELT pipelines
  • Build highly scalable and performant data solutions leveraging cloud platforms and open-source software
  • Develop data models to handle enterprise-level analytical needs
  • Make critical technical decisions on tools, frameworks, and approaches for complex data challenges
  • Optimise large-scale data processing systems for performance and cost-efficiency
  • Implement robust data quality frameworks and monitoring solutions
  • Evaluate new technologies to enhance our data engineering capabilities
  • Collaborate with stakeholders to translate business requirements into technical specifications
  • Present technical solutions to leadership and non-technical stakeholders
  • Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice

Your Impact:

  • Enable business leaders to make informed decisions with confidence through timely, accurate data insights
  • Drive adoption of modern data architectures and platforms
  • Deliver seamless data solutions that enhance user experience
  • Elevate the technical capabilities of the entire data engineering team
  • Help cultivate a data-driven culture within the organisation
  • Establish technical standards and patterns that ensure quality and maintainability

You Will Demonstrate:

  • Proven experience leading technical aspects of data projects
  • Strong data architecture and modelling skills with the ability to design scalable data solutions
  • Experience mentoring junior engineers and providing technical guidance
  • Deep understanding of data warehouse design principles and methodologies
  • Advanced knowledge of optimisation techniques for large-scale data processing
  • Strong proficiency in SQL and Python for handling complex data problems
  • Hands-on experience with Apache Spark (PySpark or Spark SQL)
  • Experience with the Azure data stack
  • Knowledge of workflow orchestration tools like Azure Data Factory or Apache Airflow
  • Experience with containerisation technologies like Docker
  • Proficiency in dimensional modelling techniques
  • Experience with CI/CD pipelines for data solutions
  • Experience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks
  • Strong communication skills for translating complex technical concepts
  • Track record of successful project delivery in a technical leadership capacity

You may also have some of the desirable skills and experience:

  • Experience designing and implementing data mesh or data fabric architectures
  • Knowledge of cost optimisation strategies for cloud data platforms
  • Experience with data quality frameworks and implementation
  • Understanding of data lineage and metadata management
  • Experience with technical project management
  • Experience with data visualisation tools like Power BI or Apache Superset
  • Experience with other cloud data platforms like AWS, GCP or Oracle
  • Experience with modern unified data platforms like Databricks or Microsoft Fabric
  • Experience with Kubernetes for container orchestration
  • Understanding of streaming technologies (Apache Kafka, event-based architectures)
  • Software engineering background with SOLID principles understanding
  • Experience with high-performance, large-scale data systems
  • Knowledge of recent innovations in AI/ML and GenAI

Security Clearance:

UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process.

Our Hiring Process

  • Internal Application Review
  • Initial Phone Screen
  • Technical Interview
  • Final Interview
  • Offer

Working at MA

Methods Analytics (MA) exists to improve society by helping people make better decisions with data.

We use a collaborative, creative and user centric approach to data to do good and solve difficult problems.

By joining us you can expect

  • Autonomy to develop and grow your skills and experience
  • Be part of exciting project work that is making a difference in society
  • Strong, inspiring, and thought-provoking leadership
  • A supportive and collaborative environment

As well as this, we offer:

  • Annual two-day technical hackathon bringing together all technical teams for innovation and collaboration
  • Monthly Engineering & Architecture Community of Practice event
  • Bi-annual whole company teambuilding events bringing everyone together for a day of fun and connection
  • Development access to Pluralsight and LinkedIn Learning
  • Volunteering - 2 paid days per year to volunteer in our local communities or within a charity organisation
  • Private Medical Insurance which is non-contributory (spouse and dependants included)
  • Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
  • Discretionary Company Bonus based on company and individual performance
  • Life Assurance of 4 times base salary
  • Time off - 25 days of annual leave a year, plus bank holidays, with the option to buy 5 extra days each year
  • Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
  • Wellness 24/7 Confidential employee assistance programme
  • Social - office parties, pizza Friday and commitment to charitable causes
#J-18808-Ljbffr
Location:
United Kingdom
Job Type:
FullTime
Category:
IT & Technology