Mid/Senior Data Engineer
New Today
Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanent basis.
This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.
What You'll Be Doing as a Data Engineer:
- Lead technical aspects of data engineering projects, providing direction and mentorship to junior and mid-level engineers
- Design and architect modern data solutions that align with business objectives and technical requirements
- Design and implement advanced ETL/ELT pipelines
- Build highly scalable and performant data solutions leveraging cloud platforms and open-source software
- Develop data models to handle enterprise-level analytical needs
- Make critical technical decisions on tools, frameworks, and approaches for complex data challenges
- Optimise large-scale data processing systems for performance and cost-efficiency
- Implement robust data quality frameworks and monitoring solutions
- Evaluate new technologies to enhance our data engineering capabilities
- Collaborate with stakeholders to translate business requirements into technical specifications
- Present technical solutions to leadership and non-technical stakeholders
- Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice
Your Impact:
- Enable business leaders to make informed decisions with confidence through timely, accurate data insights
- Drive adoption of modern data architectures and platforms
- Deliver seamless data solutions that enhance user experience
- Elevate the technical capabilities of the entire data engineering team
- Help cultivate a data-driven culture within the organisation
- Establish technical standards and patterns that ensure quality and maintainability
You Will Demonstrate:
- Proven experience leading technical aspects of data projects
- Strong data architecture and modelling skills with the ability to design scalable data solutions
- Experience mentoring junior engineers and providing technical guidance
- Deep understanding of data warehouse design principles and methodologies
- Advanced knowledge of optimisation techniques for large-scale data processing
- Strong proficiency in SQL and Python for handling complex data problems
- Hands-on experience with Apache Spark (PySpark or Spark SQL)
- Experience with the Azure data stack
- Knowledge of workflow orchestration tools like Azure Data Factory or Apache Airflow
- Experience with containerisation technologies like Docker
- Proficiency in dimensional modelling techniques
- Experience with CI/CD pipelines for data solutions
- Experience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks
- Strong communication skills for translating complex technical concepts
- Track record of successful project delivery in a technical leadership capacity
You may also have some of the desirable skills and experience:
- Experience designing and implementing data mesh or data fabric architectures
- Knowledge of cost optimisation strategies for cloud data platforms
- Experience with data quality frameworks and implementation
- Understanding of data lineage and metadata management
- Experience with technical project management
- Experience with data visualisation tools like Power BI or Apache Superset
- Experience with other cloud data platforms like AWS, GCP or Oracle
- Experience with modern unified data platforms like Databricks or Microsoft Fabric
- Experience with Kubernetes for container orchestration
- Understanding of streaming technologies (Apache Kafka, event-based architectures)
- Software engineering background with SOLID principles understanding
- Experience with high-performance, large-scale data systems
- Knowledge of recent innovations in AI/ML and GenAI
Security Clearance:
UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process.
Our Hiring Process
- Internal Application Review
- Initial Phone Screen
- Technical Interview
- Final Interview
- Offer
Working at MA
Methods Analytics (MA) exists to improve society by helping people make better decisions with data.
We use a collaborative, creative and user centric approach to data to do good and solve difficult problems.
By joining us you can expect
- Autonomy to develop and grow your skills and experience
- Be part of exciting project work that is making a difference in society
- Strong, inspiring, and thought-provoking leadership
- A supportive and collaborative environment
As well as this, we offer:
- Annual two-day technical hackathon bringing together all technical teams for innovation and collaboration
- Monthly Engineering & Architecture Community of Practice event
- Bi-annual whole company teambuilding events bringing everyone together for a day of fun and connection
- Development access to Pluralsight and LinkedIn Learning
- Volunteering - 2 paid days per year to volunteer in our local communities or within a charity organisation
- Private Medical Insurance which is non-contributory (spouse and dependants included)
- Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
- Discretionary Company Bonus based on company and individual performance
- Life Assurance of 4 times base salary
- Time off - 25 days of annual leave a year, plus bank holidays, with the option to buy 5 extra days each year
- Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
- Wellness 24/7 Confidential employee assistance programme
- Social - office parties, pizza Friday and commitment to charitable causes
- Location:
- United Kingdom
- Job Type:
- FullTime
- Category:
- IT & Technology