Data Engineer

About the team

Our team is dedicated to unlocking the rich knowledge embedded within Elsevier’s content through our semantic data platform; this empowers researchers, clinicians, and innovators worldwide to gain new insights, make informed decisions, and accelerate progress across research, healthcare, and life sciences. We lead the ongoing transformation of Elsevier’s vast, unstructured information into richly interconnected knowledge graphs that capture the full depth and nuance of scientific meaning.

Through our dynamic knowledge discovery platform, we combine graph-powered agentic AI with advanced search & retrieval technologies to deliver contextually relevant, trustworthy, and precise answers to users.

As part of this mission, the AI Engineering team is focused on building reusable generative AI capabilities that can be embedded across products and platforms. We create scalable, secure, and production-ready AI services — enabling downstream teams to integrate cutting-edge GenAI features with confidence.

About the role

We are looking for a Senior Software Engineer II who can lead the design and implementation of complex systems, mentor team members, and contribute to our evolving data engineering architecture. You’ll work on large-scale data pipelines, orchestration frameworks, and services that support our data products — collaborating closely with products, platforms, and other engineering teams to deliver impactful, high-quality solutions.

Key responsibilities

• Designing and developing scalable data workflows and microservices using tools like Spark, Spark Streaming, and Airflow.

• Writing clean, modular, and testable code in Python or Scala.

• Leading the development of system components that span multiple services.

• Troubleshooting and resolving issues in distributed data systems.

• Participating in architecture and design discussions to improve system performance and reliability.

• Building and maintaining data models to support various business needs.

• Collaborating with cross-functional teams to turn requirements into engineering solutions.

• Supporting onboarding and mentoring of team members.

• Promoting continuous improvement and sharing knowledge across the team.

Requirements

• Good years of professional experience in software or data engineering.

• Proven track record in building and optimising large-scale batch and streaming data systems.

• Proficiency with Spark, Spark Streaming, Airflow, and either Python or Scala.

• Deep understanding of distributed system design, data modelling, and performance optimisation.

• Strong experience with test-driven development and CI/CD practices.

• Ability to independently drive technical outcomes from problem to deployment.

• Familiarity with Agile or other iterative development methodologies.

Nice to Have

• Exposure to graph-based data models or knowledge graph architecture.

• Experience building internal platforms or reusable engineering components.

• Knowledge of observability best practices for data systems (e.g., logging, metrics, alerts).

Why join us?

Are you ready to help us progress science and health? Our technology leads to innovation, so join a forward-thinking digital business that is tackling world-scale challenges and align your ambitions with our passion for driving global knowledge-sharing.

Work in a way that works for you

We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

• Flexible hours - flex the times when you work in the day to help you fit everything in and work when you are the most productive.

Working for you

We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• Generous holiday allowance with the option to buy additional days.

• Health screening, eye care vouchers and private medical benefits.

• Wellbeing programs.

• Life assurance.

• Access to a competitive contributory pension scheme.

• Long service awards.

• Save As You Earn share option scheme.

• Travel Season ticket loan.

• Maternity, paternity, and shared parental leave.

• Access to emergency care for both the elderly and children.

• RECARES days, giving you time to support the charities and causes that matter to you.

• Access to employee resource groups with dedicated time to volunteer.

• Access to extensive learning and development resources.

• Access to employee discounts via Perks at Work.

About Elsevier

A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers: EEO Know Your Rights.