Azure Databricks Data Engineer

New Yesterday

This job is with Capgemini, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.

Get The Future You Want!
Choosing Capgemini means choosing a company where you will be empowered to shape yourcareer in the way you’d like, where you’ll be supported and inspired by a collaborativecommunity of colleagues around the world, and where you’ll be able to reimagine what’spossible. Join us and help the world’s leading organizations unlock the value of technology andbuild a more sustainable, more inclusive world.

Your Role:

  • Design and implement robust ETL/ELT pipelines on Databricks.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions.
  • Optimize data workflows for performance, scalability.
  • Develop and maintain data lake and data warehouse architectures.
  • Ensure data quality, governance, and security standards are met.
  • Lead code reviews, mentor junior engineers, and contribute to best practices in data engineering.
  • Integrate Databricks with other enterprise systems and tools (e.g., Delta Lake, MLflow, Power BI, etc.).
  • Monitor and troubleshoot production data pipelines and jobs.

Your Profile:

  • Lead the design, development, and optimization of scalable data pipelines using Databricks.
  • Drive data modernization initiatives to support advanced analytics and machine learning.
  • Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
  • Implement best practices for data engineering, including performance tuning and cost optimization.
  • Ensure data quality, reliability, and consistency across all data platforms.
  • Leverage Databricks features such as Delta Lake, notebooks, and MLflow for end-to-end workflows.
  • Apply knowledge of data governance frameworks and tools, including Unity Catalog.
  • Maintain and enhance data security, access controls, and compliance standards.
  • Mentor junior engineers and contribute to the development of engineering standards.
  • Hold relevant Databricks certifications (e.g., Databricks Certified Data Engineer Professional).

About Capgemini
Capgemini is a global business and technology transformation partner, helping organizations toaccelerate their dual transition to a digital and sustainable world while creating tangible impact forenterprises and society. It is a responsible and diverse group of 350,000 team members in morethan 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlockthe value of technology to address the entire breadth of their business needs. It delivers end-to-endservices and solutions leveraging strengths from strategy and design to engineering, all fueled byits market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise andpartner ecosystem. The Group reported 2023 global revenues of €22.5 billion.
Get The Future You Want 
www.capgemini.com

]]>
Apply
Location:
London
Job Type:
FullTime
Category:
Information Technology And Services

We found some similar jobs based on your search