Principal Data Engineer
New Today
Social network you want to login/join with:
Description
About the role
Are you a Principal Data Engineer with a passion for big data? Do you keep up to date with cutting-edge technologies within D&A?
If so, then you have a fantastic opportunity to join a multi-disciplinary team of engineers, architects, designers, and strategists as we continue to grow our Data & Analytics practice across Europe.
We're looking for a Principal Data Engineer with Azure, Databricks, and PySpark to join our team in London. The ideal candidate will have a strong background in data engineering, extensive experience with Azure cloud services, and experience leading a technical team on implementations.
Responsibilities
- Lead, mentor, and manage a team of Azure data engineers
- Drive the team's technical execution
- Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to ensure a quality single version of the truth
- Build end-to-end pipelines to support enterprise-wide analytics
- Design, develop, and implement scalable and secure data lake solutions on Azure
- Ensure best practices in data engineering, data integration, and ETL processes
- Code complex aspects of our pipeline as needed
- Maintain the maturity of our SVOT framework
- Monitor performance and scalability of the SVOT platform, updating the framework and code to ensure high availability and accessibility
Requirements
- Minimum of 8 years of experience in data engineering
- At least 5 years of hands-on experience with Azure data services (Apache Spark, Azure Data Factory, Synapse Analytics, RDBMS such as SQL Server)
- Proven leadership and management experience in data engineering teams
- Proficiency in PySpark, Python (with Pandas), T-SQL, SparkSQL, and experience with CI/CD pipelines
- Strong understanding of data modeling, ETL processes, and data warehousing concepts
- Knowledge of version control systems like Git
- Excellent problem-solving, analytical, communication, and collaboration skills
- Ability to manage multiple projects and meet deadlines
- Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect
Nice to Have
- Experience with Scala for Apache Spark
- Knowledge of other cloud platforms like AWS or GCP
Our Benefits Include
- Group pension plan, life assurance, income protection, and critical illness cover
- Private medical insurance and dental care
- Cyclescheme, Techscheme, season ticket loans
- Employee assistance program
- Learning and development opportunities, certifications, well-being programs, and more
- EPAM Employee Stock Purchase Plan (ESPP)
- Perks such as gym discounts, free lunches, massages, and social events
About EPAM
- EPAM is a global leader in digital platform engineering and development services. We foster a dynamic, inclusive culture, collaborating with diverse teams on innovative projects. Join us to grow your potential and be part of a community that values your contributions.
- Location:
- London
- Job Type:
- FullTime
- Category:
- IT & Technology
We found some similar jobs based on your search
-
New Today
Principal Data Engineer
-
London
- IT & Technology
Social network you want to login/join with: Description About the role Are you a Principal Data Engineer with a passion for big data? Do you keep up to date with cutting-edge technologies within D&A? If so, then you have a fantastic opportunity to ...
More Details -
-
1 Days Old
Principal Data Engineer
-
London
- IT & Technology
Overview We are looking for a skilled data engineer to help build and maintain our data infrastructure. The ideal candidate will have expertise working with cloud data platforms and architecting robust and scalable data pipelines. This role is for c...
More Details -
-
2 Days Old
Principal Data Engineer
-
London, England, United Kingdom
-
£150,000 - £200,000
- IT & Technology
Overview We are looking for a skilled data engineer to help build and maintain our data infrastructure. The ideal candidate will have expertise working with cloud data platforms and architecting robust and scalable data pipelines. This role is for c...
More Details -
-
4 Days Old
Senior / Principal Electrical Engineer (Data Centre)
-
London
- Engineering
Overview Stantec have an exciting opportunity for a Senior / Principal Electrical Engineer (Data Centre) to join our busy multidisciplinary Building Services team in London. Mission Critical / Data Centre sector experience is essential. Stantec Buil...
More Details -
-
4 Days Old
Principal Data Engineer
-
City Of London
- IT & Technology
Overview Principal Data Engineer FinTech London (Remote First) £120-140k Do you want to work for one of the fastest growing FinTech's in the B2B Banking space? Do you want to own the Snowflake rollout for a business that runs on Data-Driven Decis...
More Details -
-
4 Days Old
Principal Data Engineer
-
Islington
- IT & Technology
Overview We're looking for a Principal Data Engineer to play a leading role in shaping and implementing our enterprise data architecture. This position is ideal for someone who combines deep technical expertise with strong stakeholder engagement ski...
More Details -