Senior Data Engineer
New Today
Company description
Publicis Production harnesses the power of Publicis Groupe's entire global production capabilities. Through our family of production brands, we access best-in-class production talent, models and technology worldwide. Our purpose is to deliver seamless, relevant and impactful consumer experiences across every touchpoint in every market. We do this with pioneering production solutions that drive performance in a data-led marketing landscape and help brands to win in the platform world.
Overview
We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also.
As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimizing data workflows, and ensuring data availability and quality for production technology.
The ideal candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key to success in this role.
Responsibilities
- Architect and maintain robust data pipelines (batch and streaming) integrating internal and external data sources (APIs, structured streaming, message queues etc.)
- Collaborate with data analysts, scientists, and software engineers to understand data needs and develop solutions
- Understand requirements from operations and product to ensure data and reporting needs are met
- Implement data quality checks, data governance practices, and monitoring systems to ensure reliable and trustworthy data
- Optimize performance of ETL/ELT workflows and improve infrastructure scalability
Qualifications
Experience
- Relevant experience in data engineering and solution delivery, with a strong track record of technical leadership
- Deep understanding of data modeling, data warehousing concepts, and distributed systems
- Excellent problem-solving skills and ability to progress with design, build and validate output data independently
- Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools
- Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure
- Strong background in database technologies (SQL Server, Redshift, PostgreSQL, Oracle)
Desirable Skills
- Familiarity with machine learning pipelines and MLOps practices
- Additional experience with Databricks and specific AWS such as Glue, S3, Lambda
- Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps)
- Hands-on experience with web scraping, REST API integrations, and streaming data pipelines
- Knowledge of JavaScript and front-end frameworks (e.g., React)
Additional information
Diversity and inclusion is a core part of who we are at Prodigious London. We're committed to building an inclusive culture that encourages, celebrates and supports our wonderfully diverse employee group - whatever their age, gender identity, race, sexual orientation, physical or mental ability or ethnicity. Diversity and inclusion doesn\'t just fuel our creativity and innovation, it brings us closer to our people and audiences. We will continue to strive to create a culture and environment where everyone feels empowered and more importantly comfortable enough to bring their full, authentic selves to work. We are committed to providing reasonable adjustments for employees with disabilities and for candidates in our application process. If you need assistance or adjustment due to a disability, please contact us.
- Location:
- City Of London
- Job Type:
- FullTime
- Category:
- IT & Technology
We found some similar jobs based on your search
-
New Today
Senior / Principal Mechanical Engineer (Data Centre)
-
City Of London, England, United Kingdom
Stantec Buildings is on a mission to become the world’s leading integrated design practice. Our architects, engineers, interior designers, sustainability specialists, and technologists are passionate about the power of design. We take an innovative, ...
More Details -
-
New Today
Senior Data Engineer I
-
London, England, United Kingdom
locations London UK - Cambridge (BioData Innovation Centre) Amsterdam Oxford Aalborgtime type Full timeposted on Posted Yesterdayjob requisition id R98188About the Team:The Academic Information Systems ( AI S) DataOps team is a shared technology grou...
More Details -
-
New Today
Senior Data Engineer
-
London, England, United Kingdom
We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we ...
More Details -
-
New Today
Senior Data Engineer - Central Services
-
City Of London, England, United Kingdom
Job DescriptionPractice Group / Department: Application Centre - CanadaThe RoleThe Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis....
More Details -
-
New Today
Senior Data Engineer
-
City Of London, England, United Kingdom
Company description Publicis Production harnesses the power of Publicis Groupe's entire global production capabilities. Through our family of production brands, we access best-in-class production talent, models and technology worldwide. Our purpose i...
More Details -
-
New Today
Senior Data Engineer
-
England, United Kingdom
OverviewThis range is provided by Identify Solutions. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Senior Data Engineer (Python, FastAPI, GCP) | Permanent | London (1 day a week on-site)Series C...
More Details -