Senior Data Engineer
New Yesterday
Overview
TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.
Responsibilities
- API Development: Design, develop, and maintain robust and scalable backend systems and APIs.
- Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Google Cloud environments.
- Data Transformation: Implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency.
- Data Modeling: Develop and maintain data models and schemas to support efficient data storage and retrieval in Google Cloud platforms.
- Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Cloud Composer or other relevant tools.
- Data Lakes: Build data lakes using Google Cloud services such as Big Query.
- Performance Optimization: Optimize data pipelines and queries for improved performance and scalability in Google Cloud environments.
- Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation.
- Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing.
Qualifications
- Experience in data engineering, with a strong focus on Google Cloud Platform (GCP)-based solutions.
- Proficiency in the GCP platform, particularly in Data & AI services (e.g., BigQuery, DataProc, Cloud SQL, DataFlow, Pub/Sub, Cloud Data Fusion, Cloud Composer, Python, SQL).
- Designing, developing, and deploying scalable, reliable, and secure cloud-based solutions using GCP services.
- Translating business requirements into technical specifications.
- Proficiently utilizing core GCP services, such as Compute Engine, Kubernetes Engine (GKE), Cloud Storage, Cloud Functions, Cloud SQL, and BigQuery.
- Implementing and managing GCP networking configurations.
- Using IaC tools like Terraform to automate infrastructure provisioning and management.
- Implementing and managing Continuous Integration/Continuous Delivery (CI/CD) pipelines.
- Automating deployment processes. Implementing security best practices to protect cloud infrastructure and data.
- Identifying and resolving performance bottlenecks.
- Desirable knowledge & experience: Experience with data analytics and Big Data technologies.
- Knowledge of cloud security best practices and compliance standards.
- Experience with agile development methodologies.
- GCP certifications (e.g., Google Cloud Certified Professional Cloud Developer).
Accessibility & Diversity
Tata Consultancy Services UK&I is committed to meeting the accessibility needs of all individuals in accordance with the UK Equality Act 2010 and the UK Human Rights Act 1998. We believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity and inclusion motto is "Inclusion without Exception". Our continued commitment to culture and diversity is reflected across our workforce implemented through equitable workplace policies and processes. You"ll find a welcoming culture and many internal volunteering and social networks to join (these are optional). Our diversity, inclusion and social activities include 12 employee networks such as gender diversity, LGBTQIA+ & Allies, mental health, disability & neurodiversity inclusion and many more, as well as health & wellness initiatives and sports events and we sponsor the London Marathon. Tata Consultancy Services UK&I is consistently voted as a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.
- Location:
- Camden Town
- Job Type:
- FullTime
- Category:
- IT & Technology
We found some similar jobs based on your search
-
New Yesterday
Senior Data Engineer
-
Farringdon
- IT & Technology
Overview Venatus is an award-winning, global ad-tech platform that connects advertisers to the exclusive audiences of 500+ world-renowned gaming and entertainment publishers. We are tech-first. We are gamers. We are the difference makers. Because wh...
More Details -
-
New Yesterday
Senior Data Engineer
-
United Kingdom
- IT & Technology
Overview Are you a skilled Data Engineer looking to step into the world of architecture? An exciting opportunity has opened for an experienced Data Engineer to join our national Data & Analytics function at a time of significant technical modernisat...
More Details -
-
New Yesterday
Senior Data Engineer
-
City Of London
- IT & Technology
Overview We\'re looking for senior engineers who are particularly passionate about the back-end and data engineering to join our data platform team. We\'re looking for someone who can work - or is comfortable in learning to work - just about anywher...
More Details -
-
New Yesterday
Mid/Senior Data Engineer
-
City Of London
- IT & Technology
Base pay range This range is provided by Methods. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Overview Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanen...
More Details -
-
New Yesterday
Senior Data Engineer
-
City Of London
- IT & Technology
Overview Join us at Entrust At Entrust, we're shaping the future of identity centric security solutions. From our comprehensive portfolio of solutions to our flexible, global workplace, we empower careers, foster collaboration, and build solutions t...
More Details -
-
New Yesterday
Mid/Senior Data Engineer
-
City Of London
- IT & Technology
Overview Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanent basis. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol. What...
More Details -