Senior Data Engineer

New Yesterday

Overview

TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

Responsibilities

  • API Development: Design, develop, and maintain robust and scalable backend systems and APIs.
  • Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Google Cloud environments.
  • Data Transformation: Implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency.
  • Data Modeling: Develop and maintain data models and schemas to support efficient data storage and retrieval in Google Cloud platforms.
  • Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Cloud Composer or other relevant tools.
  • Data Lakes: Build data lakes using Google Cloud services such as Big Query.
  • Performance Optimization: Optimize data pipelines and queries for improved performance and scalability in Google Cloud environments.
  • Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation.
  • Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing.

Qualifications

  • Experience in data engineering, with a strong focus on Google Cloud Platform (GCP)-based solutions.
  • Proficiency in the GCP platform, particularly in Data & AI services (e.g., BigQuery, DataProc, Cloud SQL, DataFlow, Pub/Sub, Cloud Data Fusion, Cloud Composer, Python, SQL).
  • Designing, developing, and deploying scalable, reliable, and secure cloud-based solutions using GCP services.
  • Translating business requirements into technical specifications.
  • Proficiently utilizing core GCP services, such as Compute Engine, Kubernetes Engine (GKE), Cloud Storage, Cloud Functions, Cloud SQL, and BigQuery.
  • Implementing and managing GCP networking configurations.
  • Using IaC tools like Terraform to automate infrastructure provisioning and management.
  • Implementing and managing Continuous Integration/Continuous Delivery (CI/CD) pipelines.
  • Automating deployment processes. Implementing security best practices to protect cloud infrastructure and data.
  • Identifying and resolving performance bottlenecks.
  • Desirable knowledge & experience: Experience with data analytics and Big Data technologies.
  • Knowledge of cloud security best practices and compliance standards.
  • Experience with agile development methodologies.
  • GCP certifications (e.g., Google Cloud Certified Professional Cloud Developer).

Accessibility & Diversity

Tata Consultancy Services UK&I is committed to meeting the accessibility needs of all individuals in accordance with the UK Equality Act 2010 and the UK Human Rights Act 1998. We believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity and inclusion motto is "Inclusion without Exception". Our continued commitment to culture and diversity is reflected across our workforce implemented through equitable workplace policies and processes. You"ll find a welcoming culture and many internal volunteering and social networks to join (these are optional). Our diversity, inclusion and social activities include 12 employee networks such as gender diversity, LGBTQIA+ & Allies, mental health, disability & neurodiversity inclusion and many more, as well as health & wellness initiatives and sports events and we sponsor the London Marathon. Tata Consultancy Services UK&I is consistently voted as a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.

#J-18808-Ljbffr
Location:
Camden Town
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search