AWS Data Platform Engineer / Administrator

New Today

Overview

We are seeking an experience AWS Cloud Engineer with an active SC Clearance to design, implement, and optimise the cloud infrastructure and CI/CD pipelines of AWS data infrastructure. This role focuses on AWS-native data services, infrastructure automation, and orchestration to support large-scale data operations.

Responsibilities

  • Provision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch
  • Implement and maintain Infrastructure as Code (IaC) using Terraform
  • Manage orchestration workflows using Apache Airflow
  • Support CI/CD pipelines and version control using GitLab
  • Monitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patterns
  • Managing infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patterns
  • Collaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operations
  • Troubleshoot and resolve incidents related to AWS data infrastructure
  • Contribute to documentation and process improvement initiatives
  • Managing and monitoring access and RBAC controls

Requirements

  • Strong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMR
  • Strong hands-on experienced with Terraform for IaC
  • Experience with Airflow for DAG orchestration and monitoring
  • Experience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions)
  • Experience with Python, SQL and Bash for automation, querying and troubleshooting
  • Understanding of AWS Security best practices, IAM policies and RBAC
  • Understanding of AWS Networking and VPC
  • Experience with containerisation using Docker
  • Experience with Disaster Recovery, backups and snapshots

Desirable Skills

  • Understanding of AWS Neptune, EKS
  • Experience with Jira Service Desk
  • Experience supporting Data Engineers
  • Experience working as a consultant
  • README and Confluence documentation

Soft Skills

  • Strong problem-solving and troubleshooting skills
  • Ability to work in an Agile environment
  • Comfortable with stakeholder management
  • Excellent communication and collaboration skills

Benefits

  • Training - All team members are offered a number of options in terms of personal development
  • Private medical cover for you and your spouse/partner, offered via Vitality
  • Discretionary bonus based on a blend of personal and company performance
  • Holiday - 25 Days holiday, plus 1 day for Birthday and 1 day for work anniversary in addition to UK bank holidays
  • Electric Vehicle leasing with salary sacrifice
  • Contributed Pension Scheme
  • Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.

#J-18808-Ljbffr
Location:
City Of London
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search