AWS Data Platform Engineer / Administrator

New Yesterday

OverviewWe are seeking an experience AWS Cloud Engineer with an active SC Clearance to design, implement, and optimise the cloud infrastructure and CI/CD pipelines of AWS data infrastructure. This role focuses on AWS-native data services, infrastructure automation, and orchestration to support large-scale data operations.ResponsibilitiesProvision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, BatchImplement and maintain Infrastructure as Code (IaC) using TerraformManage orchestration workflows using Apache AirflowSupport CI/CD pipelines and version control using GitLabMonitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patternsManaging infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patternsCollaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operationsTroubleshoot and resolve incidents related to AWS data infrastructureContribute to documentation and process improvement initiativesManaging and monitoring access and RBAC controlsRequirementsStrong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMRStrong hands-on experienced with Terraform for IaCExperience with Airflow for DAG orchestration and monitoringExperience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions)Experience with Python, SQL and Bash for automation, querying and troubleshootingUnderstanding of AWS Security best practices, IAM policies and RBACUnderstanding of AWS Networking and VPCExperience with containerisation using DockerExperience with Disaster Recovery, backups and snapshotsDesirable SkillsUnderstanding of AWS Neptune, EKSExperience with Jira Service DeskExperience supporting Data EngineersExperience working as a consultantREADME and Confluence documentationSoft SkillsStrong problem-solving and troubleshooting skillsAbility to work in an Agile environmentComfortable with stakeholder managementExcellent communication and collaboration skillsBenefitsTraining - All team members are offered a number of options in terms of personal developmentPrivate medical cover for you and your spouse/partner, offered via VitalityDiscretionary bonus based on a blend of personal and company performanceHoliday - 25 Days holiday, plus 1 day for Birthday and 1 day for work anniversary in addition to UK bank holidaysElectric Vehicle leasing with salary sacrificeContributed Pension SchemeDeath in service coverAbout UBDS GroupAt UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.Equal OpportunitiesWe are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age. #J-18808-Ljbffr
Location:
City Of London, England, United Kingdom
Job Type:
FullTime

We found some similar jobs based on your search