Role Title: AWS Integration Engineer

Duration: contract to run until 20/12/2025 with high likelihood dof extension

Location: Knutsford. Hybrid, 2/3 day onsite (Some onsite work will be required -London and Glasgow may also be options).

Rate: £400 per day - PAYE via Umbrella Only

Key Skills/ requirements

Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high availability, scalability, and fault tolerance of Airflow clusters. Implement monitoring, alerting, and logging for Airflow and related components. Perform upgrades and patches for platform-related components. Oversee capacity planning, resource allocation, and optimization of Airflow workers. Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop i...