Social network you want to login/join with:Data Engineer, Kingston upon Hull, East YorkshireClient: AthsaiLocation: Kingston upon Hull, East Yorkshire, United KingdomJob Category: OtherEU work permit required: YesJob Views: 4Posted: 26.08.2025Expiry Date: 10.10.2025Job Description:This role is based in London (Remote).About the RoleThe Data Engineer will play a pivotal role in the organization by designing and implementing robust data pipelines that facilitate efficient data flow and management across various platforms. This position is essential for ensuring the integrity, reliability, and accessibility of our data, which supports critical business decisions and drives insights.Required SkillsProficiency in PySpark and AWS: Strong command of both PySpark for data processing and AWS (Amazon Web Services) for cloud-based solutions.ETL Pipeline Development: Experience in designing, implementing, and debugging ETL (Extract, Transform, Load) pipelines, responsible for moving and transforming data from various sources to data warehouses.Programming Expertise: Solid understanding of Python, PySpark, and SQL for data manipulation and analysis.Knowledge of Spark and Airflow: In-depth knowledge of Apache Spark for big data processing and Apache Airflow for workflow orchestration.Cloud-Native Services: Experience designing data pipelines leveraging cloud-native services on AWS for scalability and reliability.AWS Services: Extensive knowledge of AWS services such as S3, RDS, Redshift, and Lambda.Terraform for Deployment: Proficiency in deploying AWS resources using Terraform.CI/CD Workflows: Experience setting up CI/CD workflows with GitHub Actions.Preferred SkillsExperience with other cloud platforms like GCP or Microsoft Azure.Understanding of data governance and compliance standards.We are looking for a proactive and detail-oriented Data Engineer passionate about working with data and driving innovation. If you have a strong technical background and a commitment to excellence, we would love to hear from you! #J-18808-Ljbffr