Data Engineer

New Today

OverviewGet AI-powered advice on this job and more exclusive features.Hybrid – 3 days on siteLondon, England, United KingdomResponsibilitiesData Pipeline DevelopmentDesign and implement robust ETL/ELT pipelines using GCP services like Dataflow, Dataproc, Cloud Composer, and Data Fusion.Automate data ingestion from diverse sources (APIs, databases, flat files) into BigQuery and Cloud StorageData Modelling & Warehousing: Develop and maintain data models and marts in BigQuery. Optimize data storage and retrieval for performance and cost efficiency.Security & Compliance: Implement GCP security best practices including IAM, VPC Service Controls, and encryption. Ensure compliance with GDPR, HIPAA, and other regulatory standards.Monitoring & Optimization: Set up monitoring and alerting using Stackdriver. Create custom log metrics and dashboards for pipeline health and performance.Collaboration & Support: Work closely with cross-functional teams to gather requirements and deliver data solutions. Provide architectural guidance and support for cloud migration and modernization initiatives.SkillsetTechnical SkillsLanguages: Python, SQL, Java (optional)GCP Services: BigQuery, Dataflow, Dataproc, Cloud Storage, Cloud SQL, Cloud Functions, Composer (Airflow), App EngineTools: GitHub, Jenkins, Terraform, DBT, Apache BeamDatabases: Oracle, Postgres, MySQL, Snowflake (basic)Orchestration: Airflow, Cloud ComposerMonitoring: Stackdriver, Logging & AlertingCertificationsGoogle Cloud Certified – Professional Data EngineerGoogle Cloud Certified – Associate Cloud EngineerGoogle Cloud Certified – Professional Cloud Architect (optional)Soft SkillsStrong analytical and problem-solving skillsExcellent communication and stakeholder managementAbility to work in Agile environments and manage multiple prioritiesExperience RequirementsExtensive experience in data engineeringStrong hands-on experience with GCPExperience in cloud migration and real-time data processing is a plusSenioriy levelMid-Senior levelEmployment typeFull-timeJob functionInformation TechnologyIndustriesIT Services and IT Consulting and Business Consulting and Services #J-18808-Ljbffr
Apply
Location:
City Of London, England, United Kingdom
Job Type:
FullTime

We found some similar jobs based on your search