Data Engineer

New Today

If you are an experienced Data Engineer with excellent communication skills and a proven track record of working on large scale data enablement projects, we have a new contract we would like to discuss with you.Please note this role requires onsite attendance once a week and has been deemed inside IR35.Requirement:Experience in Azure Synapse, ETL, Pyspark, SQL , data Modelling and Data Bricks.Design and develop Azure Pipelines including data transformation and data cleansingDocument source-to-target mappingsRe-engineer manual data flows to enable scaling and repeatable useBuild accessible datasets for distribution and analysisDevelopment of Azure Pipelines for transforming dataA scalable meta-data driven ingestion and transformation frameworkAligning transformation pipelines and datasets with PurviewExperience of working with Azure Data Lakes, Data warehousing, and pipelines and Storage accountsExperience in building and managing Pipelines including: building data interfaces to source systems, combining and transforming data into appropriate storage formatsExperience identifying and resolving issues in databases, data processes, data products and services.Proficiency in T-SQL and Python to develop automation #J-18808-Ljbffr
Location:
City Of London, England, United Kingdom
Job Type:
FullTime

We found some similar jobs based on your search