Data Engineer - Python, SQL, Databricks
New Today
Overview
i am recruiting for a Data Engineer to work in Glasgow 3 days a week, 2 days remote.
The role falls inside IR35 so you will have to work through an umbrella company.
Responsibilities
- You will have several years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects.
- You will have experience of designing and implementing tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.
- Experience in data development and solutions in highly complex data environments with large data volumes.
- SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis.
- Databricks experience is essential.
- Experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
- You will be able to develop solutions in a hybrid data environment (on-Prem and Cloud).
- You must be able to collaborate seamlessly across diverse technical stacks, including Cloudera, Databricks, Snowflake, Azure, AWS, etc.
- Hands on experience with developing data pipelines for structured, semi-structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files etc).
Qualifications
- SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis.
- Databricks experience is essential.
- Experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
- You will be able to develop solutions in a hybrid data environment (on-Prem and Cloud).
- You must be able to collaborate seamlessly across diverse technical stacks, including Cloudera, Databricks, Snowflake, Azure, AWS, etc.
- Hands on experience with developing data pipelines for structured, semi-structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files etc).
Please apply ASAP to find out more
- Location:
- Glasgow, Scotland, United Kingdom
- Salary:
- £100,000 - £125,000
- Job Type:
- FullTime
- Category:
- IT & Technology