Overview

Direct message the job poster from Aubay UK

Business and Investment Relations Management

Role Summary

Aubay is seeking an experienced Senior Data Engineer with great interpersonal skills to join our team. Our business has been built on a foundation of innovative technology and skilled people. By providing energy to sustain people's lives over many years, we have become one of the world's leading companies. Our IT Engineering team offers you the chance to make an impact that matters – be it in complex predictive maintenance and inventory management solutions to optimize the uptime of our assets or innovative solutions that satisfy customers worldwide.

Your growth is our future in IT Engineering. Information technology supports all aspects of our businesses, and we have some of the world's most complex problems to solve. You will not only get an opportunity to work with the latest technology, but with our scale, you will also get the chance to shape future digital technology by working with industry leaders. With open-source technology being important to us, you will also have the opportunity to contribute back to the software community. The diversity of positions on offer will help you grow in your career.

The Senior Data Engineer will play a critical role in designing, building, and maintaining scalable data pipelines and analytics solutions using Azure and Data bricks ecosystem. Collaborate closely with business stakeholders - to ensure data is accessible, reliable, and optimized for performance.

Key Accountabilities

• Design and implement robust data pipelines using Azure Data Factory (ADF) and Databricks.
• Develop scalable ETL/ELT processes to ingest, transform, and load data from various sources.
• Write clean, efficient, and reusable Python code for data processing and automation.
• Optimize and manage SQL queries for data extraction, transformation, and reporting.
• Collaborate with business stakeholders to understand data requirements and deliver solutions aligned with business goals.
• Ensure data quality, integrity, and security across all data platforms.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
• Implement logging, alerting, and error-handling mechanisms for proactive issue resolution
• Apply domain knowledge of trading and financial markets to enhance data models and analytics capabilities.

Required Skills and Experience

• 5+ years of experience in data engineering or related roles.
• Proven expertise in Azure Data Factory and Azure Databricks.
• Strong proficiency in Python for data engineering tasks.
• Solid understanding of SQL and relational databases.
• Exposure to real-time data processing frameworks (e.g., Spark Streaming, Kafka).
• Experience in maintaining and supporting production-grade data pipelines.
• Familiarity with trading business domain, including market data, trade lifecycle, and financial instruments.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration abilities

About Aubay UK – Ahead of Innovation!

Aubay UK is a recognised InSourcing Partner for client-side deployment delivered across London and the GCC. Our team, based in Canary Wharf, specialises in hiring IT professionals within the Energy and FinTech sectors, helping our clients to expand their operations with top-tier talent who are experts in their fields. We work exclusively with clients who are globally recognized as Energy Super Majors/Financial Services and innovative FinTech players.

Aubay UK is the most recently started branch of Aubay Group www.aubay.com. Aubay Group are an international Digital Services Company, listed on a Euronext Stock Exchange, who have been operating for 21 years in the European market and working alongside some of the biggest names in the Banking, Finance, Insurance, Energy, IT/Digital, Manufacturing, Transport and Telecoms sectors. With over 7,000 employees across 7 countries and 16 offices in England, France, Belgium, Luxembourg, Italy, Spain, and Portugal, Aubay Group generated revenues of €435 million in 2019.

What Aubay UK Offers

At Aubay UK, people are at the heart of our business. We offer a competitive renumeration package which includes a range of benefits. You will receive continuous support from our dedicated team of Talent Acquisition Specialists who will support your career development and success during your assignment with our client. Other benefits include:

• Annual Leave + Bank Holidays
• Work from home opportunities
• Access to Udemy training platform and conferences
• Discount on winter sports holiday at www.aero1607.com
• Opportunity to work directly for the client at the end of assignment

Our Client

Our client is a leading global energy company and the state-owned petroleum corporation, with operations spanning over 30 countries. With a commitment to energy sustainability and economic growth, our client specializes in Exploration & Production, Natural Gas, LNG, Petrochemicals, Refining, and Renewables. The company plays a vital role in the global energy sector, leveraging the GCC country’s position as one of the world’s top natural gas producers. As part of the team, you’ll be part of a dynamic and innovative environment, contributing to ambitious goals to meet rising global energy demands through sustainable energy solutions. In your role, you will help drive impactful projects worldwide, supporting the company’s vision to diversify and ensure reliable, low-emission energy while delivering value and operational excellence.

Apply via our website - www.aubay.co.uk

You will be working remotely initially. Aubay UK is proud to be an equal opportunity employer. All aspects of employment decisions will be based on merit, competence, performance, and business needs

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Referrals increase your chances of interviewing at Aubay UK by 2x

Get notified about new Senior Data Engineer jobs in England, United Kingdom.

Cambridge, England, United Kingdom 2 days ago

Wiltshire, England, United Kingdom 3 weeks ago

Senior Data Engineer - Insurance - London/Hybrid - TWE42956

Liverpool, England, United Kingdom £50,000.00-£70,000.00 1 month ago

Snr. Data Engineer (Position located in London, United Kingdom)

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 days ago

Senior Software Engineer - Trading (Ref: 30bee)

Senior Data Analyst – Front Office – Investment Management (Python)

London, England, United Kingdom 2 days ago

Huddersfield, England, United Kingdom 1 week ago

Eastbury, England, United Kingdom 1 week ago

London, England, United Kingdom 2 months ago

Data Architect | Snowflake, Python, Terraform & AWS | Energy Trading | Up to £850 p/day | Inside IR35 | 3 days onsite | 6 Mths rolling

Senior Data Analyst- Data Management (Treasury Products)

Chester, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 day ago

Senior Data Analyst - Pricing Data Engineering & Automation, CUO Global Pricing

London, England, United Kingdom 1 week ago

City Of London, England, United Kingdom 1 month ago

Eastbury, England, United Kingdom 1 week ago

London, England, United Kingdom 22 hours ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 1 day ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.