Data Engineer
New Yesterday
Overview
As a Data Engineer, you will play a central role in our growing Data Platform team, focusing on designing, building, maintaining, and optimising our modern data infrastructure and platforms. You will be instrumental in ensuring the organisation has seamless access to high-quality, reliable, and performant data. This is a hands-on position requiring deep technical expertise in automating the management of Snowflake for a rapidly scaling team and building robust Python applications, collaborating closely with various teams across the business.
Responsibilities
- Design, build, and maintain scalable and resilient data pipelines and infrastructure, utilising Python for custom data transformations, API integrations, and orchestration.
- Own the flow and security of data in our Snowflake data warehouse and its component parts, ensuring optimal data delivery architecture and data availability for global business operations.
- Implement and manage data platforms leveraging Kubernetes for efficient deployment, orchestration, and scaling of data services and applications.
- Develop and implement internal process improvements, including CI/CD pipelines using GitHub for automated testing, deployment, and version control.
- Collaborate closely with stakeholders across the business, including Engineering, Data Scientists and Analytics Engineering teams, to gather requirements and deliver high-impact data solutions.
- Ensure data quality, reliability, and observability across our data platform, implementing robust monitoring, alerting, and testing frameworks.
- Solve complex technical problems in ambiguous situations, demonstrating a strong ability to identify root causes and implement innovative, efficient solutions to intricate data challenges.
- Maintain our data infrastructure for efficiency and consistency across multiple regions.
Qualifications
- Proven experience as a Data Engineer, designing, building, and maintaining scalable data platforms and pipelines.
- Deep experience with Snowflake, including advanced features like dynamic data masking, row-level security, data backups and ELT tools.
- Strong Python skills for data engineering, scripting, and automation.
- Strong SQL performance, with a solid understanding of data warehousing concepts.
- Demonstrated experience with GitHub, CI/CD, and collaborative development.
- Exceptional problem-solving skills, capable of navigating and resolving complex technical challenges in ambiguous, fast-paced environments.
- Strong stakeholder management and communication skills, comfortable working with technical and non-technical colleagues.
- A strong focus on data automation, reliability, testing, and performance.
- Track record of delivering clean, well-documented, and production-grade data assets and infrastructure.
- Strategic mindset with experience contributing to and delivering against a team roadmap, balancing business priorities with technical improvements and managing technical debt.
Nice to have
- Experience with Kubernetes for deploying data services
Why Join Us
Capital on Tap was founded with the mission to help small business owners and make their lives easier. Today, we provide an all-in-one business credit card & spend management platform that helps business owners save time and money. Capital on Tap proudly serves over 200,000 businesses across the world and our goal is to help 1 million small businesses by 2030.
Benefits
Private Healthcare including dental and opticians services through Vitality; Worldwide travel insurance through Vitality; Anniversary Rewards (£250, £500, £750, 4-week fully paid sabbatical); Salary Sacrifice Pension Scheme up to 7% match; Octopus EV Salary Sacrifice Scheme; 28 days holiday (plus bank holidays); Annual Learning and Wellbeing Budget; Enhanced Parental Leave; Cycle to Work Scheme; Season Ticket Loan; 6 free therapy sessions per year; Dog Friendly Offices; Free drinks and snacks in our offices.
Interview Process
First stage: 30 minute intro and values call with Talent Partner (Video call); Second stage: 45 minute CV overview with Team Manager (Video call); Final stage: 60 minute technical assessment with Head of Department (In person).
Other Information
Check out our Keep updated on new job opportunities by following us on [platform]. Email if you have any questions. Excited to work here? Apply! If you'd like to progress your career within our fast growing, profitable fintech then click apply and we will aim to get back to you within 3 working days (during busy periods this could take up to 5 working days).
- Location:
- City Of Westminster
- Job Type:
- FullTime
- Category:
- IT & Technology
We found some similar jobs based on your search
-
New Yesterday
Lead Data Engineer
-
United Kingdom
- IT
Lead Data Engineer £110,000 GBP Remote WORKING Type: Permanent Job Title: Lead Data Engineer Location: Home-based (UK) with options in Belfast, Birmingham, and London Salary: Up to £110,000 + 5% bonus Our client is a leading digital transfor...
More Details -
-
New Yesterday
Senior Data Engineer
-
United Kingdom
- IT & Technology
We have pathways for any developer to convert and master AI Engineering with the most practical, hands-on and comprehensive at Towards AI Academy.# Senior Data Engineer## Blend360Published 10 Oct 2024## Role Highlights### Languages usedPythonSCALA##...
More Details -
-
New Yesterday
Data Engineer - AWS
-
Greater London
- IT & Technology
Overview Valcon is one of Europe’s fastest growing consultancies, specialising in data and technology services. We partner with forward-thinking organisations to help them unlock value from their data, drive digital transformation, and future-proof ...
More Details -
-
New Yesterday
Data Centre Engineer
-
City Of London
- IT & Technology
Overview ONNEC Group are a leading independent technology partner and global integrator, with over 30 years experience, and a 800+ team of global experts, specialising in providing end-to-end connectivity solutions that propel organisations everywhe...
More Details -
-
New Yesterday
Specialist Data Engineer
-
City Of London
- IT & Technology
Looking for a new challenge? Take a look at our current vacancies. If you see a vacancy that is right for you, we encourage you to apply! Job Title: Specialist Data Engineer Full-time role Working Hours : Full-time 35 hours per week Salary: £64,575...
More Details -
-
New Yesterday
Mechanical Data Centre Engineer
-
City Of London
- IT & Technology
To Apply for this Job Click Here The Data Centre HVAP Technician will oversee and supervise both planned and reactive maintenance, working closely with the Building Engineering Supervisor and Shift Leader. The role involves ensuring all maintenance...
More Details -