Data Engineer

New Yesterday

Overview

As a Data Engineer, you will play a central role in our growing Data Platform team, focusing on designing, building, maintaining, and optimising our modern data infrastructure and platforms. You will be instrumental in ensuring the organisation has seamless access to high-quality, reliable, and performant data. This is a hands-on position requiring deep technical expertise in automating the management of Snowflake for a rapidly scaling team and building robust Python applications, collaborating closely with various teams across the business.

Responsibilities

  • Design, build, and maintain scalable and resilient data pipelines and infrastructure, utilising Python for custom data transformations, API integrations, and orchestration.
  • Own the flow and security of data in our Snowflake data warehouse and its component parts, ensuring optimal data delivery architecture and data availability for global business operations.
  • Implement and manage data platforms leveraging Kubernetes for efficient deployment, orchestration, and scaling of data services and applications.
  • Develop and implement internal process improvements, including CI/CD pipelines using GitHub for automated testing, deployment, and version control.
  • Collaborate closely with stakeholders across the business, including Engineering, Data Scientists and Analytics Engineering teams, to gather requirements and deliver high-impact data solutions.
  • Ensure data quality, reliability, and observability across our data platform, implementing robust monitoring, alerting, and testing frameworks.
  • Solve complex technical problems in ambiguous situations, demonstrating a strong ability to identify root causes and implement innovative, efficient solutions to intricate data challenges.
  • Maintain our data infrastructure for efficiency and consistency across multiple regions.

Qualifications

  • Proven experience as a Data Engineer, designing, building, and maintaining scalable data platforms and pipelines.
  • Deep experience with Snowflake, including advanced features like dynamic data masking, row-level security, data backups and ELT tools.
  • Strong Python skills for data engineering, scripting, and automation.
  • Strong SQL performance, with a solid understanding of data warehousing concepts.
  • Demonstrated experience with GitHub, CI/CD, and collaborative development.
  • Exceptional problem-solving skills, capable of navigating and resolving complex technical challenges in ambiguous, fast-paced environments.
  • Strong stakeholder management and communication skills, comfortable working with technical and non-technical colleagues.
  • A strong focus on data automation, reliability, testing, and performance.
  • Track record of delivering clean, well-documented, and production-grade data assets and infrastructure.
  • Strategic mindset with experience contributing to and delivering against a team roadmap, balancing business priorities with technical improvements and managing technical debt.

Nice to have

  • Experience with Kubernetes for deploying data services

Why Join Us

Capital on Tap was founded with the mission to help small business owners and make their lives easier. Today, we provide an all-in-one business credit card & spend management platform that helps business owners save time and money. Capital on Tap proudly serves over 200,000 businesses across the world and our goal is to help 1 million small businesses by 2030.

Benefits

Private Healthcare including dental and opticians services through Vitality; Worldwide travel insurance through Vitality; Anniversary Rewards (£250, £500, £750, 4-week fully paid sabbatical); Salary Sacrifice Pension Scheme up to 7% match; Octopus EV Salary Sacrifice Scheme; 28 days holiday (plus bank holidays); Annual Learning and Wellbeing Budget; Enhanced Parental Leave; Cycle to Work Scheme; Season Ticket Loan; 6 free therapy sessions per year; Dog Friendly Offices; Free drinks and snacks in our offices.

Interview Process

First stage: 30 minute intro and values call with Talent Partner (Video call); Second stage: 45 minute CV overview with Team Manager (Video call); Final stage: 60 minute technical assessment with Head of Department (In person).

Other Information

Check out our Keep updated on new job opportunities by following us on [platform]. Email if you have any questions. Excited to work here? Apply! If you'd like to progress your career within our fast growing, profitable fintech then click apply and we will aim to get back to you within 3 working days (during busy periods this could take up to 5 working days).

#J-18808-Ljbffr
Location:
City Of Westminster
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search