Principal Engineer - Databricks Specialist
New Yesterday
Join to apply for the Principal Engineer - Databricks Specialist role at UK Tote Group
1 day ago Be among the first 25 applicants
Join to apply for the Principal Engineer - Databricks Specialist role at UK Tote Group
We are looking for a Principal Software Engineer with deep expertise in Databricks to join the team and lead on the design and delivery of scalable, high-performance data solutions within our B2C business. Reporting into the Principal Architect you will drive the technical strategy for our Databricks-based data architecture, delivering critical use cases across safer gambling, real-time analytics, and regulatory compliance.
The role will be a full-time permanent role based from our Wigan (Greater Manchester) office with presence required onsite approx. twice per month/subject to business needs.
What You’ll Be Doing
- Lead the architecture and implementation of Databricks-based data pipelines, supporting real-time and batch workloads using Structured Streaming, Delta Lake, and Autoloader
- Collaborate with commercial, product and compliance teams to build data products that support responsible gambling, regulatory reporting, and customer insights
- Design and enforce data governance and access controls using Unity Catalog and AWS IAM policies
- Optimise Spark performance, DBU usage, and job scheduling to ensure reliable and cost-effective operation
- Contribute to infrastructure decisions including AWS configuration, Terraform deployments, and monitoring with CloudWatch and Databricks-native tools
- Evaluate and adopt new Databricks features to enhance platform capabilities
We are looking for candidates with the following technical attributes:
- Expert working knowledge of Databricks, especially PySpark, Delta Lake, and Structured Streaming
- Strong skills in building and optimising pipelines in AWS (e.g., S3, Glue, Lambda, IAM, CloudWatch).
- Strong skills in Python and SQL with a solid understanding of distributed processing patterns
- Experience working in regulated industries (preferably iGaming) with a focus on data privacy and compliance
- An advocate for modern engineering practices including the use of cloud native technologies, DevOps practices, CI/CD pipelines, containerised applications, and agile delivery
- A Databricks certification (e.g., Data Engineering Professional) is desirable
Who We Are
The Tote has been part of the UK betting landscape for nearly a century, we are racing's most popular pool betting operator and can be found online and across all racecourses in the UK and Ireland.In a fast-moving industry, we don’t stand still! We are focused on building something genuinely different within the betting world. Using the best in-class technology, digital innovation and customer engagement weare committed to launching exciting new products and delivering exceptional experiences to racing and sports enthusiasts!
Our headquarters in Wigan is the main hub for our team of over 200 innovative and ambitious experts dedicated to delivering our vision of providing the best betting experience for racing fans.A full induction, on the job training and development plan will be put in place for anyone who joins the team.
What We Offer
At the Tote you can expect a friendly working environment with a strong sense of teamwork and pride in what we do. Our company benefits package includes:
- Competitive basic salary
- Discretionary bonus scheme
- Company shares option plan
- Contributary pension scheme
- Life insurance (4 x basic salary)
- Simply Health plan
- Holiday entitlement (25 days plus bank holidays)
- Confidential 24/7 365 employee assistance helpline
- Agile and collaborative office environment with free parking, fruit, biscuits, and drinks
- Regular social events, charity events and volunteering opportunities
Seniority level
Seniority level
Mid-Senior level
Employment type
Employment type
Full-time
Job function
Job function
Information TechnologyIndustries
Gambling Facilities and Casinos
Referrals increase your chances of interviewing at UK Tote Group by 2x
Get notified about new Principal Software Engineer jobs in Greater Manchester, England, United Kingdom.
Greater Manchester, England, United Kingdom 2 weeks ago
Manchester, England, United Kingdom 2 weeks ago
Director of Software Technology Management
Manchester, England, United Kingdom 1 day ago
Manchester, England, United Kingdom 3 weeks ago
Software Engineering Manager, Project Delivery, Home Based
Manchester, England, United Kingdom 1 month ago
Manchester, England, United Kingdom 4 months ago
Software Engineering Squad Lead - GammaLabs
Manchester, England, United Kingdom 2 days ago
Software Development Team Leader, Trading and Tools (Manchester)
Manchester, England, United Kingdom 3 weeks ago
Manchester, England, United Kingdom 1 week ago
Greater Manchester, England, United Kingdom 1 week ago
Software Engineering Manager - Cross-platform C++ - Multipass
Manchester, England, United Kingdom 1 month ago
Software Engineering Manager - Cross-platform C++ - Multipass
Manchester, England, United Kingdom 3 weeks ago
Software Engineering Manager - Cross-platform C++ - Multipass
Manchester, England, United Kingdom 3 months ago
Software Engineering Manager - Sustaining Engineering
Manchester, England, United Kingdom 2 months ago
Software Engineering Manager, Ubuntu Gaming
Manchester, England, United Kingdom 2 weeks ago
Software Engineering Manager - Desktop and Embedded Linux Optimisation
Manchester, England, United Kingdom 5 months ago
Software Platform Engineering Manager - Ubuntu for Next-Gen Silicon
Manchester, England, United Kingdom 2 months ago
Linux Enablement - Software Engineering Manager
Manchester, England, United Kingdom 3 weeks ago
Machine Learning Engineering Manager (Operations)
Manchester, England, United Kingdom 22 hours ago
Manchester, England, United Kingdom 2 days ago
Manchester, England, United Kingdom 1 month ago
Ubuntu Enablement - Software Engineering Manager
Manchester, England, United Kingdom 2 weeks ago
Systems Integrations Engineering Manager
Manchester, England, United Kingdom 2 weeks ago
Manchester, England, United Kingdom 22 hours ago
Stockport, England, United Kingdom 2 weeks ago
Technical Manager - Automotive and Industrial
Manchester, England, United Kingdom 8 months ago
Manchester, England, United Kingdom 1 month ago
Salesforce Engineering Manager, Commercial Systems
Manchester, England, United Kingdom 2 weeks ago
Manchester, England, United Kingdom 2 days ago
Greater Manchester, England, United Kingdom 3 days ago
Greater Manchester, England, United Kingdom 2 weeks ago
Greater Manchester, England, United Kingdom 5 months ago
Staff Software Engineer - Engine by Starling
Manchester, England, United Kingdom 1 week ago
Greater Manchester, England, United Kingdom 2 weeks ago
Manchester, England, United Kingdom 1 week ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr- Location:
- Greater Manchester, England, United Kingdom
- Salary:
- £100,000 - £125,000
- Job Type:
- FullTime
- Category:
- Engineering