OverviewSenior Databricks Engineer (flexible location) at Bibby Financial Services have an exciting opportunity available for a reliable Senior Databricks Engineer to join our team. This is a full time, permanent role with a competitive salary of £60,000 - £70,000 per annum.About The RoleAs our Senior Databricks Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units domestically and internationally. You will have an active leadership role in determining and developing the shape of your team's solution delivery against business requirements, as well as helping to inform and input into the wider technical architecture and strategy. This is a hands-on role where the majority of your time will be spent actively developing solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your Responsibilities As Our Senior Databricks Engineer Will IncludeUnderstand the business / product strategy and supporting goals with the purpose of ensuring data interpretation alignsProvide technical leadership on how to break down initiatives into appropriately sized features, epics and stories that balance value and risk. Take a leadership role on setting standards, driving quality and consistency in solution deliveryWork closely with the Data Architect to collaborate on Design of our data architecture and interpret into a build planLead the build and maintenance of scalable data pipelines and ETL processes to support data integration and analytics from a diverse range of data sources, Cloud storage, databases and APIsDeliver large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniquesCollaborate with the BI Product Owner, analysts, and other business stakeholders to understand data requirements and deliver solutions that meet business needsOptimize and tune data processing systems for performance, reliability, and scalabilityImplement data quality and validation processes to ensure the accuracy and integrity of data throughout the pipelinesOperate an agile CI/CD environment within Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practicesDevelop and maintain data models, schemas, and documentationMonitor and troubleshoot data pipeline issues, ensuring timely resolutionStay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as appropriateEnsure adherence to BFS Governance processesProvide line management and technical leadership to a small team of Data EngineersWork closely with the Data Architect to collaborate on Design of our data architecture and interpret into a build planLead the build and maintenance of scalable data pipelines and ETL processes to support data integration and analytics from a diverse range of data sources, Cloud storage, databases and APIsDeliver large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniquesWhat we are looking for in our ideal Senior Databricks EngineerSignificant years of Databricks experience, including Unity CatalogTerraform, defining, deploying, and managing cloud infrastructure as codeProficiency in programming languages such as Python, Spark, SQLStrong experience with SQL databasesExpertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF)Experience with cloud platforms (Azure preferred) and related data servicesExcellent problem-solving skills and attention to detailInclusive and curious, continuously seeks to build knowledge and understandingStrong communication and collaboration skillsExperience of Waterfall and Agile delivery methodologiesCompensation and BenefitsPrivate healthcare for you and your familyCompany car allowanceCompany pension schemeWide range of flexible benefits, such as gym membership, technology, or health assessmentsAccess to an online wellbeing centreRange of discounts from many businesses25 days holiday, which increases with service, and options to buy or sell moreElectric Vehicle/Plug-in Hybrid Vehicle (EV/PHEV) schemeWhy us?We've supported small and medium-sized enterprises (SMEs) since 1982, and today we support more than 9000 businesses worldwide. We are proud to help businesses, both big and small to grow and thrive in domestic and international markets. We are in the business of relationships and strive to empower our colleagues to be themselves and grow. The role is hybrid and can be based in any of our UK offices. We are committed to being an inclusive place to work and will provide adjustments to support you through the recruitment process. We reserve the right to close applications early. No agencies.If you would like to join us, please click ‘Apply’ today to be considered as our Senior Databricks Engineer – we would love to hear from you! This role will be hybrid and can be based in any of our UK offices.LNKD1_UKTJSeniority levelMid-Senior levelEmployment typeFull-timeJob functionIndustriesCivil EngineeringReferrals increase your chances of interviewing at Association of Canadian Ergonomists by 2xSign in to set job alerts for “Senior Engineer” roles.Oxford, Milton Keynes, Brackley and other UK locations are listed on the posting. #J-18808-Ljbffr