Data Engineer - Databricks (Newcastle or Erskine)

8 Days Old

Data Engineer - Databricks (Newcastle or Erskine) page is loaded## Data Engineer - Databricks (Newcastle or Erskine)locations: GBR - NBL - NEWCASTLEtime type: Full timeposted on: Posted Todayjob requisition id: 51559561**Job Description:****Job Opportunity: Data Engineer (Databricks Specialist) – Newcastle or Erskine Area****Location:** Newcastle, UK or Erskine, Scotland **Type:** Full-Time **Salary:** Competitive + Benefits **Remote Work:** Hybrid options available**About the Role:** We’re on a mission to harness the power of data to drive innovation and deliver transformative solutions. We’re looking for a talented **Data Engineer** with deep expertise in **Databricks** to join our growing team and help shape the future of our data projects. This is a fantastic opportunity to work on cutting-edge AI and data engineering projects using the latest tools and technologies in a collaborative and innovative environment.**Please note that due to security clearance requirements, candidates should be sole UK nationals who are willing to undergo SC clearance. Applicants should also be willing to travel within the UK when required depending on project requirements.****Key Responsibilities:*** Build and maintain scalable data pipelines using Databricks.* Manage and optimize Databricks Workspace, Clusters, Jobs, Repos, and Delta Live Tables.* Develop modular ETL workflows using dbt and orchestrate them with Apache Airflow.* Write advanced PySpark code, including UDFs and Pandas UDFs, for efficient data processing.* Ensure data quality, reliability, and performance across all systems.* Collaborate with data scientists, analysts, and engineers to deliver data solutions that support business goals.* Contribute to the mentoring and development of junior team members.* Support senior team members in identifying and addressing data science opportunities.**Required Skills & Experience:*** Proven experience with **Databricks** and its ecosystem* Strong proficiency in **PySpark**, especially with UDFs and Pandas UDFs* Hands-on experience with **dbt** and **Airflow*** **Databricks Certified Data Engineer Associate** certification or willingness to achieve one* Excellent problem-solving skills and a passion for data and AI* Bachelor's degree in a relevant field or equivalent combination of education and experience* Typically, 5+ years of relevant work experience in industry, with a minimum of 2+ years in a similar role.* Proficiencies in data cleansing, exploratory data analysis, and data visualization* Continuous learner that stays abreast with industry knowledge and technology* Work with a forward-thinking team on impactful AI projects* Access to continuous learning and development opportunities* Flexible working arrangements* Inclusive and supportive company cultureAt DXC Technology, we believe strong connections and community are key to our success. Our work model prioritizes in-person collaboration while offering flexibility to support wellbeing, productivity, individual work styles, and life circumstances. We’re committed to fostering an inclusive environment where everyone can thrive.Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process. DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available ***.***locations: GBR - NBL - NEWCASTLEtime type: Full timeposted on: Posted 21 Days AgoDXC Technology (NYSE: DXC) helps global companies run their mission-critical systems and operations while modernizing IT, optimizing data architectures, and ensuring security and scalability across public, private and hybrid clouds. The world's largest companies and public sector organizations trust DXC to deploy services to drive new levels of performance, competitiveness, and customer experience across their IT estates. Learn more about how we deliver excellence for our customers and colleagues at . #J-18808-Ljbffr
Apply
Location:
Newcastle Upon Tyne, England, United Kingdom
Salary:
£80,000 - £100,000
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search