Data Platform Engineer

New Yesterday

Overview London (GB)
Octopus Energy UK – Data
Full-time / Hybrid
Octopus Energy is all about clean, green energy with transparent pricing and a relentless commitment to customer experience. Join a global team dedicated to sustainability and green tech, where energy is good for the planet and your soul. Embrace flat hierarchies and an open, agile culture that fosters innovation, flexibility, and creativity. At Octopus, great people get stuff done, all whilst being themselves.
At Octopus Energy we are passionate about building great technology to change the way customers use, and think about, energy for the good of the planet. This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero and support the energy transition.
We have developed a data platform that is used by all our businesses around the world. The platform empowers users with self-service data analytics and automates our data processing workflows, from simple ETL jobs to ML training and prediction. The Data Platform Team works on anything from natural language understanding of customer communications to processing billions of smart meter readings every day to support creating customised and market-leading smart energy tariffs. We employ software engineering best practices to design, test, and deploy our data platform and services. We are looking for an experienced Engineer to join the team to help build and maintain the platform, pipelines, and reporting tools.
What You'll Do
Build and optimise the platform used by the data team to transform raw data into business insights
Scope and deliver new data engineering projects in collaboration with business stakeholders
Develop and deploy ML infrastructure to help build out our ever-growing AI requirements and use cases
Research and implement new tooling where appropriate, whether it’s developed in-house or sourced externally
Maintain and expand our existing data infrastructure and tools
Consult the wider business on engineering best practices and stay up to date with trends within the profession
Support the internationalisation of our data infrastructure as we continue to grow globally
What You'll Have Primarily, we want our Data Platform Engineers to have a passion for writing high quality code and building lean processes. It would be helpful to have experience/expertise/knowledge in the following (in rough priority order):
Python
AWS
Docker
Data/network security
Grafana
Postgres
CDC systems
Data related products (Airflow, Jupyter, Spark, etc.)
The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems and deliver pragmatic solutions.
Our Tech Stack
Python as our main programming language
Terraform on Spacelift for infrastructure definition and deployment
Airflow for job scheduling and tracking
CircleCI for continuous deployment
Databricks for our data lake platform
Parquet and Delta file formats on S3 for data lake storage
Postgres / Aurora for our relational databases
Spark for data processing
dbt for data modelling
Kubernetes for data services and task orchestration
SparkSQL for analytics
Streamlit for data applications
Our process usually takes up to 4 weeks, but we’ll flex around what works for you. During the process, you’ll chat with our recruitment team and your Recruiter will help you throughout different stages. If you have questions, you can reach us at hiring@octoenergy.com.
Accommodations and Equality Octopus Energy is an equal opportunity employer. We welcome applicants from all backgrounds and do not discriminate on the basis of protected attributes. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.
#J-18808-Ljbffr
Location:
London
Salary:
£125,000 - £150,000
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search