Data Engineer

New Yesterday

Overview

Data Engineer role at Agio Ratings

Agio Ratings is a VC-backed risk analysis firm focused on the digital asset market. Founded in 2022, our team of PhDs developed advanced models to capture the market's unique risk factors. We were early in flagging FTX’s high risk and in recognizing Bybit’s resilience following a $1.5B hack. Today, our ratings power risk teams at top trading firms, insurance companies, and banks worldwide.

With market and regulatory momentum driving demand, Agio Ratings is entering a new phase of growth. We’re seeking an energetic, creative, and experienced Data Engineer to scale mission-critical capabilities and help us win the market.

Responsibilities

  • Design and implement scalable ETL pipelines using Apache Spark or Apache Flink
  • Build real-time streaming data pipelines to ingest blockchain transaction data
  • Create data validation and QA frameworks to ensure pipeline reliability
  • Design and optimize data schemas for high volume analytical databases
  • Integrate with node APIs (Bitcoin Core, Geth, etc.) and 3rd party data vendors
  • Implement horizontal scaling strategies for compute-intensive data processing algorithms
  • Design fault-tolerant systems with proper error handling and recovery mechanisms

Must-have Requirements

This role is only open to candidates based in or willing to commute to London, UK at least 3 days a week.

In addition, you must have a minimum 3 years’ experience in each of the following:

  • Distributed computing: Apache Spark (PySpark/Scala), Apache Flink or equivalent
  • Data warehousing: ClickHouse/Snowflake, or similar DBs
  • Data lakes: AWS S3/Glue, Azure Data Lake, GCP BigQuery
  • Programming: Python, Scala, or Java for data pipeline development
  • Streaming: Kafka, Pulsar, or other streaming platforms
  • Cloud Platforms: AWS, Azure, or GCP data services

Nice-to-have

  • Knowledge of blockchain data formats and parsing techniques
  • Experience working with blockchain node APIs and RPC interfaces
  • Knowledge of data modelling for graph-based analysis
  • Understanding of data compression and storage optimization techniques

What we offer

  • Competitive pay starting at £70,000 per year
  • Equity ownership that grows as our company grows
  • Comprehensive health insurance offered by Vitality
  • A dynamic office in Central London with unlimited coffee, snacks and gym access

Seniority level

  • Mid-Senior level

Employment type

  • Full-time

Job function

  • Information Technology

London, England, United Kingdom

#J-18808-Ljbffr
Location:
London
Job Type:
FullTime
Category:
IT & Technology

We found some similar jobs based on your search