Data Engineer
New Today
This range is provided by Cognify Search. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Overview
Cognify are hiring for a fast-growing B2B SaaS company that provides large-scale data solutions to businesses and organisations worldwide. The platform serves millions of users and handles complex, high-volume datasets across multiple regions. The company’s mission is to deliver fast, reliable, and high-quality data to customers through APIs, search, and other data delivery channels. To achieve this, they are seeking a talented engineer to optimise the performance, structure, and accessibility of their data platform.
Search & Data Platform Engineer
Cognify are looking for a Search & Data Platform Engineer to focus on performance, organisation, and optimisation of data across the company’s customer-facing platform. This role sits at the intersection of data engineering and platform engineering. The main focus is on how data is structured, indexed, cached, and delivered through APIs, search, and bulk/delta/streaming products, rather than building ingestion pipelines. The successful candidate will collaborate with platform and product teams to ensure fast, scalable, and developer-friendly data delivery, while improving the search and query experience across products.
Key responsibilities
- Optimise data delivery by designing and maintaining performant access layers for APIs, search, bulk/delta deliveries, and streaming services.
- Improve search systems and indexing strategies to ensure fast, accurate, and relevant results at scale.
- Structure and model datasets to balance usability, consistency, and performance.
- Implement multi-layered caching solutions (query caching, materialised views, edge/CDN caching, object storage pre-computation) to achieve consistently low-latency responses.
- Tune queries and indexes for high-throughput, low-latency data retrieval.
- Collaborate with architects and engineers to ensure consistency and efficiency across the data delivery stack.
- Design scalable and resilient solutions capable of handling large volumes and usage spikes without compromising reliability.
- Implement observability for search, caching, and queries to proactively identify and resolve bottlenecks.
- Ensure APIs and search systems are intuitive for developers, with clear contracts and predictable performance.
Technical expertise required
- Experience with search technologies such as Elasticsearch, OpenSearch, Solr, or similar.
- Proficiency in query optimisation and schema design for relational and/or NoSQL databases.
- Experience tuning search queries, database queries, and cache layers for large-scale platforms.
- Familiarity with designing or supporting APIs for external consumers.
- Experience with cloud environments, preferably AWS, including services such as RDS, DynamoDB, S3, CloudFront, and Redis/ElastiCache.
- Understanding of data delivery patterns (batch, bulk export, delta updates, streaming) and optimising their access paths.
- Strong programming skills in at least one modern language (Python, Go, Ruby, etc.), particularly for data tooling and optimisation.
Collaboration & problem solving
- Work closely with architects, backend engineers, and product managers.
- Strong problem-solving skills with a pragmatic approach to balancing performance, complexity, and maintainability.
- Clear communicator, able to explain technical concepts to varied stakeholders.
- Flexible hybrid working culture, with opportunities for remote and in-person collaboration.
- 28 days annual leave plus bank holidays, with an extra day per year of service.
- Flexibility to work abroad for up to 4 weeks per year.
- Regular company socials.
- Discretionary leave for milestone life events (e.g., birthdays, weddings).
- Private healthcare, life assurance, and an annual wellbeing budget.
- Personal development budget and learning days.
- Cycle to work scheme.
- £500 home office set-up budget.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology, Engineering, and Analyst
Industries
Data Infrastructure and Analytics
Referrals increase your chances of interviewing at Cognify Search by 2x
- Location:
- London
- Job Type:
- FullTime
- Category:
- IT & Technology
We found some similar jobs based on your search
-
New Today
Senior Data Engineer (Part time)
-
Ealing
- IT & Technology
Job title Senior Data Engineer - Part time Location West London, UK | Flexible hybrid working Type Permanent or Contract (Outside IR35), part-time (2 days per week) Overview Our client is a clean tech start-up who are seeking a Senior Data Engin...
More Details -
-
New Today
Senior Data Engineer - Nigel Frank
-
United Kingdom
- IT & Technology
Overview Software Engineer - DAML Application Runtime (UK) Collaborate within Agile teams to refine and monitor data collection systems using Scala and Java. Apply sound engineering principles such as test-driven development and modular design. Resp...
More Details -
-
New Today
Data Engineer
-
London
- IT & Technology
This range is provided by Cognify Search. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Overview Cognify are hiring for a fast-growing B2B SaaS company that provides large-scale data solutions ...
More Details -
-
New Today
SC Cleared Data Engineer ( Informatica)
-
London
- IT & Technology
Overview Role: Data Engineer Job Type: Contract Day Rate: £400 per day (inside IR35) Duration: 6 Months + likely to extend Work Location: ideally commutable to London, Bristol, or Manchester office Please look for Security Cleared candidate. Ca...
More Details -
-
New Today
Data Engineer
-
London
- IT & Technology
Introduction Indulge your passion for problem-solving and embrace the thrill of addressing risk head-on at Gallagher's global brokerage team. Join a family of diverse minds, united by a relentless pursuit of excellence. As part of our team, you'll be...
More Details -
-
New Today
Data Analytics Engineer (BigQuery/dbt/AirFlow)
-
London
- IT & Technology
Overview Data Analytics Engineer (BigQuery/dbt/AirFlow) – 6 month contract. Onsite in London/Manchester offices 3 days per week. Outside IR35. Interviews w/c 15/09/25. UK-based applicants with own Ltd company. No sponsorship offered. Data Analytics ...
More Details -