Data Engineer
New Today
This range is provided by Cognify Search. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Overview
Cognify are hiring for a fast-growing B2B SaaS company that provides large-scale data solutions to businesses and organisations worldwide. The platform serves millions of users and handles complex, high-volume datasets across multiple regions. The company’s mission is to deliver fast, reliable, and high-quality data to customers through APIs, search, and other data delivery channels. To achieve this, they are seeking a talented engineer to optimise the performance, structure, and accessibility of their data platform.
Search & Data Platform Engineer
Cognify are looking for a Search & Data Platform Engineer to focus on performance, organisation, and optimisation of data across the company’s customer-facing platform. This role sits at the intersection of data engineering and platform engineering. The main focus is on how data is structured, indexed, cached, and delivered through APIs, search, and bulk/delta/streaming products, rather than building ingestion pipelines. The successful candidate will collaborate with platform and product teams to ensure fast, scalable, and developer-friendly data delivery, while improving the search and query experience across products.
Key responsibilities
- Optimise data delivery by designing and maintaining performant access layers for APIs, search, bulk/delta deliveries, and streaming services.
- Improve search systems and indexing strategies to ensure fast, accurate, and relevant results at scale.
- Structure and model datasets to balance usability, consistency, and performance.
- Implement multi-layered caching solutions (query caching, materialised views, edge/CDN caching, object storage pre-computation) to achieve consistently low-latency responses.
- Tune queries and indexes for high-throughput, low-latency data retrieval.
- Collaborate with architects and engineers to ensure consistency and efficiency across the data delivery stack.
- Design scalable and resilient solutions capable of handling large volumes and usage spikes without compromising reliability.
- Implement observability for search, caching, and queries to proactively identify and resolve bottlenecks.
- Ensure APIs and search systems are intuitive for developers, with clear contracts and predictable performance.
Technical expertise required
- Experience with search technologies such as Elasticsearch, OpenSearch, Solr, or similar.
- Proficiency in query optimisation and schema design for relational and/or NoSQL databases.
- Experience tuning search queries, database queries, and cache layers for large-scale platforms.
- Familiarity with designing or supporting APIs for external consumers.
- Experience with cloud environments, preferably AWS, including services such as RDS, DynamoDB, S3, CloudFront, and Redis/ElastiCache.
- Understanding of data delivery patterns (batch, bulk export, delta updates, streaming) and optimising their access paths.
- Strong programming skills in at least one modern language (Python, Go, Ruby, etc.), particularly for data tooling and optimisation.
Collaboration & problem solving
- Work closely with architects, backend engineers, and product managers.
- Strong problem-solving skills with a pragmatic approach to balancing performance, complexity, and maintainability.
- Clear communicator, able to explain technical concepts to varied stakeholders.
- Flexible hybrid working culture, with opportunities for remote and in-person collaboration.
- 28 days annual leave plus bank holidays, with an extra day per year of service.
- Flexibility to work abroad for up to 4 weeks per year.
- Regular company socials.
- Discretionary leave for milestone life events (e.g., birthdays, weddings).
- Private healthcare, life assurance, and an annual wellbeing budget.
- Personal development budget and learning days.
- Cycle to work scheme.
- £500 home office set-up budget.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology, Engineering, and Analyst
Industries
Data Infrastructure and Analytics
Referrals increase your chances of interviewing at Cognify Search by 2x
- Location:
- London, England, United Kingdom
- Salary:
- £100,000 - £125,000
- Job Type:
- FullTime
- Category:
- IT & Technology
We found some similar jobs based on your search
-
New Today
REMOTE Python Software/Data Engineer - Hybrid working - Up to £160,000 Base (+ Bonus)
-
Liverpool
- IT & Technology
Overview REMOTE Python Software/Data Engineer — Up to £160,000 Base (+ Bonus). Location: REMOTE. Responsibilities Design, develop, and maintain scalable applications using Python to support data ingestion, transformation, and visualization pipelin...
More Details -
-
New Today
REMOTE Python Software/Data Engineer - Hybrid working - Up to £160,000 Base (+ Bonus)
-
Cambridge
- IT & Technology
Overview REMOTE Python Software/Data Engineer — Up to £160,000 Base (+ Bonus). Location: REMOTE. Responsibilities Design, develop, and maintain scalable applications using Python to support data ingestion, transformation, and visualization pipelin...
More Details -
-
New Today
Data Scientist / ML Engineer (Healthtech)
-
Basingstoke
- IT & Technology
Overview Title: Senior / Data Scientist (AI/ML – Healthtech) Location: UK / Ireland (Remote with occasional travel) Salary: £48k–£60k DOE + potential equity for business-wide contribution About the Role We are an award-winning femtech startup wi...
More Details -
-
New Today
Senior Software Engineer - Data Platform Emulators
-
East Horsley
- IT & Technology
Senior Software Engineer - Data Platform Emulators We are seeking a Senior Software Engineer to join our team working on Data Platform Emulators. This role involves developing and maintaining emulators for data platforms such as Snowflake, Redshift, ...
More Details -
-
New Today
Staff/Lead Fullstack Engineer (Data Structures Expert)
-
East Horsley
- IT & Technology
Overview Staff/Lead Fullstack Engineer (Data Structures Expert) at Mimica Mimica's mission is to empower enterprises, teams, and individuals to reclaim their most precious resource — time and work more efficiently, with greater purpose and impact....
More Details -
-
New Today
Databricks Data Engineer
-
Portsmouth
- IT & Technology
Overview Data Engineer with expertise in Azure, SQL and Databricks required by a global client. Due to continued workload growth, the team is expanding with an experienced Data Engineer. Minimum 5 years of experience as a Data Engineer with at least...
More Details -