Software Engineer

New Yesterday

Job Description

Job Title: Software Engineer

Job Duration: 3-Months

Location: London, UK(3 days onsite)



Description

Looking for a data engineer / software engineer that would support data onboarding and filtering effort in a project on LLM agents for research. The engineer will onboard data and run filtering on text, image and video datasets leveraged by FAIR research teams. The goal is to proactively mitigate potential risks associated with these datasets.

Example tasks:

Preprocessing: converting original datasets into a format that can be consumed by filtering pipelines.

Filtering: Data cleaning, improvement and running filtering using Meta pipelines.

Post-processing: consuming filtering results to filter videos/images in the original datasets, repackaging, and re-ingestion.

Technical skills: Experience building and maintaining data pipelines, knowledge of data storage solutions;

Data Management: Data preprocessing and cleaning, transformation and formatting, data quality control and validation

Communication - effective communication skills to collaborate with stakeholders and team members

Software engineering skills: Python, data pipelines.

Apply
Location:
City Of London
Category:
Technology

We found some similar jobs based on your search