Mid-Level Research Engineer, QC Automation
AI Summary
Builds automated quality control systems for AI training data, defining standards and designing experiments to assess agent outputs.
About this role
About the Role
Join an engineering team building infrastructure for AI reinforcement learning and evaluation. In this role, you will own quality control automation for training data, developing systems that help maintain high standards as data needs grow.
What You'll Do
Build automated quality control systems grounded in human judgment and a strong understanding of data, rather than relying heavily on large language models.
Define and enforce quality standards for training data.
Design experiments and metrics to assess agent outputs.
Work with data vendors to investigate quality issues, diagnose agent failure modes, and improve data generation processes.
Turn quality control findings into sampling strategies and rule-based or model-assisted validation pipelines.
Improve infrastructure tools and vendor workflows to reduce anomalies, inconsistencies, and edge cases.
What We're Looking For
Two to four years of experience in research engineering or a similar role focused on quality control automation.
Proficiency with Python, Docker, and Linux.
Experience building scalable data validation pipelines and end-to-end automated QA or QC systems.
Background in benchmarks and evaluations for reinforcement learning data, including task design, reliable rubrics, and useful training trajectories.
Experience measuring training data quality, designing experiments and metrics, and creating quality control processes.
Strong statistical understanding, communication skills, curiosity, and comfort working independently in unstructured, fast-paced environments.
Compensation & Benefits
Annual salary: $100,000 to $170,000 USD. Visa sponsorship is available.
Location
On-site in Singapore, Singapore.
Skills
Explore related jobs
More jobs at Clera
Similar Benchmarks And Evaluations jobs
Jobs in Singapore
- A
Client Partner Lead - Spotify AdsAleph · Singapore - E
Sr. Business Development Manager – Utilities & Telecom (APAC)Esri · Singapore, SG - F
Senior Tax Analyst- AsiaFirmus Technologies · Singapore - V
Senior Software EngineerVenti Technologies · Singapore - ABusiness Analyst (Managed Services)AvePoint · Singapore
- WAssistant Customer Care Manager, APACWabtec · Singapore, SG
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.
