Research Engineer, QC Automation

About the Role

Join an early-stage AI evaluation infrastructure startup as a Research Engineer focused on quality control automation. You will help build systems that make high-quality training data more scalable, combining careful human judgment with reliable measurement and automation.

What You'll Do

• Build and improve quality control systems for training data created within reinforcement learning environments.

• Define quality standards and design experiments and metrics to assess agent outputs.

• Develop auditing approaches, including sampling strategies and rule-based or model-assisted validation pipelines.

• Work with data vendors to diagnose quality issues, understand agent failure modes, and improve data generation processes.

• Turn quality control findings into improvements to internal infrastructure and vendor-facing tools.

What We're Looking For

• Two to four years of experience in a research engineering or similar role, including hands-on work in quality control automation.

• Proficiency with Python, Docker, and Linux, plus experience building scalable data validation and automated QA/QC systems end to end.

• Experience with benchmarks and evaluations for reinforcement learning training data, including realistic tasks, reliable rubrics, and useful training trajectories.

• Ability to define and measure training data quality, and to build quality control systems grounded in human judgment rather than heavy reliance on large language models.

• Knowledge of statistics and experience designing metrics, experiments, and quality assurance processes.

• Strong communication skills, curiosity, and the ability to make progress independently in ambiguous, fast-moving environments.

Compensation & Benefits

Annual salary range: $100,000 to $170,000 USD. Visa sponsorship is available.

Location

On-site in Singapore. Fully remote independent contractor arrangements may be considered for candidates based elsewhere, particularly in Europe.