
Posted today
Technical Program Manager
AI Summary
Owns complex, time-sensitive data and evaluation programs for AI research teams, coordinating requirements, vendors, quality assurance and delivery to improve model and agent evaluation. Turns ambiguous requests into specified, milestone-driven programs.
About this role
About the Role
Own complex, time-sensitive data and evaluation programs for AI research teams and internal partners. This role combines technical program management, data operations, and vendor coordination to turn evolving requirements into reliable programs that improve model and agent evaluation.
What You'll Do
Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospective.
Turn ambiguous requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.
Improve data quality procedures using quantitative signals and qualitative inspection, including analysis of task coverage, difficulty, and reward distributions.
Manage external vendors throughout delivery and scale dependable delivery pipelines.
Improve production workflows, documentation, automation, and cross-functional handoffs.
Partner with research, platform, and marketplace teams to turn findings into product improvements.
What We're Looking For
At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, or a similarly cross-functional environment.
Experience delivering projects as a technical program manager or similar role at a startup, with the ability to bring structure to ambiguity and work independently.
Hands-on familiarity with RLHF, reinforcement-learning environments, agent evaluation, human-in-the-loop data pipelines, annotation workflows, or expert data collection.
Experience managing external vendors and scaling delivery pipelines.
Strong quantitative and qualitative judgment, including the ability to assess data quality and representativeness through metrics and individual examples.
Experience supporting research teams, AI labs, or technical enterprise customers with urgent, changing requirements, paired with clear written and verbal communication.
Compensation & Benefits
Base salary range: $130,000 to $225,000 annually. Visa sponsorship is available.
Location
On-site or remote. Primary location: United States. Remote candidates should be able to maintain 70% to 80% time zone overlap with San Francisco or Singapore.
Skills
Explore related jobs
More jobs at Clera
Similar Agent Evaluation jobs
- A
AI Agent EvaluatorAnyone AI · Argentina - Fully Remote - C
AI Agent Evaluation EngineerCresta · Canada (Remote) - G
Software Engineering Director, Agentic EvaluationsG2 · Remote (US) - Z
Director, Enterprise Quality Engineering and Agentic EvaluationZayo Group LLC · United States - B
Applied Scientist, Agent Evaluation & Adaptive Model RoutingBitdeer Technologies Group · Singapore, Singapore - A
Senior Technical Product Manager – Agent Evaluation & ObservabilityAmerican Express · New York, NY
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.