Jobless Developer
Clera logo

Posted today

Technical Program ManagerClera

Technical Program Manager

United StatesOn-siteFull-time$130k–$225k

AI Summary

Owns complex, time-sensitive data and evaluation programs for AI research teams, coordinating requirements, vendors, quality assurance and delivery to improve model and agent evaluation. Turns ambiguous requests into specified, milestone-driven programs.

About this role

About the Role

Own complex, time-sensitive data and evaluation programs for AI research teams and internal partners. This role combines technical program management, data operations, and vendor coordination to turn evolving requirements into reliable programs that improve model and agent evaluation.

What You'll Do

  • Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospective.

  • Turn ambiguous requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.

  • Improve data quality procedures using quantitative signals and qualitative inspection, including analysis of task coverage, difficulty, and reward distributions.

  • Manage external vendors throughout delivery and scale dependable delivery pipelines.

  • Improve production workflows, documentation, automation, and cross-functional handoffs.

  • Partner with research, platform, and marketplace teams to turn findings into product improvements.

What We're Looking For

  • At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, or a similarly cross-functional environment.

  • Experience delivering projects as a technical program manager or similar role at a startup, with the ability to bring structure to ambiguity and work independently.

  • Hands-on familiarity with RLHF, reinforcement-learning environments, agent evaluation, human-in-the-loop data pipelines, annotation workflows, or expert data collection.

  • Experience managing external vendors and scaling delivery pipelines.

  • Strong quantitative and qualitative judgment, including the ability to assess data quality and representativeness through metrics and individual examples.

  • Experience supporting research teams, AI labs, or technical enterprise customers with urgent, changing requirements, paired with clear written and verbal communication.

Compensation & Benefits

Base salary range: $130,000 to $225,000 annually. Visa sponsorship is available.

Location

On-site or remote. Primary location: United States. Remote candidates should be able to maintain 70% to 80% time zone overlap with San Francisco or Singapore.

Skills

Agent EvaluationAnnotation WorkflowsData Quality AssessmentDocumentationExpert Data CollectionHuman-in-the-loop Data PipelinesProduction Workflow AutomationQualitative InspectionQuantitative AnalysisReinforcement Learning EnvironmentsReward Distribution AnalysisRLHFTechnical Program ManagementVendor Management

Explore related jobs

Browse these categories

Market data for this role

All reports →