AI Data Annotation Specialist (human)

Your Mission & Challenges

As an AI Data Annotation Specialist, you will operate at the intersection of data ingestion, annotation workflow design, and machine learning — with a strong focus on building training datasets for multimodal foundation models that connect perception, language, and robot action. Your primary responsibility is to design and maintain scalable workflows for automated and human-in-the-loop annotation, ensuring that datasets are properly labeled, curated, validated, and formatted for efficient model training and evaluation.

You play a critical role in enabling high-quality embodied AI systems by transforming raw multimodal robot data into structured, reliable, and semantically rich training datasets.

• Design, build, and maintain pipelines for automated, semi-automated, and human-in-the-loop data annotation, with a focus on subtask labeling for long-horizon robot demonstrations

• Develop annotation workflows for language-grounded robot learning and Visual Question Answering (VQA) datasets, including instruction generation, subtask decomposition, and grounding of natural language in visual and action data

• Ingest and integrate multimodal data (video, depth, proprioception, gripper states, language instructions) into structured annotation workflows

• Apply pre-labeling techniques using foundation models (e.g., vision-language models, LLMs) to accelerate annotation and reduce manual effort

• Define and implement data quality checks: inter-annotator agreement, label consistency, coverage analysis, and detection of annotation drift

• Drive data curation initiatives: dataset balancing, deduplication, failure-case mining, task diversity analysis, and targeted collection to close capability gaps

• Identify and resolve data quality issues, labeling inconsistencies, distributional biases, and gaps in task/skill coverage

What We Can Look Forward To

• Degree in Computer Science, Data Science, Engineering, or a related field

• 4+ years of experience in machine learning operations, AI, or software engineering

• Hands-on experience with data annotation tools and labeling workflows (e.g., Encord, CVAT, Label Studio, or comparable platforms)

• Experience with subtask annotation, ontology/taxonomy design, and VQA-style labelling

• Familiarity with robotics dataset formats and multimodal data structuring (e.g., LeRobot, RLDS, Open X-Embodiment)

• Experience with cloud platforms (AWS, GCP, Azure) is a plus

• Experience writing annotation guidelines / taxonomies (pairs with the responsibility above)

• Familiarity with VLMs/LLMs for auto-labeling (e.g. open-vocabulary detectors, Gemini/GPT-class models)

• Data engineering basics — comfortable with large-scale/streaming data and formats like ROS bags/MCAP, plus S3-style object storage

• Experience building backend services and tooling (e.g. Node.js/TypeScript, REST APIs) to integrate annotation platforms with internal data infrastructure

• Nice-to-have: direct exposure to embodied AI / teleoperation data