AI Summary

Annotates and evaluates multimodal AI datasets, creates and reviews prompts and responses, and ensures data quality for training generative AI models. Works with internal teams to improve annotation workflows and guidelines.

About this role

About the Role

We are hiring Creative Writing Generative AI Analysts in the United States to perform annotation efforts of multimedia and language data labeling and review work (e.g., video, images, and related metadata). This role focuses on annotation, data quality, prompt evaluation, and the creation of high-quality datasets used to train and improve generative AI models.

Project Details

Job Title: Creative Writing Generative AI Analyst
Location: Remote with the option to work onsite in Santa Clara, CA area.
Hours: 40 hours per week
Employment Type: W2 Full-Time Employee
Pay Rate: $38/hour

What You’ll Do

Perform annotation and labeling tasks for generative AI datasets, including text, image, video, and multimodal content

Create, review, and evaluate prompts and responses across a variety of domains and use cases

Conduct quality assurance reviews to ensure annotation accuracy, consistency, and adherence to guidelines

Assist in developing and refining annotation guidelines and evaluation criteria

Support data collection, categorization, tagging, and evaluation workflows for machine learning systems

Identify edge cases, inconsistencies, and quality issues within datasets and model outputs

Collaborate with internal teams and external partners to improve annotation quality and operational efficiency

Provide feedback on workflows, tooling, and annotation processes

Requirements:

Native level proficiency English with excellent written and verbal communication skills.

Work Authorization is required for the role.

Strong attention to detail and ability to follow complex annotation guidelines

Interest in creative writing, generative AI, machine learning, and emerging AI technologies

Experience with data annotation, content evaluation, labeling operations, or quality review workflows preferred

Bachelor’s degree or equivalent practical experience

Ways to Stand Out from the Crowd

Familiarity with generative AI systems, large language models, RLHF, or multimodal AI workflows

Domain knowledge in Law/Medical/Math/Coding/etc is a plus

Bilingual proficiency is a plus (Korean, Japanese, Mandarin, Spanish, German, or French)

Experience annotating prompts, responses, images, video sequences, or other AI training data

QA/testing experience within AI, data operations, or content review environments

Experience working with evaluation rubrics, taxonomy development, or dataset quality initiatives

Python or scripting experience is a plus

Skills

Data AnnotationDataset CurationEvaluation RubricsMultimodal Data LabelingPrompt EvaluationPython Or Scripting (plus)Quality AssuranceTaxonomy Development

Creative Writing Generative AI Analyst - California

About this role

About the Role

Project Details

What You’ll Do

Requirements:

Ways to Stand Out from the Crowd

Skills

Explore related jobs

More jobs at Welo Global

Similar Data Annotation jobs

Browse these categories