Jobless Developer
Welo Global logo
Welo Global

Posted 20 days ago

Open

Creative Writing Generative AI Analyst - USA (Remote)

United StatesRemoteFull-time

AI Summary

Annotates and evaluates prompts, responses, and multimedia data for generative AI models, ensuring quality and adherence to guidelines across text, image, video, and multimodal content.

About this role

About the Role

We are hiring Creative Writing Generative AI Analysts in the United States to perform annotation efforts of multimedia and language data labeling and review work (e.g., video, images, and related metadata). This role focuses on annotation, data quality, prompt evaluation, and the creation of high-quality datasets used to train and improve generative AI models.

Project Details

  • Job Title: Creative Writing Generative AI Analyst
  • Location: Remote, USA
  • Hours: 40 hours per week
  • Employment Type: W2 Full-Time Employee
  • Pay Rate: $28.80/hour

What You’ll Do

  • Perform annotation and labeling tasks for generative AI datasets, including text, image, video, and multimodal content
  • Create, review, and evaluate prompts and responses across a variety of domains and use cases
  • Conduct quality assurance reviews to ensure annotation accuracy, consistency, and adherence to guidelines
  • Assist in developing and refining annotation guidelines and evaluation criteria
  • Support data collection, categorization, tagging, and evaluation workflows for machine learning systems
  • Identify edge cases, inconsistencies, and quality issues within datasets and model outputs
  • Collaborate with internal teams and external partners to improve annotation quality and operational efficiency
  • Provide feedback on workflows, tooling, and annotation processes
  • Requirements:

  • Native level proficiency English with excellent written and verbal communication skills.
  • Work Authorization is required for the role.
  • Strong attention to detail and ability to follow complex annotation guidelines
  • Interest in creative writing, generative AI, machine learning, and emerging AI technologies
  • Experience with data annotation, content evaluation, labeling operations, or quality review workflows preferred
  • Bachelor’s degree or equivalent practical experience
  • Ways to Stand Out from the Crowd

  • Familiarity with generative AI systems, large language models, RLHF, or multimodal AI workflows
  • Domain knowledge in Law/Medical/Math/Coding/etc is a plus
  • Bilingual proficiency is a plus (Korean, Japanese, Mandarin, Spanish, German, or French)
  • Experience annotating prompts, responses, images, video sequences, or other AI training data
  • QA/testing experience within AI, data operations, or content review environments
  • Experience working with evaluation rubrics, taxonomy development, or dataset quality initiatives
  • Python or scripting experience is a plus
  • Skills

    Content EvaluationData AnnotationData Collection WorkflowsData Quality AssuranceDataset TaggingEdge Case IdentificationEvaluation RubricsGenerative AI WorkflowsGuideline DevelopmentLabeling OperationsLanguage ModelsMetadata LabelingMultimodal DataPrompt EvaluationPython ScriptingQA For AI DatasetsQuality Review WorkflowsRLHFTaxonomy Development

    Explore related jobs

    Browse these categories