
Posted 4 months ago
AI Data Quality Specialist - English (Philippines)
PhilippinesRemoteFull-time
AI Summary
Reviews English-language content to assess sentiment accuracy, factual consistency, and reasoning quality for LLM evaluation. Applies structured guidelines to label and validate model outputs.
About this role
Contract Type: Freelance
Language: English (Philippines)
About the Role
We are seeking a detail-oriented AI Data Quality & Annotation Specialist to help develop and evaluate large language models (LLMs). Your role will involve reviewing English language content to assess sentiment accuracy, factual consistency, and reasoning quality using structured guidelines. This position is ideal for individuals with sharp analytical skills, attention to detail, and the ability to consistently apply labeling standards.
What You Will Do:
- Review and label content for sentiment, factual accuracy, and reasoning issues.
- Evaluate model outputs across quality dimensions using scoring frameworks.
- Validate automated assessments and identify discrepancies or errors.
Requirements:
Skills
AI TrainingData AnnotationEvaluation FrameworksFactual ConsistencyLLMsReasoning QualitySentiment AnalysisStructured Guidelines
Explore related jobs
More jobs at Welo Global
Expert Rater Project - Dutch (Netherlands)Netherlands
Hydrus -Voice Contributor — English (US)Remote
Hydrus -Voice Contributor — German (Germany)Germany
Hydrus -Voice Contributor— Spanish (Mexico)Mexico
Hydrus- Voice Recording Contributor French (Quebec)Quebec City, Canada
Hydrus -Voice Contributor— Spanish (Latin America) - ArgentinaArgentina