Jobless Developer
Welo Global logo

Posted 1 month ago

Open

Project Perseus | Data Quality Analyst - Multilingual (English + Additional Languages) - (Human-in-the-Loop AI)

CaliforniaOn-siteFull-time

AI Summary

Data Quality Analyst supporting DLA teams by auditing outputs, providing structured feedback, acting as first-line support, and helping onboard new annotators in a human-in-the-loop AI environment.

About this role

Project Details

  • Job Title: Data Quality Analyst

  • Hiring Locations: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston

  • Hours: Full-time, 40 hours per week

  • Employment Type: W2 Full-Time Employee

  • Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)

  • Pay Rate: $38/hour

  • Contract Duration: 1-year contract with possibility of extension

  • Location Policy: 100% onsite position — remote work is not available. To be considered, candidates must be located in or able to commute to one of the target cities listed above.

Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston. Please only apply if you meet this location requirement.

What You’ll Do

  • Support quality and execution across DLA teams, ensuring work meets defined standards at scale
  • Audit DLA outputs and provide structured, actionable feedback to improve accuracy and consistency
  • Act as the first line of support for DLAs — answering questions and helping interpret guidelines
  • Help DLAs navigate ambiguity and apply evolving instructions effectively
  • Support onboarding and training of new DLAs through hands-on guidance and coaching
  • Monitor workflows, queues, and blockers — escalating risks and gaps to Team Leads
  • Identify patterns, recurring issues, and edge cases in both human and model outputs
  • Participate in calibrations, team discussions, and stakeholder syncs
  • Contribute to improving guidelines, processes, and overall team performance
  • Document findings and feedback in a clear, concise, and actionable way
  • What We’re Looking For

  • Language Requirements: Fluency in English plus two or more additional languages:
  • Primary Language (Must have at least one): French, Italian, Spanish, or German.
  • Secondary Language (Must have at least one): French, Italian, Spanish, German, Hindi, Portuguese, Russian, Polish, Turkish, or Vietnamese.
    • University degree (Bachelor’s or higher)

    • 2–4 years of experience in data annotation, content quality, QA, or related fields

    • Strong ability to interpret and apply complex guidelines with consistency

    • Excellent attention to detail with a high bar for quality

    • Ability to stay consistent while working with evolving guidelines and priorities

    • Experience in AI/ML data workflows or human-in-the-loop evaluation environments

    • Prior experience auditing or reviewing the work of others

    • Familiarity with safety, compliance, or policy-driven content evaluation

  • Benefits

  • Paid Vacation: 6 days
  • Paid Company Holidays: 2 days (Memorial Day and Labor Day)
  • Paid Sick Leave: accrued per applicable state law and company policy
  • Medical, Dental, and Vision Insurance (eligibility applies)
  • Health Savings Account (HSA)
  • 401(k) Retirement Plan
  • Employee Assistance Program
  • Additional voluntary benefits (life, accident, critical illness, etc.)
  • Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
  • Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
  • Unique Campus Features: Some locations include roof-top nature parks
  • Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.
  • Skills

    AI/ML Data WorkflowsCalibrationContent QualityData AnnotationGuideline InterpretationHuman-in-the-loop EvaluationPolicy-driven Content EvaluationQASafety ComplianceWorkflow Monitoring

    Explore related jobs

    Browse these categories

    Market data for this role

    All reports →