Generative Audio Evaluation - Arabic (Saudi Arabia)

We’re currently hiring AI Generalists to join a highly specialized evaluation project focused on testing and assessing the performance of a cutting-edge generative audio model. Your work will play an important role in identifying performance issues and providing feedback that can help improve the model.

What You’ll Be Doing

You will evaluate AI-generated audio for short video and text-to-audio tasks, following detailed project guidelines. Your main responsibilities will include:

• Audio Quality & Naturalness: Assess speech, background music, and sound effects for clarity, quality, and naturalness.
• Audio-Video Alignment: Evaluate synchronization between the generated audio and video, including lip-sync and timing.
• Caption Compliance: Check whether the generated audio accurately follows the provided text captions and task requirements.
• Voice Quality: Evaluate whether generated voices sound natural and, where applicable, match the reference audio.
• Evaluation & Feedback: Assign accurate scores and identify issues according to the provided evaluation guidelines.

What We’re Looking For

• Native-level fluency in Arabic (Saudi Arabia)
• Strong attention to detail and excellent listening skills
• Ability to follow detailed evaluation guidelines consistently
• Good understanding of spoken language, audio quality, and context
• Reliable equipment — high-quality headphones are required
• Ability to complete the evaluation test within 48 hours of receiving the assignment

1. Application (You are here!)
2. Screening Survey
3. Language Knowledge Assessments
4. Target Language
5. English
6. RWS Vendor Onboarding
7. Internal Testing
8. Project-specific testing will be required, such as TTS Evaluation, Audio Evaluation, or Transcription Testing.