
Posted 1 month ago
AI Quality & Evaluation Engineer, AI product
AI Summary
The AI Quality & Evaluation Engineer defines quality dimensions for AI products, designs and automates evaluation workflows, and builds feedback loops with MLOps and development teams to improve product quality.
About this role
TEAM
Toyota is redefining what it means to move. We're challenging the current state of mobility by enhancing the movement of people, goods, information and energy. Centered around three core concepts - A Living Laboratory™, Human-Centered, and Ever Evolving City™ - Woven City serves as a test course for mobility to fulfill our purpose of well-being for all.
We do this by bringing together a diverse community of people with a shared passion for the future of mobility to co-create, develop and refine innovative products and services. This cross-section of social infrastructure, mobility, and people provides a unique opportunity for inventors, residents and visitors to interact seamlessly with new technologies throughout daily life in an environment that emulates a real city.
For more information about Woven City, please visit: https://www.woven-city.global/
WHO ARE WE LOOKING FOR?
We are looking for the first dedicated QA Engineer for our AI products—someone who understands and embraces the uncertainty and non-deterministic nature of LLM-based systems, and who is interested not only in testing quality, but in making quality work as a sustainable system.
In this role, you will go beyond executing individual test cases. A key mission is to standardize and automate evaluation workflows so that user feedback and evaluation results continuously feed into product quality improvements. You will work closely not only with product development teams, but also with MLOps and data engineers, bringing a QA perspective to redesign, implement, and operate the entire feedback loop.
In particular, we expect you to take ownership of building the first practical quality feedback loop led by QA, even in situations where feedback from real users is limited or not yet sufficiently established.
This position reports to the function leader and offers a hybrid work arrangement. Additionally, there are business trips to Woven-City several times a month.
RESPONSIBILITIES
MINIMUM QUALIFICATIONS
NICE TO HAVES
Skills
Explore related jobs
More jobs at Woven by Toyota
Similar Japanese jobs
Jobs in Tokyo
Product Lead - Finance Super App (Japan)Bjak · Tokyo, Japan
Product Manager - Finance Super App (Japan)Bjak · Tokyo, Japan
Product Owner - Finance Super App (Japan)Bjak · Tokyo, Japan
ProducerMegalisVFX · Tokyo, Japan
Japan Omnichannel Marketing LeadSony Interactive Entertainment Inc. · Japan, Tokyo- MR(医薬情報担当者)/関節リウマチ領域 ※NP*(全国)Abbvie · Minato City, Tokyo