AI Summary

Senior QA Engineer focusing on AI/LLM products. Designs end-to-end testing strategies for LLM-based consumer products, verifies model outputs, and builds automated QA tooling.

About this role

Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by 300+ million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.

Responsibilities:

AI / LLM application quality assurance

Design and execute end-to-end testing strategies for LLM-based consumer products (functionality, data, model behavior)

Verify the correctness, consistency, stability, and safety of LLM outputs

Regression testing and risk assessment for model updates / prompt iterations / data changes

Automation and tooling capabilities

Design and develop automated testing and QA tools to improve testing efficiency and coverage

Use or introduce AI technologies (such as LLM) to enhance test design, defect analysis, and test case generation capabilities

Requirements:

Bachelor or Master in computer science, computer engineering or related area.

At least 3+ years of software QA engineering experiences.

Full cycle testing with test planning and both manual/automation execution.

Solid Java coding skills, and experienced in automation or QA tools development.

Good understanding in AI applications and LLM prompt engineering techniques. Experiences in LLM development or eval is a plus.

Excellent self-driven and ownership with good deliverables.

Eager to learn, be curious about AI and new technologies of LLM.

Good communication and collaboration skills.

Skills

AI ToolingAutomationAutomation ScriptingCI/CDData TestingDefect AnalysisJavaJenkinsJUnitLLM TestingManual TestingMavenModel EvaluationPrompt EngineeringPythonQA ToolingRegression TestingSeleniumTest Case GenerationTest DesignTest Planning

Senior QA Engineer - AI/LLM

About this role

Responsibilities:

Requirements:

Skills

Explore related jobs

More jobs at Binance

Similar AI Tooling jobs

Browse these categories