Senior Test Automation Engineer - Data & AI Team

• Own and evolve the test automation strategy for the Data & AI platform — unit, integration, contract, regression, and end-to-end — designing, building, and maintaining automated frameworks and suites integrated into CI/CD pipelines.
• Validate end-to-end business processes within sandboxed Miles environments, ensuring correctness, reliability, and safe failure handling.
• Develop API and contract testing approaches for distributed services and integrations.

• Design and own evaluation approaches for AI-powered and agentic capabilities where outcomes are probabilistic rather than pass/fail: LLM-as-a-judge setups, baseline/benchmark datasets, and process/quality metrics for agent behavior.
• Establish baselines and regression tracking for model and agent output quality over time, this alongside the deterministic CI gates.

• Collaborate across engineering domains to ensure platform-wide quality and release confidence.
• Drive continuous improvement in test automation practices and tooling, and act as a mentor and quality advocate, helping teams adopt effective automated testing approaches.

• Test automation engineering: unit/integration/e2e frameworks, CI/CD integration
• Testing APIs, backend services, microservices, and distributed systems
• Programming in Java and/or Python, including typed schemas, mocking, and test-data setup/teardown
• Designing scalable automation frameworks from the ground up, and coaching others in their adoption
• Non-deterministic / AI evaluation testing: LLM-as-a-judge, benchmarking, quality metrics for agentic systems (plus)
• Workflow orchestration platforms, cloud-native applications, and LLM/agentic systems (plus)
• Tooling such as Playwright, Kubernetes, and modern DevOps practices (advantage)

What's in it for you…

• Competitive salary package.
• Meal allowance provided per working day.
• Fully covered private health insurance, so you can focus on what matters most.
• Hybrid working and flexible hours, giving you the freedom to shape your workday.
• A modern co-working space offering a comfortable working environment.
• A structured onboarding program from day one, with a dedicated coach to help you get up to speed and grow in your role.
• Regular opportunities to connect beyond day-to-day work — casual drinks, team activities, and company-wide events.

Ready to build the secure and deterministic capabilities behind the next generation of mobility software? Join SOFICO and let's shape what's next together!