
Posted today
Senior Python Engineer (Performance Benchmarking Automation)Softeq · Vilnius
Senior Python Engineer (Performance Benchmarking Automation)
Vilnius, WarsawOn-site
AI Summary
Builds and maintains Python automation for performance benchmarking of games and professional applications on remote hardware, owning the core framework and cross-platform tooling. Also mentors engineers and works directly with the customer's engineering teams.
About this role
About the project
We build and develop an automation platform that a major hardware vendor uses to measure the performance, power efficiency and battery life of its CPUs and GPUs. Its results feed into hardware and driver development and product comparisons, so they have to be accurate, repeatable and comparable across devices, drivers and software versions.
The platform runs hundreds of workloads, from the latest AAA games to professional content creation tools and industry-standard benchmarks. Everything runs fully unattended on a large lab of machines covering several operating systems and hardware architectures, from desktops and laptops to handheld gaming devices. Each workload sets up its environment from scratch, configures the application, runs the benchmark scenario and delivers the results with no one at the keyboard.
The engineering challenge is reliability at scale. Games and applications update constantly, many have no automation API, and every run has to produce a trustworthy number. The core of the platform is an in-house Python framework. The team grows it and the cross-platform tooling around it, and makes a lot of the technical decisions on the project itself.
What you will do
We build and develop an automation platform that a major hardware vendor uses to measure the performance, power efficiency and battery life of its CPUs and GPUs. Its results feed into hardware and driver development and product comparisons, so they have to be accurate, repeatable and comparable across devices, drivers and software versions.
The platform runs hundreds of workloads, from the latest AAA games to professional content creation tools and industry-standard benchmarks. Everything runs fully unattended on a large lab of machines covering several operating systems and hardware architectures, from desktops and laptops to handheld gaming devices. Each workload sets up its environment from scratch, configures the application, runs the benchmark scenario and delivers the results with no one at the keyboard.
The engineering challenge is reliability at scale. Games and applications update constantly, many have no automation API, and every run has to produce a trustworthy number. The core of the platform is an in-house Python framework. The team grows it and the cross-platform tooling around it, and makes a lot of the technical decisions on the project itself.
What you will do
- Build and maintain benchmark workloads for games and professional applications, from installation and configuration to running the benchmark and collecting results
- Develop the core framework and shared cross-platform tooling
- Automate applications that offer no API, using screen recognition and input emulation
- Investigate failed or inconsistent runs on remote hardware and make the automation more resilient
- Maintain CI/CD pipelines and keep the codebase well covered with unit tests
- Review code, set technical direction and mentor other engineers
- Work directly with the customer’s engineering teams on requirements, estimates and solutions
Tech stack
- Python 3.13+, uv, ruff, pytest, mypy
- Windows (Win32 API, PowerShell), Linux (Bash, SteamOS, Proton), macOS
- OpenCV, OCR, input emulation, Selenium
- Performance capture tools (PresentMon, MangoHud)
- Azure DevOps, Artifactory, Git
- Some C#/.NET
Requirements
- 5+ years of commercial Python development
- Experience designing and maintaining a framework or shared library that other developers build on
- Good system-level knowledge of Windows and at least one of Linux or macOS
- Experience building software that runs unattended and recovers cleanly from failures
- Ability to debug issues remotely from logs, screenshots and run artifacts
- Clean, typed code and solid unit testing practices
- Experience with CI/CD and Git workflows
- Ownership mindset and direct communication with the customer
- English at Upper-Intermediate level or higher
Nice to have
- Desktop or web UI automation experience (Selenium, Playwright, pywinauto or similar)
- Basic image processing with OpenCV or a similar library
- Working knowledge of another language, such as C#, C++ or Go
- Experience with cloud services or infrastructure automation
- Experience on a customer-facing or outsourcing project
- Interest in PC hardware, gaming or performance
Skills
ArtifactoryAzure DevOpsBashCI/CDC#/.NETGitLinuxMacOSMangoHudMyPyOCROpenCVPowerShellPresentMonPytestPythonRuffSeleniumUVWin32 APIWindows
Explore related jobs
More jobs at Softeq
Similar Python jobs
- DSystemintegrator*in ArtifactoryDeutsche Rentenversicherung Bund · Berlin, Germany
- DSpezialist*in ArtifactoryDeutsche Rentenversicherung Bund · Berlin, Germany
- M
Développeur Artifactory & GitLab (DevOps)Metaline · Bordeaux, France - PSenior Platform Engineer – GitLab & JFrog ArtifactoryPPI AG · Hamburg, Germany
- A
Ingenieur DevOps – Admin JFrog Artifactory, GitHub & SonarAneo · BOULOGNE BILLANCOURT, Île-de-France - A
Software Librarian / Odyssey SMEAlpha Technologies Inc USA · Wrocław, Lower Silesian Voivodeship
Jobs in Vilnius
- G
Nekilnojamojo turto vystymo projektų vadovas (-ė)GetJet Airlines · Vilnius, Business Garden - C
Product Designer (B2B / AI Products)Cybercare · Vilnius - H
Senior Software Engineer & Team LeadHomeToGo Group Talent Acquisition · Vilnius - B
QA EngineerBITĖ Lietuva · Vilnius, Lithuania - O
Product Manager, Forms TeamOmnisend · Vilnius, Lithuania - T
Full-stack Software EngineerTwoday Lithuania · Vilnius, Lithuania
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.