Posted today
Software Engineer
AI Summary
Creates reinforcement learning environments for AI models by building reproducible coding tasks from real repositories, including reference solutions and deterministic verifiers. Remote contract work paid per approved task.
About this role
Opportunity Snapshot
- Pay: $50–100
- Time per task: 5 hours for trainers and 1.5 hours for reviewers
- Engagement: Project-based — paid per approved task
- Commitment: ~15 hours per week
- Location: Fully remote
- You’ll need: Hands-on expertise in at least one of Python, Java, Rust, Go, C++, or TypeScript
- Your tasks: Build challenging coding problems from real repositories, with reproducible environments and verifiers
- Role Title: Software Engineer
- Role Type: Contractor (~15 hrs a week)
- Location: Remote
You’ll create Reinforcement Learning Environments that test a model’s ability to solve real software engineering problems: tracking down subtle bugs, building non-trivial features, refactoring, and optimizing performance. Each task means defining the problem, building a reproducible environment, and writing a reference solution.
Scope of Work
- Create realistic, challenging coding tasks for frontier AI models, drawn from repositories you know well.
- Design problems that require real engineering skill — subtle bugs, non-trivial features, meaningful performance work — not lookup or boilerplate.
- Build a reproducible environment for each task.
- Write deterministic verifiers that accept correct solutions across different valid implementations, while rejecting incorrect, incomplete, or hard-coded approaches.
- Provide a reference solution showing how the task can be solved.
- Flag tasks that turn out to be ambiguous or unverifiable rather than submitting them.
Preferred Qualifications
- Significant hands-on expertise in at least one of: Python3, Java, Rust, Go, C++, or TypeScript.
- Deep understanding of algorithms, data structures, and software engineering principles.
- Proven ability to debug complex systems, resolve bugs, and deliver effective optimizations.
- Experience with large codebase refactoring and legacy system modernization.
- Track record of delivering high-impact features from conception through delivery.
- Strong documentation and communication skills to articulate technical concepts clearly.
- Interest in AI and its technical challenges — previous AI experience not required.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required may vary depending on your experience and workflow.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
How the selection process works
- Apply and complete the screening questions
- Complete the AI interview for this role — it’s how your expertise gets in front of the client
- Profile review
- Onboarding — our Talent Ops team will get you set up
A very attractive and competitive package is offered.
Skills
Explore related jobs
More jobs at Evb
Similar Reference Solutions jobs
- D
Senior Algorithm Engineer - Sensing AlgorithmsDexCom Inc · Remote California - K
Algorithm EngineerKi · London, England - IAlgorithm ArchitectInvisix · Eindhoven, Noord-Brabant
- VAlgorithm ResearcherVia · London
- B
Algorithm EngineerBeacon Biosignals · Boston, MA / Remote - C
Algorithm EngineerCompal USA · Timișoara, Romania
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.