
Posted 10 days ago
Research Engineer
AI Summary
Builds evaluation frameworks, datasets and metrics to measure AI agent performance on real tasks, runs experiments comparing models and tooling, and contributes engineering work to production agents such as Aria.
About this role
The role
Gauntlet is looking for an AI Research Engineer to help improve how we build, evaluate and use AI agents across the business.
We already have agents running in production, including Aria, our in-house generalist agent. They're used across research, engineering and business workflows, and we've learned a lot from seeing how they perform in practice. Some tasks work extremely well; others produce inconsistent results, and changes to models or tooling can introduce unexpected problems. Today, much of that feedback is still subjective. We want to build a more systematic way of understanding what works, what doesn't and why.
A major part of this role will be building the evaluation frameworks that allow us to measure agent performance on real tasks. You'll work with our engineers, quantitative researchers and other teams to understand where agents struggle, turn those observations into measurable experiments, and use the results to improve the systems we're building.
You'll also contribute directly to our existing agents and internal tooling. Initially, the work will be more engineering-focused as you get familiar with our systems, shipping improvements and integrations that teams can use. Over time, you'll take on more open-ended research, helping us develop better approaches to evaluation, agent behaviour and infrastructure.
We're also thinking beyond individual agents. One of our longer-term goals is to build a shared system of knowledge and reusable skills that our agents can draw from and improve over time. You'll play an important role in developing that infrastructure and how we evaluate its effectiveness.
This is an applied research role with a meaningful engineering component. We're looking for someone who enjoys investigating difficult problems, can design good experiments and is comfortable building and shipping the solutions that come out of them.
About Gauntlet
Gauntlet builds the financial systems of the future. While much of onchain finance is focused on point solutions, we operate across the entire stack to offer best-in-class vault products. Today we serve over $1.7B in client TVL across some of the largest fintechs/neobanks, protocols, exchanges, and capital allocators in crypto - and, increasingly, traditional asset management. Our team brings together traditional finance and crypto-native expertise to deliver durable, sophisticated products for institutional clients moving onchain.
Why this role is different
This is an opportunity to work at the intersection of AI, quantitative research and DeFi, tackling problems where advances in AI can have a direct impact on financial markets and onchain strategies.
You'll go beyond building individual agents, helping define how they're evaluated, how they learn from real-world tasks and how their capabilities scale across the business. With few established benchmarks in this space, you'll have the freedom to explore new approaches and take your ideas from research through to production, working directly with the teams putting them to use.
What you'll do;
What we're looking for;
Nice to have;
You don't need prior experience in crypto or DeFi. Strong research and engineering fundamentals matter more, and you'll work closely with people across Gauntlet who understand the financial systems and strategies our agents support.
We expect strong candidates to have experience working in a professional engineering or research environment, but we're more interested in what you've built and how you approach problems than a specific number of years on your CV.Benefits & Perks;
-
Remote first — work from anywhere in the United States
-
Regular in-person company retreats and cross-country "office visit" perk
-
100% paid medical, dental, and vision premiums for employees
-
$1,000 WFH stipend
-
Monthly reimbursement for home internet, phone, and cellular data
-
Unlimited vacation
-
100% paid parental leave of 12 weeks
-
Fertility benefits
-
Opportunity for incentive compensation
Skills
Explore related jobs
More jobs at Gauntlet
Similar Evaluation Frameworks jobs
- S
Software Engineer, Agent HarnessSim · San Francisco - L
Software Engineer, Agent HarnessLm Studio · New York City - EAI Software Engineer, Agent HarnessEnCharge AI · India
- C
Product Manager, Agent Harness & ModellingCohere · Toronto - VSoftware Engineer - Agent HarnessValerie Health · San Francisco, California
- S
Senior Agent Harness EngineerSavvy · NYC Office
Jobs in New York
- CService PlannerCareers Se · New York, New York
- AEarly Careers: Strategy Consulting GraduateAustralia Careers Aon · New York, New York
- CSenior Analyst, Precision (Programmatic)Careers Publicisgroupe · New York, New York
- CSenior Analyst, AudiencesCareers Publicisgroupe · New York, New York
- CAccount DirectorCareers Publicisgroupe · New York, New York
- CDirector, Video InvestmentCareers Publicisgroupe · New York, New York
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.