
Posted 7 days ago
Research, Finetuning Science
AI Summary
Advances the science of fine-tuning and frontier post-training techniques for the Tinker platform, contributing to LoRA, parameter-efficient methods, and RLHF stability while shipping research into product defaults and open-source recipes.
About this role
About Thinking Machines
The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.
About the Role
At Thinking Machines we build tools that enable people to make AI their own, customizing models to serve their unique needs. This includes the ability to train model weights.
In this role, you'll work on frontier customization techniques and help build the best post-training engine in the industry – Tinker – drawing on a whole-stack understanding of RL science. Findings directly shape Tinker's training defaults, API design, and the open-source Tinker Cookbook. You'll work with our internal research teams as well as contributing to open science for external partners.
What You’ll Do
In this role, you'll advance the science of fine-tuning and frontier post-training techniques. You’ll:
Contribute to areas like LoRA and parameter efficient fine-tuning and how to push customization quality, efficiency, and reliability to the frontier.
Ship research into product: inform Tinker's training defaults and primitives, and codify best-practice methods as recipes in the Tinker Cookbook.
Improve the stability, efficiency, and reliability of large-scale fine-tuning and RL runs on Tinker.
Share what you learn through papers, technical blog posts, and community contributions.
You’ll contribute to areas like LoRA, parameter-efficient fine-tuning, how things interact with RL and post-training, and how to push customization quality, efficiency, and reliability to the frontier.
Skills and Qualifications
Required qualifications:
Bachelor’s degree or equivalent experience in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding.
Proficiency in Python and familiarity with deep learning frameworks (e.g., PyTorch, TensorFlow, or JAX). Comfort debugging distributed training and writing code that scales.
Clarity in communication, an ability to explain complex technical concepts in writing.
Strong interest in our mission to enable custom models.
Preferred qualifications — we encourage you to apply if you meet some but not all of these:
A strong grasp of probability, statistics, and ML fundamentals. You can look at experimental data and distinguish between real effects, noise, and bugs.
Prior experience with RLHF, RLAIF, preference modeling, or reward learning for large models.
Experience managing or analyzing human data collection campaigns or large-scale annotation workflows.
Research or engineering contributions in alignment, data-centric AI, or human-AI collaboration.
Experience with RL training stability techniques for large runs.
PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding; or, equivalent industry research experience.
Logistics
Location: This role is based in San Francisco, California.
Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $350,000 - $475,000 USD.
Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.
As set forth in Thinking Machines' Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.
Skills
Explore related jobs
More jobs at Thinking Machines Lab
Similar Alignment jobs
Jobs in San Francisco
- Culinary Arts InstructorEquus · San Francisco, CA
- VP of MarketingMirantis · San Francisco, California
- Associate Project ManagerTurner & Townsend · San Francisco, California
- Cost Manager / Quantity Surveyor - Construction ManagementTurner & Townsend · San Francisco, California
- Community ManagerSia · San Francisco, CA
- Cost Manager / Quantity Surveyor - ConstructionTurner & Townsend · San Francisco, California
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.