
Posted 6 months ago
Member of Technical Staff - Safety Lead
AI Summary
Owns the red-teaming and adversarial evaluation pipeline for open weight AI models, collaborates with Alignment to turn safety findings into guardrails, and validates model releases against risk thresholds.
About this role
Our Mission
Reflection’s mission is to build open superintelligence and make it accessible to all.
We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond.
About the Role
Own the red-teaming and adversarial evaluation pipeline for Reflection’s models, continuously probing for failure modes across security, misuse, and alignment gaps.
Work hand-in-hand with the Alignment team to translate safety findings into concrete guardrails, ensuring models behave reliably under stress and adhere to deployment policies.
Validate that every release meets the lab’s risk thresholds before it ships, serving as a critical gatekeeper for our open weight releases.
Develop scalable, automated safety benchmarks that evolve alongside our model capabilities, moving beyond static datasets to dynamic adversarial testing.
Research and implement state-of-the-art jailbreaking techniques and defenses to stay ahead of potential vulnerabilities in the wild.
About You
Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline, or equivalent practical experience in AI Safety.
Deep technical understanding of LLM safety, including adversarial attacks, red-teaming methodologies, and interpretability.
Strong software engineering capabilities with experience building automated evaluation pipelines or large-scale ML systems.
Experience with Reinforcement Learning (RLHF/RLAIF) and how it impacts model safety and alignment is a strong plus.
Thrive in a fast-paced, high-agency startup environment with bias toward action.
Willing to make high-stakes decisions regarding model release and safety thresholds.
Passionate about advancing the frontier of intelligence.
What We Offer:
We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small talent-dense team. You will help define our future as a company, and help define the frontier of open foundational models.
We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.
Top-tier compensation: Salary and equity structured to recognize and retain the best talent globally.
Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance.
Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning.
Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time.
Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off-sites and team celebrations.
Skills
Explore related jobs
More jobs at Reflection
Executive AssistantNew York
Member of Technical Staff - Engineering Lead, Shared ServicesSan Francisco
Member of Technical Staff - Engineering Lead, ApplicationsSan Francisco
Head of MarketingNew York
Product Manager, Agentic AI PlatformSan Francisco
Member of Technical Staff - Engineering Lead, Platform FoundationsSan Francisco
Similar Adversarial Attacks jobs
Jobs in San Francisco
Full-Stack Engineer, Mobile & SDK - San FranciscoPlaud · San Francisco, Canada- Account ExecutiveMetriport · San Francisco
Senior Teleoperations LeadTSMG · San Francisco, Canada
Robot Teleoperator (AI & Robotics)TSMG · San Francisco, Canada
Robotics Operations TechnicianTSMG · San Francisco, Canada- Automotive - PorterStress Free Auto Care · San Francisco, California