
Posted 2 months ago
Member of Technical Staff — Inference Infrastructure
AI Summary
Build and optimize high-throughput inference systems for large-scale model evaluation and backtesting, improving latency, throughput, and reliability.
About this role
Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.
To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.
Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.
We look for infrastructure engineers who are excited to tackle unsolved problems. Progress on an LPM is gated by how fast we can evaluate it: large-scale backtesting against decades of physical observations, ensemble generation, and rollout evaluation across model scales.
Responsibilities
Your mission is to make inference so fast and cheap that evaluation never gates research.
Build high-throughput inference systems for large-scale evaluation, backtesting, and scoring against historical physical observations
Design and implement techniques that improve latency, throughput, and efficiency for real-time inference
Optimize the inference stack to fully utilize hardware FLOPs, bandwidth, and memory
Extend orchestration frameworks (e.g. Kubernetes, Ray, Slurm) for distributed inference and large-batch evaluation sweeps
Establish standards for reliability, observability, and reproducibility across the inference stack, so every evaluation is trustworthy and repeatable
Collaborate with researchers to enable high-performance inference for novel architectures as they emerge
What we're looking for
We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.
Experience building or optimizing inference and serving systems for throughput and latency (e.g. TensorRT)
Understanding of distributed compute, GPU parallelism, and hardware-aware optimization
Deep familiarity with deep learning frameworks (e.g. PyTorch, JAX) and their underlying system architectures
Strong engineering skills: performant, maintainable code and the ability to debug complex codebases
Bonus: contributions to open-source inference or systems infrastructure (e.g. vLLM, SGLang, Triton)
Skills
Explore related jobs
More jobs at Causal Labs
Member of Technical Staff — Security EngineeringSan Francisco
Member of Technical Staff — Research, PhysicsSan Francisco
Member of Technical Staff — Research, Atmospheric ScienceSan Francisco
Member of Technical Staff — Research Engineering, EvaluationSan Francisco
Member of Technical Staff — ML Research, PlanningSan Francisco
Member of Technical Staff — ML Research, MultimodalSan Francisco
Similar Distributed Compute jobs
Senior Principal Researcher & Technical Leader – Agentic RL for Distributed ComputingHuawei Technologies Canada Co., Ltd. · Markham, Ontario- Research Scientist (Computer Science/Software Engineering/Distributed Systems/Cloud Computing)Nanyang Technological University · NTU Main Campus, Singapore
- Software Engineering ManagerDev · Brooklyn Park, Minnesota
Jobs in San Francisco
Executive Sous ChefAltius Search Group · San Francisco, California
Senior Data Scientist, Fleet HealthGridware · San Francisco, California
Founding Growth LeadKastle · San Francisco
Design EngineerSuperpower · San Francisco
Mobile Engineer (iOS)Superpower · San Francisco
GTM Strategy & Operations (Post-Sales)monaco · San Francisco
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.