Member of Technical Staff, Inference
AI Summary
Owns and builds inference serving systems for frontier AI models, optimizing performance, reliability, and scalability across the full inference stack and hardware.
About this role
Mirendil
Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration across science and technology. Our first goal is to democratize frontier AI R&D across scientific disciplines. We believe accelerating scientific discovery is one of the most powerful ways to improve the future of humanity, and that AI will play a central role in making that possible.
We are building a frontier AI research company and training our own models end-to-end. Our work spans areas such as model training, reinforcement learning, reasoning systems, and infrastructure for large-scale experiments. Our team includes researchers and engineers from Anthropic, Google DeepMind, xAI, OpenAI, Microsoft, Apple, and MIT.
The Role
We are looking for an engineer to own the inference systems that power our models in production and research. You'll work across the full inference stack, from serving infrastructure down to hardware-level optimization. Some example areas you might work on (not limited to):
Design and build high-throughput, low-latency inference serving systems for frontier models, optimizing for both research iteration and production deployment
Optimize inference performance across GPU and accelerator hardware - maximizing FLOPs utilization, memory bandwidth, and compute efficiency for large-scale models
Enable and extend distributed inference frameworks (e.g. vLLM, SGLang, TensorRT-LLM) to support novel architectures, long-context workloads, and agentic inference patterns
Implement and validate inference-time optimizations: speculative decoding, quantization, KV cache management, and batching strategies
Build observability and reliability infrastructure so the team can measure latency, throughput, and cost across every serving configuration
Partner directly with teams to bring new model architectures and post-training techniques into production quickly
If you're excited about pushing the performance limits of frontier model inference, we'd love to hear from you.
We offer a base salary of $350,000–$500,000 USD and a meaningful equity grant, depending on experience and background, along with competitive benefits.
Skills
Explore related jobs
More jobs at Mirendil
- Executive Assistant & OperationsSan Francisco
- Technical Chief of Staff - GTM & OperationsSan Francisco
- Member of Technical Staff, Model EvaluationSan Francisco
- Member of Technical Staff, Post-Training, RL EnvironmentsSan Francisco
- Member of Technical Staff, Post-Training, RL InfraSan Francisco
- Member of Technical Staff, Post-Training, RLSan Francisco
Similar CUDA jobs
Jobs in San Francisco
Proposal ManagerPGH Wong Engineering, Inc. · San Francisco, California
Software Engineer Intern, Mobile (Winter 2027)Notion · San Francisco, California- Residential Security Agent (San Francisco, CA)Concentric · San Francisco, California
Partner Marketing Manger, GSI & SIAnthropic · San Francisco, California | New York City- Marketing ManagerAsset Living · Denver, CO
Program Manager, ConnectMeter · San Francisco
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.