
Open since Jun 2026
Machine Learning Engineer - Pre Training
AI Summary
Designs, builds and optimizes large-scale pre-training pipelines and distributed training systems for foundation generative AI models across GPU and TPU clusters. Works with researchers to productionize experiments and ensure reliable training.
About this role
About Mindbeam
We are building the next-generation AI infrastructure for open source and enterprise. Our work is deeply research-oriented and passionate about developing ground-breaking innovations to take state-of-the-art AI applications to the next level.
What drives us is not only advancing technology, but empowering the people behind it. We are a community of researchers, engineers, and visionaries who believe that collaboration, curiosity, and openness fuel progress. If you’re motivated by impact and inspired to build tools that others can build upon, you’ll be in the right place.
Mission
Design and optimize large-scale pre-training systems that power Mindbeam’s generative AI models.
Role Expectations
• Build scalable pre-training pipelines for foundation models, optimizing throughput and efficiency.
• Implement distributed training strategies across GPUs/TPUs and high-performance clusters.
• Collaborate with researchers to translate experimental setups into production-ready workflows.
• Develop monitoring and fault-tolerance systems to ensure reliable large-scale training.
• Continuously benchmark and tune performance across hardware and software stacks.
Background
• Bachelor’s, Master’s, or PhD in Computer Science, Engineering, or related field—or equivalent experience.
• 2+ years of experience with large-scale model training and distributed systems.
• Strong coding skills in Python and familiarity with ML frameworks (PyTorch, TensorFlow, JAX).
• Experience with GPU scheduling, memory optimization, and parallelism strategies.
• Comfort with containerized and orchestrated environments (Docker/Kubernetes).
• Understanding of high-performance computing and networking bottlenecks.
About You
You thrive on scale and complexity. You enjoy solving system-level bottlenecks, pushing hardware and software to their limits, and working closely with researchers to accelerate cutting-edge AI development.
Skills
Explore related jobs
More jobs at Mindbeam
Similar Distributed Training jobs
- CDistribution Training SpecialistCareers En Axa · HONG KONG, HK
- R
Software Engineer, Distributed TrainingRiver AI Inc. · Palo Alto, California - S
Distributed Training and Inference EngineerSciforium · San Francisco, California - P
Research Engineer - Distributed TrainingPrime Intellect · San Francisco - L
Member of Technical Staff - Distributed Training EngineerLiquid AI · San Francisco - S
Machine Learning Systems Engineer: Distributed TrainingSusquehanna International Group, LLP · Bala Cynwyd (Philadelphia Area), PA
Browse these categories
Market data for ai / ml engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.