Posted 2 days ago
Principal Machine Learning Engineer, Artificial Intelligence (AI) Required, Work From Home
AI Summary
Architects and builds large-scale ML systems for training, inference, evaluation, and deployment, setting the technical standard for ML across the organization.
About this role
Principal Machine Learning Engineer, Artificial Intelligence (AI) Required, Work From Home
Principal Machine Learning Engineer, Artificial Intelligence (AI) Required, Work From Home
As a Principal Machine Learning Engineer, you are a deep technical authority responsible for designing and evolving the most critical ML systems in the company. The Principal Machine Learning Engineer will operate across training, inference, evaluation, and infrastructure, solving the hardest architectural and performance problems. While Technical Leads may own execution at the team level, you set the technical standard and shape how ML systems are built across the organization. This is a hands-on, high-impact role focused on depth. This position is 100% Remote.
Principal Machine Learning Engineer Responsibilities:
- Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment.
- Design reproducible, high-performance training pipelines across GPU infrastructure.
- Architect inference systems that balance latency, throughput, cost, and reliability at scale.
- Design and maintain data systems for high-quality synthetic and real-world training data.
- Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership.
- Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies.
- Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products.
- Make pragmatic trade-offs and ship improvements quickly, learning from real usage.
- Work under real production constraints: latency, cost, reliability, and safety
Principal Machine Learning Engineer Outcomes:
- ML systems (training, inference, evaluation) are reliable, scalable, and meet defined performance targets.
- Models deployed to production achieve measurable quality improvements and meet user-impact goals.
- Production issues are proactively monitored, debugged, and resolved with clear root-cause analysis.
- Team and cross-functional collaborators benefit from clear guidance, best practices, and scalable ML solutions.
- Research-to-production cycles are efficient, safe, and continuously improve the product experience.
Qualifications
Principal Machine Learning Engineer Qualifications:
- Strong background in deep learning and transformer-based architectures.
- Artificial Intelligence (AI) experience required.
- Hands-on experience training, fine-tuning, or deploying large-scale ML models in production.
- Proficiency with at least one modern ML framework (e.g. PyTorch, JAX), and ability to learn others quickly.
- Experience with distributed training and inference frameworks (e.g. DeepSpeed, FSDP, Megatron, ZeRO, Ray).
- Strong software engineering fundamentals; you write robust, maintainable, production-grade systems.
- Experience with GPU optimization, including memory efficiency, quantization, and mixed precision.
- Comfort owning ambiguous, zero-to-one ML systems end-to-end.
- A bias toward shipping, learning fast, and improving systems through iteration.
- Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer.
- Contributions to open-source ML or systems libraries.
- Background in scientific computing, compilers, or GPU kernels.
- Experience with RLHF pipelines (PPO, DPO, ORPO).
- Experience training or deploying multimodal or diffusion models.
- Experience with large-scale data processing (Apache Arrow, Spark, Ray).
Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.
Keywords: San Francisco CA Jobs, Principal Machine Learning Engineer, Apache Arrow, DeepSpeed, DPO, FasterTransformer, FSDP, GPU Kernels, JAX, LLM, Machine Learning, Megatron, ML, ORPO, PPO, Principal Machine Learning Engineer, Pytorch, RLHF Pipelines, Spark, TensorRT-LLM, Virtual Large Language Model, vLLM, Work From Home, ZeRO Ray, California Recruiters, IT Jobs, California Recruiting
Looking to hire a Principal Machine Learning Engineer in San Francisco, CA or in other cities? Our IT recruiting agencies and staffing companies can help.
We help companies that are looking to hire Principal Machine Learning Engineers for jobs in San Francisco, California and in other cities too. Please contact our IT recruiting agencies and IT staffing companies today!
Additional Information
Please check out all of our jobs at www.ginastechjobs.com.
Skills
Explore related jobs
More jobs at Ginas Tech Jobs
- Web Frontend Engineer, Artificial Intelligence (AI) Required, Work From HomeSan Francisco, CA
- Technical Product Lead, AI Email Applications, Artificial Intelligence (AI) Required - Work From HomeSan Francisco, CA
- Staff Machine Learning Engineer, Artificial Intelligence (AI) Required, Work From HomeSan Francisco, CA
- Software Engineer, Desktop, Artificial Intelligence (AI) Required, Work From HomeSan Francisco, CA
- Senior Machine Learning Engineer, Artificial Intelligence (AI) Required, Work From HomeSan Francisco, CA
- Machine Learning Technical Lead, Artificial Intelligence (AI) Required, Work From HomeSan Francisco, CA
Similar Apache Arrow jobs
Jobs in San Francisco
Executive Sous ChefAltius Search Group · San Francisco, California
Senior Data Scientist, Fleet HealthGridware · San Francisco, California
Founding Growth LeadKastle · San Francisco
Design EngineerSuperpower · San Francisco
Mobile Engineer (iOS)Superpower · San Francisco
GTM Strategy & Operations (Post-Sales)monaco · San Francisco
Browse these categories
Market data for ai / ml engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.