AI Summary

Senior/Staff Software Engineer role leading ML Performance Optimization for Zoox, focusing on training and inference performance across ML platforms used in autonomous driving.

About this role

Zoox is on a mission to reimagine transportation and ground-up build autonomous robotaxis that are safe, reliable, clean, and enjoyable for everyone. We are still in the early stages of deploying our robotaxis on public roads, and it is a great time to join Zoox and have a significant impact in executing this mission. The ML Platform team at Zoox plays a crucial role in enabling innovations in ML and CV to make autonomous driving as seamless as possible.

The Opportunity

Are you excited to lead our ML Performance Optimization initiatives and make our Training and Inference platform that enables autonomous driving as fast and efficient as possible? You will get to work across all ML teams within Zoox - Perception, Prediction, Planner, Simulation, Collision Avoidance, and Advanced Hardware Engineering group and have the opportunity to significantly push the boundaries of how ML is practiced within Zoox.

We build and operate the base layer of ML tools, deep learning frameworks, and inference systems used by our applied research teams for in- and off-vehicle ML use cases. You will lead a team of strong software engineers and act as a force multiplier for our internal customers. This team has a lot of growth opportunities as we expand our robotaxi deployments and venture into new ML domains. If you want to learn more about our stack behind autonomous driving, please look here.

In this role, you will:

Develop and execute a strategic vision for the ML Performance Optimization team to unlock ML innovation in autonomous driving and rider experience.

Lead the design, implementation, and operation of cutting-edge ML Training and inference performance optimization techniques.

Collaborate closely with x-functional teams, including ML researchers, software engineers, data engineers, and hardware engineers, to define requirements and align on architectural decisions.

Enable the engineers in the team to grow their careers by providing technical guidance and mentorship.

Qualifications

Strong experience with training frameworks like PyTorch, leveraging GPUs efficiently for distributed model training.

Experience with GPU-accelerated inference using TensorRT, Ray Serve, or similar frameworks.

Experience using profiling tools like NVIDIA's Nsight or PyTorch's Profiler for identifying model training and serving bottlenecks.

Proficient in Python and C++

Experience with model compression techniques to reduce model size and improve performance.

Bonus Qualifications

10+ years of total experience, including 4+ years of working on large-scale model training or inference platforms.

Excellent leadership skills with a demonstrated ability to lead high-performing engineering teams.

Skills

C++Distributed TrainingGPUInference OptimizationModel CompressionNVIDIA NsightProfilingPythonPyTorchPyTorch ProfilerRay ServeTensorRTTraining Optimization

Senior/Staff Software Engineer, ML Performance Optimization

About this role

In this role, you will:

Qualifications

Bonus Qualifications

Skills

Explore related jobs

More jobs at Zoox

Similar C++ jobs

Browse these categories