Posted 11 months ago

Machine Learning Engineer - Perception

Foster City, CAOn-siteFull-time

AI Summary

Generative AI Engineer who designs, trains and evaluates multi-sensor fusion deep learning models for perception in Zoox's autonomous system, leveraging real and synthetic data and collaborating with Prediction/Planner teams.

About this role

The Perception team at Zoox is at the forefront of leveraging GenAI to create synthetic data, unlocking scalable training and evaluation for our autonomous system's perception and entire stack. As a Generative AI Engineer, you will develop and train cutting-edge models for sensor-level scenario generation, utilizing world models and radiance fields techniques with large-scale proprietary data. This role directly impacts the productivity, safety, and capabilities of Zoox's autonomous system by validating algorithms in real-world conditions.

In this role, you will:

Design, develop, train and evaluate multi-sensor fusion based deep learning models to understand obstacles and environmental context

Understand and curate real and synthetic datasets to improve our models

Perform latency optimization and deploy models to our robot fleet

Build a deep understanding of Perception gaps and behavioral issues around difficult obstacle types in order to help plan and prioritize our work

Collaborate with Prediction/Planner team to deploy fully autonomous vehicles in environments with difficult and rare obstacles, extreme weather conditions, and complex driving scenario

Qualifications

MS or PhD in Computer Science, Machine Learning, or related technical field with 5+ years of industry experience

Proficiency in Python and some knowledge in C++

Deep Learning expertise

Experience developing multi-sensor fusion algorithms for object detection, panoptic segmentation or object tracking

Familiar with Transformer architecture

Bonus Qualifications

Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)

Experience with autonomous robotics systems

Experience implementing 3D Gaussian Splatting

Skills

3D Gaussian SplattingC++Dataset CurationDeep LearningLarge-scale Proprietary DataLatency OptimizationModel DeploymentMulti-sensor FusionObject DetectionObject TrackingPanoptic SegmentationPythonRadiance FieldsRobot FleetTransformerWorld Models

Machine Learning Engineer - Perception

About this role

In this role, you will:

Qualifications

Bonus Qualifications

Skills

Explore related jobs

More jobs at Zoox

Similar 3D Gaussian Splatting jobs

Browse these categories