Senior Staff Machine Learning Engineer – Autonomous Driving Foundation Models
Santa ClaraOn-siteFull-time
AI Summary
Senior Staff ML Engineer leads end-to-end VLA architectures for autonomous driving, bridging perception, language reasoning, and action generation, and guides world-model research for closed-loop training.
About this role
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.
The Mission: We are building the next generation of L4 autonomous vehicles. Moving beyond traditional modular stacks, we are developing large-scale Vision-Language-Action (VLA) models and World Models to handle the infinite long-tail scenarios of global driving. As a Senior Staff Machine Learning Engineer, you will architect the transition from behavior cloning to intelligent, zero-shot decision-making in diverse global markets.
Key Responsibilities:
-
Architectural Leadership: Lead the design of end-to-end VLA architectures, bridging multi-modal perception with high-level linguistic reasoning and precise action generation.
-
World Model Development: Drive R&D in generative world models (latent dynamics) to create high-fidelity, controllable driving simulations for closed-loop training and evaluation.
-
Policy Evolution: Apply Advanced RL (Online/Offline) and IL to refine driving policies, focusing on long-horizon planning and complex multi-agent interactions.
-
Scaling & Data Strategy: Define scaling laws for driving foundation models, overseeing data curation, automated labeling, and post-training at a multi-billion parameter scale.
-
Global Generalization: Lead the model’s adaptation strategy for overseas road conditions, ensuring robust performance across varying traffic laws and driving cultures.
Qualifications:
-
5-8 years of expertise in Deep Learning, with a significant track record in VLM, VLA, or Embodied AI.
-
Proven experience in training and deploying Foundation Models (Transformers, LLMs) at scale.
-
Deep understanding of Sequential Decision Making, World Models, or Policy Gradient methods.
-
Mastery of PyTorch and expertise in distributed training (DeepSpeed, Megatron, etc.).
-
A "Product-First" mindset: The ability to balance cutting-edge research with the deterministic requirements of L4 production vehicles.
What do we provide:
-
A fun, supportive and engaging environment
-
Infrastructures and computational resources to support your ML model development/research.
-
Opportunity to work on cutting edge technologies with the top talent in the field.
-
Opportunity to make significant impact on transportation revolution by the means of advancing autonomous driving
-
Competitive compensation package
-
Snacks, lunches, dinners, and fun activities
The base salary range for this full-time position is $244,140-$413,160, in addition to bonus, equity and benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.
Skills
Automatic LabelingData CurationDeepSpeedDistributed TrainingDL ArchitecturesDriving Foundation ModelsEmbodied AIImitation LearningLatent DynamicsLLMsMegatronMulti-modal PerceptionOffline RLOnline RLPolicy Gradient MethodsPyTorchSequential Decision-makingTransformersVision-language-actionVLAVLMWorld Models
Explore related jobs
More jobs at XPENG
- AI Infra Onboard Performance InternSanta Clara, CA
- Senior AI Data Infrastructure/Pipeline EngineerSanta Clara, CA
- Agentic Infrastructure Engineer InternSanta Clara, CA
- Senior Digital World System EngineerSanta Clara, CA
- Senior Staff Physical AI Data Algorithm EngineerSanta Clara, CA
- Staff Robotics Engineer / Tech Lead – Whole-Body Control & Robot LearningSanta Clara, CA
Similar Automatic Labeling jobs
Jobs in Santa Clara
- JReceptionistJoseph J. Albanese · - Santa Clara, United States
- WRestaurant FOH SupervisorWorld Wrapps · Santa Clara, United States
- WBOH Prep & Line CooksWorld Wrapps · Santa Clara, United States
- WFOH Cashier & Customer ServiceWorld Wrapps · Santa Clara, United States
- ERunner RestaurantEataly North America · Santa Clara, CA
- SSolutions EngineerSelector · Santa Clara, United States