Posted 8 days ago
Senior Technical Program Manager - Nemotron
AI Summary
Drives sourcing, curation and release of large-scale datasets for LLM and robotics programs, and manages external data and annotation vendors including contracts, SLAs, quality and cost. Coordinates with legal, privacy and security to keep data usage compliant.
About this role
The Nemotron Edge PMO organization seeks a Technical Program Manager to oversee the collection, curation, and release of massive-scale datasets. In this position, the TPgM will build the data foundation that enables NVIDIA’s models to lead in enterprise and agentic AI, delivering premier language understanding and synthetic data generation optimized for NVIDIA infrastructure.
What you will be doing:
- Drive execution for sourcing, curating, and maintaining high‑quality data used to train and evaluate Robotics/LLM programs
- Identify, evaluate, and onboard external data/annotation vendors aligned with LLM use cases, quality needs, and compliance constraints.
- Negotiate contracts, pricing, SLAs, and KPIs with vendors; track performance and drive continuous improvement and cost efficiency.
- Partner with Legal, Privacy, and Security to ensure data contracts, access, and usage comply with regulatory and internal policies.
- Dashboards and reporting to monitor data quality, vendor throughput, turnaround time, and budget utilization.
- Create and maintain documentation, playbooks, and processes for repeatable, scalable LLM data and vendor operations.
What we need to see:
- 8+ years of experience in data operations, vendor management, or technical program management—preferably supporting AI/ML or LLM initiatives.
- Bachelors degree or equivalent experience
- Exceptional skills in prioritizing and building alignment.
- Consistent track record of leading and successfully delivering medium to large organizational-wide programs and projects.
- Experience with AI/ML data vendors (annotation, eval, labeling platforms)
- Comfort working with research teams who have fast-changing requirements
- AI-native mindset — uses tooling to automate vendor reporting, tracking, and communication
- Ability to operate in ambiguity and rapid pivots — vendor scopes change fast in GenAI.
Ways to stand out from the crowd:
- Strong understanding of data governance, data quality, and compliance frameworks.
- Proven experience managing external data vendors, setting KPIs, SLAs, and performance metrics.
- Working knowledge of LLM training data pipelines, annotation workflows, and synthetic data generation.
- Proven track record of driving measurable cost savings or quality improvements directly tied to how you structured and managed vendor relationships
- Built vendor scorecards, playbooks, or tracking tools that were adopted as well as being comfortable working with research teams in fast-moving GenAI environments where vendor scope changes frequently and pivots are the norm
With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and versatile people in the world working with us, and our engineering teams are growing fast in some of the most impactful fields of our generation: AI, Data Engineering, and Data Science. If you're a creative engineer who enjoys autonomy and shares our passion for technology, we want to hear from you.
Skills
Explore related jobs
More jobs at NVIDIA USA
- NMarketing Manager, Open Source FoundationsUS, CA
- NPackage Layout Engineer - HardwareIndia, Bengaluru
- NSenior DevOps Engineer - E-commerceIndia, Pune
- NSenior Power and Thermal ArchitectUS, CA
- NSenior Silicon Product Architect, Performance and PowerUS, CA
- NSenior Software Engineer, NVIDIA KubernetesUS, CA
Similar Compliance Frameworks jobs
Jobs in Munich
- S
Ausbildung Kaufmann*frau für DialogmarketingSunny Cars GmbH · Munich, Germany - ISchlosser in München – bis 26,16 €/StdIndustriemontage Roding GmbH · München, Germany
- S
Ausbildung Kaufmann*frau für BüromanagementSunny Cars GmbH · Munich, Germany - PIT Systemadministratorpuro Personaldienstleistung GmbH · München, Germany
- PAdministrator Systembetreuungpuro Personaldienstleistung GmbH · München, Germany
- SFloristin / Florist gesucht - Schönes aus Blumen, München-SendlingSchönes aus Blumen bei Thyra Daecke · München, Germany
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.