
Posted today
AI Computing Software Developer - New College Graduate 2027
AI Summary
Develops and optimizes AI computing software for NVIDIA GPUs, either building high-performance LLM inference pipelines in TensorRT-LLM or improving graph transformations and code generation in the TensorRT compiler backend.
About this role
We are now looking for an AI Computing Software Development Engineer! NVIDIA invites skilled interns in artificial intelligence computing solutions to join our AI Compute team in Taiwan. This is your chance to work on one of the globe’s most advanced AI systems. You will help develop technologies for Large Language Models, Recommender Systems, and Generative AI, and push the limits of GPU performance for AI inference.
What you will be doing:
As an intern, you’ll focus on one of two specialized tracks: TensorRT-LLM – Inference Optimization (Python / PyTorch) or TensorRT Compiler – Graph Optimization (C++).
For TensorRT-LLM:
- Build and enhance high‑performance LLM inference pipelines on key LLM models.
- Analyze and optimize LLM model execution, scalability, and memory use.
- Collaborate across framework and research teams to deliver efficient multi‑GPU model serving for Agentic AI workloads.
For TensorRT Compiler:
- Work on the TensorRT compiler backend to improve graph transformations and code generation for NVIDIA GPUs.
- Develop compiler optimization passes, refine operator fusion, and optimize memory usage.
- Collaborate with CUDA and hardware architecture teams to accelerate Deep Learning inference computations.
What we need to see:
- Master or higher degree in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics or related computing focused degree (or equivalent experience)
- Excellent problem‑solving ability, curiosity for modern AI systems, and passion for GPU computing and deep learning software performance.
- TensorRT‑LLM: Strong Python programming and experience with PyTorch; solid understanding of underlying LLM inference operations and GPU acceleration.
- TensorRT Compiler: Proficient in C++, with experience in compiler or performance optimization.
Join us and play a part in building the AI computing platforms that drive innovation across industries worldwide.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Skills
Explore related jobs
More jobs at NVIDIA USA
- N
IC Reliability Practical EngineerIsrael, Yokneam - N
Senior Solutions Architect, Agent Infrastructure and SecurityUS, CA - N
AI Operations Intern, AI Clouds - Summer 2027US, CA - N
HR Specialist - New College GradTaiwan, Taipei - N
Senior Solutions Architect, Open ModelsUS, CA - N
Senior Network Deployment EngineerUS, CA
Similar LLM Inference jobs
- S
C++, C#SQUIRCLE IT CONSULTING SERVICES PVT. LTD · Bengaluru, KA - P
C/C++ DeveloperProcom Consultants Group · Hillsboro, OR - A
C/C++ DeveloperAdagrad AI · Pune, India - FSoftwareentwickler C++/C#FERCHAU GmbH Niederlassung Kassel · Kassel, Germany
- PC/C++ DeveloperPremium Technology · New York, NY
- FSoftwareentwickler C / C++FERCHAU GmbH Niederlassung Bremen City · Bremen, Germany
Jobs in Taipei
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.