
Posted 1 month ago
Senior Software Developer, AI Networking
AI Summary
Develops a high-performance inference framework using hardware offloads, GPU kernels, and RDMA network cards for AI networking acceleration on large-scale supercomputers and data centers.
About this role
We are looking for an enthusiastic software engineer to join our AI networking acceleration team, to work on a groundbreaking open-source library, using hardware offloads, GPU Kernels and RDMA network cards. Our product is a performance-oriented low-level infrastructure, crafted to change the way inference works.
We thrive as a team in a deeply strong environment, and we're passionate about innovation. The rewards are sweet and include working with some of the brightest people in the industry, an aggressive compensation plan that rewards top performers, and the opportunity to collaborate on products that transform daily the way people work and play.
What you'll be doing:
Developing a highly optimized inference framework
Running on the world’s largest supercomputers and data centers.
The work environment is dynamic and challenging as our employees work on innovative, next-generation products at the forefront of technology in terms of performance, scalability, and features.
What we need to see:
B.Sc. or equivalent experience in Computer Science or Software Engineering
6+ years of experience in modern C++ / C / Rust development
3 years of experience in Linux environment and familiarity with development tools
Deep knowledge of the TCP/IP network stack
Understanding of computer architecture and operating systems concepts
Ways to stand out from the crowd:
Background in Linux internals and low-level software optimizations (benchmarking, bottleneck research, performance tuning)
Experience in programming CUDA kernels is an advantage
Familiarity with ML frameworks and LLMs
Background in parallel programming / high-performance computing / RDMA technology
With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you. NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most hard-working and talented people in the world working for us. If you're creative and passionate about developing cloud services we want to hear from you!
Skills
Explore related jobs
More jobs at NVIDIA USA
- N
Senior Hardware System EngineerChina, Shenzhen - N
Senior Performance Modeling EngineerIsrael, Yokneam - N
Senior AI Engineer, Forward Deployed - Palantir Foundry and AIPIsrael, Yokneam - N
Senior QA Engineer, System Product EngineeringIsrael, Yokneam - N
Senior Verification Engineer - HSIO Unit LevelIndia, Bengaluru - N
Deep Learning Framework Communications Engineer - New College Grad 2026US, CA
Similar RDMA jobs
- A
Consultant - BenchmarkingAvasant · Delhi, New Delhi - P
Benchmarking AnalystProcure Analytics · Atlanta, Georgia - H
BenchMarking EngineerHuawei Technologies · Bengaluru, KA - C
Research Engineer, BenchmarksClera · Singapore - M
Research Engineer – BenchmarkingMercor · San Francisco - E
Project Manager (with Benchmark)EROS Technologies Inc. · Atlanta, GA
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.