Senior Software Developer, AI Networking

at Nvidia

📍 Santa Clara, United States

USD 152,000-287,500 per year

SENIOR

✅ On-site

Used Tools & Technologies

LLM

Required Skills & Competences
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

Kubernetes @ 3 Linux @ 7 Python @ 4 GitHub @ 4 Communication @ 4 Networking @ 4 PyTorch @ 4 AI @ 4 InfiniBand @ 4 Slurm @ 3 HPC @ 4

Details

NVIDIA is adding an AI Networking Software Developer to the AI Networking SW development and codesign team. The team works with the latest NVIDIA hardware and technologies, performing full-stack benchmarking for data center scale systems for AI training and inference. They develop automation and in-house tools (some publicly on GitHub) to ensure large-scale systems deliver expected performance by uncovering bottlenecks and driving continuous improvements.

Responsibilities

Develop AI networking communication frameworks and applications running in production on large supercomputers and data centers.
Develop production tools and benchmarks used by multiple teams inside and outside NVIDIA.
Enable new AI models within benchmarking infrastructure and deliver insights through end-to-end analysis of large-scale workloads across hardware and software stacks.
Design and implement automation systems, including large-scale parameter search to identify optimal configurations across complex systems.
Collaborate closely with networking and hardware teams to co-design new features and software interfaces in a fast-paced, evolving environment.

Requirements

B.Sc. or M.Sc. degree in Computer Science / Software Engineering or equivalent experience.
5+ years of experience.
Professional Python development experience (build maintainable, long-lived tools).
Solid Linux expertise and strong command-line proficiency.
Ability and willingness to work across a broad and evolving stack, from hardware and networking up to large-scale AI systems running across clusters.

Preferred / Ways to stand out

Knowledge and/or experience with modern AI ecosystem: PyTorch, LLMs, inference and training.
Familiarity with cluster orchestration systems such as Slurm or Kubernetes.
Knowledge in MPI and HPC, InfiniBand, Ethernet and networking.
Experience in performance optimizations.

Compensation & Benefits

Base salary ranges provided by location and level:
- Level 3: 152,000 USD - 241,500 USD
- Level 4: 184,000 USD - 287,500 USD
You will also be eligible for equity and benefits.

Other information

Applications accepted at least until July 19, 2026.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is an equal opportunity employer committed to an inclusive work environment.