Senior System Software Engineer - AI Performance and Efficiency Tools

at Nvidia
📍 Santa Clara, United States
USD 184,000-356,500 per year
SENIOR
✅ Hybrid

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Software Development @ 6 Kubernetes @ 4 Linux @ 4 Python @ 7 TensorFlow @ 4 Communication @ 7 Networking @ 4 Debugging @ 4 PyTorch @ 4 CUDA @ 4 GPU @ 4

Details

A key part of NVIDIA's strength is our sophisticated analysis and debugging tools that empower engineers to improve performance and power efficiency of our products and the running applications. This role involves developing tools for AI researchers and software/hardware teams running AI workloads in GPU clusters. You will work with users from Architecture and Software teams to provide intuitive, rich, and accurate insight into workloads and systems, enabling identification of opportunities in software and hardware, building high-level models, and debugging tricky failures to improve system performance and efficiency.

Responsibilities

  • Build internal profiling and analysis tools for AI workloads at large scale
  • Build debugging tools for commonly encountered problems such as memory or networking issues
  • Create benchmarking and simulation technologies for AI systems or GPU clusters
  • Partner with hardware architects to propose new features or improve existing features using real-world use cases
  • Collaborate with global teams and customers to understand requirements and deliver usable tooling

Requirements

  • BS or higher in Computer Science or related field (or equivalent experience) and 5+ years of software development experience
  • Strong software design, coding, analytical, and debugging skills (C++ and Python)
  • Good understanding of deep learning frameworks such as PyTorch and TensorFlow, and of distributed training and inference workflows
  • Knowledge of GPU cluster job scheduling (Slurm or Kubernetes), storage, and networking
  • Experience with NVIDIA GPUs, CUDA programming, and NCCL
  • Motivated self-starter with strong problem-solving skills and customer-facing communication skills
  • Passion for continuous learning and ability to work concurrently with multiple global groups

Ways to stand out

  • Proven experience in GPU-cluster-scale continuous profiling and analysis tools/platforms
  • Solid experience in large AI job performance analysis for training/inference workloads
  • Knowledge of Linux device drivers and/or compiler implementation
  • Knowledge of GPU and/or CPU architecture and general computer architecture principles

Compensation and Benefits

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits.

Additional information

  • Office policy: Hybrid (#LI-Hybrid)
  • Applications for this job will be accepted at least until July 29, 2025.
  • NVIDIA is an equal opportunity employer committed to fostering a diverse work environment.