Senior Software Engineer, GPU Communications And Networking

at Nvidia
šŸ“ Santa Clara, United States
USD 148,000-287,500 per year
SENIOR
āœ… On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Linux @ 7 TensorFlow @ 4 Hiring @ 4 Communication @ 4 Parallel Programming @ 4 Debugging @ 4 System Architecture @ 4 PyTorch @ 4 CUDA @ 4 GPU @ 4

Details

NVIDIA is a leader in Artificial Intelligence, High-Performance Computing, and Visualization. The GPU, invented by NVIDIA, serves as the visual cortex of modern computers and powers innovations from AI to autonomous vehicles. This role focuses on advancing communication libraries and network software for complex heterogeneous computing systems that support cutting-edge products in High Performance Computing and Deep Learning.

Responsibilities

  • Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g., NCCL for TensorFlow/Pytorch) and HPC programming interfaces (e.g., UCX for MPI/OpenSHMEM) on GPU clusters.
  • Participate in and contribute to parallel programming interface specifications such as MPI/OpenSHMEM.
  • Design, implement and maintain system software facilitating interactions among GPUs and between GPUs and other system components.
  • Create proof-of-concepts to explore extensions in programming models, runtime designs, and hardware features.

Requirements

  • M.S./Ph.D. degree in Computer Science, Computer Engineering, or equivalent experience.
  • 5+ years of relevant experience.
  • Excellent C/C++ programming and debugging skills.
  • Strong experience with Linux.
  • Expert understanding of computer system architecture and operating systems.
  • Experience with parallel programming interfaces and communication runtimes.
  • Ability to work and communicate effectively in a multinational, multi-time-zone environment.

Ways To Stand Out

  • Deep technological understanding and passion.
  • Experience with CUDA programming and NVIDIA GPUs.
  • Knowledge of high-performance networks such as InfiniBand, iWARP.
  • Experience with HPC applications.
  • Experience with Deep Learning frameworks like PyTorch, TensorFlow.
  • Strong collaborative and interpersonal skills with proven effectiveness in dynamic matrix environments.

Benefits

NVIDIA offers highly competitive salaries and a comprehensive benefits package, including equity. The company fosters a diverse work environment and is an equal opportunity employer, valuing diversity and inclusion in hiring and promotion practices.

Base salary range: $148,000 - $287,500 USD/year, determined based on location, experience, and market comparisons.