Principal Architect, AI Networking

at Nvidia
📍 Santa Clara, United States
USD 272,000-425,500 per year
SENIOR
✅ Hybrid

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Software Development @ 3 Machine Learning @ 7 Communication @ 4 Networking @ 4 Rust @ 3 LLM @ 4

Details

NVIDIA has been redefining computer graphics, PC gaming, and accelerated computing for more than 25 years. The company is tapping into the unlimited potential of AI to define the next era of computing. As a member of the AI Networking team you will help craft the future of AI networking by using cutting-edge technologies to address sophisticated challenges in AI infrastructure.

Responsibilities

  • Work on accelerating NVIDIA Dynamo — KV cache management and large-scale inference.
  • Develop and research networking technologies to advance and scale AI networks.
  • Co-design software and hardware networking solutions across domains from network transports to AI frameworks.
  • Collaborate closely with NVIDIA's hardware architecture, software architecture, and research teams to build innovative networking hardware and software solutions.
  • Lead the development of prototypes that optimize AI training and inference infrastructure.

Requirements

  • Master's or Ph.D. in Computer Science, Electrical or Computer Engineering (or related field) from a top-tier university, or equivalent experience.
  • 12+ years of relevant academic or proven industry experience.
  • Comprehensive understanding of AI workloads (primarily inference, also training) and their impact on network infrastructure.
  • Strong proficiency in Machine Learning / Deep Learning fundamentals, inference runtimes, and Deep Learning frameworks.
  • Skilled in C or C++ for systems software development; familiarity with Rust is helpful.
  • Ability to work and communicate effectively across diverse teams and time zones.
  • Curiosity for building leading-edge technology.

Ways to Stand Out

  • Proven research track record.
  • Experience in LLM inference and understanding AI network and storage needs.
  • Background in storage and storage optimization: file systems, object stores, caches, coherency.
  • Stellar communication skills.

Benefits & Compensation

  • Base salary range: 272,000 USD - 425,500 USD (final salary determined by location, experience, and internal pay bands).
  • Eligible for equity and a comprehensive benefits package (details at https://www.nvidia.com/en-us/benefits/).

Other Information

  • Office policy: Hybrid (#LI-Hybrid).
  • Application window: Applications accepted at least until October 25, 2025.
  • Location listed: Santa Clara, CA, United States.