Principal Architect, AI Networking

Details

NVIDIA has been redefining computer graphics, PC gaming, and accelerated computing for more than 25 years. The company is tapping into the unlimited potential of AI to define the next era of computing. As part of the AI Networking team you will drive technological innovation in networking for AI infrastructure, influence software and hardware co-design, and lead prototypes that optimize AI training and inference at scale.

Responsibilities

• Work on accelerating NVIDIA Dynamo - KV cache management and large-scale inference.
• Research and develop advanced networking technologies to scale AI networks.
• Co-design software and hardware networking solutions across networking domains, from network transports to AI frameworks.
• Collaborate closely with NVIDIA hardware architecture, software architecture, and research teams to build innovative networking hardware and software solutions.
• Lead development of prototypes that optimize AI training and inference infrastructure.

Requirements

• Master’s or Ph.D. in Computer Science, Electrical or Computer Engineering (or a related field) from a top-tier university, or equivalent experience.
• 12+ years of relevant academic or proven industry experience.
• Comprehensive understanding of AI workloads (primarily inference, but also training) and their impact on network infrastructure.
• Strong proficiency in machine learning / deep learning fundamentals, inference runtimes, and deep learning frameworks.
• Skilled in C or C++ for systems software development; familiarity with Rust is helpful.
• Ability to work and communicate effectively across diverse teams and time zones.

Ways to stand out

• Proven research track record.
• Experience in LLM inference, AI network and storage needs.
• Background in storage and storage optimization (file systems, object stores, caches, coherency).
• Stellar communication skills.

Compensation & Other Information

• Base salary range: 272,000 USD - 425,500 USD (final base determined by location, experience, and comparable employees).
• Eligible for equity and benefits (see NVIDIA benefits).
• Location: Santa Clara, CA, United States. #LI-Hybrid (hybrid work model).
• Employment type: Full time. Applications accepted at least until July 29, 2025.

Company & Diversity Statement

NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer. The company does not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.