Senior Performance Architect, Nemotron

Details

We are now looking for a Senior Performance Architect for Nemotron at NVIDIA. You will shape the next generation of Nemotron models through performance modeling, analysis, and forward projections, developing high-fidelity models to evaluate how architectural choices translate into real-world deployment efficiency. You will ensure future models achieve Pareto-optimal trade-offs across accuracy, throughput, and interactivity on target platforms.

Recent efforts such as LatentMoE architectures and the Nemotron Super model exemplify the kind of performance-driven co-design you will help advance — where modeling insights directly shape model architecture and system efficiency at scale. This role partners across research, framework development, compiler, and hardware teams to guide decisions that determine how efficiently intelligence scales in production.

Responsibilities

• Develop high-fidelity analytical performance models to prototype emerging algorithmic techniques and hardware optimizations for the Nemotron family of models.
• Prioritize features to guide future software and hardware roadmap based on detailed performance modeling and analysis.
• Model end-to-end performance impact of emerging GenAI workflows such as Speculative Decoding, Agentic Pipelines, inference-time compute scaling, and RL to understand future datacenter needs.
• Keep up with latest deep learning research and collaborate with DL researchers, hardware architects, and software engineers.
• Define metrics, design experiments, and visualize large performance datasets to identify resource bottlenecks.

Requirements

• Minimum qualification: Master's degree (or equivalent experience) in Computer Science, Electrical Engineering, or related fields.
• Strong background in computer architecture, roofline modeling, queuing theory, and statistical performance analysis techniques.
• Solid understanding of ML fundamentals, model parallelism, and inference serving techniques.
• Proficiency in Python (optionally C++) for simulator design and data analysis.
• 3+ years of hands-on experience in system evaluation of AI/ML workloads or performance analysis, modeling, and optimizations for AI.
• Comfortable defining metrics, designing experiments, and visualizing large performance datasets to identify resource bottlenecks.
• Experience with deep learning frameworks such as PyTorch, TRT-LLM, VLLM, and SGLang.

Ways to Stand Out

• Proven track record of working in multi-functional teams spanning algorithms, software, and hardware architecture.
• Ability to distill complex analyses into clear recommendations for both technical and non-technical collaborators.
• Experience with GPU computing (CUDA).

Compensation & Additional Info

• Base salary ranges: Level 3: 152,000 USD - 241,500 USD; Level 4: 184,000 USD - 287,500 USD.
• You will also be eligible for equity and benefits.
• Applications for this job will be accepted at least until May 23, 2026. This posting is for an existing vacancy.
• NVIDIA uses AI tools in its recruiting processes and is an equal opportunity employer committed to fostering a diverse work environment.