Senior Deep Learning Performance Architect

Details

We are seeking a Senior Deep Learning Performance Architect to analyze and develop next-generation architectures that accelerate AI and high-performance computing applications. The role focuses on performance analysis, performance modeling, and close HW/SW collaboration to improve deep learning performance and efficiency.

Responsibilities

• Develop innovative architectures to advance deep learning performance and efficiency.
• Analyze performance, cost, and power trade-offs by developing analytical models, simulators, and test suites.
• Understand and analyze the interplay of hardware and software architectures on future algorithms, programming models, and applications.
• Evaluate PPA (performance, power, area) for hardware features and system-level architectural trade-offs.
• Develop high-level simulators in C++ and Python.
• Collaborate with software, product, and research teams to guide the direction of deep learning hardware and software.

Requirements

• MS or PhD in Computer Science, Computer Engineering, Electrical Engineering or equivalent experience.
• 6+ years of relevant professional experience.
• Strong background in GPU or deep learning ASIC architecture for distributed training and/or inference spanning multi-chip / multi-node systems.
• Experience with performance modeling, architecture simulation, profiling, and analysis.
• Solid foundation in machine learning and deep learning, including understanding of modern transformer-based architectures and their performance at scale.
• Strong programming skills in Python, C, and C++.

Preferred / Ways to Stand Out

• Background with deep neural network training, inference and optimization in leading frameworks (e.g. PyTorch, JAX, TensorRT).
• Familiarity with advanced optimizations and SW/HW co-design for LLM training and inference.
• Exposure to using AI to accelerate software engineering workflows.
• Demonstrated self-motivation, creative and critical thinking.

Compensation & Benefits

• Base salary range (Level 4): 184,000 USD - 287,500 USD.
• Base salary range (Level 5): 224,000 USD - 356,500 USD.
• Eligibility for equity and company benefits (see NVIDIA benefits page).

Additional Information

• Applications accepted at least until July 29, 2025.
• NVIDIA is an equal opportunity employer and committed to fostering a diverse work environment. The company does not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.