Senior System Architect, GPU

Details

A key part of NVIDIA's strength is to innovate and deliver the highest performance in the world for AI and accelerated computing. We are constantly looking for ways to improve our GPU architecture and maintain our leadership. NVIDIA is seeking a motivated system architect to define future aspects of our GPU through employing pioneering technologies. Your role will be cross-disciplinary, working with software, ASIC design, verification, physical design, VLSI and platform teams. Our system architects excel at pushing the state of the art while making the best engineering trade-offs.

Responsibilities

• Develop GPU architecture innovations and improvements, optimizing along the axes of scalability/modularity, performance and power efficiency, area, yield, effort, and schedule.
• Benchmark GPU configurations (core count, memory and interconnect bandwidth) employing advanced packaging; identify optimal designs for future data center workloads.
• Develop and enhance architecture analysis infrastructure, including performance simulators, testbench components and analysis tools, to evaluate configurations under different constraints.
• Implement and maintain high-level functional and performance models. Analyze application workloads and performance simulation results to identify areas of architecture improvements.
• Document architecture specifications; work with ASIC design, software, and VLSI teams to review and explore trade-offs, define solutions, and track progress.
• Collaborate with other functional teams (Design, Floorplan, Packaging and Systems Engineering, etc.) to validate packaging choices against performance, cost, and scalability targets.

Requirements

• Master's/PhD in Computer Engineering, Computer Science or related fields (or equivalent experience).
• A minimum of 8 years of relevant work experience in GPU or CPU System Architecture development.
• Proficiency in data analysis (Python, Excel) to correlate configuration changes with performance metrics.
• Deep understanding of accelerated computing and AI data center requirements and tradeoffs, including performance bottlenecks, TCO, Power Delivery Network (PDN), DC Networking, etc.
• Strong communication and interpersonal skills, and the ability to thrive in a dynamic, collaborative, distributed team.

Ways to stand out

• Experience with GPU architecture, especially in off-chip IO, memory subsystem, and/or Network-on-Chip (NoC)/Interconnect. Knowledgeable in system level functions such as reset and boot, DFT, and power management.
• Expertise in analyzing performance scaling and bottlenecks at device and system levels for AI/accelerated computing workloads.
• Knowledgeable in modern packaging technologies, and their costs and benefits.
• Consistent track record of efficiently implementing complex architectural features.
• Outstanding problem-solving skills with a focus on optimizing performance, area, complexity, and power.

Compensation and benefits

• Base salary range: 184,000 USD - 287,500 USD (determined based on location, experience, and pay of employees in similar positions).
• You will also be eligible for equity and benefits.

Additional information

• Location: Santa Clara, California, United States.
• Employment type: Full time.
• Applications for this job will be accepted at least until November 16, 2025.
• NVIDIA is an equal opportunity employer committed to fostering a diverse work environment.