Senior Technical Program Manager, AI Inference

at Nvidia

📍 Santa Clara, United States

USD 168,000-322,000 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 4 Agile @ 6 Communication @ 6 Deep Learning @ 4 GPU @ 4 Machine Learning @ 4

Details

NVIDIA’s AI Platform Inference team builds the inference technology that powers AI applications worldwide. The Senior Technical Program Manager will lead critical programs across software, hardware, and tooling, helping engineering teams move from roadmap to delivery. The role owns the full program lifecycle, from initial planning through delivery, in technically complex environments.

Responsibilities

Drive planning, scheduling, dependency tracking, and executive reporting across multiple concurrent inference programs.
Partner with hardware and software engineering leads to align library development with current and upcoming hardware timelines.
Coach teams on agile practices and run program rituals.
Build and maintain metrics that identify risks early and support data-driven decisions.
Communicate program status and technical context to engineering teams and senior leadership.
Align global, cross-disciplinary teams spanning hardware, software, and product.
Identify process gaps and implement improvements that increase delivery quality and team efficiency.
Moderate complex technical discussions and drive them to clear, documented conclusions.

Requirements

Bachelor’s degree in Computer Science, Artificial Intelligence, or equivalent experience.
10 years of experience leading global technical programs.
Solid knowledge of software engineering standard methodologies, hardware bring-up processes, and enterprise quality standards.
Proficiency with Scaled Agile frameworks and program tracking tools.
Ability to resolve resource conflicts, unblock teams, and drive alignment at every level of the organization.
Clear, compelling communication skills across technical and business audiences.

Preferred Qualifications

Experience in machine learning, deep learning, GPU technology, or AI infrastructure.
Experience shipping production AI software or co-managing software-hardware programs end to end.
Experience building scalable program management practices in growing engineering organizations.
Mentorship skills and a commitment to investing in surrounding teams.
Familiarity with open-source inference frameworks or model optimization tooling.

Compensation and Benefits

Base salary range for Level 4: USD 168,000–258,750 per year.
Base salary range for Level 5: USD 200,000–322,000 per year.
Eligible for equity and benefits.
Applications will be accepted at least until October 27, 2026.
NVIDIA is an equal opportunity employer committed to an inclusive work environment.