Senior Technical Program Manager, Cloud Infrastructure

at Nvidia
USD 168,000-322,000 per year
SENIOR
✅ On-site

Tech Stack

AI @ 4 Agile @ 6 Communication @ 6 Deep Learning Distributed Systems @ 3 GPU @ 4 HPC Jira @ 6 Kubernetes @ 3 Security

Details

NVIDIA's deep learning platforms are at the forefront of innovation and are widely adopted by academic institutions, startups, and major Internet companies globally. The NVIDIA DGX Cloud team is seeking an accomplished Technical Program Manager to deliver value to DGX Cloud customers.

The role focuses on CSP/NCP cloud environments, on-premises infrastructure bring-up, and hardware automation.

Responsibilities

  • Coordinate end-to-end remote bootstrapping, active bring-up, and validation of large server fleets, taking clusters from physical rack-and-stack through customer-ready deployment.
  • Drive adoption of automation tooling for fleet maintenance, node security, and burn-in, and establish workflows to triage and resolve day-one deployment issues.
  • Partner with NVIDIA software teams to integrate and deploy DSX and other core software stacks in on-premises environments.
  • Lead capacity operations focused on availability, maintenance, and multi-tiered infrastructure workflows.
  • Drive capacity onboarding and operations with NCP partners as part of internal DGX Cloud capacity.
  • Coordinate technology roadmaps across NVIDIA engineering teams with physical data center readiness timelines.
  • Gather requirements, build roadmaps, and manage risks under the Product Lifecycle framework for bare-metal capacity deployment.
  • Use Jira and program management tools to support structured execution across engineering and data center teams.
  • Establish metrics to track program velocity, infrastructure availability, and cluster health.
  • Develop communication strategies and facilitate collaborative weekly operations reviews.

Requirements

  • 8+ years of technical program management experience, specifically planning and executing cloud infrastructure programs involving hardware and software integration across multiple engineering teams.
  • Extensive hands-on experience with cloud or on-premises enterprise infrastructure, data center bring-up, bare-metal deployments, and hardware infrastructure.
  • Expert-level proficiency with Jira, Smartsheet, or similar program management tools, including designing ticket queues and guiding engineering teams within an Agile/Scrum framework.
  • Strong strategic and tactical thinking, consensus-building, operational workflow development, and program execution skills.
  • Excellent communication, collaboration, and technical presentation skills, including the ability to align senior, multifunctional stakeholders.
  • Bachelor's or master's degree in Electrical Engineering or Computer Science, or equivalent experience.

Preferred Qualifications

  • In-depth knowledge of NVIDIA GPU products, cluster deployment, validation testing, and high-performance computing infrastructure bring-up.
  • Experience managing dependencies between AI software stacks and physical infrastructure.
  • Experience with accelerated deployment schedules, such as rapid 30-day data center rollouts, and asset-backed operational models.
  • Experience establishing automated server benchmarking, burn-in, and infrastructure health validation workflows.
  • Familiarity with cloud-native architectures, managed Kubernetes platform layers, and distributed systems.
  • Experience with productivity tools, process automation, and establishing standard operating guidelines across technical domains.

Benefits

NVIDIA offers competitive salaries, equity, and a comprehensive benefits package. The base salary is determined by location, experience, and compensation for similar positions.

  • Level 4 base salary: USD 168,000–258,750 per year
  • Level 5 base salary: USD 200,000–322,000 per year

Applications will be accepted at least until October 19, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes and is an equal opportunity employer.

More jobs at Nvidia

Similar jobs