Director, Technical Program Management - AI and ML Platforms

Details

The DGX Cloud organization builds and operates the AI infrastructure that enables NVIDIA researchers to develop, train, and deploy AI models globally. This Director of Technical Program Management (TPM) role will lead AI/ML Platform initiatives within the DGX Cloud Infrastructure team, scaling and coordinating multi-functional programs across hardware, orchestration, and developer productivity for NVIDIA's advanced GPU systems.

Responsibilities

• Lead and scale the Technical Program Management organization responsible for the DGX Cloud AI/ML platform, enabling 1,000+ NVIDIA researchers globally.
• Drive the roadmap for end-to-end AI/ML infrastructure, spanning cluster bring-up, workload orchestration, GPU resource management, and integration with MLOps pipelines.
• Coordinate with NVIDIA Research, DGX Engineering, and Cloud Operations to align platform capabilities with AI model development and researcher workflows.
• Lead complex programs involving next-generation systems (e.g., GB200) and fleet-wide scaling initiatives across OCI, GCP, and other hyperscalers.
• Own platform efficiency and capacity management, using deep understanding of scheduling systems (e.g., Slurm, hybrid models) to optimize job placement, utilization, and turnaround time.
• Establish data-driven operational metrics (occupancy, wait times, throughput) and use them to guide continuous improvement and prioritization.
• Implement governance and visibility frameworks that drive alignment, predictability, and accountability across AI platform initiatives.
• Represent DGX Cloud programs to senior leadership, articulating impact, risk, and value across engineering and research organizations.

Requirements

• 15+ years of technical program management experience, including 7+ years leading and developing TPM teams in infrastructure, AI/ML, or platform engineering domains.
• Demonstrated success implementing AI and machine learning systems and platform initiatives at large scale, including workload coordination, data pipeline incorporation, model training environments, and GPU fleet supervision.
• Deep technical understanding of AI/ML workflows, job scheduling (Slurm, Kubernetes, hybrid orchestration), and large-scale distributed systems.
• Proficiency optimizing resource usage and monitoring performance metrics in compute-heavy settings.
• Experience building platforms across cloud and on-prem hybrid architectures and integrating with internal and external MLOps stacks.
• Proficiency with observability and telemetry tools (e.g., Grafana, Prometheus) for infrastructure monitoring and performance analysis.
• Bachelor or Master in Computer Science, Engineering, or related field (or equivalent experience).

Ways to Stand Out

• Proven proficiency across AI/ML systems, model lifecycle oversight, and developer tools for large training tasks.
• Track record driving R&D productivity platforms and reducing friction for machine learning practitioners.
• Experience in new product introduction (NPI) for research and infrastructure systems.
• Deep familiarity with cloud compute and orchestration technologies, automation, and operational excellence.
• Strong executive communication skills, able to translate complex technical programs into clear business and research outcomes.

Compensation & Benefits

• Base salary range: 264000 USD - 402500 USD (determined by location, experience, and comparable pay).
• Eligibility for equity and company benefits (see NVIDIA benefits page).
• Applications accepted at least until November 3, 2025.

Other

• Hybrid role (#LI-Hybrid).
• NVIDIA is an equal opportunity employer committed to a diverse work environment.