Senior Technical Program Manager, Cloud Infrastructure, Observability and Systems Monitoring
at Nvidia
USD 200,000-379,500 per year
Used Tools & Technologies
Not specified
Required Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Grafana @ 4
Kubernetes @ 3
VictoriaMetrics @ 4
Hiring @ 4
Leadership @ 4
Communication @ 4
Jira @ 4
Agile @ 6
OpenTelemetry @ 4
GPU @ 4
Deep Learning @ 4
Observability @ 7
AI @ 4
InfiniBand @ 4
NVLink @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
NVIDIA's deep learning platforms lead innovation across academia, startups, and major Internet companies worldwide. The DGX Cloud team is seeking a seasoned Principal Technical Program Manager (TPM) with deep knowledge of observability, systems telemetry, and cloud infrastructure operations to collaborate with hardware/software supply teams, DGXC operations, and external Cloud Service Providers (CSPs and NCPs) to develop unified telemetry mentorship and confirm operational readiness worldwide.
Responsibilities
- Collaborate closely with Engineering, Infrastructure, and Software teams to lead programs focused on telemetry and data center fleet health & management.
- Establish a balanced feedback loop between DGX Cloud and other NVIDIA organizations to align and unify telemetry requirements and mentorship for external partners.
- Drive the end-to-end telemetry lifecycle for upcoming NVIDIA Cloud Providers (NCPs): ensure requirements are committed, delivered, and ingested into a centralized telemetry platform for DGXC operations.
- Participate in early product lifecycle (Day -1 / Day 0) reviews to examine Plan of Record (POR) for new silicon, systems, firmware, and software architectures to ensure telemetry requirements for advanced tenants are coordinated.
- Collaborate across technical domains (including NVLink, InfiniBand, SpectrumX, GPU, CPU, and DPU or equivalent experience) to establish standard telemetry operations mentorship across NVIDIA.
- Drive a program for NVIDIA’s attestation platform to verify device integrity, authenticity, and trust across the accelerated computing ecosystem.
- Provide leadership and mentorship to the DGXC TPM organization and drive process improvements.
- Improve day-to-day efficiency by demonstrating and building AI tools (examples given: Claude Co-Work, NotebookLM, Glean, and building NemoClaw agents) to automate manual workflows such as Jira management.
- Develop and execute a robust communication strategy to ensure cross-functional visibility on program progress, including regular presentations to NVIDIA executive leadership.
Requirements
- 12+ years of technical program management experience, specifically driving planning and execution of large-scale engineering, cloud infrastructure, and observability programs within a matrixed organization.
- Extensive practical experience managing cloud infrastructure, ideally from employment at a leading Cloud Service Provider (CSP).
- Proven ability to act as the interface between cross-functional organizations, managing complex feedback loops and resolving misaligned requirements.
- Expert-level proficiency with Jira, Smartsheet, or similar program management tools; ability to guide engineering teams on their effective use within an Agile framework.
- Outstanding strategic and tactical thinking, with strong capacity to build consensus and drive program success across diverse business units.
- Excellent communication and technical presentation skills, particularly for executive audiences.
- BS or MS in Electrical Engineering or Computer Science, or equivalent experience.
Ways to stand out
- Comprehensive knowledge of NVIDIA architectures and interconnects, including deployment, bring-up, and telemetry requirements for GPUs, NVLink, and InfiniBand.
- Experience with observability technologies such as OpenTelemetry (OTel), Grafana, Warpstream, VictoriaMetrics, and Loki.
- Familiarity with cloud platform architecture, cloud-native services, and Kubernetes.
- A proactive, process-improvement oriented mindset and the ability to guide teams through ambiguity.
Compensation & Benefits
- Base salary ranges (determined by location, experience, and internal pay parity):
- Level 5: 200,000 USD - 322,000 USD
- Level 6: 240,000 USD - 379,500 USD
- Eligible for equity and benefits. (Links provided in original posting.)
Additional details
- Applications accepted at least until April 28, 2026.
- This posting is for an existing vacancy.
- NVIDIA uses AI tools in its recruiting processes.
- NVIDIA is an equal opportunity employer and provides nondiscriminatory hiring and promotion practices.
More jobs at Nvidia
Senior Systems Software Engineer, Observability and Telemetry Platform
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Systems Software Engineer – GPU Software
Nvidia · Santa Clara, United States
USD 152,000-241,500 per year
Senior Software Engineer, CUDA Core Libraries
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Principal Engineer, Applied Research - Accelerator Programming Model and Compiler
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Senior System Software Architect - Halos Core and Robotics Platform
Nvidia · Santa Clara, United States
USD 224,000-431,200 per year
Similar jobs
Principal Software Engineer, Rack-Scale System Software — CSP Engagements
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Senior GPU And HPC Infrastructure Engineer - DGX Cloud
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Full-Stack Software Engineer – Verification Data and Visualization Platform
Nvidia · Santa Clara, United States
USD 152,000-287,500 per year
Senior Software Engineer - Datacenter Systems
Nvidia · Santa Clara, United States
USD 184,000-287,500 per year
NCX Engineer, AI Accelerator
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Member of Technical Staff - Observability
xAI · Palo Alto, United States
USD 180,000-440,000 per year
Principal Network Automation Engineer
Nvidia · Santa Clara, United States
USD 248,000-396,800 per year
Senior HPC Cluster Engineer
Nvidia · Santa Clara, United States
USD 152,000-287,500 per year