Senior Technical Program Manager, Cloud Infrastructure, Observability and Systems Monitoring

at Nvidia
USD 200,000-379,500 per year
SENIOR
✅ On-site

Used Tools & Technologies

Not specified

Required Skills & Competences

Grafana @ 4 Kubernetes @ 3 VictoriaMetrics @ 4 Hiring @ 4 Leadership @ 4 Communication @ 4 Jira @ 4 Agile @ 6 OpenTelemetry @ 4 GPU @ 4 Deep Learning @ 4 Observability @ 7 AI @ 4 InfiniBand @ 4 NVLink @ 4

Details

NVIDIA's deep learning platforms lead innovation across academia, startups, and major Internet companies worldwide. The DGX Cloud team is seeking a seasoned Principal Technical Program Manager (TPM) with deep knowledge of observability, systems telemetry, and cloud infrastructure operations to collaborate with hardware/software supply teams, DGXC operations, and external Cloud Service Providers (CSPs and NCPs) to develop unified telemetry mentorship and confirm operational readiness worldwide.

Responsibilities

  • Collaborate closely with Engineering, Infrastructure, and Software teams to lead programs focused on telemetry and data center fleet health & management.
  • Establish a balanced feedback loop between DGX Cloud and other NVIDIA organizations to align and unify telemetry requirements and mentorship for external partners.
  • Drive the end-to-end telemetry lifecycle for upcoming NVIDIA Cloud Providers (NCPs): ensure requirements are committed, delivered, and ingested into a centralized telemetry platform for DGXC operations.
  • Participate in early product lifecycle (Day -1 / Day 0) reviews to examine Plan of Record (POR) for new silicon, systems, firmware, and software architectures to ensure telemetry requirements for advanced tenants are coordinated.
  • Collaborate across technical domains (including NVLink, InfiniBand, SpectrumX, GPU, CPU, and DPU or equivalent experience) to establish standard telemetry operations mentorship across NVIDIA.
  • Drive a program for NVIDIA’s attestation platform to verify device integrity, authenticity, and trust across the accelerated computing ecosystem.
  • Provide leadership and mentorship to the DGXC TPM organization and drive process improvements.
  • Improve day-to-day efficiency by demonstrating and building AI tools (examples given: Claude Co-Work, NotebookLM, Glean, and building NemoClaw agents) to automate manual workflows such as Jira management.
  • Develop and execute a robust communication strategy to ensure cross-functional visibility on program progress, including regular presentations to NVIDIA executive leadership.

Requirements

  • 12+ years of technical program management experience, specifically driving planning and execution of large-scale engineering, cloud infrastructure, and observability programs within a matrixed organization.
  • Extensive practical experience managing cloud infrastructure, ideally from employment at a leading Cloud Service Provider (CSP).
  • Proven ability to act as the interface between cross-functional organizations, managing complex feedback loops and resolving misaligned requirements.
  • Expert-level proficiency with Jira, Smartsheet, or similar program management tools; ability to guide engineering teams on their effective use within an Agile framework.
  • Outstanding strategic and tactical thinking, with strong capacity to build consensus and drive program success across diverse business units.
  • Excellent communication and technical presentation skills, particularly for executive audiences.
  • BS or MS in Electrical Engineering or Computer Science, or equivalent experience.

Ways to stand out

  • Comprehensive knowledge of NVIDIA architectures and interconnects, including deployment, bring-up, and telemetry requirements for GPUs, NVLink, and InfiniBand.
  • Experience with observability technologies such as OpenTelemetry (OTel), Grafana, Warpstream, VictoriaMetrics, and Loki.
  • Familiarity with cloud platform architecture, cloud-native services, and Kubernetes.
  • A proactive, process-improvement oriented mindset and the ability to guide teams through ambiguity.

Compensation & Benefits

  • Base salary ranges (determined by location, experience, and internal pay parity):
    • Level 5: 200,000 USD - 322,000 USD
    • Level 6: 240,000 USD - 379,500 USD
  • Eligible for equity and benefits. (Links provided in original posting.)

Additional details

  • Applications accepted at least until April 28, 2026.
  • This posting is for an existing vacancy.
  • NVIDIA uses AI tools in its recruiting processes.
  • NVIDIA is an equal opportunity employer and provides nondiscriminatory hiring and promotion practices.

More jobs at Nvidia

Similar jobs