Senior Technical Product Manager - AI Infrastructure

at Nvidia
USD 208,000-327,800 per year
SENIOR
βœ… On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Marketing @ 4 Docker @ 4 Kubernetes @ 4 Linux @ 7 MLOps @ 3 Leadership @ 7 Communication @ 7 Networking @ 4 IaaS @ 3 Product Management @ 4 OSS @ 7 LLMOps @ 3

Details

NVIDIA data centers power advanced research and AI products. This role is for a Senior Product Manager who will drive the roadmap and deliver features across Data Center Infrastructure, Kubernetes container management, and AI training software used by researchers and developers. The position focuses on building complex, usable products that improve AI developer efficiency and customer outcomes.

Responsibilities

  • Define product strategy and solutions for NVIDIA Enterprise Infrastructure products using NVIDIA DGX and NVIDIA Networking.
  • Create go-to-market (GTM) collateral and evangelize solutions to customers, sales, and marketing teams.
  • Distill insights from strategic customers and partners to define, prioritize, and execute product roadmaps.
  • Engage with internal collaborators and ecosystem partners to define solutions that improve customer experience and efficiency at the data center solution level.
  • Lead product lifecycle from ideation to launch and post-launch support.

Requirements

  • BS or MS in Computer Science, Computer Engineering, or similar field (or equivalent experience) and 12+ years of product management or similar experience at a technology company serving enterprises.
  • Proven product management experience serving enterprise customers.
  • Deep understanding of AI/ML infrastructure, high-performance computing (HPC), and networking.
  • Technical expertise in server platform design and architecture (GPUs, CPUs, storage, networking).
  • Proficiency in network architecture and protocols including Infiniband, Ethernet, and RoCE.
  • Experience with containerization technologies (e.g., Docker), Kubernetes, and virtualization.
  • Familiarity with cloud technologies (IaaS, PaaS) and automation tools.
  • Knowledge of AI/ML training and inference, including Large Language Models (LLMs) and Generative AI (Gen AI).
  • Strong leadership, communication, and interpersonal skills to collaborate with cross-functional teams.
  • Strategic and analytical thinking with the ability to balance high-level strategy and detailed planning.

Ways to Stand Out

  • Familiarity with the MLOps and LLMOps ecosystem and experience building integrations with popular enterprise platforms.
  • Experience deploying systems at scale in modern data center environments.
  • Direct experience using or building Gen AI services for automation or information retrieval.
  • Deep experience in Linux and open-source software (OSS) automation tools.

Benefits & Compensation

  • Base salary range: 208,000 USD - 327,750 USD (actual base salary determined by location, experience, and pay of employees in similar positions).
  • Eligible for equity and benefits (see https://www.nvidia.com/en-us/benefits/ for details).

Additional Info

  • Applications accepted at least until July 29, 2025.
  • NVIDIA is an equal opportunity employer and values diversity in its workforce. NVIDIA does not discriminate on the basis of legally protected characteristics.