Senior Technical Product Manager – AI Agents

at Nvidia
USD 168,000-258,800 per year
SENIOR
βœ… On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Security @ 3 Software Development @ 8 MLOps @ 8 Product Management @ 4 API @ 3 LLM @ 3

Details

NVIDIA is the defining technology company of the Artificial Intelligence era. The Enterprise Product Group is building end-to-end platforms and solutions that integrate NVIDIA's stack with the evolving AI agent ecosystem. This senior technical product manager role will help steer the future of agentic AI and lead foundational products such as the NeMo Agent toolkit and the AI‑Q Blueprint.

Responsibilities

  • Collaborate across functions to discover AI solutions developed internally and adapt them into enterprise offerings for customers.
  • Maintain a deep technical understanding of the domain through rapid prototyping, expert conversations, and hands-on development and testing.
  • Represent NVIDIA and gain recognition in the AI agent field through publishing, presentations, and community engagement.
  • Work closely with internal teams, software ecosystem partners, and the open-source agent community to define shared initiatives and prioritize features based on customer feedback.
  • Author clear requirements documents projecting desired future states and develop product roadmaps with engineering and program management.
  • Make informed product decisions grounded in experience, research, and intuition.

Requirements

  • Experience with generative AI technologies and approaches, including training, inference, customization, and evaluation.
  • Proficient knowledge of the AI agent landscape, including open-source frameworks, agent structures, and ISV offerings.
  • Familiarity with LLM agents, tool calling, APIs, and output schema.
  • Experience with LLM and RAG optimization techniques such as model fine-tuning, retrieval re-ranking, query expansion, and prompt engineering.
  • Familiarity with developer concerns when deploying production software: security, identity, telemetry, data governance.
  • BS or MS in Computer Science, Electrical Engineering, or equivalent experience.
  • 10+ years of combined experience in software development, MLOps, and/or technical product management.
  • 8+ years of experience building and shipping software, hardware, or platform infrastructure solutions for enterprises.

Ways to stand out

  • Hands-on experience architecting multi-step, tool-using LLM agents to automate complex research workflows (data interrogation, hypothesis validation, evidence synthesis).
  • Recent research publications and/or contributions to open-source agent frameworks.
  • Ability to reduce complexity to simplicity when explaining agentic workflows.
  • Experience with NVIDIA technologies, particularly NeMo, NIM, or Triton Inference Server.

Compensation & Benefits

  • Base salary range: 168,000 USD - 258,750 USD (final base determined by location, experience, and comparable pay).
  • Eligible for equity and benefits (see NVIDIA benefits page).

Additional information

  • Applications accepted at least until August 30, 2025.
  • NVIDIA is an equal opportunity employer committed to diversity and inclusion.