Senior Inference Technical Product Marketing Manager - Accelerated Computing

Details

We are looking for a Senior Technical Product Marketing Manager in our rapidly growing data center business, pivotal in inference marketing. The role involves working closely with engineering to understand technical capabilities of the inference stack, including GPUs, CPUs, networking, CUDA libraries, model architectures, and deployment techniques such as parallelisms and configurations. This position influences NVIDIA’s technical marketing strategy showcasing leadership in AI inference.

Responsibilities

• Drive NVIDIA’s inference platform technical go-to-market efforts.
• Collaborate with engineering and product management to understand the inference stack’s key technical capabilities.
• Stay updated on model architectures, frameworks, papers, deployment techniques, and identify intersections with NVIDIA’s platform to optimize performance and cost.
• Develop clear positioning, messaging, and marketing assets (blogs, whitepapers, presentations, analyst briefings, seminars at conferences).
• Monitor competitive inference announcements and prepare responses for technical and business audiences.
• Assist in building keynote slides for executives as a subject matter expert.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or related field; Master’s preferred.
• 6+ years in LLM, AI/ML development engineering role and 5+ years in product management or technical product marketing for AI/ML products.
• Deep understanding of data center architectures, accelerated computing, distributed inference, deep learning frameworks (PyTorch, TensorFlow, JAX), and inference-specific frameworks & optimizations (Dynamo, Triton Inference Server, TensorRT-LLM, vLLM, SGLang).
• Experience in technical competitive analysis and insights synthesis.
• Proven cross-functional collaboration with engineering, product management, sales, and marketing.
• Strong communication and storytelling skills to translate complex concepts for varied audiences.
• Ability to present to executive audiences.

Ways to Stand Out

• Hands-on experience with AI inference workflows using NVIDIA or open-source serving frameworks on accelerated data center computing.
• Experience developing LLM models.
• Experience with hyperscale cloud providers.
• Software development background in AI infrastructure or data center silicon.
• Engagement with executive leadership and external partners.
• Published technical content or industry speaking engagements.
• Portfolio of published marketing/launch assets.

NVIDIA is a forward-thinking technology employer fostering diversity and creativity, aiming for an environment in which you can do your life’s best work.

#LI-Hybrid