Product Marketing Manager - Inference Optimization Software

Details

Become a part of NVIDIA, the industry frontrunner in AI computing, and help us revolutionize AI-powered solutions. As an NVIDIAN, you'll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. We are looking for a technical product marketing manager who is passionate about model optimization and deployment to join NVIDIA's developer team. Inference is where AI delivers results, powering innovation across every industry. Optimized inference allows for larger models to be used in real world applications while increasing throughput, lowering cost, and reducing power consumption.

Responsibilities

• Build product positions by collaborating with business leaders across NVIDIA to understand and communicate the value of products to developers. Gather evidence, develop compelling product claims, and establish positioning points highlighting strengths and addressing competitors' weaknesses.
• Introduce products by developing and completing well-crafted marketing plans, ensuring consistent messaging across all materials. Collaborate with cross-functional teams including product management, technical marketing, engineering, campaign managers, and PR.
• Foster awareness by segmenting and targeting audiences, identifying asset gaps, and working with technical teams to build developer-centric marketing content such as blogs, webinars, tutorials showcasing TensorRT-LLM features.
• Engage publicly by representing NVIDIA at trade shows, conferences, and customer meetings. Evangelize and nurture use of software development kits to grow the NVIDIA developer community.

Requirements

• Familiarity with popular large language models like Llama, GPT, Gemma, and Phi.
• Understanding of kernel fusion, quantization, memory manipulation, and other model optimization techniques for inference deployment.
• Knowledge of inference ecosystem; experience with compilers such as OAI Triton, XLA, MLIR, and frameworks like PyTorch, JAX, and ONNX.
• Ability to explain core computer science concepts related to performance, such as Amdahl’s law.
• 10+ years of meaningful work experience in a technical marketing role related to deep learning software.
• Degree in Computer Science, Computer Engineering, or similar field (or equivalent experience).
• Proficiency in modern programming languages like Python.
• Outstanding written and verbal communication and interpersonal skills, able to articulate value propositions to technical and non-technical audiences.
• Ability to prioritize projects, work independently, and commit to results.
• Willingness to work on new products and technologies with an entrepreneurial spirit.
• Submission of writing samples of public-facing technical content.

Ways to Stand Out

• Experience in marketing inference optimization products.
• Familiarity with NVIDIA GPUs and the CUDA parallel programming model.
• Direct experience with NVIDIA TensorRT-LLM.
• Master's degree or equivalent experience from a leading university in software engineering or computer science.

Compensation and Benefits

The base salary range is 184,000 USD - 356,500 USD, determined by location, experience, and comparable employee pay. Eligible for equity and benefits. NVIDIA values diversity and is an equal opportunity employer.