Used Tools & Technologies
GPURequired Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Algorithms @ 3
Leadership @ 6
Communication @ 3
Jira @ 2
Debugging @ 3
Project Management @ 2
LLM @ 6
Deep Learning @ 3
AI @ 3
vLLM @ 3
TensorRT @ 3
SGLang @ 3
Performance Analysis @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
NVIDIA is seeking an engineering manager to lead engineering activities related to productizing deep learning models. Academic and commercial groups around the world are using GPUs to redefine artificial intelligence and data analytics, and to power data centers. You will interact with the scientific community to implement and improve the latest algorithms and work on software used by a global user base. The role requires the ability to work in a multifaceted, product-centric environment and excellent interpersonal skills.
Responsibilities
- Plan, schedule, mentor, and lead the execution of projects and activities of the team, including creating, optimizing, and deploying inference deep learning workloads.
- Collaborate with internal customers to align priorities across business units.
- Coordinate projects across different geographic locations.
- Grow and develop a world-class team; lead and mentor engineers.
- Travel to conferences, other sites, or visit customers occasionally.
- Own activities and interactions with teams across NVIDIA for roadmap development of highly optimized novel and state-of-the-art numerical, analytics, and deep learning algorithms and associated R&D duties.
Requirements
- Minimum requirement of BSc or equivalent experience.
- 8+ years of overall related experience, including 3 years of management/leadership experience.
- Experience leading multiple software engineering projects.
- Strong experience with Large Language Models (LLMs) and Large Visual-Language Models (VLMs).
- Good understanding of deep learning and a strong algorithmic background, with exposure to large-scale LLM/VLM deployment and inference optimization.
- Excellent programming, debugging, performance analysis, and test design skills.
- Great communication and interpersonal skills.
Ways to stand out
- Experience with inference of deep learning models.
- Experience doing performance analysis and tuning.
- Exposure to inference platforms such as TensorRT-LLM, vLLM, and SGLang.
- Familiarity with project management tools (e.g., JIRA, Microsoft Project).
Compensation & Other Details
- Base salary ranges (location, experience, and peer pay dependent):
- Level 3: 224,000 USD - 356,500 USD per year
- Level 4: 272,000 USD - 431,250 USD per year
- Eligible for equity and benefits.
- Applications accepted at least until July 11, 2026.
- NVIDIA uses AI tools in its recruiting processes.
- NVIDIA is an equal opportunity employer and is committed to fostering an inclusive work environment.
More jobs at Nvidia
Senior Systems Software Engineer, Observability and Telemetry Platform
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Systems Software Engineer – GPU Software
Nvidia · Santa Clara, United States
USD 152,000-241,500 per year
Senior Software Engineer, CUDA Core Libraries
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Principal Engineer, Applied Research - Accelerator Programming Model and Compiler
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Senior System Software Architect - Halos Core and Robotics Platform
Nvidia · Santa Clara, United States
USD 224,000-431,200 per year
Similar jobs
Principal Deep Learning Communication Architect
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
AI Inference Performance Engineer
Nvidia · Santa Clara, United States
USD 152,000-241,500 per year
System Software Engineer, Dynamo-Triton Inference Server - New College Grad 2026
Nvidia · Santa Clara, United States
USD 124,000-241,500 per year
Principal ML Solutions Architect - Token Factory
Nebius · United States
USD 208,000-261,000 per year
Principal Software Engineer, E2E Performance and Goodput — CSP Engagements
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Senior Inference Engineer, AIConfigurator for Dynamo
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Deep Learning Frameworks CUDA Software Engineer
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year
Senior Software Engineer, RL Post-Training Frameworks
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year