Senior Manager, Software Engineering - NIM Factory

Details

NVIDIA is seeking a deeply technical, hands-on Senior Engineering Manager to lead the NVIDIA Inference Microservices (NIM) Factory team. The team delivers day-10 model launches and enterprise-grade software, providing reliable, performant, and secure AI services at massive scale. You will partner with product, research, SRE, and security teams to define strategy, drive execution across multiple workstreams, and safeguard the long-term technical health of the platform.

Responsibilities

• Lead the NIM Factory engineering team across containers, orchestration, workflow, observability, and platform APIs.
• Attract, hire, onboard, and develop top engineering talent.
• Define the vision, strategy, and roadmap for building, shipping, and operating NIM from day-10 launch through enterprise-grade hardening, including security, reliability, performance, and compliance.
• Own end-to-end delivery of cross-functional programs, align stakeholders, and manage dependencies.
• Drive predictable delivery across multiple programs by managing priorities, resourcing, schedules, and dependencies.
• Establish engineering excellence through code health and reviews, documentation, CI/CD, and testing.
• Collaborate with research and platform teams on inference architecture and scalable deployment patterns.

Requirements

• 10+ years of experience building and delivering production software systems, including 5+ years leading engineering teams as a manager. Experience leading multiple teams or managing managers is a plus.
• Proven track record driving complex, cross-functional programs from inception through successful production launch and scale.
• Strong foundation in cloud-native engineering, including containers, Kubernetes, and microservices.
• Experience with modern software development lifecycle practices, including CI/CD, testing, and observability.
• Proficiency with cloud languages such as Python, with the ability to read code, guide designs, and drive high-quality engineering outcomes.
• Demonstrated ability to hire, coach, and develop senior engineers and technical leads; build inclusive teams; and establish a culture of ownership and excellence.
• Excellent communication and stakeholder-management skills, with the ability to influence product, research, security, and operations teams.
• Bachelor's or master's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.

Preferred Qualifications

• Experience leading teams that built and operated large-scale LLM inference or model-serving platforms such as Triton, TensorRT-LLM, or vLLM in production.
• Experience architecting next-generation container build systems or CI/CD platforms at scale.
• Experience building organizations across multiple time zones and establishing durable engineering processes that improve quality and velocity.
• Proven success building talent pipelines, mentoring managers and technical leads, and increasing team engagement and retention.
• Contributions to open-source ecosystems, technical publications, or talks in containers, Kubernetes, GPU, or inference communities.

Benefits

• Equity and benefits are provided.
• NVIDIA is an equal opportunity employer committed to an inclusive work environment.

Applications will be accepted at least until August 17, 2026. The posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.