Senior Software Engineer, NeMo Core Platform

Details

NVIDIA is looking for a Senior Software Engineer to help build NeMo Platform, a product for developing, evaluating, deploying, and operating AI systems at scale. The Core team owns and ships an open-source, plugin-based AI platform for running and optimizing agents across multiple compute backends, including local or Docker environments, Kubernetes, and Slurm.

As AI systems become more autonomous and integrated into real workflows, NeMo Platform provides APIs and orchestration systems for running, monitoring, and optimizing agents at scale. The platform enables agents to run hundreds of experiments in parallel to identify efficient agent architectures, reduce token usage, and improve model throughput.

Responsibilities

• Work in a product research environment involving fast iteration, high ownership, pragmatic decisions, and performance-minded implementation under production constraints.
• Design an agentic execution system that works across local, Kubernetes, Slurm, on-premises, and air-gapped environments.
• Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems.
• Build and maintain Core Platform APIs for running jobs, storing data, managing entities and secrets, and implementing RBAC and authentication.
• Extend the flexible plugin architecture to allow internal teams and external customers to install new capabilities.
• Build in the open in the open-source repository while maintaining high community standards.
• Improve reliability, observability, debuggability, and performance across NeMo Platform, SDKs, plugins, jobs, and developer workflows.
• Build strong test coverage across unit, integration, end-to-end, Docker, and Kubernetes workflows.

Requirements

• Bachelor’s degree, master’s degree, or equivalent experience in Computer Science, Computer Engineering, or a related technical field.
• 10+ years of professional software engineering experience building production systems.
• Comfort working in a fast and ambiguous environment.
• Exceptional verbal and written communication skills, including the ability to produce and review high-quality architectural RFCs and communicate technical details effectively to engineering, product, and marketing audiences.
• Strong system design skills and a pragmatic approach to designing robust systems without unnecessary complexity.
• Strong understanding of reliability, scalability, security, and performance trade-offs in production infrastructure.
• Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration.
• Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design.
• Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces.
• Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries.

Preferred Qualifications

• Experience building, deploying, and iterating on production agentic AI systems at scale in Kubernetes.
• Experience with sophisticated plugin architectures.
• Ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency.
• Experience with enterprise AI systems requiring measurement, regression testing, observability, governance, and continuous improvement for production deployment.

Compensation and Benefits

• Level 4 base salary: CAD 170,000–220,000 per year.
• Level 5 base salary: CAD 225,000–275,000 per year.
• Eligibility for equity and benefits.
• Applications will be accepted at least until October 2, 2026.
• This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.