Principal Engineer, Distributed Systems - NIM Factory

Details

NVIDIA has become the platform upon which every new AI-powered application is built. We are seeking a principal engineer to architect and build factory automation for NVIDIA Inference Microservices (NIMs). The right person for this role is technical, creative and driven to change the way NVIDIA optimizes and serves performant inferencing for every AI model. Our NIM offerings are easy to use, highly performant and tested in all deployment scenarios, in the cloud, on customer’s self-hosted infrastructure and locally on all NVIDIA GPUs. You will apply your deep technical expertise to design an efficient, scalable and reliable automated service that will take AI models to become NIMs that are validated for best in class performance and accuracy.

Responsibilities

• Architect and build a software factory that will take an AI model and create deployable services across Cloud and On-prem Kubernetes environments.
• Design scalable services with resource efficiency to build and deploy distributed applications.
• Define and deliver rapid iterations of the group's technical strategies and roadmaps for a scalable NIM factory system.
• Deliver a highly scalable and reliable factory architecture that operates with very high uptime while performant.
• Collaborate with multiple AI model teams to understand their requirements and build an efficient infrastructure that improves productivity.
• Define metrics and drive improvements based on user feedback.
• Partner with our NIM leadership to deliver a cohesive product to customers.

Requirements

• You possess advanced programming skills to build distributed and compute systems, backend services, microservices and cloud technologies.
• Experience on designing and implementing highly scalable Cloud Services with well-defined APIs.
• Ability to work optimally with multi-functional teams, principals and architects, across organizational boundaries.
• Deep technical expertise in Microservices, K8s, Cloud Endpoints, Temporal, Helm, Prometheus, Kafka.
• Passion for building rich, microservice applications with automated build and test pipeline.
• Excellent interpersonal skills and the ability to lead multi-functional efforts.
• BS or MS in Computer Science, Computer Engineering or related field (or equivalent experience).
• 12+ years of proven experience in performant microservice and/or cloud technical leadership roles in an agile software development environment.
• 12+ years of demonstrated ability in build, debugging, performance analysis and optimization.

Benefits

• The base salary range is 272,000 USD - 419,750 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
• You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.