Principal Engineer, Distributed Systems - NIM Factory

Details

NVIDIA has become the platform upon which every new AI-powered application is built. We are seeking a principal engineer to architect and build factory automation for NVIDIA Inference Microservices (NIMs). The right person for this role is technical, creative and driven to change the way NVIDIA optimizes and serves performant inferencing for every AI model. Our NIM offerings are easy to use, highly performant and tested in all deployment scenarios, in the cloud, on customer’s self-hosted infrastructure and locally on all NVIDIA GPUs. You will apply your deep technical expertise to design an efficient, scalable and reliable automated service that will take AI models to become NIMs that are validated for best in class performance and accuracy.

NVIDIA is building a new category of products by intersecting our prowess in deep learning and computing with industry-leading technologies. You will harness groundbreaking technologies, and build highly efficient factory to power how NVIDIA builds and validates NIMs for Inferencing all the way through deployment in heterogeneous hardware and software environments. You will influence and drive technical advances in NVIDIA’s workflows and build the cross-functional infrastructure and software platform that strives to accelerate the delivery of every AI model on NVIDIA's GPUs anywhere. We are looking for a principal engineer to design and build our factory capabilities, including the underlying infrastructure, software platform, backends, containerized build, test harness, with metrics and traceability.

Responsibilities

• Architect and build a software factory that will take an AI model and create deployable services across Cloud and On-prem Kubernetes environments.
• Design scalable services with resource efficiency to build and deploy distributed applications.
• Define and deliver rapid iterations of group’s technical strategies and roadmaps for a scalable NIM factory system.
• Deliver a highly scalable and reliable factory architecture that operates with very high uptime while performant.
• Collaborate with multiple AI model teams to understand their requirements and build an efficient infrastructure that improves productivity.
• Define metrics and drive improvements based on user feedbacks.
• Partner with our NIM leadership to deliver a cohesive product to customers.

Requirements

• You possess advanced programming skills to build distributed and compute systems, backend services, microservices and cloud technologies.
• Experience on designing and implementing highly scalable Cloud Services with well defined APIs.
• Ability to work optimally with multi-functional teams, principals and architects, across organizational boundaries.
• Deep technical expertise in Microservices, K8s, Cloud Endpoints, Temporal, Helm, Prometheus, Kafka.
• Passion for building rich, microservice applications with automated build and test pipeline.
• Excellent interpersonal skills and the ability to lead multi-functional efforts.
• BS or MS in Computer Science, Computer Engineering or related field (or equivalent experience).
• 12+ years of proven experience in performant microservice and/or cloud technical leadership roles in an agile software development environment.
• 12+ years of demonstrated ability in build, debugging, performance analysis and optimization.

Ways to stand out from the crowd:

• Highly proficient in building distributed systems, Microservices, Cloud and On-prem deployments, and CI/CD pipelines.
• Prior experience in working with large scale full stack development.

We are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and talented people in the world working for us. If you’re creative and autonomous with a real passion for technology we want to hear from you.