Software Manager, AI Infrastructure System

Details

NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI and enabled the next era of computing. NVIDIA is a “learning machine” that constantly evolves by adapting to new opportunities that are hard to address, matters to the world, and that only we can address. This is our life’s work, to amplify human imagination and intelligence, and expand what is possible. We’re seeking strategic, bold, hard-working, and creative individuals who are passionate about helping us tackle challenges no one else can solve. Make the choice to join us today.

Responsibilities

• Mentor, grow, and develop a world-class team of AI infrastructure engineers.
• Work across several teams and organizations to build products that use LLMs and agent systems to serve the needs of NVIDIA engineering teams, collaborating with research and infrastructure teams and serving a large user base (hardware/software teams across NVIDIA).
• Align priorities across collaborators and define metrics for measuring the success of the product/team.
• Develop and execute strategies for scalable, reliable, and secure AI infrastructure supporting both research and production workloads.
• Ensure robust monitoring, logging, visualization, and alerting capabilities to guarantee promised uptime and operational excellence.
• Architect, design, develop, and maintain infrastructure and large-scale applications for LLM-based solutions, optimizing these systems for performance, scalability, reliability, and secure data management.
• Stay updated with the latest trends in AI, ML, and infrastructure, proactively seeking opportunities to integrate advancements into NVIDIA’s LLM and AI infrastructure solutions.

Requirements

• 10+ years of industry large distributed system software development experience.
• BS+ degree in Computer Science or related/equivalent experience.
• 5+ years of experience managing AI and software development teams.
• Familiarity with modern software development stacks and tools, including containerization, cloud or on-premises deployments, API integration for seamless model operation, and real-time processing frameworks.
• Experience in developing and maintaining LLM or Generative AI infrastructure.
• Excellent communication, collaboration, and problem-solving skills, with a dedication to encouraging an inclusive and diverse workplace.
• Hands-on experience developing large-scale distributed systems.

Ways to Stand Out

• Strong technical background in cloud/distributed infrastructure.
• Experience debugging functional and performance issues in HPC GPU clusters.
• Background in running and instrumenting distributed LLM training on a multi GPU HPC cluster.
• Experience with HPC schedulers such as Slurm.

Widely considered one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. More details available at www.nvidiabenefits.com.