Senior Manager, AI Infrastructure Engineering - DGX Cloud

Details

We are looking for a seasoned leader to provide strategic direction and guidance to the operational and AI tooling team in a large-scale, mission-critical environment. This is a people-focused role where you will drive operational excellence by maturing our incident response, change management, problem management, and issue management tooling. You will foster a blameless culture of continuous improvement, while empowering your team to leverage and contribute to both foundational infrastructure and pioneering AI/ML tools for smarter debugging, automation, knowledge sharing, and post-incident learning.

AI Infrastructure Engineers at NVIDIA ensure that our internal and external facing GPU cloud services run maximum reliability and uptime as promised to the users and at the same time enabling developers to make changes to the existing system through careful preparation and planning while keeping an eye on capacity, latency and performance.

Responsibilities

• Lead a team of software and AI engineers responsible for building systems that power incident, change, and problem management across the DGXC Universe.
• Guide technical strategy and execution across multiple workstreams across multiple teams.
• Partner with infrastructure, product, and security teams to design resilient systems and enforce consistent operational practices across domains.
• Own the roadmap and delivery of AI/ML-powered operational tools—improving incident classification, root cause analysis, and mitigation automation.
• Develop and scale engineering teams to meet growing demands; mentor engineers and technical leads while fostering a high-performing, collaborative culture.
• Represent the team in cross-organizational forums, drive alignment on priorities, and provide clear technical direction during complex or high-severity incidents.

Requirements

• 12+ overall years of proven experience in software engineering or related technical roles, with 5+ years in engineering leadership, including managing multiple teams or technical programs.
• BS degree in Computer Science or a related technical field, or equivalent experience.
• Demonstrated success in building and scaling systems that support incident, change, and problem management across complex, high-scale environments.
• Experience leading teams in the adoption and integration of AI/ML technologies to enhance operational insight, efficiency, and automation.
• Excellent interpersonal skills, with the ability to synthesize and convey technical and operational issues to executive stakeholders and multi-functional audiences.
• Strong people leadership skills—you know how to develop engineers, grow new teams, and drive alignment and execution in high-pressure, high-visibility situations.

Ways to Stand Out from the Crowd

• Experience leading the design and rollout of internal platforms or operational tooling used company-wide, especially in high-scale or hybrid cloud environments.
• Hands-on experience integrating LLMs or other AI/ML technologies into engineering workflows—especially for automation, classification, or summarization use cases.
• Established or matured incident management programs that improved accountability, reduced MTTR, or enhanced learning from operational events.
• Driven successful cross-functional efforts involving security, infrastructure, and product teams, with measurable improvements in process or system resilience.
• Product-minded approach to internal tools—focusing on functionality, usability, adoption, and long-term maintainability.
• Experience owning and scaling a service catalog program at the organizational level to improve service ownership, operational readiness, and engineering accountability across large, complex environments.

NVIDIA is widely considered to be one of the technology world’s most desirable employers with forward-thinking and hardworking people. It leads developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, invented by NVIDIA, is at the heart of their products and services.

Salary

The base salary range is 272,000 USD - 425,500 USD. The final base salary will be determined based on location, experience, and pay of employees in similar positions. You will also be eligible for equity and benefits.