Director, Software Engineering – Cloud Compute and Infrastructure

at Nvidia
USD 320,000-488,800 per year
SENIOR
✅ On-site

Tech Stack

AI @ 4 AWS @ 6 Automated Testing Azure @ 6 Communication @ 7 Distributed Systems @ 7 GPU @ 4 HPC InfiniBand @ 4 Leadership @ 6 Linux @ 7 NVLink @ 4 Networking @ 7 Observability @ 4 OpenStack @ 4 Security

Details

NVIDIA is seeking an engineering director to lead the software teams behind its bare-metal datacenters and cloud compute infrastructure. The organization supports hundreds of megawatts of datacenter capacity already online, with more capacity coming. You will build the software that makes this growing physical infrastructure available as reliable, secure, and efficient compute services for NVIDIA engineering.

The team provides NVIDIA’s continuous integration (CI) infrastructure: the environment where hardware, firmware, drivers, networking, and system software are integrated and tested on their path to production. The role enables engineering teams to bring up preproduction systems, reproduce failures, validate changes, and move platforms toward production readiness. The fleet spans multiple hardware generations and maturity levels, including x86 and Arm servers, GPUs, DPUs, high-speed networking, storage, and rack-scale, liquid-cooled systems. Platforms such as Grace Blackwell and Vera Rubin illustrate the breadth of compute and interconnect technology involved.

Responsibilities

  • Lead software engineering teams responsible for cloud compute, bare-metal fleet management, and CI infrastructure, owning architecture, implementation, deployment, and operations.
  • Set the technical direction for compute control planes, resource provisioning, topology-aware placement, reservations, and capacity management across physical servers, virtual machines, and containers.
  • Automate the bare-metal lifecycle, including hardware discovery and inventory, server bring-up, imaging, firmware and driver configuration, out-of-band management, health checks, reprovisioning, and recovery.
  • Build CI services that allocate the right hardware, provision repeatable test environments, record hardware and software configurations, collect diagnostics, and restore systems to a known state.
  • Improve the path from hardware or software changes to actionable validation results.
  • Define service-level objectives, isolate failures, improve observability, and turn incidents and recurring test-infrastructure failures into engineering fixes.
  • Measure and improve hardware onboarding time, provisioning speed, CI queue time, productive fleet utilization, recovery time, and cost efficiency as capacity expands.
  • Set engineering standards for design and code reviews, automated testing, secure development, release quality, and safe changes to production systems.
  • Hire, coach, and retain engineers and engineering managers; establish clear ownership and develop technical leaders.
  • Partner with hardware, firmware, drivers, networking, storage, security, and validation teams to onboard platforms and diagnose failures across system boundaries.
  • Work with datacenter operations and facilities teams to bring additional capacity online, connecting rack power, cooling, physical topology, and hardware-health telemetry to provisioning, placement, serviceability, and operational readiness.

Requirements

  • 15+ years of overall experience in software engineering, distributed systems, or cloud infrastructure, including 7+ years leading engineering teams and experience managing engineering managers.
  • Direct engineering ownership of the underlying services of a public or private compute cloud, such as AWS EC2, Google Compute Engine, Azure Compute, OCI Compute, or a comparable infrastructure-as-a-service platform.
  • Strong technical depth in distributed systems, Linux, virtualization, containers, and the networking and storage services that support large compute fleets.
  • Experience building software and automation for bare-metal infrastructure, including server provisioning, hardware inventory, firmware or operating-system lifecycle management, and recovery across heterogeneous systems.
  • Experience running production infrastructure with demanding availability requirements, including failure isolation, incident response, observability, and reliable deployment and recovery mechanisms.
  • Ability to guide architecture, evaluate implementation choices, and debug complex interactions among hardware, firmware, drivers, operating systems, and distributed services with senior engineers.
  • A record of sustained ownership as platforms evolve, with measurable improvements in reliability, scalability, or engineering delivery.
  • Strong communication, collaboration, and people-development skills.
  • A degree in computer science, computer engineering, or a related discipline, or equivalent experience.

Preferred Qualifications

  • Experience building or operating OpenStack infrastructure, particularly Nova, Neutron, Cinder, or Ironic, or contributing to related open-source projects.
  • Engineering leadership spanning compute control planes and site reliability, including multi-tenant isolation, scheduling, placement, and capacity allocation.
  • Experience with GPU clusters, rack-scale computing, NVLink, InfiniBand or high-speed Ethernet, and AI or high-performance computing workloads.
  • Experience supporting preproduction hardware, new product introduction, or hardware-in-the-loop CI, including repeatable validation environments and systematic regression isolation.
  • Familiarity with liquid-cooled, high-density datacenters and how power, thermal constraints, cooling, and component health affect fleet availability and scheduling.
  • Experience delivering compute platforms across multiple regions, datacenters, or hybrid-cloud environments, including fleet upgrades and workload migration with minimal service disruption.

Compensation and Benefits

The base salary range is USD 320,000–488,750. Base salary is determined based on location, experience, and the pay of employees in similar positions. The role also includes eligibility for equity and benefits.

Applications will be accepted at least until October 13, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer.

More jobs at Nvidia

Similar jobs