Senior AI Infrastructure Engineer - DGX Cloud

at Nvidia
📍 Santa Clara, United States
USD 184,000-356,500 per year
SENIOR
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Go @ 4 Kubernetes @ 4 Linux @ 4 IaC @ 4 Terraform @ 4 Python @ 4 Java @ 4 Distributed Systems @ 4 Communication @ 7 Mathematics @ 4 Networking @ 4 OpenStack @ 4 Planning @ 4 GPU @ 4

Details

NVIDIA is seeking a Senior AI Infrastructure Engineer to join the DGX Cloud group. This engineering role focuses on designing, building and maintaining large-scale production systems with high efficiency and availability using a combination of software and systems engineering practices. The role spans systems, networking, coding, databases, capacity management, continuous delivery/deployment and open source cloud enabling technologies such as Kubernetes and OpenStack. The team ensures high reliability and uptime for internal and external GPU cloud services while managing capacity and performance and supporting changes through careful preparation and planning.

Responsibilities

  • Design, build, deploy, and run internal tooling for a large-scale AI training and inference platform built on top of cloud infrastructure.
  • Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
  • Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation and refinement.
  • Support services before they go live via system design consulting, developing software tools, platforms and frameworks, capacity management and launch reviews.
  • Maintain services after launch by measuring and monitoring availability, latency and overall system health.
  • Scale systems sustainably through automation and push for changes that improve reliability and velocity.
  • Practice sustainable incident response and blameless postmortems.
  • Participate in an on-call rotation to support production systems.

Requirements

  • BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience.
  • 6+ years of experience.
  • Demonstrated ability to initiate projects, collaborate and drive cross-team efforts.
  • Experience with infrastructure automation and distributed systems design; developing tools for running large-scale private or public cloud systems in production.
  • Experience in one or more programming languages: Python, Go, C/C++, Java.
  • In-depth knowledge in one or more of: Linux, Networking, Storage, and Container technologies.
  • Experience with public cloud platforms and Infrastructure as Code (IaC) tools such as Terraform.
  • Distributed systems experience.

Ways to stand out

  • Interest in crafting, analyzing and fixing large-scale distributed systems.
  • Systematic problem-solving approach, strong communication skills, sense of ownership and drive.
  • Ability to debug and optimize code and automate routine tasks.
  • Experience using or running large private and public cloud systems based on Kubernetes or Slurm.

Benefits & Compensation

  • Base salary ranges (determined by location, experience, and peer pay):
    • Level 4: 184,000 USD - 287,500 USD
    • Level 5: 224,000 USD - 356,500 USD
  • Eligible for equity and company benefits (see NVIDIA benefits).

Other details

  • Location: Santa Clara, California, United States.
  • Employment type: Full time.
  • Start date (as listed): 2025-10-14.
  • Applications accepted at least until October 18, 2025.
  • NVIDIA is an equal opportunity employer committed to diversity and inclusion.