Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale - DGX Cloud

Details

NVIDIA's DGX Cloud organization delivers accelerated computing infrastructure for large-scale AI workloads. The team is seeking a Senior Systems Software Engineer with deep expertise in distributed systems, Kubernetes, containers, systems performance, and scalability. The role focuses on scaling AI infrastructure, minimizing total cost of ownership, reducing cost per token, and enabling future AI innovation and AI factories.

Responsibilities

• Lead end-to-end performance and scalability analysis across the Kubernetes-based accelerated runtime stack, including control and data planes.
• Analyze NVIDIA components such as GPU Operator, Network Operator, node-feature-discovery, topograph, dra-driver-nvidia-gpu, and nvsentinel, tracking issues from orchestration down to the hardware.
• Design and contribute upstream architectural changes to the Kubernetes control plane and related projects for reliable operation at hyperscale cluster sizes.
• Improve container startup and cold-start latency for low-latency inference scaling across thousands of GPU nodes while minimizing API server pressure and operational fragility.
• Assess, improve, and contribute to open-source projects supporting Kubernetes AI workloads, including Grove and gateway-api-inference-extension.
• Advance the scalability and performance of confidential containers (CoCo) on Kubernetes for encrypted inference workloads.
• Use DSX and related large-scale simulation infrastructure to model AI-factory deployments and validate scalability across thousands of simulated GPUs.
• Collaborate with AI researchers, developers, customers, and upstream communities to design workload tests, including production agent-trace replay.
• Build monitoring and analysis tooling and integrate continuous performance and scale testing into CI/CD workflows.
• Document methods and results and present findings internally and at industry events such as KubeCon and GTC.
• Engage with Kubernetes SIG Scalability, CNCF, and NVIDIA open-source communities.

Requirements

• Bachelor's or Master's degree in Engineering, or equivalent experience; ideally in Electrical Engineering, Computer Engineering, or Computer Science.
• 8+ years of experience in computer architecture, networking, storage systems, and accelerator-based platforms.
• Expertise in Kubernetes and familiarity with the broader CNCF ecosystem.
• Deep experience with large-scale, parallel, distributed accelerator systems and performance optimization of AI workloads.
• Experience with performance modeling and benchmarking for large-scale systems.
• Proficiency in Golang and/or Python.
• Strong familiarity with the NVIDIA software stack across training and inference.
• Expertise with at least one major public cloud provider, such as AWS, Azure, GCP, or OCI.

Preferred Qualifications

• Strong operational experience with a Kubernetes distribution.
• Experience scaling Kubernetes clusters to ultra-large node and object counts.
• Demonstrated history of contributing to open-source communities.
• Excellent communication and interpersonal abilities.
• PhD or equivalent experience in a relevant area.

Compensation and Benefits

• Base salary range for Level 4: USD 184,000–287,500 per year.
• Base salary range for Level 5: USD 224,000–356,500 per year.
• Eligibility for equity and benefits.
• Hybrid work is preferred, with remote arrangements also available.

NVIDIA is an equal opportunity employer committed to fostering an inclusive work environment.