Senior Software Engineer, DGX Cloud Orchestration

at Nvidia
USD 184,000-356,500 per year
SENIOR
✅ On-site

Tech Stack

AI @ 3 API @ 4 AWS @ 7 Azure @ 7 CUDA @ 3 Communication @ 6 Data Pipelines @ 4 Debugging @ 7 Distributed Systems @ 4 Docker @ 7 GCP @ 7 GPU Go @ 6 Grafana Java @ 6 Kubernetes @ 7 Machine Learning Observability OpenTelemetry Prometheus Python @ 6

Details

We are looking for a Senior Software Engineer to join NVIDIA's DGX Cloud team and build the foundational systems that drive NVIDIA's high-performance GPU infrastructure. You will design scalable automation solutions, integrate diverse systems, and enable seamless workflows across global cloud operations.

Responsibilities

  • Design and develop APIs to orchestrate and integrate operational workflows.
  • Build state management and workflow automation systems that streamline infrastructure lifecycle processes.
  • Collaborate across teams to codify business processes into scalable, self-measuring systems.
  • Develop extensible, schema-driven platforms to reduce manual toil and ensure operational consistency.
  • Drive integrations with container orchestration tools such as Kubernetes and observability systems such as Prometheus, OpenTelemetry, and Grafana.
  • Optimize the reliability and efficiency of cloud operations through automated workflows and telemetry systems.
  • Lead and deliver impactful technical projects, ensuring quality and scalability at every stage.

Requirements

  • 8+ years of industry experience with a bachelor's degree or equivalent experience; a master's degree is preferred.
  • Expertise in designing, building, and operating services in high-reliability environments.
  • Proficiency in programming languages such as Go, Java, or Python.
  • Strong understanding of cloud infrastructure, including AWS, GCP, and Azure, and container technologies such as Docker and Kubernetes.
  • Experience with high-scale distributed systems, including architectural patterns for APIs and data pipelines.
  • Outstanding communication and collaboration skills, with a focus on solving complex operational challenges.
  • Passion for automating manual processes and driving system efficiency.

Preferred Qualifications

  • Track record of designing workflow orchestration systems for large-scale infrastructure.
  • Proven experience reducing operational inefficiencies through automation and integration.
  • Strong debugging and problem-solving skills in distributed environments.
  • Prior experience or strong familiarity with the operational aspects of the NVIDIA AI/ML software stack, including CUDA, cuDNN, and containerization.

Compensation And Benefits

  • Base salary range: $184,000–$287,500 for Level 4, or $224,000–$356,500 for Level 5, depending on location, experience, and compensation for similar positions.
  • Eligible for equity and benefits.

Applications will be accepted at least until August 29, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer.

More jobs at Nvidia

Similar jobs