Principal Software Engineer - DGX Cloud

at Nvidia

USD 272,000-431,200 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 3 API @ 6 AWS @ 7 Azure @ 7 CUDA @ 3 Cloud Computing @ 7 Data Pipelines @ 6 Distributed Systems @ 4 Docker @ 7 GCP @ 7 GPU Go @ 6 Grafana Java @ 6 Kubernetes @ 7 Machine Learning Observability OpenTelemetry Prometheus Python @ 6 Security @ 4 Slurm

Details

NVIDIA is looking for a Principal Software Engineer to join its DGX Cloud team and build the foundational systems that drive NVIDIA’s high-performance GPU infrastructure. You will lead scalable automation, integrate diverse systems, and enable seamless workflows across global cloud operations.

Responsibilities

Lead the build and development of next-generation APIs, state management, and workflow orchestration systems that automate fleet lifecycle operations at a massive scale.
Drive technical alignment across dependent systems and partner teams to ensure cohesive integration, clear interfaces, and reliable end-to-end workflows, with a strong focus on delivery.
Coach, mentor, and encourage senior engineers to elevate technical standards and guidelines across the organization.
Maintain a strong focus on customer experience and product requirements, translating deep technical insight into high-impact business solutions.
Partner with executive and engineering leadership to codify critical business processes into self-measuring, scalable, and operationally consistent platforms, reducing manual toil.
Direct the integration strategy for key technologies, including common AI schedulers (e.g., Kubernetes, Slurm) and observability systems (e.g., Prometheus, OpenTelemetry, Grafana).

Requirements

16+ years of progressive industry experience.
Master’s or Bachelor’s degree, or equivalent experience defining and shipping complex distributed systems.
Deep, hands-on expertise establishing, operating, and scaling services in a fast-paced, high-reliability environment.
Ability to thrive in ambiguous, fast-paced environments by rapidly testing ideas, iterating toward working solutions, and then hardening the winners into reliable, scalable systems.
Outstanding proficiency in modern systems programming languages such as Go, Java, or Python.
Proven track record defining, owning, and evolving the architecture of high-scale distributed systems, including advanced patterns for APIs, control planes, and data pipelines.
Deep understanding of global cloud infrastructure (AWS, GCP, Azure) and container ecosystems (Docker, Kubernetes).
Demonstrated ability to drive technical strategy and influence outcomes across organizational boundaries.
Ability to communicate complex technical concepts, drive organizational consensus, and mentor high-performing engineers.

Ways to Stand Out from the Crowd

History of successfully leading the development and adoption of organization-wide workflow orchestration systems for petabyte-scale infrastructure.
Experience in a Principal/Staff+ capacity delivering measurable improvements in operational efficiency, reliability, and security across a large engineering org.
Deep familiarity with operational and deployment aspects of the NVIDIA AI/ML software stack (CUDA, cuDNN, containerization).
Patent contributions or a strong publication record related to distributed systems, cloud computing, or infrastructure automation.

NVIDIA offers highly competitive salaries and a comprehensive benefits package. Base salary is determined based on location, experience, and the pay of employees in similar positions. You may also be eligible for equity and benefits.