Principal Site Reliability Engineer

at Nvidia
USD 248,000-396,800 per year
SENIOR
✅ Hybrid

Tech Stack

AI @ 6 AWS @ 4 Azure @ 6 CloudFormation @ 4 Communication @ 6 Distributed Systems @ 8 GCP @ 6 GPU @ 4 Go @ 7 HPC Java @ 7 JavaScript @ 7 Kubernetes @ 6 Leadership @ 6 Linux @ 6 Machine Learning @ 4 Networking @ 6 Observability @ 7 OpenTelemetry @ 7 Profiling @ 7 Python @ 7 SRE Security Software Development @ 4 Technical Leadership @ 6 Terraform @ 4 TypeScript @ 7

Details

Site Reliability Engineering at NVIDIA is an engineering discipline focused on designing, building, and operating large-scale production systems with exceptional efficiency, resilience, and availability. It combines software and systems engineering practices with expertise in distributed systems, networking, cloud infrastructure, Kubernetes, databases, capacity management, continuous delivery, and observability.

As a Principal SRE, you will shape the technical direction of NVIDIA's AI Platform Runtime and lead reliability engineering initiatives spanning multiple organizations. You will solve complex, ambiguous problems at enterprise scale, establish architectural standards, and influence how teams design and operate critical AI-powered services. You will also advance the use of AI agents and skills to transform platform operations and developer productivity.

Responsibilities

  • Define and drive the long-term technical vision, architecture, and roadmap for reliability across NVIDIA's AI Platform Runtime and related enterprise systems.
  • Architect highly available, resilient, secure, and scalable distributed platforms that power next-generation AI-driven products and services.
  • Lead the design and development of AI agents, AI skills, and intelligent automation for platform operations, incident response, troubleshooting, and remediation.
  • Establish platform-wide reliability standards, including service-level objectives, error budgets, capacity models, resilience patterns, and operational readiness requirements.
  • Identify systemic risks and lead cross-functional programs that improve availability, scalability, performance, security, and developer productivity.
  • Advance observability across complex distributed environments through OpenTelemetry, metrics, logs, traces, profiling, analytics, and automated anomaly detection.
  • Partner with senior leaders and engineers across Cloud, Platform, Security, Networking, and AI/ML organizations on architectural and investment decisions.
  • Provide technical leadership during critical incidents and ensure incident lessons result in durable engineering and organizational improvements.
  • Develop reference architectures, shared platform capabilities, and automation frameworks for adoption across multiple engineering organizations.
  • Influence, mentor, and raise the technical bar for senior engineers and technical leaders.

Requirements

  • 15+ years of experience in Site Reliability Engineering, Platform Engineering, Distributed Systems, Cloud Architecture, or related infrastructure engineering roles.
  • BS or MS degree in Computer Science or a related technical field involving significant software development, or equivalent experience.
  • Experience setting technical strategy and leading large-scale engineering initiatives across multiple teams or organizations.
  • Deep expertise in distributed systems architecture, networking, Linux, Kubernetes, and public cloud platforms such as AWS, Azure, or GCP.
  • Strong proficiency in one or more programming languages, such as Python, Go, TypeScript, JavaScript, or Java, with experience building production-grade automation and platform software.
  • Extensive experience with infrastructure-as-code and platform automation technologies such as Terraform, Crossplane, AWS CDK, AWS CloudFormation, or equivalent tools.
  • Deep understanding of observability at scale, including OpenTelemetry and modern metrics, logging, tracing, profiling, and analytics platforms.
  • Expertise in reliability engineering practices, including service-level objectives, error budgets, capacity planning, fault tolerance, disaster recovery, incident management, and blameless postmortems.
  • Track record of delivering measurable improvements in availability, performance, operational efficiency, or engineering productivity within complex environments.
  • Outstanding technical judgment, communication, and collaboration skills, with the ability to influence senior stakeholders across technical and organizational boundaries.

Preferred Qualifications

  • Experience designing or operating large-scale AI/ML platforms, GPU infrastructure, inference systems, training environments, or high-performance computing platforms.
  • Hands-on experience building AI agents, agentic workflows, or intelligent automation for infrastructure and production operations.
  • Success establishing reliability architecture and engineering standards adopted across a large enterprise.
  • Experience applying machine learning, analytics, or advanced automation to capacity management, anomaly detection, incident response, or autonomous remediation.
  • Recognized technical leadership through patents, publications, open-source contributions, industry standards, conference presentations, or widely adopted internal platforms.

Benefits

  • Base salary range: USD 248,000–396,750 per year, determined by location, experience, and the pay of employees in similar positions.
  • Eligible for equity and benefits.
  • NVIDIA is committed to an inclusive work environment and is an equal opportunity employer.

Applications will be accepted at least until September 12, 2026.

More jobs at Nvidia

Similar jobs