Site Reliability Engineer, Cloud

at Nvidia
📍 Santa Clara, United States
USD 116,000-218,500 per year
MIDDLE SENIOR
✅ On-site

Used Tools & Technologies

Machine Learning GenAI

Required Skills & Competences

SEO @ 3 Marketing @ 3 Kubernetes @ 6 Linux @ 3 Python @ 3 Java @ 3 Airflow @ 2 CI/CD @ 3 MLOps @ 2 AWS @ 3 Communication @ 3 FastAPI @ 3 SRE @ 3 KubeFlow @ 2 MLFlow @ 2 LLM @ 3 GPU @ 3 Generative AI @ 3 AI @ 3 Data Pipelines @ 2

Details

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. An era where our GPU serves as the intelligence behind computers, robots, and autonomous vehicles that perceive the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.

We are looking for an outstanding SRE to join the Digital Marketing Organization. SREs are responsible for ensuring that all of NVIDIA’s Digital Marketing Services are reliable, fast, and efficient, all the time. This role is responsible for leading and improving AWS infrastructure and scripting. The SRE will use current tools and software to monitor the platform and services closely, develop or improve monitoring and alerting tools, plan tests, update existing infrastructure, and further automate deployment pipelines. The ideal candidate will respond quickly to urgent issues and outages worldwide, validate the deployment process, resolve problems in the field, and communicate status to internal and external partners.

Responsibilities

  • Quickly identify and categorize user-reported problems within the Digital Marketing Organization ecosystem.
  • On-board new applications, AI/ML services, and model endpoints on AWS infrastructure.
  • Contribute to overall health, performance, and uptime of services running in Linux and Windows.
  • Implement monitors, alerts, and SOPs to ensure early detection and accurate response to service-impacting issues, including tracking model drift and inference latency.
  • Automate, script, and build tooling for new/existing scripts to achieve full automation of daily tasks and ML CI/CD deployment pipelines.
  • Provide on-call support for production-grade applications, respond to incidents, prioritize issues, and drive resolution across deployment pipelines, Akamai CDN, WAF, and cloud infrastructure.
  • Build and implement large-scale dynamic URL redirects using Akamai Edge Redirector Cloudlets for marketing campaigns and site migrations.
  • Set up Akamai Forward Rewrite Cloudlets to redirect incoming requests to SEO-friendly URLs.
  • Develop, test, and deploy shared and non-shared Cloudlet Policies through the Akamai Cloudlets Policy Manager.
  • Maintain custom match criteria (Geo, Device Characteristics, RegEx, Query Strings) to guarantee efficient origin offload and smart content delivery.

Requirements

  • MS or BS in Computer Science/Engineering or a related field, or equivalent experience, plus 3+ years supporting technical operations in a live-site production environment and strong passion for automation, tooling, and infrastructure supporting AI applications.
  • Experience building and running critical production services or ML model serving frameworks (e.g., FastAPI, Triton, TorchServe) using Python or Java.
  • Strong knowledge of the Kubernetes platform, deployments, and cloud-native automation.
  • Familiarity with MLOps frameworks and data pipelines (e.g., MLflow, Kubeflow, Airflow, or AWS SageMaker).
  • SRE on-call experience and ability to contribute to incident management (early discovery, triage, partner communication, impact containment, restoration, and post-incident follow-up).
  • Advanced scripting and development experience in Python; experience automating operational steps with one-click rapid solutions.
  • Strong problem-solving and root-cause analysis skills and focus on optimization and efficiency.
  • Experience building and deploying large-scale dynamic URL redirects using Akamai Edge Redirector Cloudlets and Forward Rewrite Cloudlets; experience with Akamai Cloudlets Policy Manager and custom match criteria for efficient content delivery.

Ways to stand out

  • Extensive experience with AWS Cloud Platform and Kubernetes as a platform; SRE on-call experience.
  • Hands-on experience deploying and scaling Generative AI/LLM applications, integrating vector databases, or managing GPU-accelerated infrastructure.
  • Strong Akamai CDN support skills and deep understanding of edge computing/edge AI.
  • Excellent communication, presentation, and analytical skills; ability to communicate infrastructure and AI concepts clearly across audiences.

Compensation and benefits

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 116,000 USD - 189,750 USD for Level 2, and 136,000 USD - 218,500 USD for Level 3.

You will also be eligible for equity and benefits (see NVIDIA benefits page).

Applications for this job will be accepted at least until July 18, 2026.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer. The company does not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.