Senior Systems Software Engineer - NV Cloud Functions

at Nvidia

USD 152,000-287,500 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 4 Bash @ 4 Deep Learning @ 4 Distributed Systems @ 4 GPU @ 4 Go HPC @ 6 Kubernetes @ 6 LLM @ 6 Linux @ 4 Load Testing Machine Learning @ 4 Mathematics @ 4 Performance Optimization @ 4 Python @ 4 Rust @ 4 SGLang @ 6 Slurm @ 6 Software Development @ 3 TensorRT @ 6 vLLM @ 6

Details

The NVIDIA Cloud Functions team is seeking a motivated, product-minded AI/ML Engineer with expertise in AI platform engineering at scale. The team builds and operates a serverless deployment platform for AI applications, enabling and scaling AI inference workloads through globally distributed orchestration across GPU-backed, cloud-agnostic Kubernetes clusters.

Responsibilities

Become a trusted subject matter expert by understanding user challenges and constraints, translating them into product requirements and solutions that accelerate delivery of AI models and inference hosted on the NVIDIA Cloud Functions platform.
Lead implementation of key features, including user-acceptance testing, load testing, and performance evaluations.
Focus on customer experience, performance optimization, and platform reliability.
Mentor and embed with engineering teams building products on the platform, providing best practices for AI/ML workloads at scale and ML reliability engineering.
Produce reference architectures for customer use cases using the newest platform features and AI technologies.
Shepherd customer issues through resolution and provide timely warnings about issues and risks.
Evaluate emerging technologies and tooling to support a competitive product and forward-looking roadmap.

Requirements

Master's degree, PhD, or equivalent experience in Computer Science, Artificial Intelligence, Applied Mathematics, or a related field.
At least 2 years of work experience with Python, Rust, Golang, Linux, or Bash.
Experience with deep learning and machine learning.
Expertise using AI/deep learning frameworks and inference software such as SGLang, vLLM, TensorRT-LLM, or Dynamo.
Knowledge of CPU and GPU architecture.
Excellent interpersonal skills, including the ability to explain sophisticated technical topics to non-experts.
Experience designing, implementing, and releasing AI/ML products to market.
Familiarity with all aspects of the software development lifecycle.

Preferred Qualifications

Knowledge-sharing experience with clients, partners, and coworkers.
Expertise demonstrated through projects or open-source contributions in HPC, data analytics, machine learning, deep learning, cloud-native projects, Kubernetes, Slurm, or GPU workloads.
Ability to work in unfamiliar technical areas and tackle complex problems.
Prior experience building distributed systems.

Compensation and Benefits

The base salary is determined by location, experience, and the pay of employees in similar positions. The base salary range is USD 152,000–241,500 for Level 3 and USD 184,000–287,500 for Level 4. The role also includes eligibility for equity and benefits.

Applications will be accepted at least until September 13, 2026. NVIDIA uses AI tools in its recruiting processes and is an equal opportunity employer.