Systems Software Engineer - AI and Cloud

at Nvidia

USD 124,000-241,500 per year

MIDDLE SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 3 API @ 3 Algorithms @ 6 Cloud Computing Data Structures @ 6 Debugging @ 5 Engineering Management HPC JavaScript @ 5 Kubernetes @ 3 LLM @ 3 Marketing Microservices Python @ 5 RAG TensorRT @ 3 vLLM @ 3

Details

NVIDIA is pushing the boundaries of AI and cloud computing. This role joins a collaborative team working on advanced AI models, cloud-native architectures, and NVIDIA products and technologies in Silicon Valley.

Responsibilities

Evaluate cloud-native, full-stack applications using microservices architecture to support AI use cases with NVIDIA frameworks, SDKs, and microservices.
Design and implement agentic workflows using techniques such as Retrieval-Augmented Generation (RAG) and the latest AI models.
Evaluate user experiences and analyze the technical performance of AI solutions, documenting findings in comprehensive reports.
Provide practical product improvement recommendations to senior executives and engineering management.
Collaborate with product, marketing, hardware, software engineering, and QA teams to improve NVIDIA product offerings.
Develop developer-focused content, including tutorials and code samples, demonstrating features in NVIDIA tools and libraries.
Write technical whitepapers and product briefs, and deliver technical product demonstrations at industry conferences.

Requirements

Bachelor's or master's degree in Software Engineering, Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.
At least 3 years of experience.
Proficiency in Python and JavaScript for programming and debugging.
Strong foundation in data structures, algorithms, and software design principles.
Basic familiarity with C++ and its use in high-performance computing environments.
Experience building cloud-native systems optimized for Kubernetes deployment.
Experience with inference frameworks such as vLLM and NVIDIA Triton Inference Server.
Understanding of API design principles for scalable, production-ready inference systems.

Preferred Qualifications

Advanced knowledge of large language models (LLMs), modern AI software architecture, and cloud APIs.
Contributions to public-facing technical content and open-source projects.
Expertise deploying LLM inference frameworks such as Triton Inference Server, vLLM, or TensorRT on Kubernetes or edge devices to improve performance.

Compensation and Benefits

Base salary range: $124,000–$195,500 for Level 2.
Base salary range: $152,000–$241,500 for Level 3.
Eligible for equity and benefits.
Salary is determined based on location, experience, and compensation for similar positions.

NVIDIA is an equal opportunity employer committed to an inclusive work environment.