Senior Systems Engineer -- Agentic AI

at Nvidia

USD 224,000-431,200 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 4 Agentic AI @ 7 Distributed Systems @ 6 ETL @ 4 Experimentation @ 6 GPU @ 4 Go @ 7 HPC @ 4 Kubernetes LLM @ 4 Python @ 7 Rust @ 7 Technical Leadership

Details

NVIDIA is hiring a Senior Software Architect for the Agent Harness & Runtime Engineering team to build foundational systems for the next generation of agentic AI. The team works at the intersection of AI and systems engineering across agent runtimes, inference, evaluation, and large-scale execution. The role requires broad AI knowledge, deep systems expertise, and the ability to build scalable, production-quality systems.

Responsibilities

Architect and build scalable, reliable systems for agentic AI, including agent runtimes, harnesses, inference, evaluation, and orchestration.
Solve large-scale systems challenges across distributed execution, data and ETL pipelines, high-performance computing, cloud, Kubernetes, and GPU compute environments.
Optimize systems for reliability, scalability, performance, resource utilization, and developer experience.
Prototype emerging ideas, write high-quality production code, and provide technical leadership across research, engineering, product, and infrastructure teams.

Requirements

Bachelor's degree, master's degree, or equivalent experience in Computer Science, Computer Engineering, AI, or a related field, with 12 or more years of relevant industry experience.
Strong foundation in modern AI, including large language models, multimodal models, inference, agentic AI, and evaluation.
Deep expertise in software architecture, distributed systems, and large-scale systems design.
Strong hands-on programming skills in Python, C++, Go, Rust, or similar languages, with a track record of building high-quality production software.
Experience building large-scale systems involving distributed execution, data processing and ETL, workflow orchestration, HPC, cloud, or GPU infrastructure.
Ability to reason across the stack, from AI model behavior and application logic to runtime, compute, and infrastructure.
Proven ability to take ambiguous, complex technical problems from architecture through implementation and production.

Preferred Qualifications

Knowledge of LLM/VLM inference, model serving, model routing, or inference optimization.
Background in AI evaluation, benchmarking, experimentation, or large-scale AI infrastructure.
Track record of building reusable platforms supporting heterogeneous AI workloads and compute environments.

Compensation and Benefits

Base salary range of $224,000–$356,500 for Level 5.
Base salary range of $272,000–$431,250 for Level 6.
Base salary is determined based on location, experience, and the pay of employees in similar positions.
Eligible for equity and benefits.
Applications will be accepted at least until September 13, 2026.

NVIDIA is an equal opportunity employer committed to fostering an inclusive work environment. NVIDIA uses AI tools in its recruiting processes.