Senior Software Engineer, Agentic AI

at Nvidia

USD 184,000-356,500 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI API @ 6 Asynchronous Programming @ 4 Data Pipelines Debugging @ 4 GPU Go @ 7 LLM @ 6 Mathematics @ 4 Node.js @ 3 Observability @ 4 OpenTelemetry @ 4 Profiling @ 4 Python @ 7 RAG Rust @ 7 Vector Databases

Details

NVIDIA is developing foundational technology for the next generation of agentic applications. This role focuses on building scalable agentic capabilities, reusable building blocks, and high-quality libraries that improve developer productivity, agent quality, performance, and efficiency.

Responsibilities

Track evolving agent development patterns across NVIDIA and the broader ecosystem, including research and commercial products.
Develop open-source libraries and tools that accelerate and optimize agent harnesses and frameworks for performance, accuracy, quality, and stability.
Benchmark the latest agents to identify bottlenecks and develop solutions that increase performance, reduce cost, and improve latency.
Collaborate with teams building high-performance data pipelines, retrieval-augmented generation (RAG) systems, vector databases, and GPU-optimized training and inference workflows.
Identify gaps and friction in current agent architectures and translate insights into agentic tools supported by evaluations, benchmarking, and feedback loops.

Requirements

Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Applied Mathematics, or a related field, or equivalent experience.
8+ years of experience in at least one of Rust, Python, Go, or Node.js, with working familiarity in at least one additional language.
Solid understanding of asynchronous programming, callbacks, request lifecycles, and event-driven systems.
Hands-on experience with evolving agent architectures, multiple agent frameworks, and agent harnesses.
Proficiency in LLM applications, agent workflows, tool calls, and model-provider APIs.
Ability to design or extend cross-language APIs with attention to consistency, usability, stability, and backward compatibility.
Systems-level debugging and performance intuition, including tracing execution from high-level API calls through runtime internals, language bindings, callbacks, serialization, and event emission to understand overhead and optimize hot paths.
Strong interpersonal skills and the ability to collaborate directly with the open-source community.

Preferred Qualifications

Experience building evaluation and benchmarking systems for agent workflows, including metrics, regression testing, feedback loops, and related systems.
Rust systems experience, particularly async Rust, Tokio, Serde, API design, or runtime state management.
Python native extension experience with PyO3, Maturin, or Python/Rust bindings.
Experience instrumenting third-party frameworks without changing user-visible behavior.
Knowledge of OpenTelemetry, tracing, structured events, exporters, or observability pipelines.
Experience with middleware, plugin systems, guardrails, policy engines, request/response interception, open-source libraries, SDKs, or internal developer platforms.
Experience profiling or optimizing runtime and library overhead across language boundaries, asynchronous execution, native bindings, serialization, tracing, or middleware pipelines.