Distinguished Engineer - Dynamo

at Nvidia

📍 United States

USD 320,000-488,800 per year

SENIOR

✅ Remote ✅ Hybrid

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 4 AWS @ 3 Azure @ 3 Cloud Computing @ 3 Communication @ 6 GCP @ 3 Go @ 6 Machine Learning Networking Observability @ 4 Python @ 6 Rust @ 6

Details

We are currently seeking a senior-level Engineer with distinguished expertise to join the Dynamo engineering team. As a Distinguished Engineer, you will be a key technical leader, helping drive technology and product direction, provide deep technical expertise and guidance to the team and NVIDIA at large, and have a material impact on the next generation of inference on NVIDIA hardware.

NVIDIA Dynamo helps users achieve state-of-the-art performance through advanced techniques such as disaggregated serving and KV-aware routing. As inference extends across modalities such as image, video, and audio, the need for Dynamo continues to increase.

Responsibilities

Contribute to the Dynamo family of open source projects.
Serve as a technical expert in AI inferencing, helping to push the frontier of what is possible.
Represent Dynamo and NVIDIA with customers, partners, and the AI community.
Lead critical initiatives around resiliency, performance, and scalability for Dynamo and AI inference.
Build and drive Dynamo to continue being a production-ready, data center-scale AI inferencing platform.
Collaborate with diverse partner teams at NVIDIA across storage, networking, hardware, and performance.
Keep abreast of the latest advancements in AI/ML infrastructure technologies, frameworks, and effective strategies, and promote their implementation within the company.

Requirements

Bachelor's degree, master's degree, PhD, or equivalent experience in Computer Science, Computer Engineering, Artificial Intelligence, or a related field.
18+ years of proven experience in systems software engineering.
Expertise in the AI inference space, such as operating production inference systems at scale, working on inference engines, or similar experience.
Experience serving as a senior technical leader in an organization, with the ability to lead through influence.
Proficiency in programming languages such as Rust, Python, and Go.
Familiarity with cloud computing platforms such as AWS, GCP, and Azure.
Excellent problem-solving skills, including analyzing complex systems, identifying bottlenecks, and implementing scalable solutions.
Excellent communication and collaboration skills, with demonstrated effectiveness working with diverse teams and individuals.

Preferred Qualifications

Experience with production-grade infrastructure, including observability, resilience, and operations.
Enthusiasm for continual learning and keeping abreast of new technologies and effective approaches within the AI/ML systems domain.

Benefits

NVIDIA offers competitive salaries, equity, and a comprehensive benefits package.

Applications for this job will be accepted at least until October 11, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer.