Senior Engineer, Local AI - Agents and Systems

at Nvidia

📍 Santa Clara, United States

USD 184,000-356,500 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 4 CUDA @ 4 GPU @ 4 LLM @ 4 LangChain @ 4 Python @ 6 Security @ 7 TensorRT @ 4 vLLM @ 6

Details

Artificial intelligence is shifting from passive help to autonomous, always-on workflows. The mission is to make this change seamless, efficient, and secure for millions globally. This role leads technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX GPUs. The position focuses on enabling open-source AI agents such as Nemoclaw and OpenClaw to operate locally, safely, and efficiently on consumer PCs. By combining local inference with Nemotron models, privacy routers, and sandboxed execution, the role contributes to the foundation of a desktop AI operating system.

Responsibilities

Act as the lead engineer for developing agent frameworks natively on Windows.
Build the technical roadmap for always-on, self-evolving AI assistants on GeForce RTX PCs and laptops.
Lead efforts to optimize agent runtimes for Windows.
Ensure autonomous agents operate within policy-based privacy and security frameworks, including filesystem access, secure inference routing, and network egress.
Partner with internal AI research teams, driver teams, and the open-source OpenClaw community.
Help ensure consumer hardware provides an excellent ecosystem for autonomous agents.
Mentor engineers, establish guidelines for AI agent deployment, and write reliable, production-ready code.

Requirements

10+ years of relevant professional software engineering experience, including at least 3+ years in a Staff or Lead Architect role.
BS, MS, or PhD in Computer Science, Computer Engineering, or a related technical field, or equivalent experience.
Deep understanding of Windows OS internals, process isolation, sandboxing technologies, and system-level security architecture.
Proven understanding of LLM inference pipelines, including Ollama, Llama.cpp, and vLLM.
Experience with GPU-accelerated computing, including CUDA and TensorRT.
Experience running local models on consumer-grade hardware.
Practical experience with modern AI orchestration and agentic frameworks such as OpenClaw, Hermes, and LangChain.
Understanding of how multi-agent systems plan, act, and use tools.
Proficiency in multiple programming languages, particularly C++ for performance-critical systems and OS integration, and Python for AI and blueprint logic.
Experience building virtualization, containerization, or robust sandboxing tools natively for the Windows ecosystem.

Compensation and Benefits

Base salary range: $184,000–$287,500 for Level 4.
Base salary range: $224,000–$356,500 for Level 5.
Eligibility for equity and benefits.
Salary is determined based on location, experience, and compensation of employees in similar positions.

Applications will be accepted at least until July 28, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes and is committed to an inclusive, equal-opportunity work environment.