Principal Software Engineer

Details

NVIDIA is building the next generation of AI platforms and products to improve business efficiency and productivity. This role involves developing AI products using retrieval-augmented generation (RAG), agentic AI paradigms, third-party platforms, and open-source repositories. The engineer will help shape the architecture, development, and scaling of software systems while collaborating with Cloud, AI/ML, and Generative AI teams in an agile environment.

Responsibilities

• Develop AI platforms and products using RAG and agentic AI paradigms.
• Integrate agents with enterprise data sources, APIs, and internal microservices to enable real-world actions.
• Collaborate with cross-functional teams to deliver end-to-end intelligent experiences across applications.
• Ensure the reliability, safety, and performance of autonomous systems operating at scale.
• Architect and build agentic AI systems that leverage large language models (LLMs) for reasoning, planning, and tool orchestration across enterprise workflows.
• Design and implement multi-agent frameworks supporting coordination, delegation, and dynamic task execution.
• Develop scalable platforms for RAG, long-term memory, and contextual reasoning.
• Build reusable infrastructure for agent orchestration, tool integration, evaluation, and observability.
• Establish best practices for agent evaluation, guardrails, and human-in-the-loop workflows.
• Apply test automation, production testing, and automation frameworks.
• Work with Linux, embedded systems, firmware, and hardware/software integration.
• Mentor engineers and provide technical leadership in the design of complex distributed AI systems.
• Stay current with advancements in LLMs, agent frameworks, tool use, reasoning architectures, and open-source ecosystems.

Requirements

• Bachelor's, master's, or doctoral degree in Computer Science, Electrical or Computer Engineering, or a related field, or equivalent experience.
• 15 or more years of experience building large-scale distributed systems and cloud-native applications; Python is preferred.
• Strong experience designing and deploying LLM-powered systems, including RAG, tool use, and agent-based architectures.
• Deep understanding of agentic AI paradigms, including planning, memory, tool invocation, and multi-step reasoning.
• Experience with agent frameworks and orchestration tools such as LangChain or similar technologies.
• Proven ability to design systems with high reliability, scalability, and performance.
• Hands-on experience deploying applications in Kubernetes environments.
• Experience building systems in cloud and hybrid environments.
• Strong programming skills across multiple languages and modern software stacks.
• Experience with cloud platforms, Kubernetes, and Docker is advantageous.
• Proven track record leading complex technical initiatives and mentoring high-performing teams.
• Excellent problem-solving, communication, system design, programming, debugging, performance analysis, and test design skills.
• Experience enhancing enterprise efficiency and employee experience through Generative AI solutions is advantageous.
• Self-motivation, persistence, and a drive to deliver results.

Benefits

• Equity eligibility.
• Employee benefits.
• NVIDIA is committed to an inclusive work environment and is an equal opportunity employer.

Applications will be accepted at least until October 27, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.