Principal Engineer, AI Tooling and Workflows

Details

NVIDIA's Infrastructure, Planning and Process (IPP) Team is seeking a Principal Software Engineer to lead the next generation of AI-powered engineering platforms. The role focuses on defining and building agentic AI systems, developer productivity platforms, and intelligent workflow automation that accelerate software delivery across NVIDIA's engineering organization. The work will support thousands of engineers, improve quality, and reduce manual overhead across engineering workflows.

Responsibilities

• Lead the technical vision, architecture, and execution for AI-native developer tooling and workflow automation platforms used across NVIDIA engineering.
• Invent and develop production-grade autonomous AI systems that can reason over engineering workflows, including code, documentation, and CI/CD pipelines.
• Drive the evolution of AI-assisted software development processes, including code understanding, requirements traceability, validation, testing, build and release automation, and security review.
• Define platform-level standards for reliability, evaluation, observability, safety, security, latency, cost efficiency, and human-in-the-loop controls for LLM-powered systems.
• Partner with engineering leaders and teams across products, infrastructure, security, and research to identify high-leverage opportunities and deliver broadly impactful solutions.
• Influence technical direction across multiple teams by setting architecture patterns, reviewing designs, raising engineering standards, and mentoring senior engineers.

Requirements

• PhD, MS, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
• 15+ years of software engineering experience.
• Experience with large-scale platforms, distributed systems, AI systems, or developer infrastructure used by demanding engineering teams.
• Deep hands-on expertise with LLM applications, agentic workflows, retrieval-augmented generation (RAG), embeddings, vector search, tool use, prompt engineering, model evaluation, and AI system safety.
• Exceptional architecture judgment across APIs, services, data pipelines, Kubernetes, observability, reliability engineering, security, and production operations.
• Strong coding ability in Python and at least one major production language such as C++, Go, or Rust.
• Principal-level technical leadership experience, including setting direction, aligning collaborators, guiding senior engineers, and raising engineering standards across organizational boundaries.

Preferred Qualifications

• Experience building AI tools, copilots, or autonomous agents that materially changed how large engineering organizations build, validate, or operate software.
• Understanding of enterprise AI systems, including MCPs, tool-using agents, skills, retrieval, knowledge graphs, fine-tuning, model serving, evaluation, and governance.
• Experience optimizing AI platforms for real-world scale, including latency, throughput, cost, GPU acceleration, TensorRT, Triton, quantization, batching, caching, or model routing.
• Domain depth in GPU computing, drivers, compilers, embedded systems, robotics, autonomous vehicles, or other hardware-software environments.
• Ability to identify significant productivity opportunities and turn them into efficient platforms that engineers value and leaders trust.

Benefits

• Base salary range of $272,000–$431,250 USD, determined based on location, experience, and compensation for similar positions.
• Eligibility for equity and benefits.
• Comprehensive benefits package.
• NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer.