Senior Product Architect, K8s-Based AI Infrastructure

at Nvidia

USD 184,000-356,500 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 7 Agentic AI Ansible @ 4 Communication @ 9 Deep Learning @ 6 DevOps @ 4 HPC @ 7 Kubernetes @ 4 Networking Python @ 4 RAG Security

Details

NVIDIA is seeking a visionary Product Architect with strong systems architecture expertise to design and shape architectures that connect large-scale AI clusters. The role involves transforming ideas into well-defined products, balancing technical feasibility with user needs and market demands, and overseeing cutting-edge AI solutions throughout their lifecycle.

Responsibilities

Stay current with technology trends in AI infrastructure and agentic AI, and propose new product concepts.
Define detailed product architectures covering performance, scalability, interoperability, and data center deployment requirements.
Lead prototyping and testing to validate product design and functionality, diagnose bottlenecks, and drive performance innovations at scale.
Iterate and refine designs based on feedback, testing results, and evolving requirements.
Collaborate with hardware, software, security, and systems teams to integrate networking, compute, and storage ecosystems.
Work with partners and customers to conceptualize solutions and build proof-of-concepts and minimum viable products.
Provide comprehensive product design documentation, including technical specifications and user guides.
Develop whitepapers, blog posts, and curriculum for customers, partners, and users.

Requirements

8+ years of experience architecting data center-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent.
Bachelor's degree in computer science or a related field, or equivalent experience.
Strong background in technologies supporting large-scale infrastructure management for complex systems, networks, and storage.
Extensive experience with DevOps solutions, including Python, Ansible, container runtimes, Kubernetes, and data center deployments.
Familiarity with AI workloads, including agentic and retrieval-augmented generation workflows, inference at scale, large-scale training and fine-tuning, and model evaluation.
Exceptional communication skills and the ability to explain complex technical details to diverse audiences.
Passion for staying current with technological advancements in AI and related fields.

Preferred Qualifications

First-hand experience building large-scale AI infrastructure.
Advanced certifications or publications in AI, deep learning, or related fields.
Experience leading high-impact projects or initiatives in cutting-edge technology domains.

Benefits

Eligibility for equity and benefits.
NVIDIA is committed to an inclusive work environment and is an equal opportunity employer.
Applications will be accepted at least until August 24, 2026.