Senior Product Architect

at Nvidia

USD 224,000-356,500 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 7 Agentic AI Ansible @ 4 Communication @ 9 Deep Learning DevOps @ 4 HPC @ 8 Kubernetes @ 4 Networking Python @ 4 RAG @ 3 Security

Details

Role description

NVIDIA is seeking a visionary Product Architect with strong expertise in systems architecture to design and shape the architectures that connect the world’s most powerful AI clusters. You will design and oversee the development of cutting-edge AI solutions from conception through their entire lifecycle, balancing technical feasibility with user needs and market demands.

Responsibilities

Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance
Iterate and refine designs based on feedback, testing results, and evolving requirements
Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems
Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision
Provide comprehensive documentation for product designs, including technical specifications and user guides
Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

Requirements

12+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
Bachelor’s degree in computer science or related field (or equivalent experience)
Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage
Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation
Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
Passion for staying updated with the latest technological advancements in AI and related fields

Ways to stand out from the crowd

Prior first-hand experience on having built large scale AI infrastructure
Advanced certifications or publications in AI, deep learning, or related fields
Experience leading high-impact projects or initiatives in cutting-edge tech domains