Senior Architect, AI Solutions Engineering

Details

NVIDIA is seeking an AI Solutions Architect to join its Infrastructure Planning and Process (IPP) Team. This role focuses on scaling key AI solutions for NVIDIA's internal cloud infrastructure that supports nearly half a million automated jobs daily across thousands of servers. The environment includes a diverse mix of machines and devices (Windows / Linux / Android) and hardware platforms (NVIDIA GPUs, Tegra processors).

Responsibilities

• Serve as an architect developing internal AI systems used by thousands of NVIDIANs globally.
• Manage and improve tools used to deliver solutions quickly; identify gaps and determine whether AI or conventional approaches are most appropriate.
• Research market tools and evaluate "buy vs build" options for AI solutions.
• Align with teams across NVIDIA to establish AI system goals and break them down into objectives for sub-systems.
• Drive, motivate, convince, and mentor sub-system leads to achieve improvements with agility and speed.
• Identify performance bottlenecks and optimize speed and cost efficiency of AI development and testing systems.
• Plan software/hardware capacity across internal and public cloud, balancing time and utilization.
• Introduce technologies for massively parallel systems to improve turnaround time by orders of magnitude.
• Collaborate with AI product vendors to gain industry insights and share them internally.
• Understand movement of data across the platform, define solutions, develop key components, write APIs, and own deployments.
• Guide engineers in solving complex problems, develop acceptance tests, and review implementation and test results.

Requirements

• BS in EE/CS or equivalent experience, with 10+ years of systems software development experience and at least 1 year developing/exploring AI.
• Experience with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning LLMs, AI agentic workflows, LangChain, LangGraphs, and cascading models.
• Experience deploying in hybrid and multi-cloud architectures and edge computing.
• Extensive experience architecting and shipping large-scale distributed software systems.
• Strong ability to identify gaps and bottlenecks and develop solutions to optimize performance.
• Strong programming and software development skills in Java, Python, and shell scripting; good understanding of distributed systems and REST APIs.
• Experience with SQL/NoSQL databases such as MySQL, Cassandra, MongoDB, or Elasticsearch.
• Excellent knowledge and working experience with Docker containers and virtual machines.
• Familiarity with cloud and infrastructure technologies: OpenStack, Docker, Kubernetes, Chef/Puppet, Hadoop, Ceph, SwiftStack, LXC, Git, Perforce, JFrog, Kafka.
• Ability to work across organizational boundaries in a multinational, multi-time-zone corporate environment.

Ways to Stand Out

• MS or PhD in EE/CS.
• Deep knowledge of AI, machine learning, and deep learning algorithms and techniques.
• Strong collaborative and interpersonal skills with a record of guiding and influencing others.
• Experience developing large-scale software systems using service-oriented architecture under real-time performance requirements.
• Background in designing high-performance, scalable software systems with a focus on hardware cost optimization.

Compensation & Benefits

• Base salary ranges (location- and level-dependent):
  • Level 4: 184,000 USD - 287,500 USD
  • Level 5: 224,000 USD - 356,500 USD
• Eligible for equity and benefits.

Additional Information

• Applications accepted at least until July 29, 2025.
• NVIDIA is an equal opportunity employer and values diversity in hiring and promotion practices.