Lead Enterprise AI Architect, Enterprise AI Platform - Agentic AI

Details

Join the Enterprise AI & Automation team in NVIDIA IT to architect the future of agentic AI at scale. NVIDIA’s Enterprise AI Platform powers AI agents to transform employee productivity and accelerate business impact. As the lead enterprise AI architect, you will design, evangelize, and implement the architectural foundations of this platform. You will guide the vision for orchestration, integration, security, and lifecycle management of AI agents, ensuring the platform delivers trusted, scalable, and innovative solutions. This is a rare opportunity to define the blueprint for enterprise AI agents inside one of the world’s most advanced AI companies.

Responsibilities

• Define and evolve the architecture for NVIDIA’s Enterprise AI Platform, including frameworks for agent orchestration, multi-agent coordination, RAG, deployment, monitoring, and life cycle management.
• Architect and enable data flywheels that drive continuous improvement of AI agents through evaluation, feedback, and iteration loops.
• Partner with engineering, product, and research teams to shape platform strategy and roadmaps; evaluate LLMs, agentic frameworks, and NVIDIA technologies (e.g., NeMo, AIQ).
• Ensure integration with enterprise data sources and tools (ServiceNow, Salesforce, SAP, Workday, GDrive, SharePoint, Confluence) with a strong focus on content security.
• Drive architectural decisions across deployment models (on-prem, cloud, hybrid, containerized) to deliver scalable, reliable, and efficient solutions.
• Lead design reviews, develop technical documentation, and mentor engineers in principles of architecture and code development.
• Champion observability, monitoring, versioning, and telemetry to ensure trustworthy and auditable AI agents.
• Influence enterprise adoption by partnering with stakeholders across IT, chip design, supply chain, sales, finance, and HR; serve as a reference adopter providing feedback to strengthen NVIDIA’s ecosystem.

Requirements

• Bachelor’s degree in Computer Science or related field (or equivalent experience); Master’s or PhD preferred.
• 15+ years of demonstrable experience in software architecture, systems design, or enterprise platform engineering.
• Deep expertise in architecting large-scale distributed systems with focus on reliability, performance, and security.
• Proficiency in AI/ML systems, generative AI, and agentic AI frameworks.
• Familiarity with large language models, RAG pipelines, and orchestration frameworks (e.g., ReAct, LangChain, AutoGPT-like flows).
• Experience integrating enterprise platforms (ERP, CRM, ITSM) via APIs, data connectors, or custom services.
• Hands-on development experience with AI agents, frameworks, and tooling, including setting architectural and coding standards.
• Solid understanding of security, governance, and compliance for AI in enterprise contexts.
• Excellent collaboration and communication skills; ability to influence cross-functional stakeholders and present complex architectural concepts clearly.

Ways to stand out

• Hands-on experience with containerized deployments, Kubernetes, and hybrid cloud/on-prem environments.
• Prototyping skills in Python and ability to build proof-of-concept agent workflows.
• Experience with NVIDIA AI technologies such as NeMo, NeMo Guardrails, AIQ, or GPU-optimized inference stacks.
• Track record of publishing technical papers, architecture patterns, or thought leadership in AI systems.
• Knowledge of observability tools, telemetry dashboards, and evaluation frameworks for AI agent performance and experience solving real-world problems with AI in IT, supply chain, or finance domains.

Compensation & Benefits

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 425,500 USD. You will also be eligible for equity and company benefits.

Other details

• Employment type: Full time
• Location: Santa Clara, California, United States
• Application window: Applications accepted at least until September 7, 2025.
• NVIDIA is an equal opportunity employer and committed to fostering a diverse work environment.

Technologies & Tools Mentioned

LLMs, RAG, agent orchestration frameworks (ReAct, LangChain, AutoGPT-like), NeMo, NeMo Guardrails, AIQ, ServiceNow, Salesforce, SAP, Workday, GDrive, SharePoint, Confluence, Kubernetes, containerized deployments, cloud and on-prem architectures, Python, observability and telemetry, GPU-optimized inference stacks, ERP/CRM/ITSM integrations.