Principal Enterprise AI Architect, Enterprise AI Platform - Agentic AI

Details

Join the Enterprise AI & Automation team in NVIDIA IT to architect the future of agentic AI at scale. NVIDIA’s Enterprise AI Platform powers AI agents to transform employee productivity and accelerate business impact. As the lead enterprise AI architect, you will design, evangelize, and implement the architectural foundations of this platform. You will guide the vision for orchestration, integration, security, and lifecycle management of AI agents, ensuring the platform delivers trusted, scalable, and innovative solutions. This is a rare opportunity to define the blueprint for enterprise AI agents inside one of the world’s most advanced AI companies.

Responsibilities

• Define and evolve the architecture for NVIDIA’s Enterprise AI Platform, including frameworks for agent orchestration, multi-agent coordination, RAG, deployment, monitoring, and life cycle management.
• Architect and enable data flywheels that drive continuous improvement of AI agents through evaluation, feedback, and iteration loops.
• Partner with engineering, product, and research teams to shape platform strategy and roadmaps, while evaluating LLMs, agentic frameworks, and NVIDIA’s own NeMo and AIQ technologies.
• Ensure integration with enterprise data sources and tools (e.g., ServiceNow, Salesforce, SAP, Workday, GDrive, SharePoint, Confluence) with a strong content security focus.
• Drive architectural decisions across deployment models (on-prem, cloud, hybrid, containerized) to deliver scalable, reliable, and efficient solutions.
• Lead design reviews, develop technical documentation, and mentor engineers in principles of architecture and code development.
• Champion observability, monitoring, versioning, and telemetry to ensure trustworthy and auditable AI agents.
• Influence enterprise adoption of the platform by partnering with stakeholders across IT, chip design, supply chain, sales, finance, and HR, and serve as a reference adopter providing feedback to strengthen NVIDIA’s ecosystem.

Requirements

• Bachelor’s degree in Computer Science or related field (or equivalent experience); Master’s or PhD preferred.
• 15+ years of demonstrable experience in software architecture, systems design, or enterprise platform engineering.
• Deep expertise in architecting large-scale distributed systems with a focus on reliability, performance, and security.
• Demonstrated proficiency in AI/ML systems, generative AI, or agentic AI frameworks.
• Familiarity with large language models, RAG pipelines, orchestration frameworks (e.g., ReAct, LangChain, AutoGPT-like flows).
• Experience integrating enterprise platforms (e.g., ERP, CRM, ITSM) with APIs, data connectors, or custom services.
• Hands-on development of AI agents, frameworks, and tooling, including setting architectural and coding standards.
• Solid understanding of security, governance, and compliance for AI in enterprise contexts.
• Excellent collaboration skills with the ability to influence cross-functional stakeholders and build trusted partnerships.
• Ability to communicate complex architectural concepts clearly and inspire confidence across technical and business audiences.

Ways to stand out from the crowd

• Hands-on experience with containerized deployments, Kubernetes, and hybrid cloud/on-prem environments.
• Prototyping skills in Python with ability to build proof-of-concept agent workflows.
• Experience with NVIDIA AI technologies such as NeMo, NeMo Guardrails, AIQ, or GPU-optimized inference stacks.
• Track record of publishing technical papers, architecture patterns, or thought leadership in AI systems.
• Knowledge of observability tools, telemetry dashboards, and evaluation frameworks for AI agent performance as well as experience solving real-world problems with AI in IT, supply chain, or finance domains.

Compensation & Benefits

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 425,500 USD.

You will also be eligible for equity and benefits (see NVIDIA benefits page).

Additional information

• Applications for this job will be accepted at least until September 30, 2025.
• NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer.
• #LI-Hybrid