Senior Software Architect, Agentic AI

Details

NVIDIA is looking for a senior software AI architect to help redefine engineering flows by building agentic systems that improve future chip designs — in other words, using AI to design next-generation AI systems. The role combines generative AI, agentic workflows, and close collaboration with hardware architects and infrastructure teams to deploy AI-based solutions for complex engineering problems.

Responsibilities

• Serve as an expert in implementing and deploying AI applications based on large language models (LLMs), internal and external agentic frameworks, and custom models.
• Work with hardware architects to identify how to best design, customize, and deploy AI-based solutions to their specific problem domains.
• Collaborate with infrastructure engineers to improve existing automated workflows by incorporating LLMs and establishing best practices for future solutions.
• Develop and optimize retrieval and generation algorithms for enterprise data (text, code, and images) to build advanced AI applications.
• Interact with internal research groups on how to solve complex chip design problems in new ways by leveraging machine learning (ML) and deep learning (DL).
• Research emerging AI technologies and engineering best practices to continuously evolve the development ecosystem and maintain a competitive edge.

Requirements

• MSc or PhD in Data Science, Computer Science/Engineering, Electrical Engineering, or equivalent experience.
• 5+ years of industry or research experience.
• Deep practical knowledge of LLMs, DL/ML, and agent development.
• Well versed in agentic literature and eager to continue learning.
• Strong background in implementing AI solutions to solve real-world engineering problems.
• Experience with training/fine-tuning custom models, building multi-agent systems, retrieval-augmented generation (RAG) pipelines, and vector databases.
• Strong analytical, communication, and interpersonal skills.

Nice-to-have / Ways to stand out

• Background in computer architecture or hardware development.
• Good understanding of distributed systems and microservice architecture.
• Hands-on experience with NVIDIA Inference Microservices (NIMs).

Compensation & Benefits

• Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
• The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.
• You will also be eligible for equity and benefits.

Additional information

• Applications for this job will be accepted at least until September 22, 2025.
• NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer. They do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

#LI-Hybrid