Solution Architect - OEM AI Software

Details

NVIDIA is seeking an outstanding Solutions Architect to help grow our OEM enterprise AI business. You will become a trusted technical advisor with our OEM partners and work on software solutions focused on enabling enterprise Generative AI workflows. The role requires experience with Generative AI, LLMs, Deep Learning, and GPU technologies and involves collaborating across OEM partners, sales, and NVIDIA engineering teams to architect and deploy enterprise-grade AI solutions.

Responsibilities

• Work with OEM partners to architect enterprise-grade end-to-end generative AI software solutions.
• Collaborate closely with OEM partners' software development teams to craft joint AI solutions.
• Support pre-sales activities, including technical presentations and demonstrations of Generative AI capabilities.
• Work with NVIDIA engineering teams to provide feedback and contribute to the evolution of generative AI software.
• Engage directly with customers and partners to understand requirements and challenges.
• Lead workshops and design sessions to define and refine generative AI solutions with emphasis on enterprise workflows.
• Implement strategies for efficient and effective training of LLMs to achieve peak performance.
• Design and implement RAG-based workflows to improve content generation and information retrieval.

Requirements

• 3-5+ years of hands-on experience as a solution architect or similar role with a focus on AI solutions.
• BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience).
• Proven track record of deploying and optimizing Generative AI models for inference in production environments.
• Expertise in training and fine-tuning LLMs using frameworks such as TensorFlow, PyTorch, or Hugging Face Transformers.
• Proficiency in model deployment and optimization techniques for efficient inference on various hardware platforms, with a focus on GPUs.
• Solid understanding of GPU cluster architecture and parallel processing for accelerated model training and inference.
• Excellent communication and collaboration skills; ability to articulate complex technical concepts to technical and non-technical audiences.
• Experience leading workshops, training sessions, and presenting technical solutions to diverse audiences.

Ways to Stand Out

• Experience deploying Generative AI models in cloud environments and on-premises infrastructures.
• Experience with NVIDIA GPUs and software libraries such as NVIDIA NIM, NVIDIA NeMo Framework, NVIDIA Triton Inference Server, TensorRT, TensorRT-LLM.
• Proven ability to optimize LLMs for inference speed, memory efficiency, and resource utilization.
• Familiarity with Docker or equivalent containerization technologies and Kubernetes for scalable model deployment.
• Deep understanding of GPU cluster architecture, parallel computing, and distributed computing concepts.

Compensation & Benefits

• Base salary ranges by level:
  • Level 2: 120,000 USD - 189,750 USD
  • Level 3: 148,000 USD - 235,750 USD
• You will also be eligible for equity and benefits (see NVIDIA benefits).

Additional Information

• Location: US, TX, Remote (role lists US and TX locations and remote option).
• Employment type: Full time.
• Application window: Applications for this job will be accepted at least until July 29, 2025.
• NVIDIA is an equal opportunity employer committed to a diverse work environment.