Senior Solutions Architect, GPU - Cloud Service Providers

at Nvidia

📍 Santa Clara, United States

$148,000-276,000 per year

SENIOR
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Docker @ 4 Kubernetes @ 4 DevOps @ 4 GCP @ 4 MLOps @ 4 AWS @ 4 Azure @ 4 Networking @ 4 Debugging @ 4 LLM @ 4 PyTorch @ 4

Details

Join our team at NVIDIA and help bring AI solutions to our largest customers. We are seeking an expert Solutions Architect to assist customers in building AI/ML and HPC software solutions at scale. As a member of our Solutions Architecture team, you will collaborate with strategic customers, providing end-to-end technology solutions and technical support based on our product strategy.

Responsibilities

  • Working with tech giants to develop and demonstrate solutions based on NVIDIA’s groundbreaking software and hardware technologies.
  • Partnering with Sales Account Managers and Developer Relations Managers to identify and secure business opportunities for NVIDIA products and solutions.
  • Serving as the main technical point of contact for customers engaged in the development of intricate AI infrastructure, while also offering support in understanding performance aspects related to tasks like large scale LLM training and inference.
  • Conducting regular technical customer meetings for project/product details, feature discussions, introductions to new technologies, performance advice, and debugging sessions.
  • Collaborating with customers to build Proof of Concepts (PoCs) for solutions to address critical business needs and support cloud service integration for NVIDIA technology on hyperscalers.
  • Analyzing and developing solutions for customer performance issues for both AI and systems performance.

Requirements

  • BS/MS/PhD in Electrical/Computer Engineering, Computer Science, Physics, or other Engineering fields or equivalent experience.
  • 3+ years of engineering (performance/system/solution) experience.
  • Hands-on experience building performance benchmarks for data center systems, including large scale AI training and inference.
  • Understanding of systems architecture including AI accelerators and networking as it relates to the performance of an overall application.
  • Effective engineering program management with the capability of balancing multiple tasks.
  • Ability to communicate ideas clearly through documents, presentations, and in external customer-facing environments.

Ways to stand out from the crowd:

  • Hands-on experience with Deep Learning frameworks (PyTorch, JAX, etc.), compilers (Triton, XLA, etc.), and NVIDIA libraries (TRTLLM, TensorRT, Nemo, NCCL, RAPIDS, etc.).
  • Familiarity with deep learning architectures and the latest LLM developments.
  • Background with NVIDIA hardware and software, performance tuning, and error diagnostics.
  • Hands-on experience with GPU systems in general including but not limited to performance testing, performance tuning, and benchmarking.
  • Experience deploying solutions in cloud environments including AWS, GCP, Azure, or OCI as well as knowledge of DevOps/MLOps technologies such as Docker/containers, Kubernetes, data center deployments, etc. Command line proficiency.