DGX Cloud Performance Engineer

Details

NVIDIA DGX™ Cloud is an end-to-end, scalable AI platform for developers, offering scalable capacity built on the latest NVIDIA architecture and co-engineered with major cloud service providers (CSPs). We are seeking highly skilled parallel and distributed systems engineers to drive performance analysis, optimization, and modeling to define the architecture and design of NVIDIA's DGX Cloud clusters.

Responsibilities

• Develop benchmarks and end-to-end customer applications running at scale, instrumented for performance measurements, tracking, and sampling to measure and optimize performance of important applications and services.
• Construct carefully designed experiments to analyze, study and develop critical insights into performance bottlenecks and dependencies from an end-to-end perspective.
• Develop ideas and proposals to improve end-to-end system performance and usability by driving changes in hardware, software, or both.
• Collaborate with AI researchers, developers, and application service providers to understand internal developer and external customer pain points and requirements, project future needs, and share best practice.
• Develop modeling frameworks and TCO (total cost of ownership) analysis to enable efficient exploration and sweeping of the architecture and design space.
• Develop methodologies to drive engineering analysis that inform the architecture, design, and roadmap of DGX Cloud.

Requirements

• Expertise working with large-scale parallel and distributed accelerator-based systems.
• Expertise optimizing performance and AI workloads on large-scale systems.
• Experience with performance modeling and benchmarking at scale.
• Strong background in computer architecture, networking, storage systems, and accelerators.
• Familiarity with popular AI frameworks such as PyTorch, TensorFlow, JAX, Megatron-LM, Tensort-LLM, VLLM, among others.
• Experience with AI/ML models and workloads, in particular LLMs, and an understanding of DNNs and their use in emerging AI/ML applications and services.
• Bachelor's or Master's in Engineering or equivalent experience (preferably Electrical Engineering, Computer Engineering, or Computer Science).
• Approximately 10 years of experience in the above areas.
• Proficiency in Python and C/C++.
• Expertise with at least one public CSP infrastructure (GCP, AWS, Azure, OCI, ...).

Ways to stand out

• PhD in relevant areas.
• Very high intellectual curiosity; confidence to dig in as needed; not afraid of confronting complexity; able to pick up new areas quickly.
• Proficiency in CUDA and XLA.
• Excellent interpersonal skills.

Compensation & Benefits

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until October 25, 2025.

Company & Equal Opportunity

NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.