Senior Deep Learning Engineer – Model Evaluation & AI Systems

at Nvidia

📍 Santa Clara, United States

USD 224,000-431,200 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 4 Communication @ 6 Deep Learning @ 4 GPU LLM Machine Learning @ 4 Mathematics @ 4 NLP RAG

Details

NVIDIA is seeking a Senior / Principal Deep Learning Engineer to help shape the future of AI. The role focuses on model evaluation and AI systems, with work directly impacting product releases and market positioning.

Responsibilities

Define and build evaluation methodologies for innovative AI models, including large language models, retrieval-augmented generation systems, agents, and vision/multimodal models.
Build and expand NeMo Evaluator as an open-source platform, focusing on correctness, reproducibility, and ease of adoption.
Build scalable, reproducible evaluation infrastructure, including harnesses, orchestration, and result pipelines running on large GPU clusters.
Collaborate with and engage the open-source community by reviewing contributions, shaping the roadmap, and sharing best practices.
Work with model training, inference, and product divisions to provide trusted evaluation signals that inform release and optimization decisions.

Requirements

BS, MS, or PhD in Computer Science, AI, Applied Mathematics, or a related field, or equivalent experience.
Senior-level experience, typically 12 or more years, developing or assessing contemporary machine learning and deep learning systems.
Hands-on experience with large language models and natural language processing, including model behavior analysis and evaluation.
Demonstrated experience contributing to open-source software or building platforms, libraries, or tools used by other engineers.
Ability to take charge of unclear technical challenges and communicate effectively across research, engineering, and product teams.

Preferred Qualifications

Experience building or improving evaluation frameworks, benchmarks, or machine learning infrastructure used by other teams or external users.
Strong appreciation for evaluation quality, including correctness, reproducibility, and consistency across environments.
Hands-on experience evaluating modern AI systems such as large language models, retrieval-augmented generation pipelines, agents, or multimodal models.
Prior involvement in open-source projects through contributions, reviews, maintenance, or community engagement.
Experience acting as a technical bridge across teams or platforms, such as evaluation, training, or agent frameworks, combining architectural understanding with clear communication and influence.

Benefits

NVIDIA offers competitive salaries, a comprehensive benefits package, equity, and benefits for employees and their families. NVIDIA is an equal opportunity employer committed to fostering a diverse work environment.

Applications for this job will be accepted at least until March 7, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.