Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 4
Data Science @ 4
LLM @ 7
Leadership @ 6
Machine Learning
Security @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
At NVIDIA, you will work at the forefront of AI safety and contribute to advancements in artificial intelligence technology. The role focuses on safety programs for Nemotron models, LLM security, frontier risks, agentic safety, hallucinations, and model-release readiness.
Responsibilities
- Lead cross-functional planning and execution for evaluation identification, selection, and execution, with a focus on agentic-safety evaluations such as multi-turn tool calling, unsafe tool use, unintended actions, excessive autonomy, and multi-step failures.
- Track evaluation execution and results, analysis, mitigation plans, and research plans. Translate evaluation findings into prioritized mitigation plans with accountable owners, committed dates, and measurable closure criteria.
- Lead end-to-end safety planning and execution for Nemotron models, including program scope, dependencies, risks, resources, and release-readiness criteria.
- Translate technical safety priorities into executable programs covering LLM security, frontier risks, agentic safety, and hallucinations.
- Establish and track multi-turn, multimodal, multilingual, long-context, and reasoning-model evaluations across relevant use cases, domains, languages, modalities, and model releases.
- Establish governance for reviewing safety findings, assigning severity, determining release impact, and escalating unresolved risks.
- Ensure required safety evidence, approvals, exceptions, and risk-acceptance decisions are documented before release.
- Identify program gaps and critical dependencies early, and drive decisions, escalations, recovery plans, and corrective actions.
- Build and maintain dashboards and executive reporting for evaluation coverage, critical findings, mitigation progress, residual risk, and release readiness.
Requirements
- Bachelor's degree or equivalent experience in computer science, engineering, data science, or a related technical field.
- 10+ years of experience in technical program management, engineering, product development, technical operations, or a similar area.
- Strong understanding of LLM architecture, frameworks such as OpenAI, Anthropic, and Hugging Face, and model evaluation.
- Familiarity with LLM development, post-training, inference, tool calling, evaluation datasets, and model-release lifecycles.
- Experience directing programs related to AI/ML development, model evaluation, agentic safety, security, content safety, hallucinations, and/or production releases.
- Familiarity with AI safety risks such as hallucinations, prompt injection attacks, unsafe tool use, data poisoning, model manipulation, and unintended agent behavior.
- Experience supporting model-safety evaluations, red teaming, adversarial testing, security assessments, or responsible-AI programs.
- Ability to interpret technical evaluation findings and communicate their product, schedule, and release implications to leadership.
Preferred Qualifications
- Experience with LLM agentic safety, security, red teaming, hallucinations, adversarial assessment, or responsible AI.
- Experience defining evaluation datasets, rubrics, benchmarks, and release gates.
- Ability to use evaluation results and data to make clear release recommendations and communicate residual risk to leadership.
- Experience crafting or operationalizing multi-turn, hallucination, adversarial, or agentic-safety evaluations.
Compensation and Benefits
- Base salary range: $168,000–$258,750 for Level 4 and $200,000–$322,000 for Level 5.
- Eligible for equity and benefits.
- Applications will be accepted at least until October 30, 2026.
- NVIDIA is an equal opportunity employer and is committed to an inclusive work environment.
More jobs at Nvidia
AI Systems Software Engineering Intern – Summer 2027
Nvidia · Austin, United States
USD 20-71 per hour
Software Engineer, Performance Instrumentation
Nvidia · Santa Clara, United States
USD 168,000-270,200 per year
Software Engineer, Data Systems
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year
Compiler Software Engineering Intern - Summer 2027
Nvidia · Redmond, United States
USD 20-71 per hour
Software Engineer, Technical Lead – Performance Data Platform
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Similar jobs
Senior MLOps Engineer - DSX Enablement
Nvidia · Germany
PLN 292,500-650,000 per year
Threat Intel Manager, CBRN-E & Advanced Weapons
Anthropic · Washington, United States, New York City, United States, San Francisco, United States
USD 375,000-455,000 per year
Applied AI Architect, Public Sector (Federal Civilian)
Anthropic · San Francisco, United States, New York City, United States
USD 275,000-315,000 per year
Technical Cyber Threat Investigator
Anthropic · San Francisco, United States, Washington, United States
USD 230,000-290,000 per year
Forward Deployed Engineer - Finance
Nvidia · Santa Clara, United States
USD 116,000-230,000 per year
Senior AI Engineer
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year
Senior Full Stack Software Engineer, Marketing Platforms
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year
Tech Lead Manager, AI Evaluations
Glean · Mountain View, United States
USD 250,000-350,000 per year