Senior Architect, Model Performance and Post-Training

at Nvidia
USD 224,000-431,200 per year
SENIOR
✅ On-site

Tech Stack

AI @ 4 Algorithms @ 4 Automated Testing @ 7 Debugging LLM Performance Analysis Python @ 6 Reinforcement Learning @ 4

Details

NVIDIA is seeking a Senior Engineer to drive the performance modeling, evaluation, and post-training of large language models specialized in code generation, software engineering, and agentic coding tasks. The role operates at the intersection of model training, inference optimization, and empirical analysis to improve coding model capabilities, efficiency, reliability, and real-world developer productivity. The successful candidate will collaborate with research scientists, infrastructure engineers, and product teams to translate model insights into production-ready capabilities.

Responsibilities

  • Develop frameworks to measure and analyze coding model performance across code generation, debugging, code completion, repository-level reasoning, and multi-step software engineering tasks.
  • Develop and optimize post-training pipelines for coding models, including supervised fine-tuning (SFT), preference optimization, reinforcement learning (RL), and outcome-based or process-based reward modeling.
  • Analyze benchmark results, training dynamics, failure modes, and model behaviors to identify opportunities for improvement.
  • Improve model performance on sophisticated coding tasks through targeted training interventions, reward design, curriculum development, and iterative error analysis.
  • Build scalable, reproducible infrastructure for training experiments, evaluation pipelines, and model performance analysis.

Requirements

  • Bachelor's degree or equivalent experience in Computer Science or AI, with 12 or more years of meaningful work experience.
  • Excellent programming skills in Python.
  • Strong understanding of large language models, transformer architectures, and the training and evaluation of generative models.
  • Foundational understanding of reinforcement learning algorithms and implementation, including Markov decision processes (MDPs), policies, and reward design.
  • Deep understanding of software engineering fundamentals, code generation, automated testing, and program correctness.
  • Proven track record leading model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines.

Preferred Qualifications

  • Experience training or post-training state-of-the-art coding models or models designed for software engineering agents.
  • Experience with execution-based rewards, verifiable rewards, reward hacking mitigation, and automated code evaluation.
  • Familiarity with coding benchmarks and evaluation environments such as SWE-bench.

Compensation and Benefits

  • Base salary range of $224,000–$356,500 for Level 5.
  • Base salary range of $272,000–$431,250 for Level 6.
  • Additional eligibility for equity and benefits.
  • Applications will be accepted at least until October 17, 2026.
  • NVIDIA is an equal opportunity employer and is committed to an inclusive work environment.

More jobs at Nvidia

Similar jobs