Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 6
CUDA @ 3
Experimentation @ 4
GPU @ 3
Machine Learning @ 4
Profiling @ 4
Prompt Engineering @ 4
Python @ 7
Reinforcement Learning @ 4
vLLM
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Responsibilities
- Design and implement AI-based technology addressing core problems of low-level GPU code generation.
- Build SFT and RL training pipelines.
- Define model inputs using low-level compiler representations.
- Define, implement, and evaluate strategies for intelligent prompt engineering in compilation domain.
- Prototype and iterate on model architectures, prompts, and training strategies for NP-hard problems in optimizing compilers.
- Prepare datasets from compiler traces, optimization passes, and target-specific performance signals.
- Apply RL techniques to optimize for downstream objectives and run rigorous experiments, analysis, and benchmarking across workloads and hardware targets.
- Build rigorous benchmarks to assess code quality, correctness, and generation overhead.
- Partner with compiler engineers to integrate and ship learned policies with production toolchains.
Requirements
- M.S. or PhD degree in Computer Engineering, Computer Science related technical field (or equivalent experience).
- 5+ years of experience building AI/ML systems.
- Solid understanding of machine learning fundamentals and experimentation best practices.
- Strong software engineering skills in Python and C++.
- Hands-on experience training/fine-tuning/post-training large models.
- Experience with reinforcement learning.
- Reward modeling from non-differentiable signals (binary runtime/compile success, performance counters).
- Knowledge of prompt-engineering techniques (CoT, chaining/orchestration, context adaptation, etc).
- Ability to work across research and engineering, from prototype to production.
- CUDA programming experience and GPU performance familiarity.
Ways to stand out from the crowd
- Distributed training/inference at scale (Megatron, NeMo, vLLM, Triton).
- Experience working with the NVIDIA training stacks.
- Fundamentals of construction of optimizing compilers.
- Understanding of GPU performance, experience with benchmarking suites and performance profiling tools.
- Knowledge of formal methods or static analysis for correctness guarantees.
Benefits
- Eligible for equity and a generous benefits package.
More jobs at Nvidia
HPC Performance Engineer
Nvidia · United States
USD 152,000-241,500 per year
Senior System Software Engineer - Halos Core And Robotics Platform
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior System Software Engineer – Dynamo Tools
Nvidia · Santa Clara, United States
USD 152,000-287,500 per year
Senior Systems Software Engineer - Autonomous Vehicles
Nvidia · Santa Clara, United States
USD 152,000-287,500 per year
Senior Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Similar jobs
Senior Software Engineer, CUDA Deep Learning Systems
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Systems Generalist, GPT Infrastructure
OpenAI · San Francisco, United States, Seattle, United States
USD 293,000-445,000 per year
Research Engineer, Code RL (Reinforcement Learning)
Anthropic · San Francisco, United States, New York City, United States
USD 500,000-850,000 per year
Senior AI Researcher - World Foundation Models
Nvidia · United States
USD 184,000-356,500 per year
Senior Software Engineer, RL Post-Training Frameworks
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Software Engineer, Humanoid Robotics
Nvidia · Santa Clara, United States
USD 152,000-287,500 per year
Senior Software Engineer, AI Inference Systems
Nvidia · Germany
PLN 292,500-650,000 per year
Senior Software Engineer, Ai Inference Systems
Nvidia · Toronto, Canada
CAD 170,000-275,000 per year