Compiler Engineer - AI Inference

at Nvidia
USD 152,000-241,500 per year
MIDDLE
✅ On-site

Tech Stack

AI @ 3 Communication @ 6 Debugging @ 6 GPU @ 3 LLM Performance Analysis @ 6 Python @ 8

Details

NVIDIA is seeking an AI Compiler Engineer to drive innovation within its compiler organization. The role focuses on improving AI performance and building technology for next-generation computing platforms.

Responsibilities

  • Develop compiler technology for kernel generation and computational graph optimizations targeting next-generation NVIDIA GPUs.
  • Solve complex compilation problems for AI inference and training workloads.
  • Transition compiler innovations into enterprise and consumer products.
  • Collaborate with software, hardware, and research teams on hardware/software co-design and future silicon architectures.
  • Advance and optimize datacenter-scale AI workload deployments.

Requirements

  • Bachelor's or master's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience. A PhD is strongly preferred.
  • At least 3 years of relevant industry experience specializing in compiler optimizations, synthesis, and placement.
  • Hands-on experience with MLIR.
  • Exceptional C/C++ and Python programming and software design skills.
  • Strong debugging, performance analysis, and test design abilities.
  • Strong communication and interpersonal skills, with the ability to collaborate in a dynamic, fast-paced, product-oriented environment.

Preferred Qualifications

  • Hands-on experience implementing complex AI workloads on CPU, GPU, or custom AI accelerator architectures.
  • Deep understanding of Large Language Model inference and its implications for computer architecture.
  • Experience designing and architecting comprehensive compiler frameworks from the ground up.

Benefits

  • Equity and benefits are provided.
  • NVIDIA offers a competitive salary and benefits package.
  • Applications will be accepted at least until April 28, 2026.
  • NVIDIA is an equal opportunity employer.

More jobs at Nvidia

Similar jobs