Senior System Software Engineer - Dynamo

at Nvidia
šŸ“ World
šŸ“ Canada
šŸ“ United States
USD 152,000-287,500 per year
SENIOR
āœ… Remote

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Python @ 4 Algorithms @ 4 Distributed Systems @ 4 Hiring @ 4 gRPC @ 4 Protobuf @ 4 Rust @ 4 Debugging @ 4 HTTP @ 4 JSON @ 4 PyTorch @ 4 Agile @ 4 GPU @ 4

Details

We are looking for a Senior System Software Engineer to work on Dynamo. NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team. Academic and commercial groups around the world are using GPUs to power a revolution in AI, enabling breakthroughs in problems from image classification to speech recognition to natural language processing. The team builds back-end services and software to make design and deployment of new AI models easier and accessible to all users.

Responsibilities

  • Develop open source software to serve inference of trained AI models running on GPUs.
  • Build robust, scalable, high-performance software components to support distributed inference workloads.
  • Work with team leads to prioritize features and capabilities.
  • Load-balance asynchronous requests across available resources and optimize prediction throughput under latency constraints.
  • Integrate the latest open source technology into the product stack.

Requirements

  • Masters or PhD or equivalent experience.
  • 3+ years in Computer Science, Computer Engineering, or a related field.
  • Ability to work in a fast-paced, agile team environment.
  • Excellent programming and software design skills in Rust, Python, and C++ (including debugging, performance analysis, and test design).
  • Experience with high-scale distributed systems and ML systems.

Ways to stand out

  • Prior work improving performance of AI inference systems.
  • Background with deep learning algorithms and frameworks, especially Large Language Models and frameworks such as PyTorch, TensorRT, and ONNX Runtime.
  • Experience building and deploying cloud services using HTTP REST, gRPC, protobuf, JSON and related technologies.
  • Familiarity with the latest AI research and how these systems are efficiently implemented.

Compensation & Benefits

  • Base salary ranges:
    • Level 3: 152,000 USD - 218,500 USD
    • Level 4: 184,000 USD - 287,500 USD
  • Eligible for equity and benefits (see NVIDIA benefits information).

Additional information

  • Applications for this job will be accepted at least until January 17, 2026.
  • This posting is for an existing vacancy.
  • NVIDIA uses AI tools in its recruiting processes.
  • NVIDIA is an equal opportunity employer and is committed to fostering a diverse work environment.