Senior Computer Vision, VLM Performance Engineer

at Nvidia
📍 Santa Clara, United States
USD 184,000-356,500 per year
SENIOR
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Marketing @ 4 Software Development @ 7 Python @ 6 Statistics @ 4 CI/CD @ 4 Communication @ 7 gRPC @ 4 Data Analysis @ 4 Product Management @ 4 API @ 4 PyTorch @ 4 CUDA @ 4

Details

NVIDIA's computer vision team builds hardware-accelerated computer vision pipelines, cloud services and SDKs that bring the latest AI innovations to data centers, gaming rigs, cars, robots, buildings, medical devices, and more. This role focuses on productizing and optimizing Vision Language Models (VLMs) and their inference pipelines to deliver high-performance, production-grade solutions at scale.

Responsibilities

  • Develop, profile, and optimize inference pipelines for VLMs and other AI computer vision models to improve throughput and latency, including data loading, pre-processing, and post-processing.
  • Improve efficiency of VLM models via kernel optimization in CUDA.
  • Contribute upstream improvements to SDKs and libraries across NVIDIA and the broader ecosystem to enable accelerated computer vision at scale.
  • Promote high-performance AI computer vision practices across NVIDIA teams and functions (Engineering, Product Management, Marketing, etc.).

Requirements

  • Master's degree in Computer Science, Electrical Engineering, or equivalent experience.
  • Approximately 8 years of practical experience (or equivalent).
  • Expertise in AI computer vision, including Vision Language Models (VLMs), Vision Transformers, and Diffusion models; proven experience using the associated software ecosystem (PyTorch, HuggingFace, vLLM) to develop and release production-grade software.
  • Excellent software engineering fundamentals: source control, CI/CD, testing/validation, packaging, containerization, and release processes.
  • Proficiency in Python and C++.
  • Strong experience with CUDA, including kernel optimization for performance-critical code paths.
  • Experience developing cloud applications and services (REST APIs, gRPC).
  • Strong communication skills (written, visual, verbal) to present performance challenges, tradeoffs, and architectural alternatives.
  • Curiosity and drive to learn new technologies and collaborate across teams and functions.

Nice to Have / Ways to Stand Out

  • Expertise in classical (non-ML) computer vision.
  • Strong system-level performance fundamentals: multi-threaded, multi-process, and distributed software development.
  • Solid grounding in mathematical fundamentals such as linear algebra, numerical methods, statistics, and exploratory data analysis.
  • Demonstrated creativity and innovation around performance across multiple problem domains.

Compensation & Benefits

  • Base salary ranges (dependent on level and location):
    • Level 4: 184,000 USD - 287,500 USD
    • Level 5: 224,000 USD - 356,500 USD
  • Eligible for equity and company benefits.
  • Applications accepted at least until September 7, 2025.

Equal Opportunity

NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer. The company does not discriminate on the basis of any legally protected characteristic.