Senior Research Scientist, Multi-Modal Language Models

at Nvidia

USD 192,000-356,500 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 6 Algorithms @ 6 Computer Vision @ 6 Data Structures @ 6 Deep Learning @ 4 Distributed Systems @ 4 LLM @ 4 PyTorch @ 6 Python @ 6

Details

NVIDIA is seeking a Senior Research Scientist passionate about multi-modal language models. The team drives Nemotron Multi-modal technology and develops state-of-the-art open-source multi-modal models with open models, open weights, and open data. The goal is to deliver models that work effectively in real-world applications and uplift the broader ecosystem of multi-modal LLM users.

Responsibilities

Drive new abilities into the model.
Improve generalization of existing functionalities by identifying weak points, designing data synthesis solutions, and retraining models.
Develop training recipes that combine multiple modalities, including text, image, video, and audio.
Design solutions that improve Pareto efficiency.
Collaborate with researchers to translate cutting-edge ideas into production-ready implementations.
Explore new paradigms for evaluation.
Demonstrate strong engineering practices and contribute to open-source communities.

Requirements

PhD in Computer Science, Electrical Engineering, or a related field, or equivalent research experience in LLMs, systems, or related areas.
4+ years of experience in computer vision, especially multi-modal LLMs.
Proficiency in Python with hands-on experience using frameworks such as PyTorch.
Solid computer science fundamentals, including algorithms, data structures, parallel and distributed computing, and systems programming.
Proven ability to collaborate across research and engineering teams in multifaceted environments.

Preferred Qualifications

Specific multi-modal LLM research experience.
Experience developing and scaling large distributed systems for deep learning.
Contributions to open-source LLM systems or large-scale AI infrastructure.

Benefits

Equity and benefits are provided.
NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer.

Applications will be accepted at least until February 8, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.