Senior Software Engineer, Spatial Intelligence And Foundation Models
at Nvidia
USD 184,000-356,500 per year
Used Tools & Technologies
Not specified
Required Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Python @ 7
Algorithms @ 4
TensorFlow @ 4
Communication @ 4
Experimentation @ 6
PyTorch @ 4
GPU @ 4
Codex @ 6
Claude Code @ 6
Deep Learning @ 4
AI @ 4
Computer Vision @ 4
Robotics @ 4
Data Pipelines @ 4
JAX @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
NVIDIA is seeking a Software Engineer to join the Isaac Spatial Intelligence team within the Isaac Engineering organization. You will join a group of robotics software and applied research engineers focused on geometric and semantic understanding and reasoning for robots — building perception systems that turn raw sensor data into actionable world understanding and shaping the future of physical AI.
Responsibilities
- Design, implement, and deploy novel algorithms for spatial understanding, working on problems ranging from SLAM, structure-from-motion (SfM), optical flow, scene flow, and object reconstruction to training vision-language models (VLMs) on spatial reasoning skills.
- Develop robust perception, mapping, and reasoning systems that run on robots, in simulation, and at scale in data pipelines for training foundation models.
- Advance the state of the art in geometric computer vision by combining classical multi-view geometry and optimization with modern deep learning approaches.
- Train and evaluate vision-language models on skills relevant to robotics.
- Collaborate closely with Cosmos and GR00T teams on perception and spatial understanding for foundation models, and with other Isaac teams (Sim/Lab, Platform, SQA) to deploy, validate, extend, and release capabilities on physical robots and in at-scale simulations.
- Contribute to integration, validation, and release of applied research efforts on NVIDIA's robotics platforms.
- Support innovation through prototypes, open source contributions, patents, and publications.
- Work cross-functionally with product, hardware, and software teams to translate engineering work into products.
Requirements
- PhD or Master’s degree in Computer Science, Robotics, or a related field (or equivalent experience).
- 8+ years of experience working on computer vision, robotics, or deep learning technologies.
- Strong foundation in 3D geometric computer vision: multi-view geometry, visual odometry/SLAM, structure-from-motion, or dense correspondence (optical flow, scene flow, stereo).
- Strong hands-on programming skills in Python and/or C++.
- Experience with deep learning frameworks (PyTorch, JAX, TensorFlow).
- Experience training and evaluating deep learning models for perception tasks; familiarity with vision-language models is a strong plus.
- Proficiency with agentic tool use — working with AI coding agents and agentic workflows (e.g., Claude Code, Cursor, Codex) to accelerate development, testing, and experimentation.
- Excellent communication, organizational, and interpersonal skills.
Ways To Stand Out
- Contributions to widely used SLAM, SfM, or 3D reconstruction systems (open source or shipped products).
- Experience with large-scale model training on GPU clusters, including VLMs or other foundation models.
- Publications at top computer vision or robotics venues (CVPR, ICCV, ECCV, ICRA, IROS, RSS, CoRL).
- Hands-on experience with simulation-based training and evaluation, sim-to-real and real-to-sim transfer.
Compensation and Benefits
- Base salary ranges by level:
- Level 4: 184,000 USD - 287,500 USD
- Level 5: 224,000 USD - 356,500 USD
- Eligible for equity and company benefits (link provided in original posting).
Additional Information
- Applications accepted at least until July 20, 2026.
- This posting is for an existing vacancy.
- NVIDIA uses AI tools in its recruiting processes.
- NVIDIA is an equal opportunity employer and is committed to fostering an inclusive work environment.
More jobs at Nvidia
Senior Systems Software Engineer, Observability and Telemetry Platform
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Systems Software Engineer – GPU Software
Nvidia · Santa Clara, United States
USD 152,000-241,500 per year
Senior Software Engineer, CUDA Core Libraries
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Principal Engineer, Applied Research - Accelerator Programming Model and Compiler
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Senior System Software Architect - Halos Core and Robotics Platform
Nvidia · Santa Clara, United States
USD 224,000-431,200 per year
Similar jobs
Senior Machine Learning Engineer
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Forward Deployed Engineer - Physical AI
Nebius · United States, San Francisco, United States, Austin, United States
USD 169,900-254,900 per year
Principal Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Software Engineering Manager, Robotics Neural Reconstruction And Real2Sim Applications
Nvidia · Santa Clara, United States
USD 224,000-431,200 per year
Senior Machine Learning Engineer, End-to-End Autonomous Driving
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Director, Perception - Autonomous Vehicles
Nvidia · Santa Clara, United States
USD 320,000-488,800 per year
Senior Architect, Camera ISP
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Software Engineer, Metropolis Vision AI
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year