Senior Software Engineer, Robotics Foundation Models

at Nvidia
📍 Santa Clara, United States
USD 148,000-287,500 per year
SENIOR
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Software Development @ 4 Python @ 6 CI/CD @ 6 Algorithms @ 4 TensorFlow @ 4 Communication @ 4 PyTorch @ 4

Details

We are in the midst of a revolution where artificial intelligence is helping us accelerate all aspects of our lives. NVIDIA's mission is to accelerate this revolution. By combining NVIDIA's strengths in simulation (Omniverse), world models (Cosmos), foundation models (GR00T), and compute, we strive to bring general intelligence to humanoid robots. The Isaac team is looking for a robotics foundation model expert to help with this revolution. In this role, you will be working on imbuing humanoid robots with natural language intelligence, semantic understanding, and geometric awareness. Come join us to push the boundaries of robotics and enable the next generation of robotics!

Responsibilities

  • Conduct applied research and design innovative algorithms in the space of geometric computer vision and image/video/vision-language/vision-centric foundation models.
  • Deploy algorithms on real humanoid robots to gauge sim-to-real transfer of models.
  • Work hand-in-hand across multiple engineering and research teams to enable foundation models on humanoid robots.
  • Constantly learn and explore unfamiliar technologies and adopt modern software development practices.

Requirements

  • Master's degree in Computer Science, Robotics, Deep Learning, or related field (or equivalent experience).
  • 5+ years of algorithm development / research experience in one or more of: vision-language models, foundation models, 3D-LLMs, video generative models and diffusion algorithms, or action-based transformers.
  • Experience training vision-foundation models including 3D-VLMs, ViT, LLaVA, CLIP, diffusion models, and VLMs.
  • Hands-on experience with deep learning frameworks (e.g., TensorFlow, PyTorch).
  • Proficiency in modern software development practices (version control, testing, CI/CD).
  • Hands-on experience running algorithms on real-world robotic systems, including sim-to-real considerations.
  • Proficient in C++ and Python.
  • Excellent communication skills and ability to collaborate in cross-functional, distributed teams.
  • Thirst and ability to learn and adapt to new technologies.

Ways to Stand Out

  • Ph.D. in Computer Science, Robotics, Deep Learning, or related field.
  • Publications in top-tier AI conferences or contributions to open-source projects.
  • Experience with vision-language-action models.

Compensation & Benefits

  • Base salary ranges (dependent on level, location, and experience):
    • Level 3: 148,000 USD - 235,750 USD
    • Level 4: 184,000 USD - 287,500 USD
  • You will also be eligible for equity and benefits.

Additional Information

  • Team: Isaac (humanoid robotics / foundation models)
  • Location: Santa Clara, CA, United States
  • Employment type: Full time
  • Applications accepted at least until July 29, 2025
  • NVIDIA is an equal opportunity employer and values diversity in its workforce.