Senior Software Engineer, Generalist Embodied Agent Research

at Nvidia

📍 Santa Clara, United States

$148,000-276,000 per year

SENIOR
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Python @ 4 GitHub @ 4 Machine Learning @ 8 Hiring @ 4 HTTP @ 4 PyTorch @ 7

Details

We are now looking for a Senior Software Engineer for our Generalist Embodied Agent Research (GEAR) team.

NVIDIA is searching for an outstanding engineer to build humanoid robot foundation models and systems in the Generalist Embodied Agent Research (GEAR) group. Everything that moves will eventually be autonomous. Our mission is to build general-purpose embodied agents that learn to explore and master complex skills across the virtual and the physical world. You will work with an amazing and collaborative research team that consistently produces influential works on multimodal foundation models, large-scale robot learning, game AI, and physical simulation. Our past projects include Eureka, VIMA, Voyager, MineDojo, MimicPlay, Prismer, and more. One of our team’s most recent milestones includes Project GR00T, a foundation model for humanoid robots. Your contributions will have a significant impact on our moonshot research projects and product roadmaps.

Responsibilities

  • Work with world-class researchers at NVIDIA to develop robust AI solutions for general-purpose humanoid robots and embodied agents.
  • Develop large-scale AI training and inference infrastructure for foundation models.
  • Develop robust and scalable data pipelines.
  • Systematically evaluate and analyze AI models in physical simulation and on robot hardware.
  • Collaborate with research and engineering teams across all of NVIDIA to ensure your software integrates seamlessly up and down the stacks.

Requirements

  • A Masters Degree in Computer Science, Computer Engineering, or Robotics or equivalent experience.
  • 4+ years of relevant work experience in one or both of the following domains:
    • Large-scale AI systems:
      • Outstanding engineering skills for rapid prototyping and product development. Python is required; C++ and CUDA proficiencies are a plus.
      • Excellent knowledge and hands-on experience in working with large-scale machine learning/AI systems and compute infrastructure.
      • Hands-on training experience with multimodal large language models.
      • Deep expertise in building multimodal data pipelines.
    • Practical robotics systems:
      • Deep understanding of robot kinematics, dynamics, and sensors.
      • Ability to safely operate robot hardware, lab equipment, and tools.
      • Experience with rapid prototyping technologies, such as CAD design and 3D fabrication.
      • Strong programming skills in Python, C++, ROS, and machine learning frameworks like PyTorch.
      • Knowledge of control methods, including PID, model predictive control, and whole-body control.
      • Familiarity with physics simulation frameworks such as MuJoCo and Isaac Sim.
      • Robot hardware design and hands-on building experience.

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and productive people in the world. Please join us and be part of the forefront of developing general-purpose robots and embodied agents!

The base salary range is 148,000 USD - 276,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.