Senior System Software Engineer, AI Solutions Engineering

at Nvidia
📍 Santa Clara, United States
USD 148,000-287,500 per year
SENIOR
✅ On-site

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Software Development @ 4 Docker @ 8 ElasticSearch @ 4 Go @ 4 Linux @ 4 MySQL @ 4 DevOps @ 4 Python @ 4 SQL @ 4 Java @ 4 NoSQL @ 4 Distributed Systems @ 4 Machine Learning @ 4 Hiring @ 4 MongoDB @ 4 SRE @ 4 Service Oriented Architecture @ 4 Android @ 4 API @ 4 LLM @ 4

Details

NVIDIA is hiring senior system software engineers in its Infrastructure, Planning and Process Team (IPP), to accelerate AI adoption across various engineering workflows within the company. IPP is a global organization within NVIDIA. The group works with various other teams within NVIDIA such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure needs. These cloud services provide almost half a million automated jobs per day on five thousand servers helping with the productivity of thousands of NVIDIA’s software developers worldwide. The cloud hosts a heterogeneous mix of machines and devices with various operating systems (Windows/Linux/Android), a multitude of hardware platforms both NVIDIA GPUs and Tegra processors.

Are you passionate about infrastructure and looking for complex meaningful issues, ready to build the next generation of cloud services, design creative solutions, mine through data to uncover real problems and fix them? We are excited to have a fun-loving person like you join our team!

Responsibilities

  • Responsible for building industry insights into AI tools, collaborating with vendors, and evaluating AI based product features.
  • Accelerate the evaluation of AI tools by developing robust testing environments, with a strong focus on functionality requirement coverage and efficiency.
  • Implement AI/ML use cases to improve efficiency in software development, DevOps and SRE workflows.
  • Work with software architects and developers in internal and external development teams.

Requirements

  • BS (MS preferred) or equivalent experience in Electrical Engineering/Computer Science with 5+ years of work experience.
  • Well versed with Large Language Models (LLM), Machine Learning (ML), and Agentic AI techniques.
  • Hands-on experience in leveraging large language models (LLMs) and implementing agentic AI for various workflows.
  • Expert programming ability in Python, Go, or Java.
  • Experience working with SQL/NoSQL database systems such as MySQL, MongoDB, or Elasticsearch.
  • Good understanding of distributed systems, microservice architecture, and REST APIs.
  • Excellent knowledge and working experience with Docker containers.
  • Consistent track record in developing large scale distributed applications.
  • Ability to effectively work across organizational boundaries to enhance alignment and productivity between teams.
  • Open to taking on SRE or program management responsibilities if needed, aligned with the NVIDIA "The mission is the Boss" culture.

Ways to stand out from the crowd

  • Proactively track AI tool and technology trends, build insights, and collaborate with vendors early to address feature gaps before NVIDIA adoption.
  • Expertise in leveraging large language models (LLMs) and Agentic AI to automate complex workflows, with knowledge of retrieval-augmented generation (RAG) and fine-tuning LLMs on enterprise data.
  • Prior development of a large software project using service oriented architecture operating with real time constraints.

Benefits

  • Eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.
  • Committed to fostering a diverse work environment and equal opportunity employer.