Senior Software Engineer, Bare Metal Infrastructure – DGX Cloud
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 6
GPU
Go @ 7
HTTP @ 4
InfiniBand @ 4
Kubernetes @ 4
LLM @ 6
Linux @ 7
NVLink @ 4
Networking @ 6
Python @ 7
Rust @ 7
Software Development @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
NVIDIA DGX Cloud builds large-scale GPU infrastructure that powers demanding AI workloads. The Bare Metal Infrastructure team develops the software that turns newly racked hardware into reliable, validated production capacity. This role works across the full bare-metal lifecycle, including new platform introduction, firmware qualification, automated provisioning, validation, remediation, and handoff to production. The team uses AI agents and LLM tools extensively to build software.
Responsibilities
- Design, build, and maintain production services for bare-metal discovery, provisioning, hardware validation, firmware upgrades, auditing, and repair across large GPU fleets.
- Develop integrations with Redfish and vendor BMC interfaces to manage server state, collect inventory and health data, enforce configuration, and drive recovery across vendor-specific implementations.
- Contribute to and review code in a Rust codebase, while building supporting tools and services in Go and Python.
- Turn recurring hardware, firmware, and connectivity failures into automated detection, validation, and repair workflows.
- Define and implement automated validation and handoff criteria for new platforms, firmware releases, and rack-scale deployments.
- Debug complex failures across hardware, firmware, Linux, networking, and provisioning services, and incorporate findings into the software.
- Partner with server and component vendors and with internal platform, networking, datacenter, and production engineering teams to resolve cross-boundary issues.
- Use AI agents and LLM tools daily to write, review, and test code and investigate failures, while helping shape how the team builds with AI.
Requirements
- BS or MS in Computer Science, Computer Engineering, or equivalent experience.
- 5+ years of experience building production infrastructure software, automation, or services, including substantial hands-on work with bare-metal server systems.
- Strong programming skills in Rust, Go, or Python, with experience designing, testing, shipping, and maintaining production code, and willingness to work regularly in Rust.
- Deep knowledge of enterprise server hardware from multiple vendors, including Dell, Supermicro, Lenovo, and HPE systems, BMCs, BIOS/UEFI, and firmware management.
- Direct experience with Redfish and IPMI for provisioning, health inspection, power management, or fault diagnosis, as well as network boot technologies such as PXE/iPXE, DHCP, and HTTP boot.
- Strong Linux knowledge, including the boot process, kernel and driver interactions, hardware discovery, and low-level failure analysis.
- Solid datacenter networking fundamentals and the ability to trace connectivity problems across host, management, and infrastructure networks.
- Demonstrated, regular use of AI agents and LLM tools in software development, with the judgment to validate their output.
Preferred Qualifications
- Production experience writing Rust.
- Experience with NVIDIA DGX or NVL72 systems, NVLink, InfiniBand, Spectrum-X, or BlueField DPUs.
- Experience with hardware qualification, rack-scale bring-up, firmware certification, or new product introduction, including scalable workflows for fleet firmware upgrades, configuration enforcement, hardware replacement, and recovery.
- Experience with Kubernetes, GitOps/Argo CD, or fleet-management platforms.
- Examples of AI-driven tooling or workflows that measurably changed how a team ships software.
Compensation and Benefits
The base salary range is $152,000–$241,500 USD for Level 3 and $184,000–$287,500 USD for Level 4. Base salary is determined by location, experience, and the pay of employees in similar positions. The role is also eligible for equity and benefits.
Applications will be accepted at least until November 1, 2026. NVIDIA uses AI tools in its recruiting processes and is an equal opportunity employer.