Senior Systems Software Engineer - HPC and AI Storage
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI
Communication @ 4
Debugging @ 7
Experimentation
GPU @ 4
HPC
Linux @ 7
Mathematics @ 8
Python @ 6
Security @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
NVIDIA is hiring a Senior Systems Software Engineer to join its Applied Systems Engineering team and improve storage development in AI systems. The role involves software development, practical experimentation, systems integration, technical analysis, workload characterization, and the implementation of storage policies for next-generation NVIDIA platforms and datacenter-scale systems.
Responsibilities
- Engineer and integrate storage systems for large-scale HPC and AI clusters, including Lustre and NFS, and their interaction with compute nodes, networks, and storage hardware.
- Investigate performance and reliability issues throughout the I/O stack, including filesystem clients, Linux kernel paths, network protocols, servers, and storage devices.
- Develop software fixes and performance improvements in collaboration with NVIDIA engineering teams, storage partners, and open-source maintainers.
- Characterize application I/O patterns, including training-data access, checkpointing and restart, metadata-intensive operations, and concurrent workloads.
- Translate workload findings into improvements to software, system configuration, and system design.
- Build reproducible benchmarks, diagnostic tools, and regression tests measuring efficiency, latency, metadata performance, scalability, and contention behavior.
- Lead storage qualification and commissioning, validating functionality, data integrity, failure recovery, and sustained cluster-scale performance.
- Define and implement storage placement, caching, and data lifecycle policies based on workload requirements, capacity, and operational evidence.
Requirements
- Deep engineering experience with Lustre, NFS, or comparable shared storage systems, including implementation-level debugging in at least one stack and storage integration into Linux clusters.
- Strong C programming and Linux debugging skills, including experience reading, modifying, and diagnosing kernel or user-space storage software.
- Understanding of filesystem and distributed-system behavior, including metadata operations, caching and consistency, locking, concurrency, client/server communication, and recovery.
- Experience analyzing application access patterns and tuning filesystem or storage-stack behavior for performance improvements.
- Ability to take complex performance or correctness problems from initial symptoms through reproduction, root-cause analysis, implementation, and validation.
- Proficiency in Python and shell scripting for diagnostic, test automation, and analysis tools.
- Ability to independently lead technical efforts, influence cross-team design decisions, and communicate findings and tradeoffs clearly.
- BS or MS in Computer Science, Engineering, Mathematics, Physics, or equivalent practical experience, with 12+ years of relevant experience.
Preferred Qualifications
- Contributions to Lustre, Linux filesystems, NFS implementations, or other storage projects, including features, performance improvements, bug fixes, or technical reviews.
- Expertise in Lustre metadata and client I/O, Linux VFS and page cache, NFS protocol and client/server internals, or distributed locking and recovery.
- Experience with hierarchical storage management, policy engines, or migration between filesystems and object storage, including data recall and recovery from interrupted transfers.
- Experience with RDMA storage transports, GPUDirect Storage, or optimizing data loading and checkpointing for GPU workloads.
- Experience with storage security and multi-tenancy, including authentication, identity mapping, permissions, and encryption.
Compensation
The expected base salary depends on location, experience, and other objective job-related factors. The listed ranges are 375,000 PLN–650,000 PLN for Level 5 and 483,750 PLN–838,500 PLN for Level 6 in Poland; 114,000 EUR–197,600 EUR for Level 5 and 150,000 EUR–260,000 EUR for Level 6 in France; and 141,900 EUR–245,960 EUR for Level 5 and 165,825 EUR–287,430 EUR for Level 6 in Germany.