Deep Learning Framework Communications Engineer - New College Grad 2026
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 3
CUDA @ 3
Communication @ 5
Deep Learning @ 3
GPU
HPC @ 3
JAX @ 3
LLM @ 3
MPI @ 3
NCCL @ 5
Parallel Programming @ 3
Performance Analysis
Profiling @ 2
PyTorch @ 3
Python @ 3
Reinforcement Learning @ 3
SGLang @ 3
System Architecture @ 3
vLLM @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
NVIDIA is developing technologies in artificial intelligence, high-performance computing, and visualization. The GPU is at the heart of its products and services, enabling advances in artificial intelligence, autonomous vehicles, and other applications.
This role focuses on bringing advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, and JAX. The team develops communication libraries and technologies such as NCCL, NVSHMEM, and GPUDirect for scaling deep learning and high-performance computing applications. Customers have diverse multi-GPU requirements, ranging from training workloads using up to 100,000 GPUs to inference workloads requiring microsecond latency.
Responsibilities
- Integrate new communication library features into AI frameworks, from proof of concept and performance analysis through production deployment.
- Analyze AI workloads and frameworks to identify multi-GPU communication requirements and opportunities.
- Collaborate hands-on with teams working on the latest AI models.
- Improve AI compilers to hide communication or perform automatic fusion.
- Conduct in-depth performance characterization of AI workloads on multi-GPU clusters.
- Design fault-tolerant and elastic solutions for large-scale or dynamic AI workloads.
- Author custom communication or fused compute-communication kernels to achieve high performance on NVIDIA platforms.
- Influence the roadmap of communication libraries, including NCCL and NVSHMEM.
- Collaborate with a dynamic team across multiple time zones.
Requirements
- Bachelor's, master's, or Ph.D. degree in computer science or a related field, or equivalent experience, with software engineering and HPC/AI experience.
- Development or integration experience with deep learning frameworks such as PyTorch and JAX, and inference engines such as TRT-LLM, vLLM, and SGLang.
- Rapid prototyping and development experience with Python, C++, CUDA, or related domain-specific languages such as Triton and cuTe.
- Solid understanding of AI models, parallelism, and/or compiler technologies such as
torch.compile. - Experience benchmarking performance on AI clusters.
- Familiarity with at least one performance profiling toolchain, such as PyTorch Profiler or NVIDIA Nsight Systems.
- Understanding of HPC/AI communication concepts, including one-sided and two-sided communication, elasticity, resiliency, and topology discovery.
- Adaptability and willingness to learn new areas and tools.
- Ability to work and communicate effectively across teams and time zones.
Preferred Qualifications
- Experience with parallel programming using at least one communication runtime, such as NCCL, NVSHMEM, or MPI.
- Understanding of computer system architecture, hardware-software interactions, operating system principles, and systems software fundamentals.
- Expertise in one or more areas including training, distributed inference, mixture-of-experts, reinforcement learning, or kernel authoring with CUDA, Triton, or cuTe.
- Experience programming compute and communication overlap in distributed runtimes.
- Experience with AI compiler pattern matching and lowering.
- Solid understanding of memory hierarchy, consistency models, and tensor layout.
Compensation and Benefits
The expected base salary ranges are $124,000–$195,500 for Level 2 and $152,000–$241,500 for Level 3. Base salary is determined by location, experience, and other objective job-related factors. The role also includes eligibility for equity and benefits.
Applications will be accepted at least until November 18, 2026. This posting is for an existing vacancy. NVIDIA is an equal opportunity employer committed to an inclusive work environment.