Senior Software Engineer, AI Networking

at Nvidia

USD 184,000-356,500 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 7 CUDA Debugging @ 6 Distributed Systems @ 7 GEO @ 7 InfiniBand @ 7 Leadership @ 7 NCCL Networking @ 7 Technical Leadership @ 7

Details

NVIDIA is seeking an outstanding Software Engineer to join its US-based networking software team. As a technical leader, you will lead the transformation of AI networking systems. You will apply your deep expertise to manage complex customer engagements and help develop NVIDIA's product and architecture direction.

Responsibilities

Establish yourself as a technical specialist in AI networking products, specifically the BlueField DPU and ConnectX product lines. Architect, design, and develop innovative, scalable, and high-performance hardware-accelerated software solutions.
Lead deep technical engagements with hyperscalers, involving design-in, coding, bring-up, performance tuning, failure analysis, and production hardening.
Partner with internal engineering, product, and architecture teams to transform customer needs into product features, reference architectures, tooling, and guidelines.
Drive performance, reliability, and debuggability improvements across customer stacks and translate findings into actionable product, firmware, and software roadmap items.

Requirements

A Bachelor’s, Master’s or PhD in Software Engineering, Computer Science, Computer Engineering, Electrical Engineering or a related science degree (or equivalent experience)
8+ years of relevant industry experience, including technical leadership across complex systems.
Deep knowledge of networking protocols and distributed systems, with a strong understanding of RoCE/InfiniBand, L1–L4 fundamentals, and performance/latency tradeoffs.
Proven low-level software expertise with proficiency in C/C++ and comfort debugging across firmware, driver, OS, and application.
Demonstrated experience in high-performance networking and system-level debugging, including packet drops, retransmissions, congestion, QoS, ordering, and buffer management.
Excellent interpersonal skills, with the ability to clearly explain complex topics to engineers, PMs, and customer collaborators, and align cross-organizational teams toward a decision.
Result driven and comfortable multitasking in a dynamic environment with shifting priorities and changing requirements

Ways to Stand Out from the Crowd

Prior experience in customer-facing technical leadership at hyperscalers/CSPs.
Hands-on expertise with RDMA verbs, DPDK, DOCA, NCCL, CUDA-aware networking, congestion control, and performance tuning at scale.
Experience building internal tools, telemetry, and automation that improve triage speed and operational excellence.
Experience leading multi-team initiatives across geo/time zones, with clear examples of influence without authority as well as eager and proactive in bringing to bear AI-powered tools to accelerate debugging, documentation, and day-to-day engineering efficiency while maintaining strong engineering judgment.

NVIDIA will determine your base salary based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.