Senior Software Engineer, AI Networking

at Nvidia
USD 184,000-356,500 per year
SENIOR
✅ On-site

Used Tools & Technologies

Not specified

Required Skills & Competences

Distributed Systems @ 7 Leadership @ 7 Networking @ 4 Debugging @ 6 Technical Leadership @ 7 CUDA @ 4 AI @ 4 InfiniBand @ 7 NCCL @ 4

Details

NVIDIA is seeking an outstanding Software Engineer to join the US-based networking software team as a technical leader to drive the transformation of AI networking systems. The role involves managing complex customer engagements, influencing product and architecture direction, and developing hardware-accelerated software solutions for AI networking products such as BlueField DPU and ConnectX.

Responsibilities

  • Establish yourself as a technical specialist in AI networking products (BlueField DPU and ConnectX). Architect, design, and develop innovative, scalable, high-performance hardware-accelerated software solutions.
  • Lead deep technical engagements with hyperscalers, including design-in, coding, bring-up, performance tuning, failure analysis, and production hardening.
  • Partner with internal engineering, product, and architecture teams to translate customer needs into product features, reference architectures, tooling, and guidelines.
  • Drive performance, reliability, and debuggability improvements across customer stacks and convert findings into actionable product, firmware, and software roadmap items.

Requirements

  • Bachelor’s, Master’s or PhD in Software Engineering, Computer Science, Computer Engineering, Electrical Engineering or a related science degree (or equivalent experience).
  • 8+ years of relevant industry experience, including technical leadership across complex systems.
  • Deep knowledge of networking protocols and distributed systems, with a strong understanding of RoCE/InfiniBand, L1–L4 fundamentals, and performance/latency tradeoffs.
  • Proven low-level software expertise with proficiency in C/C++ and comfort debugging across firmware, driver, OS, and application layers.
  • Demonstrated experience in high-performance networking and system-level debugging, including packet drops, retransmissions, congestion, QoS, ordering, and buffer management.
  • Excellent interpersonal skills with the ability to explain complex topics to engineers, PMs, and customers and align cross-organizational teams.
  • Result-driven and comfortable multitasking in a dynamic environment with shifting priorities and requirements.

Ways to Stand Out

  • Prior customer-facing technical leadership experience at hyperscalers/CSPs.
  • Hands-on expertise with RDMA verbs, DPDK, DOCA, NCCL, CUDA-aware networking, congestion control, and performance tuning at scale.
  • Experience building internal tools, telemetry, and automation to improve triage speed and operational excellence.
  • Experience leading multi-team initiatives across geographies, and proactive use of AI-powered tools to accelerate debugging, documentation, and engineering efficiency while maintaining strong engineering judgment.

Compensation & Benefits

  • Base salary ranges provided by level: Level 4: 184,000 USD - 287,500 USD; Level 5: 224,000 USD - 356,500 USD.
  • Eligible for equity and benefits.

Other Information

  • Applications accepted at least until May 31, 2026.
  • NVIDIA uses AI tools in its recruiting processes.
  • NVIDIA is an equal opportunity employer committed to diversity.