SGLang Jobs

SGLang is an open-source framework and runtime for serving large language and vision-language models. Engineers use it to build, optimise and benchmark low-latency inference systems, including structured generation and GPU-accelerated workloads.

Browse 40 open SGLang jobs from 4 companies including Nvidia, Nebius, and OpenAI. Popular hiring locations include Santa Clara, United States, and Palo Alto.

SGLang Salary Ranges

Pay is quoted per market: the same role is worth several times more in one city than in another, so a single figure spanning countries would describe none of them. 39 of these 40 listings publish a salary. Markets with fewer than 8 disclosed salaries are not shown.

Median yearly pay by country, each in the currency named in its own row

Median yearly pay by metro, each in the currency named in its own row

Seniority and Work Setup for SGLang Roles

A role can offer more than one arrangement, so the shares add up to more than 100%.

2 offer relocation assistance.

Skills Commonly Paired with SGLang

Top Companies Hiring for SGLang

Employers with the most open SGLang jobs

Where SGLang Jobs Are Located

Where these SGLang jobs are based

40 Open SGLang Jobs

Featured Forward Deployed Engineer, Ecosystem at Nebius SENIOR

📍 United States

💰 USD 208,800-261,000 per year

✅ Remote

AI @ 7 API @ 7 AWS Agentic Systems Azure CUDA @ 3 Communication @ 7 Docker @ 6 FastAPI Flask GPU Git @ 6 IaaS Kubernetes @ 6 LLM @ 7 LangChain @ 4 Machine Learning Planning @ 4 Python @ 7 RAG @ 7 SGLang @ 4 TensorRT @ 4 Vector Databases @ 7 vLLM @ 4

Senior Production Engineer - DGX Cloud at Nvidia SENIOR

📍 Santa Clara, United States

💰 USD 184,000-356,500 per year

✅ On-site

AI @ 4 AWS Azure CI/CD @ 4 CUDA @ 3 Communication @ 6 Debugging @ 6 Distributed Systems @ 4 GPU @ 3 Go @ 7 IaC Kubernetes @ 7 LLM @ 3 Linux @ 7 NCCL @ 3 Networking @ 7 Observability Performance Analysis @ 3 PyTorch @ 3 Python @ 7 SGLang @ 3 SRE @ 4 Security TensorRT @ 3 Terraform @ 4 vLLM @ 3

Senior High-Performance AI Engineer, Agentic AI at Nvidia SENIOR

📍 Santa Clara, United States

💰 USD 152,000-241,500 per year

✅ On-site

AI @ 6 Agentic AI @ 6 Agentic Systems @ 6 CUDA @ 4 Deep Learning @ 6 GPU @ 4 HPC LLM @ 4 Leadership @ 6 Machine Learning @ 6 Performance Optimization @ 4 Python @ 7 Reinforcement Learning @ 4 Rust @ 7 SGLang @ 4 vLLM @ 4

Senior Systems Software Engineer - NV Cloud Functions at Nvidia SENIOR

📍 Santa Clara, United States

💰 USD 152,000-287,500 per year

✅ On-site

AI @ 4 Bash @ 4 Deep Learning @ 4 Distributed Systems @ 4 GPU @ 4 Go HPC @ 6 Kubernetes @ 6 LLM @ 6 Linux @ 4 Load Testing Machine Learning @ 4 Mathematics @ 4 Performance Optimization @ 4 Python @ 4 Rust @ 4 SGLang @ 6 Slurm @ 6 Software Development @ 3 TensorRT @ 6 vLLM @ 6

Lead Sales Engineer - Token Factory at Nebius SENIOR

📍 United States

💰 USD 228,000-285,000 per year

✅ Remote

AI @ 7 Communication @ 6 GPU @ 4 LLM @ 4 Leadership @ 6 Machine Learning Mentoring @ 4 SGLang @ 4 Technical Leadership @ 6 TensorRT @ 4 vLLM @ 4

Senior Software Engineer - AI Inference Performance at Nvidia SENIOR

📍 Santa Clara, United States

💰 USD 184,000-356,500 per year

✅ On-site

AI @ 4 CUDA @ 7 Distributed Systems @ 4 GPU @ 7 LLM @ 7 NCCL @ 6 Networking @ 4 PyTorch @ 6 Python @ 7 Rust @ 7 SGLang @ 6 TensorRT @ 6 vLLM @ 6

Senior Manager, Software Engineering - RL Post-Training Frameworks at Nvidia SENIOR

📍 Santa Clara, United States

💰 USD 272,000-431,200 per year

✅ Hybrid

AI @ 8 Algorithms @ 4 CUDA @ 3 Distributed Systems @ 8 GPU HPC Hiring @ 4 Kubernetes @ 4 LLM @ 3 Machine Learning NCCL @ 3 Networking Reinforcement Learning SGLang Slurm @ 4 TensorRT @ 3

Software Engineer, Model Runtime at OpenAI MIDDLE

📍 San Francisco, United States

💰 USD 266,000-445,000 per year

✅ Hybrid

✅ Relocation

AI Communication @ 3 Debugging @ 3 Distributed Systems @ 3 LLM @ 3 Observability @ 3 Profiling @ 3 Python @ 6 Rust @ 6 SGLang System Architecture vLLM

Manager, ML Solutions Architecture - Token Factory at Nebius MIDDLE

📍 United States

💰 USD 228,000-285,000 per year

✅ Remote

AI @ 3 AWS Azure Communication @ 3 Debugging @ 3 DevOps @ 5 Docker @ 5 GCP Git Kubernetes @ 5 LLM @ 6 MLOps Machine Learning Python @ 5 Reporting @ 3 SGLang @ 3 TensorRT @ 3 Vertex AI vLLM @ 3

Distinguished Engineer, Scaled Out Inferencing at Nvidia SENIOR

📍 Santa Clara, United States

💰 USD 320,000-488,800 per year

✅ On-site

AI @ 4 CUDA @ 6 Communication @ 7 Distributed Systems @ 4 GPU @ 6 Kubernetes @ 6 LLM @ 6 Leadership @ 4 Linux @ 6 Machine Learning @ 4 SGLang @ 6 Technical Leadership @ 6 TensorRT @ 6 vLLM @ 6

Senior Deep Learning Software Engineer, Inference at Nvidia SENIOR

📍 Netherlands

💰 PLN 221,200-507,000 per year

✅ Remote

AI @ 4 Agile @ 1 Algorithms CUDA @ 4 Debugging @ 1 Deep Learning @ 1 GPU @ 1 GenAI Generative AI LLM NCCL @ 4 Profiling @ 1 PyTorch @ 6 Python @ 1 SGLang @ 6 Software Development @ 6 vLLM @ 6

Senior Software Engineer, CUDA Deep Learning Systems at Nvidia SENIOR

📍 Santa Clara, United States

💰 USD 184,000-356,500 per year

✅ On-site

AI @ 4 Agentic AI @ 4 Algorithms CUDA @ 4 Communication @ 4 Deep Learning @ 4 GPU @ 3 GenAI Generative AI @ 4 JAX @ 6 LLM MPI @ 4 Machine Learning @ 4 NCCL @ 4 Performance Optimization @ 4 Profiling @ 4 PyTorch @ 6 Python @ 7 SGLang @ 6 TensorRT @ 6 vLLM @ 6

Engineering Manager, Deep Learning Inference at Nvidia SENIOR

📍 Santa Clara, United States

💰 USD 184,000-356,500 per year

✅ Hybrid

AI @ 9 Agile @ 4 CUDA @ 4 Deep Learning @ 4 Engineering Management @ 7 GPU @ 4 GenAI Generative AI LLM @ 6 Leadership @ 7 NCCL @ 7 Performance Optimization @ 4 Profiling @ 6 PyTorch @ 6 Python @ 7 SGLang @ 6 Software Development @ 7 Technical Leadership @ 7 TensorRT @ 6 vLLM @ 6

Generation time: 0.398