Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 4
API @ 4
AWS @ 4
Communication @ 7
Consul @ 4
Distributed Systems @ 4
GCP @ 4
GPU
Go @ 6
IaC
Kubernetes @ 4
Linux @ 4
Machine Learning
NCCL @ 3
Networking @ 3
Python @ 6
Rust @ 6
Slurm @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The Kubernetes Platform team owns the Kubernetes control plane and core cluster services that make Anthropic’s fleets of hundreds of thousands of nodes work across multiple cloud providers and datacenters. The team focuses on scheduler extensions, scaling control plane components, and building core services that must remain fast, correct, and highly available as object and node counts grow by orders of magnitude.
Responsibilities
- Own, operate, and extend the Kubernetes scheduler for accelerator fleets, including custom scheduling plugins and policies for gang scheduling, topology awareness, and preemption.
- Scale Kubernetes control plane components (apiserver, etcd, controller-manager) to support clusters far beyond typical limits and identify bottlenecks proactively.
- Design, build, and operate core cluster services such as service discovery that every workload in the fleet depends on.
- Build and maintain custom controllers, operators, and CRDs.
- Partner with research, training, and inference teams to understand workload shapes and convert requirements into platform capabilities.
- Collaborate with cloud providers on required features and escalations.
- Participate in on-call rotations, lead incident response, and design processes (postmortems, runbooks, SLOs) to prevent repeat failures.
Requirements (Minimum qualifications)
- Significant software engineering experience building and operating production distributed systems.
- Proficiency in at least one systems-appropriate language (examples provided: Go, Python, Rust, or C++).
- Deep, hands-on Kubernetes experience (beyond user-level) in areas such as scheduler, controllers, apiserver, or operating large multi-tenant clusters.
- Demonstrated ability to debug complex issues across the stack, from API behavior down to node and network-level root causes.
- Track record of designing for reliability, correctness, and clear failure semantics in systems other engineers depend on.
- Strong written and verbal communication; comfortable building consensus with internal stakeholders.
Preferred qualifications
- Experience with Kubernetes internals or contributions (kube-scheduler / scheduling framework, apiserver, etcd, client-go, controller-runtime, or similar).
- Experience building or operating cluster schedulers or batch systems (e.g., Kueue, Volcano, Slurm, or in-house equivalents).
- Background scaling control planes or coordination systems (etcd, ZooKeeper, Consul, or large DNS/service-mesh deployments).
- Familiarity with ML infrastructure: GPUs, TPUs, or Trainium; gang scheduling; topology-aware placement; collective networking such as NCCL.
- Experience with GCP and/or AWS, including GKE/EKS internals and Infrastructure as Code.
- Low-level systems experience such as Linux kernel tuning, cgroups, or eBPF.
- 8+ years of relevant industry experience, including time leading large, ambiguous infrastructure projects.
Compensation
- Annual Salary: $320,000 - $405,000 USD
Logistics
- Minimum education: Bachelor’s degree or equivalent combination of education, training, and/or experience.
- Location-based hybrid policy: staff are expected to be in one of the offices at least 25% of the time (role may require more time in offices).
- Visa sponsorship: The company states they do sponsor visas and retain an immigration lawyer to help with the process.
More jobs at Anthropic
Life Sciences Operator, Lead
Anthropic · San Francisco, United States
USD 300,000-320,000 per year
Finance Systems Engineer, Revenue
Anthropic · San Francisco, United States, Seattle, United States
USD 205,000-270,000 per year
Research Scientist, Life Sciences (Computational)
Anthropic · San Francisco, United States
USD 300,000-320,000 per year
Product Manager, Safeguards (Verticals)
Anthropic · San Francisco, United States
USD 305,000-385,000 per year
Lead, Frontier Red Team (Cyber)
Anthropic · San Francisco, United States, New York City, United States
USD 485,000-690,000 per year
Similar jobs
Staff Software Engineer, Kubernetes Platform
Anthropic · London, United Kingdom
GBP 325,000-485,000 per year
Senior Software Engineer, AI Inference Systems
Nvidia · Germany
PLN 292,500-650,000 per year
Forward Deployed Engineer - Physical AI Cloud Platform
Nebius · United States, San Francisco, United States, Austin, United States
USD 179,500-224,300 per year
Staff Software Engineer, Node Infra
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 320,000-405,000 per year
Staff Software Engineer, Node Infra
Anthropic · London, United Kingdom
GBP 325,000-485,000 per year
Staff + Sr. Software Engineer, Cloud Inference Launch Engineering
Anthropic · San Francisco, United States
USD 320,000-485,000 per year
Staff + Sr. Software Engineer, Cloud Inference
Anthropic · San Francisco, United States
USD 320,000-485,000 per year
Senior Full-Stack Lead Engineer
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year