Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Communication @ 6
Debugging @ 3
Distributed Systems @ 3
Go @ 6
Kubernetes @ 3
LLM
Linux @ 3
Machine Learning
Networking @ 3
Observability @ 3
Python @ 6
Reinforcement Learning @ 2
Rust @ 6
Security @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic is hiring an engineer to help secure large-scale reinforcement learning systems. Reinforcement learning enables Claude to reason, write code, and act autonomously over long horizons. At frontier scale, an RL run is a large distributed system in which training, sampling, and environment execution run concurrently across a large fleet of accelerators and hosts.
This is a hands-on engineering role working in the RL codebase and the underlying infrastructure alongside engineers and researchers. Candidates may come from security engineering backgrounds with an interest in large-scale ML systems, or from ML systems and research engineering backgrounds with an interest in security.
Responsibilities
- Design, build, and operate security controls for RL training systems and their infrastructure.
- Work across orchestration, environments, training, and inference as needed.
- Review designs and code across the RL stack, identify security problems, and fix them.
- Build shared libraries and tooling for RL engineers and researchers.
- Build observability systems to understand the behavior of these systems.
- Work with researchers and performance engineers to ensure security changes preserve training correctness and performance.
- Write clear design documents for systems and tools.
Requirements
- Strong software engineering skills in Python and at least one systems language, such as Rust, C++, or Go.
- Experience designing, building, and operating large-scale distributed systems or production security systems.
- Strong understanding of security fundamentals.
- Working knowledge of Linux, containers, and cloud infrastructure.
- Experience debugging complex problems across many hosts and services.
- Ability to reason about tradeoffs among security, performance, and reliability.
- Strong written communication skills, including experience writing design documents.
- Bachelor’s degree or an equivalent combination of education, training, and experience.
- A field of study relevant to the role, as demonstrated through coursework, training, or professional experience.
Preferred qualifications
- Experience running ML training or inference infrastructure at scale.
- Experience with infrastructure security, including isolation, access control, networking, or identity.
- Experience with container orchestration such as Kubernetes and with sandboxed or virtualized code execution at scale.
- Experience building observability for large fleets.
- Experience supporting research teams or other fast-moving internal users.
- Familiarity with reinforcement learning or large language model training workloads.
Compensation
The annual salary range is $320,000–$405,000 USD.
Benefits and Logistics
- Anthropic expects staff to work from one of its offices at least 25% of the time under its location-based hybrid policy; some roles may require more office time.
- Anthropic sponsors visas, although sponsorship may not be available for every role or candidate. The company retains an immigration lawyer to assist with the process.
- Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration spaces.
More jobs at Anthropic
Technical Program Manager, External Evaluators
Anthropic · San Francisco, United States, New York City, United States
USD 290,000-365,000 per year
Technical Program Manager, Pacing
Anthropic · San Francisco, United States, New York City, United States
USD 290,000-365,000 per year
Tech Lead Manager, Growth Data Science
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 460,000 per year
Staff Software Engineer, Support Technology
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 405,000-485,000 per year
Partner Support Operations Lead
Anthropic · San Francisco, United States, New York City, United States
USD 215,000-300,000 per year
Similar jobs
Research Engineer / Performance Engineer, RL Distributed Systems
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 500,000-850,000 per year
Staff+ Software Engineer, Infrastructure (Distributed Systems)
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 320,000-485,000 per year
Senior Production Engineer - DGX Cloud
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior MLOps Engineer - DSX Enablement
Nvidia · Germany
PLN 292,500-650,000 per year
Staff Software Engineer, Infrastructure (Distributed Systems)
Anthropic · London, United Kingdom
GBP 325,000-390,000 per year
Systems Generalist, GPT Infrastructure
OpenAI · San Francisco, United States, Seattle, United States
USD 293,000-445,000 per year
Senior Software Engineer, Datacenter Automation Platforms
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Manager, Software Engineering - Rack-Scale Systems Infrastructure
Nvidia · Santa Clara, United States
USD 248,000-391,000 per year