Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 6
API
Communication @ 7
Distributed Systems @ 7
GPU
InfiniBand @ 4
LLM
Machine Learning
Networking @ 4
Observability @ 6
SRE @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic’s AI Reliability Engineering (AIRE) team partners with teams across the company to improve reliability across critical Claude serving paths, including the SDK, network, API layers, serving infrastructure, and accelerators. The team works alongside partner teams during incidents and on projects to make systems more robust and resilient.
Responsibilities
- Develop appropriate Service Level Objectives for large language model serving systems, balancing availability and latency with development velocity.
- Design and implement monitoring and observability systems across the token path.
- Assist in designing and implementing high-availability serving infrastructure across multiple regions and cloud providers.
- Lead incident response for critical AI services, ensuring rapid recovery, thorough incident reviews, and systematic improvements.
- Support the reliability of safeguard model serving, which is critical for site reliability and Anthropic’s safety commitments.
Requirements
- Strong background in distributed systems, infrastructure, or reliability engineering.
- Reliability-minded software engineering or Site Reliability Engineering experience.
- Ability to work comfortably with unfamiliar systems during incidents and help drive resolution.
- Holistic understanding of how systems compose and where system seams occur.
- Ability to build lasting relationships and collaborate across teams.
- Strong communication and collaboration skills.
- A bachelor’s degree or equivalent combination of education, training, and experience.
- Education or experience in a field relevant to the role.
Preferred Qualifications
- Experience as an SRE, Production Engineer, or in a similar reliability-focused role on large-scale systems.
- Experience operating large-scale model serving or training infrastructure with more than 1,000 GPUs.
- Experience with ML hardware accelerators, including GPUs, TPUs, or Trainium.
- Understanding of ML-specific networking optimizations such as RDMA and InfiniBand.
- Expertise with AI-specific observability tools and frameworks.
- Experience with chaos engineering and systematic resilience testing.
- Contributions to open-source infrastructure or ML tooling.
Benefits
Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office spaces for collaboration.
More jobs at Anthropic
Product Manager, Growth
Anthropic · New York City, United States, San Francisco, United States, Seattle, United States
USD 385,000-460,000 per year
Staff+ Research Engineer, RL Data Platform
Anthropic · New York City, United States, San Francisco, United States
USD 500,000-850,000 per year
Engineering Manager, Hardware Platform Security
Anthropic · San Francisco, United States, Seattle, United States
USD 485,000-625,000 per year
Staff+ Software Engineer, RL Data Platform
Anthropic · New York City, United States, San Francisco, United States
USD 320,000-405,000 per year
Applied AI Architect, Strategic Enterprise Tech
Anthropic · New York City, United States, San Francisco, United States, Seattle, United States
USD 240,000-315,000 per year
Similar jobs
Staff Software Engineer, AI Reliability Engineering
Anthropic · Dublin, Ireland
EUR 235,000-295,000 per year
Staff Software Engineer, AI Reliability
Anthropic · New York City, United States, San Francisco, United States, Seattle, United States
USD 325,000-485,000 per year
NCX Senior Engineer
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Forward Deployed Engineer - Physical AI Cloud Platform
Nebius · United States, Austin, United States
USD 179,500-224,300 per year
Senior AI Infrastructure Software Engineer - DGX Cloud
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Member of Technical Staff (AI Infrastructure Engineer)
Perplexity AI · Palo Alto, United States, San Francisco, United States
USD 220,000-405,000 per year
Senior Technical Marketing Engineer - DSX AI Infrastructure Software
Nvidia · Santa Clara, United States
USD 160,000-322,000 per year
Senior Technical Program Manager, AI Infrastructure and Capacity Operations
Nvidia · Santa Clara, United States
USD 168,000-322,000 per year