Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
API @ 4
Azure @ 7
Data Engineering
Data Pipelines
DevOps @ 7
GPU @ 3
Grafana @ 4
Kubernetes
Machine Learning @ 4
Observability @ 4
Planning @ 4
Profiling @ 4
Prometheus @ 4
Python @ 6
SQL @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic's Capacity Engineering team builds the production systems used to account for, measure, allocate, and maximize utilization across a large infrastructure fleet spanning multiple accelerator families, CPU families, and cloud providers. The role focuses on data engineering, systems engineering, observability, capacity planning, efficiency, attribution, and forecasting for compute infrastructure.
Responsibilities
- Build the planning and allocation stack used by leadership, engineering teams, and schedulers, including cross-region and cross-provider placement, guardrails, queueing, and occupancy KPIs.
- Drive efficiency programs covering stranding and rightsizing, unused capacity recovery, and job-level utilization across training, inference, and evaluation workloads.
- Establish per-configuration baselines and work with system-owning teams to improve utilization.
- Own attribution and forecasting by reconciling billing across more than ten providers with telemetry and internal systems, attributing spend to workloads, and converting demand signals and research roadmaps into compute plans and supply pipelines.
- Build data pipelines that ingest occupancy, utilization, and cost data into BigQuery, with ownership of completeness, latency SLOs, and gap detection.
- Integrate data from new cloud providers and normalize billing, usage, and telemetry data across heterogeneous environments.
- Operate Kubernetes-native systems at scale, including collection agents, workload labeling, taint and reservation behavior, and scheduling systems.
- Define schema contracts, gather requirements, design self-service data products, and support consumers ranging from research engineers to finance and company leadership.
- Establish on-call processes and SLOs for production systems.
- Collaborate with research engineering, infrastructure, inference, and finance teams in a high-autonomy, ambiguous environment.
Requirements
- Strong track record building and operating production systems in a hands-on engineering role with a DevOps focus.
- Production-quality Python and SQL skills. Pipeline code is primarily Python, while the presentation layer uses BigQuery SQL, including table-valued functions and views.
- Deep experience with at least one major cloud provider: Amazon Web Services, Google Cloud, or Microsoft Azure.
- Experience with observability tooling, including Prometheus, PromQL, and Grafana; recording rules and monitoring relied upon by engineering teams.
- Ability to gather requirements independently and work across organizational boundaries with limited direction.
- Bachelor's degree or an equivalent combination of education, training, and experience.
- Relevant field of study demonstrated through coursework, training, or professional experience.
Preferred Qualifications
- Experience with capacity planning, resource management, or cost attribution systems at a hyperscaler or in a large-scale machine learning environment.
- Scheduling and packing efficiency experience, or profiling-driven optimization of large distributed workloads.
- Multi-cloud data ingestion experience, including billing exports, reservation APIs, on-demand capacity reservations, commitments, and vendor telemetry.
- Total cost of ownership and forecasting experience.
- Familiarity with accelerator infrastructure, including GPU metrics such as DCGM, TPU utilization, Trainium power and utilization metrics, or machine learning training and inference systems at the hardware level.
- Experience building internal data products with self-service access, schema contracts, API serving, documentation, and discoverability.
- Storage efficiency, retention, and lifecycle program experience at exabyte scale.
Benefits
Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office space for collaboration.
More jobs at Anthropic
Manager, Applied AI Architects – Digital Natives, EMEA
Anthropic · London, United Kingdom
GBP 190,000-230,000 per year
Principal Engineer Capacity/Compute
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 320,000-485,000 per year
Principal Engineer Capacity/Compute
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 320,000-485,000 per year
Staff+ Software Engineer, Enterprise (Full Stack)
Anthropic · San Francisco, United States, New York City, United States
USD 405,000-485,000 per year
Applied AI Architect, Security Specialist
Anthropic · San Francisco, United States, New York City, United States
USD 300,000-400,000 per year
Similar jobs
Staff+ Software Engineer, Capacity Engineering
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 320,000-485,000 per year
Senior Engineering Manager, Capacity Engineering
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 405,000-485,000 per year
Senior Software Engineer
SentinelOne · United States
USD 132,000-182,000 per year
NCX Senior Engineer
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Systems Software Engineer, Developer Productivity and Cloud Automation - GeForce NOW
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Full-Stack Lead Engineer
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year
Senior IT Engineer Security
ABN AMRO · Amstelveen, Netherlands
EUR 72,800-104,000 per year
Infrastructure Security Engineer (Bare Metal & Platform)
SpaceXAI · Austin, United States, New York City, United States, Palo Alto, United States, Seattle, United States
USD 100,000-258,000 per year