Used Tools & Technologies
Machine LearningRequired Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Grafana @ 4
Kubernetes @ 6
Prometheus @ 4
DevOps @ 7
Python @ 4
SQL @ 4
Leadership @ 4
Azure @ 7
Planning @ 4
API @ 4
GPU @ 3
Observability @ 4
AI @ 4
Profiling @ 4
Data Pipelines @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The Capacity Engineering team ensures infrastructure resources are accounted for, well-utilized, and efficiently allocated across accelerator families, CPU families, and clouds. As an engineer on Capacity Engineering you will build production systems: data pipelines that ingest and normalize telemetry from heterogeneous cloud environments, observability tooling for real-time fleet visibility, and performance instrumentation to measure workload efficiency. You will write production-quality code, operate Kubernetes-native infrastructure at scale, and influence decisions around one of Anthropic’s largest areas of spend.
Responsibilities
- Build planning and allocation tooling used by leadership and teams: cross-region and cross-provider placement, guardrails, queueing, occupancy KPIs, and scheduler-enforced allocations.
- Drive efficiency programs: identify and remediate stranding and rightsizing, recover unused capacity, and improve job-level utilization across training, inference, and eval.
- Own attribution and forecasting: reconcile billing across many providers with telemetry and internal systems, attribute spend to workloads/teams, and turn demand signals and roadmaps into a compute plan.
- Build and operate the data platform: pipelines that ingest occupancy, utilization, and cost data into BigQuery with ownership of completeness, latency SLOs, and gap detection.
- Operate Kubernetes-native systems at scale: collection agents, workload labeling, taint/reservation/scheduling behavior affecting usable capacity.
- Treat outputs as product surfaces: gather requirements, define schema contracts, design for consumers including research engineers and finance, and run on-call/SLOs for load-bearing systems.
Requirements
- Strong track record building and operating production systems; hands-on engineering with a DevOps flavor.
- Production-quality Python and SQL; experience authoring BigQuery SQL including table-valued functions and views.
- Deep experience with at least one major cloud provider (Amazon Web Services, Google Cloud, or Microsoft Azure) and its operations.
- Experience with observability tooling: Prometheus, PromQL, and Grafana (including writing recording rules and building monitoring relied upon by engineering teams).
- Ability to gather requirements and work across organizational boundaries in ambiguous environments.
Preferred qualifications
- Experience with capacity planning, resource management, or cost attribution systems in large-scale ML environments or at a hyperscaler.
- Scheduling and packing efficiency experience or profiling-driven optimization of large distributed workloads.
- Multi-cloud data ingestion experience, especially normalizing billing exports, reservation APIs, commitments, and vendor telemetry from differing billing arrangements.
- Total cost of ownership and forecasting experience; decomposing infrastructure growth vs business drivers.
- Accelerator infrastructure familiarity (GPU metrics/DCGM, TPU utilization, Trainium metrics) or ML training/inference systems at the hardware level.
- Experience building internal data products with self-service access, schema contracts, API serving, documentation, and discoverability.
- Storage efficiency, retention, and lifecycle program experience at exabyte scale.
Logistics & Compensation
- Locations: San Francisco, CA; New York City, NY; Seattle, WA.
- Location-based hybrid policy: staff expected to be in an office at least 25% of the time.
- Minimum education: Bachelor’s degree or equivalent experience.
- Visa sponsorship: Anthropic states they do sponsor visas and retain an immigration lawyer to assist when possible.
- Annual salary range: $320,000 - $485,000 USD.
More jobs at Anthropic
Life Sciences Operator, Lead
Anthropic · San Francisco, United States
USD 300,000-320,000 per year
Finance Systems Engineer, Revenue
Anthropic · San Francisco, United States, Seattle, United States
USD 205,000-270,000 per year
Research Scientist, Life Sciences (Computational)
Anthropic · San Francisco, United States
USD 300,000-320,000 per year
Product Manager, Safeguards (Verticals)
Anthropic · San Francisco, United States
USD 305,000-385,000 per year
Lead, Frontier Red Team (Cyber)
Anthropic · San Francisco, United States, New York City, United States
USD 485,000-690,000 per year
Similar jobs
Principal Software Engineer - DGX Cloud
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year
Senior Software Engineer
SentinelOne · United States
USD 132,000-182,000 per year
Principal Network Automation Engineer
Nvidia · Santa Clara, United States
USD 248,000-396,800 per year
NCX Engineer, AI Accelerator
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Forward Deployed Engineer - Physical AI Cloud Platform
Nebius · United States, San Francisco, United States, Austin, United States
USD 179,500-224,300 per year
Forward Deployed Engineer, Ecosystem
Nebius · United States
USD 255,000-315,000 per year
Senior Full-Stack Lead Engineer
Nvidia · Santa Clara, United States
USD 224,000-356,500 per year
Staff Full Stack Engineer, Identity
Stripe · South San Francisco, United States, New York City, United States, Seattle, United States
USD 224,000-336,000 per year