Staff + Senior Software Engineer, Cloud Inference

Details

Anthropic's Cloud Inference team scales and optimizes Claude for developers and enterprise companies across AWS, GCP, Azure, and future cloud service providers. The team owns Claude's end-to-end cloud platform product, including API integration, intelligent request routing, inference execution, capacity management, and operations.

The role focuses on designing backend services and infrastructure that operate reliably and cost-effectively at massive scale across cloud providers with different hardware, networking stacks, and operational models.

Responsibilities

• Design, build, and own backend services and infrastructure that serve Claude across multiple cloud service providers, accounting for differences in compute hardware, networking, APIs, and operational models.
• Collaborate with internal inference, product API, systems, and security teams, as well as cloud service provider partners, to launch serving stacks on new platforms, resolve operational issues, and influence provider roadmaps.
• Build and evolve CI/CD automation systems, including validation and deployment pipelines, to reliably ship new model versions to millions of users across cloud platforms without regressions.
• Design interfaces and tooling abstractions across cloud service providers to enable cost-effective inference management, scale across providers, and reduce per-platform complexity.
• Contribute to capacity planning, autoscaling, and workload-routing strategies that match supply with demand and direct requests to the most cost-effective accelerator and region.
• Analyze observability data across providers to identify performance bottlenecks, cost anomalies, and regressions, and drive remediation based on production workloads.

Requirements

• Significant software engineering experience, with a strong background in high-performance, large-scale distributed systems serving millions of users.
• Experience building or operating services on at least one major cloud platform: AWS, GCP, or Azure.
• Exposure to Kubernetes, infrastructure as code, or container orchestration.
• Curiosity about large language model serving; prior inference or machine learning experience is not required.
• Ability to collaborate cross-functionally with internal teams and external partners.
• Experience working with external partners to align goals and deliver impact.
• Ability to quickly learn new technologies, hardware platforms, and provider ecosystems.
• High autonomy and ownership of problems end-to-end.

Preferred Qualifications

• Direct experience working with cloud service providers to scale infrastructure or products across multiple platforms, including differences in networking, security, privacy, billing, and managed service offerings.
• Hands-on experience with capacity management, cost optimization, or resource planning at scale across heterogeneous environments.
• Solid understanding of multi-region deployments, geographic routing, and global traffic management.
• Proficiency in Python or Rust.

Education and Experience

• Bachelor's degree or an equivalent combination of education, training, and/or experience.
• A field of study relevant to the role, as demonstrated through coursework, training, or professional experience.
• Required years of experience correlate with the internal job-level requirements for the position.

Benefits

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.
• Office space for collaboration.

Work Policy and Sponsorship

• Hybrid policy: Staff are currently expected to work from an Anthropic office at least 25% of the time, although some roles may require more office time.
• Anthropic sponsors visas for this role, subject to role- and candidate-specific eligibility, and retains an immigration lawyer to provide assistance.