Engineering Manager, Inference

Details

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

This role sits on Anthropic’s performance and scaling teams, focused on making the most efficient and impactful use of compute resources for inference and training. As an Engineering Manager you will ensure your team identifies and removes bottlenecks, builds robust and durable solutions, and maximizes system efficiency. You will provide clarity, focus, and context to teams in a fast-paced, dynamic environment and maintain a deep understanding of technical work and its implications for AI safety.

Responsibilities

• Provide front-line leadership of engineering efforts to improve model performance and scale inference and training systems.
• Become familiar with the team’s technical stack enough to make targeted contributions as an individual contributor.
• Manage day-to-day execution of the team's work.
• Prioritize the team’s work and manage projects in a highly dynamic, fast-paced environment.
• Coach and support direct reports in understanding and pursuing their professional growth.
• Maintain a deep understanding of the team's technical work and its implications for AI safety.

Requirements

• 1+ years of management experience in a technical environment, particularly in performance or distributed systems.
• Background in machine learning, AI, or a related technical field (Bachelor’s degree in a related field or equivalent experience required).
• Strong interpersonal skills and ability to build relationships with stakeholders at all levels.
• Ability to learn quickly and contribute to discussions on complex technical topics.
• Experience managing teams through periods of rapid growth and change.
• Capacity to understand a broad range of complex technical systems at a high level of abstraction.

Preferred / Strong candidates may also have

• Experience with high-performance, large-scale ML systems.
• GPU / accelerator programming experience.
• Knowledge of ML framework internals.
• Familiarity with OS internals.
• Experience with language modeling and transformers.

Logistics

• Location-based hybrid policy: staff are expected to be in an office at least 25% of the time (some roles may require more office time).
• Visa sponsorship: Anthropic will make every reasonable effort to sponsor visas for offered candidates and retains an immigration lawyer to assist, though sponsorship cannot be guaranteed for every role.
• Education: at least a Bachelor’s degree in a related field or equivalent experience is required.

Benefits / Compensation

• Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office space for collaboration.
• Annual salary range: $425,000 - $560,000 USD.

About the team / culture

• Anthropic emphasizes large-scale, high-impact AI research and collaboration across a single cohesive team. The organization values communication skills and diverse perspectives and encourages applicants who may not meet every listed qualification to apply.