Engineering Manager, Inference

Details

Anthropic's performance and scaling teams focus on making efficient and impactful use of compute resources across inference and training. The Engineering Manager will lead efforts to identify and remove bottlenecks, build robust and durable solutions, maximize system efficiency, and provide clarity and focus in a fast-paced environment.

Responsibilities

• Provide front-line leadership for engineering efforts to improve model performance and scale inference and training systems.
• Become familiar with the team's technical stack enough to make targeted individual-contributor contributions.
• Manage the day-to-day execution of the team's work.
• Prioritize team work and manage projects in a highly dynamic, fast-paced environment.
• Coach and support reports in understanding and pursuing their professional growth.
• Maintain a deep understanding of the team's technical work and its implications for AI safety.

Requirements

• At least 1 year of management experience in a technical environment, particularly performance or distributed systems.
• Background in machine learning, artificial intelligence, or a related technical field.
• Strong interest in the potential transformative effects of advanced AI systems and commitment to their safe development.
• Ability to build strong relationships with stakeholders at all levels.
• Ability to quickly understand and contribute to discussions on complex technical topics.
• Experience managing teams through periods of rapid growth and change.
• Ability to understand a broad range of complex technical systems at a high level of abstraction.
• Bachelor's degree or an equivalent combination of education, training, and experience. The field of study must be relevant to the role through coursework, training, or professional experience.

Strong candidates may also have experience with:

• High-performance, large-scale machine learning systems.
• GPU or accelerator programming.
• Machine learning framework internals.
• Operating system internals.
• Language modeling with transformers.

Benefits

Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and an office environment for collaboration.

Work Policy and Sponsorship

Staff are currently expected to work from one of Anthropic's offices at least 25% of the time, although some roles may require more office time. Anthropic sponsors visas when possible and makes reasonable efforts to obtain a visa for candidates who receive an offer, with support from an immigration lawyer.