Engineering Manager, Inference

Details

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The performance and scaling teams focus on making the most efficient and impactful use of compute resources for both inference and training. As an Engineering Manager on these teams you will ensure your team identifies and removes bottlenecks, builds robust and durable solutions, and maximizes the efficiency of systems. You will bring clarity, focus, and context to your teams in a fast-paced, dynamic environment, while maintaining a deep understanding of technical work and its implications for AI safety.

Responsibilities

• Provide front-line leadership of engineering efforts to improve model performance and scale inference and training systems
• Become familiar with the team’s technical stack enough to make targeted contributions as an individual contributor
• Manage day-to-day execution of the team's work
• Prioritize the team’s work and manage projects in a highly dynamic, fast paced environment
• Coach and support reports in understanding and pursuing their professional growth
• Maintain a deep understanding of the team's technical work and its implications for AI safety

Requirements

• 1+ years of management experience in a technical environment (particularly performance or distributed systems)
• Background in machine learning, AI, or a related technical field
• Ability to learn quickly and contribute to discussions on complex technical topics
• Experience managing teams through periods of rapid growth and change
• Strong stakeholder management and communication skills
• Education: at least a Bachelor's degree in a related field or equivalent experience

Strong candidates may also have

• Experience with high-performance, large-scale ML systems
• GPU/Accelerator programming
• ML framework internals
• OS internals
• Language modeling with transformers

Compensation & Logistics

• Annual base salary: $425,000 - $560,000 USD
• Total compensation includes equity, benefits, and may include incentive compensation
• Location-based hybrid policy: staff expected to be in one of Anthropic's offices at least 25% of the time (some roles may require more time in office)
• Visa sponsorship: Anthropic does sponsor visas when possible and retains an immigration lawyer to assist
• Education requirement: Bachelor's degree or equivalent experience

Why Anthropic / Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours and a collaborative office environment
• Emphasis on high-impact, large-scale AI research and frequent research discussions
• Encouragement to apply even if you do not meet every qualification listed

Notes

• The role sits at the intersection of many complex technical systems related to inference, training, performance, and scaling. A strong candidate will be comfortable operating at a high level of abstraction across these domains and committed to the safe development of advanced AI systems.