Product Manager, Safeguards Rare Harms

Details

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The Safeguards team builds protections for frontier models and AI products to prevent misuse and reduce ethical, technical, and social risks. As a Product Manager on Safeguards you will own ideation, design, development, and deployment of Safeguards systems and product UX across cloud platforms and product surfaces.

Responsibilities

• Determine how to build safety-by-design upstream and leverage downstream defenses for Anthropic’s frontier models and AI products across surfaces such as Claude.ai, 1P API, and external cloud providers.
• Write safety evals and communicate about safety externally.
• Drive impact through prioritization: define problems, evaluate solution options, and produce clear requirements for MVP vs ideal states considering business and technical tradeoffs.
• Align and collaborate with policy, enforcement, research, engineering, and other cross-functional stakeholders.
• Understand the AI landscape and plan mitigations for deployment risks from increasingly powerful models and determined adversaries.
• Lead development of metrics to understand performance, blindspots, and to inform future planning.

Requirements

• 5+ years in product management focused on fast problem understanding, roadmap building, and delivering tractable progress.
• Deep technical expertise in development, deployment, and measurement of Safeguards systems (detections, evals, interventions, infrastructure, and tools).
• Experience making technical tradeoff decisions and working across policy experts, AI/ML research engineers, and software engineering teams to design and build safety systems.
• Strong user understanding of product usage and Safeguards concerns, and ability to craft solutions addressing those concerns.
• Demonstrated experience designing and building metrics to evaluate risks, system performance, and user impact.
• Experience planning, building, launching, and measuring new products/systems in a zero-to-one environment.
• Excellent written and verbal communication; ability to explain complex technical concepts to non-technical audiences.
• Evidence of sound judgment and decision-making in ambiguous situations; ability to prioritize amid rapidly changing specs.

Logistics

• Location: San Francisco, CA. Location-based hybrid policy: staff are expected to be in an office at least 25% of the time (some roles may require more).
• Minimum education: Bachelor’s degree or equivalent combination of education, training, and/or experience.
• Visa sponsorship: Anthropic states they do sponsor visas and retain an immigration lawyer, though not every role/candidate can be guaranteed sponsorship.
• The posting encourages applicants who may not meet every qualification to apply.

Compensation

• Annual Salary: $305,000 - $385,000 USD

Benefits

• Competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office space for collaboration.