Technical Program Manager, External Evaluators

USD 290,000-365,000 per year
SENIOR
✅ Hybrid
✅ Visa Sponsorship

Tech Stack

AI @ 6 Scoping @ 4 Security

Details

Anthropic is hiring a Technical Program Manager to establish and deepen partnerships with independent external evaluators and embedded reviewers, supporting a rigorous frontier evaluation ecosystem for AI safety.

Responsibilities

  • Own the external evaluator program end to end, including evaluator relationships and the pipeline of future partners.
  • Manage each evaluator from initial conversation through scoping, contracting, onboarding, access, review, and publication of a final report.
  • Define stages and tiers for working with evaluators and develop information-access policies that address evaluator needs while protecting security and confidential information.
  • Drive evaluator access and information requests toward fast, well-documented decisions in partnership with Research, Security, Legal, and IT.
  • Design evaluator access with Security, IT, and infrastructure teams, including permissions, environments, and monitoring.
  • Close gaps between policy and technical controls without slowing evaluators down.
  • Run the review process for evaluator reports against agreed timelines and redaction criteria while protecting evaluators' ability to publish their conclusions.
  • Scope evaluations with researchers and engineers, translating questions about training, monitoring, and alignment into requirements for model access, data, tooling, and compute.
  • Plan capacity for each new evaluator and turn technical findings into research and engineering work with owners and dates.
  • Drive accountability for Anthropic's responses to evaluator findings.
  • Keep the company informed through regular program updates and guidance on working with evaluators.
  • Collect feedback, run retrospectives, and iterate on policies and practices.
  • Use Claude and work with engineering teams to build program tooling, including access provisioning, request tracking, and report review systems.
  • Support a broader ecosystem of evaluators by sharing lessons learned about conducting independent evaluations.

Requirements

  • Experience leading complex technical programs with engineering or research teams, from ambiguous goals through delivery.
  • Experience managing relationships with external organizations, including scoping work, navigating contracting, setting expectations, and resolving disagreements.
  • Strong program management skills, including program planning, milestone and dependency tracking, and risk management across multiple concurrent workstreams.
  • Technical fluency in how frontier AI models are trained, evaluated, and monitored, sufficient to define technical requirements, identify technical risks, and challenge tradeoffs with researchers and engineers.
  • Sound judgment and discretion when handling confidential and sensitive information.
  • A bachelor's degree or equivalent combination of education, training, and experience.
  • A relevant field of study demonstrated through coursework, training, or professional experience.

Compensation

Annual salary: $290,000–$365,000 USD.

Work Arrangement and Logistics

The role follows a location-based hybrid policy. Staff are expected to work from an Anthropic office at least 25% of the time. The position is available in San Francisco, California, or New York City, New York.

Anthropic explicitly states that it sponsors visas, although sponsorship cannot be successfully provided for every role and candidate. Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration spaces.

More jobs at Anthropic

Similar jobs