Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 6
Scoping @ 4
Security
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic is hiring a Technical Program Manager to establish and deepen partnerships with independent external evaluators and embedded reviewers, supporting a rigorous frontier evaluation ecosystem for AI safety.
Responsibilities
- Own the external evaluator program end to end, including evaluator relationships and the pipeline of future partners.
- Manage each evaluator from initial conversation through scoping, contracting, onboarding, access, review, and publication of a final report.
- Define stages and tiers for working with evaluators and develop information-access policies that address evaluator needs while protecting security and confidential information.
- Drive evaluator access and information requests toward fast, well-documented decisions in partnership with Research, Security, Legal, and IT.
- Design evaluator access with Security, IT, and infrastructure teams, including permissions, environments, and monitoring.
- Close gaps between policy and technical controls without slowing evaluators down.
- Run the review process for evaluator reports against agreed timelines and redaction criteria while protecting evaluators' ability to publish their conclusions.
- Scope evaluations with researchers and engineers, translating questions about training, monitoring, and alignment into requirements for model access, data, tooling, and compute.
- Plan capacity for each new evaluator and turn technical findings into research and engineering work with owners and dates.
- Drive accountability for Anthropic's responses to evaluator findings.
- Keep the company informed through regular program updates and guidance on working with evaluators.
- Collect feedback, run retrospectives, and iterate on policies and practices.
- Use Claude and work with engineering teams to build program tooling, including access provisioning, request tracking, and report review systems.
- Support a broader ecosystem of evaluators by sharing lessons learned about conducting independent evaluations.
Requirements
- Experience leading complex technical programs with engineering or research teams, from ambiguous goals through delivery.
- Experience managing relationships with external organizations, including scoping work, navigating contracting, setting expectations, and resolving disagreements.
- Strong program management skills, including program planning, milestone and dependency tracking, and risk management across multiple concurrent workstreams.
- Technical fluency in how frontier AI models are trained, evaluated, and monitored, sufficient to define technical requirements, identify technical risks, and challenge tradeoffs with researchers and engineers.
- Sound judgment and discretion when handling confidential and sensitive information.
- A bachelor's degree or equivalent combination of education, training, and experience.
- A relevant field of study demonstrated through coursework, training, or professional experience.
Compensation
Annual salary: $290,000–$365,000 USD.
Work Arrangement and Logistics
The role follows a location-based hybrid policy. Staff are expected to work from an Anthropic office at least 25% of the time. The position is available in San Francisco, California, or New York City, New York.
Anthropic explicitly states that it sponsors visas, although sponsorship cannot be successfully provided for every role and candidate. Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration spaces.