Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 6
Claude Code @ 3
Product Management @ 3
Prompt Engineering @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
As a Product Manager on Claude Code's model performance team, you will drive model launches end-to-end, build evaluations that measure what matters, and partner directly with researchers and product engineers to translate model improvements into developer-facing outcomes.
Claude Code is a coding agent, and the team is focused on extracting maximum performance from its models. The role requires experience building agentic evaluations, systems thinking, daily use of Claude Code, and the ability to analyze model behavior and transcripts. You will connect frontier research with the developers who depend on Claude Code.
Responsibilities
- Own model launch planning and execution for Claude Code, including defining readiness criteria, coordinating across research and product engineering, and ensuring launches land cleanly with developers.
- Design and implement agentic evaluations that measure real-world coding performance.
- Drive the engineering team's evaluation roadmap.
- Partner with researchers working on coding capabilities to define target behaviors and influence model development using evidence from real usage.
- Talk with users and analyze transcripts to understand capability gaps and turn research progress into shipped improvements.
- Synthesize signals from internal users, external developers, and competitive benchmarks into clear priorities.
Requirements
- Personally built agentic evaluations, such as SWE-bench-style task suites.
- Daily user of Claude Code who can articulate model behaviors to change or add.
- An engineering background and at least 2 years of product management experience, or equivalent experience driving product direction as an engineer.
- Deep understanding of AI concepts, with the ability to work deeply on model behavior, prompt engineering, and evaluation methodology.
- Systems-thinking approach to solving problems and building infrastructure that prevents entire classes of issues.
- Experience launching products or capabilities in ambiguous, research-adjacent environments.
- Creative, hacker spirit and enthusiasm for solving puzzles.
- Bachelor's degree or an equivalent combination of education, training, and/or experience. The field of study must be relevant to the role as demonstrated through coursework, training, or professional experience.
Work Location and Policy
The role is available in San Francisco or Seattle. Staff are currently expected to work from one of Anthropic's offices at least 25% of the time, although some roles may require more office time.
Benefits
Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and an office space for collaboration.
Anthropic sponsors visas, although sponsorship may not be available for every role or candidate. If an offer is made, the company states that it will make every reasonable effort to obtain a visa and provides support from an immigration lawyer.