Safeguards Enforcement Analyst, Age-Appropriate Design
📍 Washington, United States
📍 New York City, United States
📍 San Francisco, United States
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 3
Communication @ 6
Data Science
GenAI
Generative AI @ 3
SQL @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic is seeking a Safeguards Enforcement Analyst to join the user well-being team and build and execute enforcement workflows that keep its products safe. The initial focus is age assurance, including detection signals, verification paths, appeals workflows, and guidance for third-party developers deploying Claude appropriately for younger users. The role may expand into broader user well-being enforcement.
This position may involve exposure to explicit content, including sexual, violent, or psychologically disturbing material. It also includes an on-call responsibility across the Policy and Enforcement teams.
Responsibilities
- Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy.
- Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems.
- Review flagged content to drive enforcement and policy improvements.
- Enforce usage policies by detecting and mitigating potentially harmful uses of AI systems.
- Work with Legal, Public Policy, and Privacy stakeholders to maintain a proportionate, privacy-preserving age assurance approach that responds to evolving regulations.
- Support safeguards policy design by providing detailed feedback on policy gaps based on real enforcement scenarios.
- Track emerging AI policy enforcement best practices and apply them to decision-making and workflows.
- Own Anthropic's layered age assurance approach, including self-declaration, behavioral signals, verification, and ban appeals, for first-party consumer products.
- Support adjacent user well-being enforcement areas where age is relevant, including sexual content and illicit substances.
Requirements
- Experience in trust and safety, online child safety, age assurance, privacy, product policy, or a related field.
- Subject matter expertise in age assurance or age verification systems, age-appropriate design, child online safety, privacy-preserving verification methods, or content classification for young people.
- Experience leading cross-functional initiatives with Product, Engineering, Legal, and Policy partners while navigating safety, privacy, and usability tradeoffs.
- Experience with evolving regulatory landscapes and enforcement best practices concerning age assurance, including the UK AADC, COPPA, and the DSA, as well as CSAM/CSEM, NCII, and digital well-being.
- A thoughtful perspective on privacy and safety tradeoffs in age verification, including when less invasive approaches are appropriate.
- Strong written communication skills and experience producing clear briefs and recommendations for technical and non-technical stakeholders.
- Comfort using data, including SQL or similar tools, to measure effectiveness and inform decisions.
- Excellent judgment and ability to collaborate while navigating rapidly evolving priorities and workstreams.
- Bachelor's degree or an equivalent combination of education, training, and experience. The field of study must be relevant to the role through coursework, training, or professional experience.
Preferred Qualifications
- Experience building or operating age-gating flows, age-estimation signals, underage account detection, or appeals workflows.
- Experience advising or partnering with third-party platforms on safe deployment to younger users.
- Experience working with or evaluating third-party age-verification providers.
- Deep interest in AI safety and responsible technology development.
- Experience writing effective prompts for generative AI systems in a content review or enforcement context.
Benefits
Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office space for collaboration. Staff are currently expected to work from one of Anthropic's offices at least 25% of the time, although some roles may require more office time. Anthropic sponsors visas and states that it will make reasonable efforts to obtain a visa for candidates who receive an offer, with assistance from an immigration lawyer.