Safeguards Enforcement Analyst, Child Safety

Details

As a Safeguards Enforcement Analyst on the Child Safety team, you will manage and improve child safety enforcement workflows used to detect and respond to child sexual abuse material (CSAM) and child sexual exploitation material (CSEM) generated or facilitated through Anthropic's products.

This is a deeply operational role involving content review operations, workflow management, quality assurance, escalation processes, and collaboration with Engineering, Data Science, Policy, and Legal teams. The role regularly involves exposure to explicit sexual content involving minors and potentially violent or psychologically disturbing material. Anthropic provides wellness resources and support for team members working in this area.

Responsibilities

• Own day-to-day operational management of child safety content review workflows, including task routing, queue management, escalation handling, and SLA monitoring.
• Serve as the primary point of contact for review partners conducting child safety content review, including onboarding, training, quality assurance, and ongoing relationship management.
• Design and improve enforcement workflows to scale as volume grows while maintaining accuracy and consistency.
• Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for CSAM, CSEM, and related child safety policy violations.
• Review novel or ambiguous flagged content to drive enforcement decisions and identify policy gaps.
• Develop and maintain internal documentation, decision trees, and review guidelines for accurate and consistent enforcement at scale.
• Track emerging AI policy enforcement best practices, legal frameworks, and child safety technology developments.
• Identify and report trends in misuse patterns to Policy, Legal, and Trust & Safety leadership.
• Coordinate reporting obligations to relevant external bodies, such as NCMEC, in accordance with applicable law and Anthropic policy.

Requirements

• Experience in trust and safety, content moderation operations, or policy enforcement, with direct exposure to child safety, CSAM/CSEM, or related child protection harm areas.
• Experience managing or coordinating content review operations, including quality assurance and workflow management.
• Experience establishing and scaling policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools for monitoring workflow health, review queue metrics, and enforcement trends.
• Experience identifying emerging risks and communicating findings to cross-functional stakeholders, including Product, Policy, Engineering, and Legal teams.
• Understanding of implementing product policies at scale in the content moderation space.
• Bachelor's degree or an equivalent combination of education, training, and experience.

Preferred Qualifications

• Subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), or online child protection, including familiarity with CSAM/CSEM classification standards such as COPINE and the SAM scale.
• Experience working with or reporting to NCMEC, IWF, or equivalent child safety reporting bodies.
• Familiarity with relevant legal and regulatory frameworks, including CSAM reporting obligations, KOSA, and COPPA.
• Experience working with generative AI products and understanding how AI systems can be misused to generate or facilitate CSEA.
• Experience designing or evaluating trauma-informed support structures and wellness protocols for content reviewers working with harmful material.
• Proficiency in Python for workflow automation or data analysis.
• Experience with hash-matching technologies such as PhotoDNA and CSAI Match, or perceptual hashing tools used in CSAM detection.
• Familiarity with age assurance technologies and their role in child safety enforcement.
• Experience in a technology-company trust and safety role, with an understanding of how platform policy intersects with child protection obligations.

Compensation

• Annual salary: $245,000–$285,000 USD.

Benefits

Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office space for collaboration. Anthropic sponsors visas where possible and makes reasonable efforts to support visa applications with immigration counsel.