Safeguards Enforcement Analyst, Ban Evasion & Recidivism
📍 Washington, United States
📍 New York City, United States
📍 San Francisco, United States
Used Tools & Technologies
GenAIRequired Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
SQL @ 5
Data Science @ 3
Communication @ 6
Fraud @ 3
QA @ 3
Generative AI @ 3
AI @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The Safeguards Enforcement Analyst on the account abuse team will build and execute enforcement workflows focused on detecting and mitigating potential harm, with an initial emphasis on recidivism — detecting when banned actors return, linking accounts across identities, and closing re-registration paths. This role covers high-stakes populations including child-safety enforcement and may expand into broader enforcement areas over time.
Responsibilities
- Investigate evasion clusters end to end — from a single appeal or signal anomaly to the full linked actor network
- Convert individual findings into durable systemic controls and detection proposals
- Operationalize re-registration controls for high-severity ban populations
- Partner with Engineering and Data Science teams on account-linking signals to connect returning actors across identities
- Build the recidivism measurement framework: how often banned actors return, how fast we catch them, and which controls reduce return rates
- Author playbooks for contractor-supported evasion review with QA against your own gold standard
- Keep up to date with emerging AI policy enforcement best practices and use these to inform decision-making and workflows
Requirements
Minimum qualifications
- Experience investigating ban evasion, multi-accounting, or repeat fraud actors at a platform with adversarial users
- Fluency in SQL and comfort building analyses across large account and event datasets
- Experience working with fraud or identity-linking signals and a working understanding of their precision/recall tradeoffs
- Rigor about evidence standards and comfort with the asymmetric cost of false positives in severe-harm enforcement
- A track record of turning one-off investigations into repeatable detection logic and policy
- Strong written communication skills, with experience producing clear briefs and recommendations for technical and non-technical stakeholders
- Excellent judgment and the ability to collaborate with team members while navigating rapidly evolving priorities and workstreams
Preferred qualifications
- Experience using payment or network risk signals in an enforcement context
- Experience with child-safety or other high-severity integrity enforcement
- Experience collaborating directly with detection engineering or data science teams on rule deployment
- A deep interest in AI safety and responsible technology development
- Experience writing effective prompts for generative AI systems in a content review or enforcement context
Compensation
- Annual Salary: $245,000 - $285,000 USD
Logistics
- Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
- Location-based hybrid policy: currently expect all staff to be in one of our offices at least 25% of the time (some roles may require more time)
- Visa sponsorship: Anthropic states they do sponsor visas and retain an immigration lawyer to assist, though sponsorship is not guaranteed for every role/candidate
About Anthropic
Anthropic is a public benefit corporation headquartered in San Francisco focused on building safe, steerable AI systems. The company emphasizes collaborative research, communication skills, and large-scale empirical AI research. Benefits referenced include competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office spaces.