Safeguards Enforcement Analyst, Account Takeover & Credential Abuse
📍 Washington, United States
📍 New York City, United States
📍 San Francisco, United States
Used Tools & Technologies
GenAIRequired Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Security @ 3
SQL @ 3
Data Science @ 3
Communication @ 6
API @ 3
Fraud @ 3
Generative AI @ 3
AI @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. This Safeguards Enforcement Analyst role on the account abuse team focuses on building and operating enforcement workflows to detect and mitigate account compromise and credential abuse. The role owns detection, revocation, user notification, remediation, and criteria for restoring access, and will partner with Engineering and Data Science to improve separation of compromised-customer traffic from willful abuse. The position may expand into broader enforcement areas over time and contributes to policy enforcement to keep Anthropic's products safe.
Responsibilities
- Investigate credential-compromise incidents across first-party and third-party platforms, tracing actor behavior across accounts and surfaces
- Design and operate remediation workflows for compromised accounts: revocation, customer notification, and standards for restoring access
- Partner with Engineering and Data Science teams to improve how compromised-customer traffic is distinguished from willful abuse
- Enforce usage policies with a focus on detecting and mitigating potentially harmful use of AI systems
- Work with threat intelligence on emerging credential-abuse patterns and the actors behind them
- Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios
- Keep up to date with emerging AI policy enforcement best practices and use these to inform decision-making and workflows
- Write the policy framework for compromise scenarios, including cases where Anthropic cannot independently verify a customer's security posture
- Act as the enforcement subject-matter expert when account compromise intersects with active abuse investigations
Requirements
- Experience in trust and safety, fraud investigation, security operations, or a related field
- Subject matter expertise in one or more of: account takeover, credential abuse, session security, or incident response
- Experience designing or operating enforcement, remediation, or customer-recovery flows (not just detection)
- Comfort using data (SQL or similar tools) to trace actor behavior across accounts and to measure what's working
- A thoughtful perspective on the tension between protecting the platform and restoring access for legitimate compromised customers
- Strong written communication skills, with experience producing clear briefs about messy incidents for technical and non-technical stakeholders
- Excellent judgment and the ability to collaborate with team members while navigating rapidly evolving priorities and workstreams
Preferred Qualifications
- Familiarity with credential-theft ecosystems or threat intelligence tooling
- Experience working with fraud/risk vendors (e.g., device or network intelligence platforms)
- Experience with API platform abuse specifically, not just consumer-account ATO
- A deep interest in AI safety and responsible technology development
- Experience writing effective prompts for generative AI systems in a content review or enforcement context
Compensation
Annual Salary: $245,000 - $285,000 USD
Logistics
- Minimum education: Bachelor’s degree or equivalent combination of education, training, and/or experience
- Minimum years of experience: will correlate with internal job level requirements
- Location-based hybrid policy: currently expect all staff to be in one of our offices at least 25% of the time (some roles may require more)
- Visa sponsorship: Anthropic states they do sponsor visas and retain an immigration lawyer to assist, though sponsorship is not guaranteed for every role/candidate
About Anthropic
Anthropic is a public benefit corporation headquartered in San Francisco focused on building steerable, trustworthy AI. The team includes researchers, engineers, policy experts, and business leaders working together on high-impact research directions and safety-focused products.