Safeguards Enforcement Analyst, Bio Harms
📍 Washington, United States
📍 New York City, United States
📍 San Francisco, United States
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 3
Communication @ 3
Data Analysis @ 5
Data Science
GenAI
Generative AI @ 3
SQL @ 5
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
This role protects against the misuse of AI systems for biological and related CBRNE harms. The analyst will enforce Usage Policy, detect and mitigate bio risks, investigate potential violations, and continuously strengthen safeguards. The work combines biosecurity threat analysis with platform enforcement, including reviewing model interactions and determining whether activity is benign research or a credible attempt at harm.
The role involves exposure to explicit, violent, sexual, or psychologically disturbing content and includes shared on-call responsibilities across the Policy and Enforcement teams.
Responsibilities
- Enforce Usage Policies with a focus on detecting and mitigating potential biological risks and harmful uses of AI systems.
- Own and improve enforcement monitoring workflows for the bio-harms area, including detection, investigation, triage, and escalation.
- Monitor and analyze platform activity to identify emerging biological, chemical, radiological, nuclear, and explosive threats.
- Design and architect automated enforcement systems and review workflows that scale while maintaining high accuracy.
- Investigate potential violations and gather and document evidence supporting enforcement decisions.
- Identify trends and propose improvements to detection methods and review workflows.
- Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems.
- Work with Policy and Threat Intelligence teams to understand potential exploits and contribute to risk-assessment frameworks.
- Provide enforcement-grounded feedback on policy gaps and handle escalations and time-sensitive situations involving potential bio-related Usage Policy violations.
Requirements
- Degree in a bio-related field such as microbiology, molecular biology, biochemistry, or public health, or relevant professional experience.
- Experience in Trust & Safety, content moderation, or policy enforcement at platform scale.
- Experience working with generative AI tools to refine and optimize content review and enforcement workflows.
- Experience using AI tools to develop data dashboards for metrics collection and continuous improvement.
- Ability to analyze complex and ambiguous situations and make well-reasoned, defensible decisions under time pressure.
- Proactive and self-directed approach, including identifying trends and independently delivering improvements.
- Clear written communication skills and the ability to explain technical biological concepts to technical and non-technical stakeholders.
Preferred Qualifications
- Subject matter expertise in biodefense, biosecurity, WMD/CBRNE non-proliferation, or threat intelligence.
- Understanding of biological risk, adversary intent, acquisition and weaponization pathways, dual-use concerns, cross-platform threat analysis, and relevant OSINT techniques.
- Proficiency in SQL and/or other data analysis tools for analyzing large datasets and monitoring enforcement workflow health.
- Familiarity with dual-use research of concern, select agents, and relevant policy frameworks.
Benefits
Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office spaces for collaboration. Anthropic also retains an immigration lawyer to assist with visa sponsorship where possible.