Staff+ Software Engineer, Safeguards Review Tooling

Details

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The Safeguards team ensures models and products are developed and deployed safely. The Review Tooling team builds systems that humans — and increasingly Claude — use to investigate potential harms and take enforcement actions across Anthropic's first-party products and third-party cloud platforms.

As one of the first engineers on this new team, you'll own the tools safety investigators rely on to understand platform activity and take actions, plus the platform underneath those tools. The platform includes analytics capabilities, privacy-preserving primitives that keep review workflows compatible with data retention commitments, and a sandbox environment for building and iterating review interfaces and workflows. You will also drive scaling review through automation and integrating Claude to extend reviewer capabilities while keeping humans in the loop where judgment matters.

Responsibilities

• Build investigation, review, and enforcement tooling across first-party and third-party surfaces, including case queues, investigation views, decision and audit logging, and account-actioning workflows
• Develop the platform layer of reusable APIs, data storage, and backend services to enable new review workflows to be stood up quickly and safely
• Scale review through automation, enabling reviewers to use Claude and building toward Claude-assisted and Claude-driven review workflows
• Partner with policy, operations, legal, privacy, and data science stakeholders to translate enforcement and investigation needs into reliable systems that reduce handling time and decision error
• Implement guardrails required by sensitive internal tools: granular permissions, audit trails, data-access controls, and reviewer wellbeing features such as content obfuscation and exposure limits
• Instrument shipped tools to surface metrics on queue health, reviewer throughput, and decision quality, and ensure tooling evolves alongside new privacy primitives and data retention commitments

Minimum qualifications

• Technical background in full-stack or platform engineering, able to engage deeply in architecture and design discussions
• Experience shipping internal tools or platforms with demanding operational users and a track record of improving workflows measurably
• Experience working cross-functionally with non-engineering partners such as operations, policy, or legal teams
• Excellent communication skills, including explaining technical tradeoffs to non-technical stakeholders
• Care about the societal impacts of AI and desire to make powerful systems safer

Preferred qualifications

• 8+ years of industry software engineering experience
• Experience building trust and safety, integrity, fraud, or abuse-prevention tooling, or other systems supporting human review at scale
• Experience designing systems under strict privacy, compliance, or data governance constraints (e.g., zero data retention environments)
• Experience integrating LLMs or agentic systems into operational workflows, or building human-in-the-loop automation — including using agentic coding tools (e.g., Claude Code) in your development workflow
• Experience building developer platforms or extensible tooling frameworks consumed by other teams
• Experience supporting enforcement or moderation systems across multiple product surfaces, including enterprise or cloud platform contexts
• A product-minded approach to internal users: working directly with the people using your tools, observing struggles, and iterating to fix them

Compensation

• Annual Salary: $320 - $485,000 USD

Logistics

• Minimum education: Bachelor’s degree or equivalent combination of education, training, and/or experience
• Minimum years of experience: Correlates with internal job level requirements for the position
• Location-based hybrid policy: staff are expected to be in an office at least 25% of the time; some roles may require more time in offices
• Visa sponsorship: Anthropic states they do sponsor visas and retain an immigration lawyer to help, though sponsorship may not be possible for every role/candidate

Benefits

• Competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a collaborative office space in San Francisco

About Anthropic

Anthropic is a public benefit corporation headquartered in San Francisco focused on steerable, trustworthy AI. The organization emphasizes collaborative, large-scale research and values strong communication skills among researchers and engineers.