Software Engineer, Safeguards Foundations (Internal Tooling)

Details

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The Safeguards team builds systems that detect, review, and act on misuse of Anthropic's models. The Foundations team builds the platforms, infrastructure, and internal tools that the rest of the organisation depends on.

Role overview

This is a hands-on, full-stack role owning and extending the internal tooling that powers human review — case management, labelling, investigation, and enforcement interfaces used by analysts and policy specialists. The work impacts how quickly Anthropic can identify harmful behaviour, make enforcement decisions, and feed signal back into model training. You will work closely with Trust & Safety operations, policy, and detection-engineering teams to turn operational workflows into durable software.

Responsibilities

• Design, build, and maintain internal review and enforcement tooling used by Safeguards analysts (case queues, content review surfaces, decision/audit logging, account-actioning workflows).
• Understand user workflows and establish tooling for processes distributed across multiple tools and UIs.
• Develop reusable APIs, data storage, and backend services to enable new review workflows to be stood up quickly and safely.
• Partner with operations and policy teams to translate reviewer pain points into product improvements that reduce handling time and decision error.
• Integrate tooling with upstream detection systems and downstream enforcement infrastructure so flagged behaviour flows from signal → human review → action.
• Build guardrails for sensitive internal tools: granular permissions, audit trails, data-access controls, and reviewer-wellbeing features (e.g. content blurring, exposure limits).
• Instrument tools to surface metrics on queue health, reviewer throughput, and decision quality.
• Contribute to the Foundations team's shared platform and on-call responsibilities.

Requirements

• 4+ years of experience as a software engineer, with meaningful time spent building internal tools, operations platforms, or back-office products.
• Comfortable using agentic coding tools (e.g. Claude Code) as part of your workflow and able to direct them to ship well-tested, production-quality software.
• Product-minded approach to internal users: work with users, observe struggles, and iterate on fixes.
• Results-oriented with a bias toward flexibility and impact; willing to pick up slack beyond your job description.
• Strong communication skills to explain technical trade-offs to operations and policy partners.
• Care about societal impacts and want to apply engineering skills to AI safety.

Strong candidates may also have

• Built tooling in trust & safety, content moderation, fraud, integrity, or risk-operations settings.
• Experience designing case-management or workflow systems (queues, SLAs, escalation paths, audit logs).
• Experience with sensitive data, privacy, access-control, and reviewer-wellbeing considerations.
• Experience with GCP/AWS, Postgres/BigQuery, and CI/CD in production.
• Used LLMs as a building block inside operational tools (assisted triage, summarisation, classification in review loop).

Representative projects

• Rebuild analyst review queue to route cases by severity and skill with full decision history and one-click escalation.
• Ship a unified account-investigation view that pulls signals from multiple detection systems into a single, permissioned surface.
• Add content-obfuscation and exposure-tracking features to protect reviewers working with harmful material.
• Build an internal labelling tool that feeds high-quality ground truth back to detection and research teams.

Candidates need not have

• 100% of the skills listed above.
• Prior experience in AI or machine learning.
• Formal certifications or education credentials (equivalent experience is acceptable).

Logistics

• Location: London, UK. Location-based hybrid policy: staff are expected to be in one of our offices at least 25% of the time.
• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience.
• Visa sponsorship: Anthropic states they do sponsor visas and retain an immigration lawyer to help, though sponsorship may not be possible for every role/candidate.
• No application deadline; applications reviewed on a rolling basis.

Compensation

• Annual Salary: £255,000 - £325,000 GBP.

Benefits

Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office workspace for collaboration.

How we're different

Anthropic emphasises large-scale, collaborative research on steerable, trustworthy AI and values communication and impact over small, narrow tasks. The team is interdisciplinary and highly collaborative.