Data Operations Manager, Knowledge

Details

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The team consists of researchers, engineers, policy experts, and business leaders focused on building beneficial AI systems.

Responsibilities

Strategic Leadership & Vision

• Lead data strategies for Claude Skills, Safety evaluations, and frontier capability assessment impacting model performance and safety.
• Drive initiatives affecting data quality, operational efficiency, and research velocity.
• Collaborate with research leaders to translate technical requirements into scalable operational frameworks.

Technical Infrastructure & Innovation

• Design and build novel data collection systems and evaluation frameworks for AI capability and safety measurements.
• Architect scalable, automated infrastructure to collect, process, and manage human feedback data.
• Develop tooling and platforms supporting complex human-AI interaction scenarios.

Cross-functional Partnership & Project Management

• Partner with researchers, engineers, and product teams to scope projects, resolve blockers, and integrate with training pipelines.
• Manage multiple high-stakes projects, balancing complexity and timelines.
• Create analytics and measurement frameworks for data-driven decision making.

Operational Excellence & Scaling

• Build/manage relationships with contractors and vendors for technical data collection.
• Implement robust quality control and verification processes for data usability.
• Establish processes for rapid iteration while maintaining high safety and quality standards.

Requirements

• 5+ years in technical operations, product management, or similar, with experience building complex systems from scratch.
• Entrepreneurial experience as a technical founder, early-stage startup operator, or in 0-to-1 leadership roles.
• Strong technical intuition about high-quality training data and experience with AI systems, large language models, or evaluation frameworks.
• Exceptional project management skills and ability to coordinate complex initiatives across teams.
• Comfortable with ambiguity, defining goals and execution independently.
• Strong product mindset and user needs understanding.
• Passionate about AI safety and data quality in building beneficial AI.

Preferred Qualifications

• Experience with AI agents, evaluation systems, or advanced AI safety methodologies.
• Background in evaluation systems or human-in-the-loop workflows for large language models.
• Knowledge of AI safety evaluation methods such as red teaming and constitutional AI.
• Experience in human-computer interaction, UX, or optimizing human-AI collaboration.
• Experience in high-growth startups in technical and operational roles.
• Collaboration with AI researchers and research organizations.
• Technical expertise in data pipelines, evaluation frameworks, or machine learning infrastructure.

Benefits

• Competitive compensation and benefits, equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours and collaborative office space.

Location Policy

Role based in San Francisco office with potential for exceptional remote candidates case-by-case.

Logistics

• Education: Bachelor's degree or equivalent experience required.
• Hybrid policy: expected office presence approximately 25% of the time.
• Visa sponsorship available with immigration support.
• Encouragement for diverse candidates to apply.

Impact

Work on data infrastructure enabling advances in AI capability, safety, and alignment, directly influencing frontier AI research.