Data Operations Manager - Computer Use & Tool Use

Details

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

This role will build and scale data operations that advance Claude's computer use capabilities and tool use safety. You will partner with research teams to design and execute data strategies, manage vendor relationships, and own the entire data pipeline from requirements to production. This is a zero-to-one role requiring technical depth to understand what makes high-quality training data for autonomous agents, with a focus on strategy and execution rather than hands-on engineering.

Responsibilities

• Develop and execute data strategies for computer use, tool use safety, and agentic AI research
• Partner with research leaders to translate technical requirements into operational frameworks
• Build data collection and evaluation systems for complex scenarios such as prompt injection robustness, multi-turn agent conversations, adversarial attacks, and autonomous workflows
• Scale the generation of realistic evaluation environments that capture real-world tool use and computer use challenges
• Identify, evaluate, and manage specialized contractors and vendors for technical data collection
• Implement quality control processes to ensure data meets training requirements for both capabilities and safety
• Manage multiple complex projects simultaneously, balancing research velocity with rigorous evaluation standards
• Track metrics and communicate progress to stakeholders

Requirements

• 3+ years in technical operations, product management, or entrepreneurial experience building from zero to scale
• Strong technical foundations — proficiency in Python and understanding of ML workflows, RL environments, and evaluation frameworks
• Strong communication skills; able to engage with both technical and non-technical stakeholders
• Familiarity with how LLMs work and ability to describe concepts like RLHF, tool use, and agentic workflows
• Understanding of the unique challenges of evaluating autonomous systems and long-horizon agent behaviors
• Highly organized and able to manage multiple parallel workstreams effectively
• Comfortable navigating ambiguity and balancing strategic priorities with rapid execution
• Passion for AI safety and appreciation for the importance of high-quality data in building safe, capable agentic systems

Strong candidates may also have

• Experience at companies training AI models, building AI agents, or creating AI training data, evaluations, or environments
• Knowledge of computer and tool use safety challenges like prompt injection, data exfiltration attempts, or adversarial attacks
• Experience with RLHF, reinforcement learning techniques, or similar human-in-the-loop training methods
• Domain expertise in computer use automation, security, or AI safety evaluation
• Familiarity with model performance monitoring, training observability, or quality assessment systems
• Track record of building and scaling operations teams

Compensation & Logistics

• Annual base salary: $250,000 - $365,000 USD
• Education requirements: At least a Bachelor's degree in a related field or equivalent experience
• Location-based hybrid policy: staff are expected to be in one of our offices at least 25% of the time (some roles may require more time in-office)
• Visa sponsorship: Anthropic does sponsor visas and retains an immigration lawyer, though sponsorship may not be possible for every role/candidate

About Anthropic & Benefits

Anthropic is a public benefit corporation headquartered in San Francisco. They offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office space for collaboration. Candidates are encouraged to apply even if they do not meet every qualification listed.