Used Tools & Technologies
Machine Learning LLMRequired Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Communication @ 3
QA @ 3
AI @ 3
Reinforcement Learning @ 3
Data Pipelines @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The Domain Scaling team focuses on making Claude world-class at real-world knowledge work in domains such as finance, healthcare, and legal. This role combines applied research and hands-on data work: you will own end-to-end processes for creating RL environments, from identifying high-value tasks through reward design, data sourcing, vendor management, and measuring impact on model performance.
Responsibilities
- Own the data strategy for knowledge work verticals end-to-end, from task sourcing through RL training
- Manage technical relationships with external data vendors, including evaluation of data quality and reward design
- Collaborate with domain experts to design data pipelines and evaluations
- Explore novel ways of creating RL environments for high-value tasks
- Develop and improve QA frameworks to catch reward hacking and ensure environment quality
- Run generalization experiments to measure how data strategy changes improve model capabilities
- Partner with other RL research teams and product teams to translate capability goals into training environments and evaluations
Requirements
- Experience fine-tuning large language models for specific domains or real-world use cases
- Experience with reinforcement learning, reward design, or training data curation for LLMs
- Comfortable managing technical vendor relationships and iterating quickly on feedback
- Ability to read through datasets to understand them and spot issues
- Strong cross-functional collaboration skills
- Interest in a role combining applied research and hands-on data work
Strong candidates may also have:
- Experience training production ML systems
- Experience designing evaluations or benchmarks for LLMs
- Domain expertise in a vertical (e.g., finance, healthcare, legal)
- Experience working with external vendors or technical partners
Logistics
- Annual Salary: $350,000 - $850,000 USD
- Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
- Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
- Minimum years of experience: Correlates with internal job level requirements for the position
- Location-based hybrid policy: Staff are expected to be in one of the offices at least 25% of the time (some roles may require more)
- Visa sponsorship: Anthropic states they do sponsor visas and retain an immigration lawyer to assist, though sponsorship is not guaranteed for every role/candidate
Benefits
- Competitive compensation and benefits
- Optional equity donation matching
- Generous vacation and parental leave
- Flexible working hours
- Office space for collaboration
About Anthropic
Anthropic is a public benefit corporation headquartered in San Francisco focused on building steerable, trustworthy AI. The company emphasizes large-scale, collaborative research and values communication and impact. For candidates, Anthropic provides guidance on acceptable AI usage in the application process and warns about recruiting scams.