Research Engineer / Research Scientist, Tokens

Details

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

You will build large-scale ML systems from the ground up and care about making safe, steerable, trustworthy systems. As a Research Engineer, you'll touch all parts of our code and infrastructure, whether that's making the cluster more reliable for big jobs, improving throughput and efficiency, running and designing scientific experiments, or improving dev tooling. You should be excited to write code when you understand the research context and why it's important.

Responsibilities

• Build and operate large-scale, high-performance machine learning systems and experiments.
• Improve cluster reliability, throughput, and efficiency for large training jobs.
• Run and design scientific experiments and improve developer tooling.
• Collaborate closely with researchers and engineers; participate in pair programming and writing design docs (for example, fault tolerance strategies).
• Work on representative projects such as optimizing attention mechanisms, comparing Transformer variants for compute efficiency, creating consumable datasets from Wikipedia, scaling distributed training to thousands of GPUs, and creating visualizations of attention between tokens.

Requirements

• At least a Bachelor's degree in a related field or equivalent experience.
• Significant software engineering experience.
• Results-oriented with a bias toward flexibility and impact.
• Comfort with pairing and collaboration; willingness to take work beyond a narrow job description.
• Interest in and desire to learn more about machine learning research and the societal impacts of AI.

Strong candidates may also have experience with:

• High-performance, large-scale ML systems
• GPUs
• Kubernetes
• PyTorch
• Operating system internals
• Language modeling with transformers
• Reinforcement learning
• Large-scale ETL

Compensation

Annual Salary: $340,000 - $425,000 USD

Total compensation for full-time employees includes equity, benefits, and may include incentive compensation.

Logistics & Other Details

• Education requirements: At least a Bachelor's degree in a related field or equivalent experience.
• Location-based hybrid policy: Currently, staff are expected to be in one of our offices at least 25% of the time (some roles may require more time in office).
• Visa sponsorship: Anthropic does sponsor visas in many cases and retains an immigration lawyer to assist, though they cannot guarantee sponsorship for every role or candidate.
• This is an evergreen role kept open on an ongoing basis; team-specific postings may be listed separately and may be given preference.
• Anthropic encourages applicants from diverse backgrounds and urges candidates to apply even if they do not meet every listed qualification.

How We're Different

• Anthropic focuses on large-scale, high-impact AI research as a single cohesive team, emphasizing collaboration, communication, and empirical scientific approaches. Recent research directions include work related to GPT-3, circuit-based interpretability, multimodal neurons, scaling laws, AI & compute, concrete problems in AI safety, and learning from human preferences.

Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours and office spaces for collaboration

Application Notes

• Candidates are encouraged to review Anthropic's candidate AI guidance policy for using AI in the application process.
• The application form collects standard contact, resume/CV or LinkedIn, availability, visa sponsorship information, and voluntary self-identification surveys for reporting purposes.