Research Engineer/Research Scientist, Pre-Training

at Anthropic

📍 New York City, United States
📍 San Francisco, United States
📍 Seattle, United States

USD 350,000-850,000 per year

MIDDLE

✅ Remote ✅ Hybrid

✅ Visa Sponsorship

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 3 Algorithms Communication @ 6 Deep Learning @ 3 ETL GPU Kubernetes LLM Machine Learning @ 2 PyTorch @ 3 Python @ 3 Reinforcement Learning

Details

Anthropic is seeking a Research Engineer or Research Scientist to join its Pre-training team and help develop the next generation of large language models, with a focus on safe, steerable, and trustworthy AI systems.

Responsibilities

Conduct research and implement solutions involving model architecture, algorithms, data processing, and optimizer development.
Independently lead small research projects and collaborate on larger initiatives.
Design, run, and analyze scientific experiments to advance understanding of large language models.
Optimize and scale training infrastructure for improved efficiency and reliability.
Develop and improve developer tooling to increase team productivity.
Contribute across the technology stack, from low-level optimizations to high-level model design.
Work on projects such as optimizing attention mechanisms, comparing Transformer variants, preparing large-scale datasets, scaling distributed training to thousands of GPUs, designing fault-tolerance strategies, and visualizing model internals.

Requirements

Advanced degree, such as an MS or PhD, in Computer Science, Machine Learning, or a related field.
Strong software engineering skills and experience building complex systems.
Expertise in Python and experience with deep learning frameworks, preferably PyTorch.
Familiarity with large-scale machine learning, particularly language models.
Ability to balance research objectives with practical engineering constraints.
Strong problem-solving, communication, collaboration, and results-oriented skills.
Commitment to considering the societal impacts of AI research.

Preferred Experience

High-performance, large-scale machine learning systems.
GPUs, Kubernetes, and operating-system internals.
Language modeling with Transformer architectures.
Reinforcement learning techniques.
Large-scale ETL processes.

Logistics and Work Policy

The role is remote-friendly but requires travel. Staff are currently expected to work from one of Anthropic's offices at least 25% of the time, and some roles may require more office time. The minimum education requirement is a bachelor's degree or an equivalent combination of education, training, and experience. Anthropic sponsors visas and makes reasonable efforts to assist with visa applications, supported by an immigration lawyer.

Benefits

Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office spaces for collaboration.