Data Infrastructure Engineer, Pre-Training

Details

Anthropic is seeking a Staff-level Engineer to join its Pre-training team and help develop the next generation of large language models. The role combines cutting-edge AI research with practical engineering to build safe, steerable, and trustworthy AI systems.

Responsibilities

• Design and implement highly performant, reproducible, and traceable data-processing infrastructure for large language model training.
• Develop and maintain scalable processing primitives, including tokenization, deduplication, and chunking.
• Build robust systems for data quality assurance and validation at scale.
• Collaborate with research teams to implement novel data-processing architectures.
• Build and operate end-to-end data pipelines that transform raw web-scale corpora into training-ready datasets.
• Design distributed computing architectures for web-scale data processing.
• Build scalable infrastructure for model-training data preparation.
• Develop fault-tolerant distributed processing systems.
• Implement infrastructure components based on research requirements.

Requirements

• At least 5 years of professional experience outside of internships.
• Strong software engineering skills and experience building high-throughput, fault-tolerant distributed systems.
• Hands-on experience with distributed computing frameworks, particularly Apache Spark.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills and the ability to work collaboratively.
• A bachelor's degree or equivalent combination of education, training, and experience. An advanced degree in Computer Science or a related field is also noted as relevant experience.
• Experience with language model training infrastructure.
• Background in data infrastructure, MLOps, or machine learning infrastructure.
• Expertise with Python and Rust is valued.
• Passion for system reliability and performance.
• Ability to work with ambiguous requirements and evolving specifications, take ownership of problems, and drive solutions independently.
• Interest in machine learning research infrastructure and the development of safe and ethical AI systems.

Benefits

Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and an office environment for collaboration. Anthropic sponsors visas where possible and makes reasonable efforts to assist with visa applications, including access to an immigration lawyer.

The role follows a location-based hybrid policy, with staff expected to work from an Anthropic office at least 25% of the time. Some roles may require more time in the office.