Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 3
Data Analysis @ 6
LLM
Machine Learning @ 3
Python @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic is seeking a research engineer to build safety and oversight mechanisms governing how AI models handle biological knowledge. The role sits at the intersection of applied machine learning and biosecurity and focuses on model evaluations, safety classifier development, adversarial testing, and deployment recommendations.
Responsibilities
- Design, build, and run capability evaluations to assess what frontier models can do in the biological domain and turn results into deployment recommendations.
- Develop training and evaluation datasets for safety classifiers in collaboration with internal and external threat-modeling experts.
- Train, tune, and iterate on safety classifiers with machine learning engineers, optimizing for adversarial robustness and low false-positive rates.
- Build tooling and pipelines that make evaluation and classifier development fast and repeatable.
- Analyze classifier and evaluation performance against production traffic, identify gaps, and prioritize improvements.
- Design and run red-teaming and stress-testing of safeguards as threats, models, and product surfaces evolve.
- Partner with Research, Product, and Policy teams to embed biological safety throughout the model development lifecycle.
- Contribute to external communications, including model cards, blog posts, and policy documents.
- Track developments in biology, machine learning, and biosecurity for potential risks and mitigations.
Requirements
- Strong proficiency in Python and extensive experience with scientific programming and data analysis.
- Excellent grasp of machine learning fundamentals and the ability to rapidly adopt machine learning development practices.
- Excellent knowledge of modern biology, including high-throughput assays, functional characterization, gene synthesis, genome editing, strain construction, and protein engineering.
- Ability to build and maintain personal tooling rather than relying on others to implement ideas.
- Experience designing quantitative experiments or evaluations and drawing defensible conclusions from noisy results.
- Strong analytical and writing skills, including the ability to explain technical concepts to non-technical stakeholders.
- Familiarity with dual-use research concerns and biosecurity frameworks such as select agent regulations, the Biological Weapons Convention, or Australia Group guidelines.
- Comfort with ambiguity and shifting priorities as AI capabilities change.
- Ability to work independently while collaborating effectively with cross-functional teams.
- Results-oriented approach, flexibility, and ability to work in a fast-paced research environment while balancing rigorous scientific standards with rapid iteration.
Preferred Qualifications
- Experience working with large language models, including prompting, fine-tuning, or evaluation.
- Experience training or deploying classifiers or other machine learning systems in production.
- Experience developing machine learning methods for biological systems or biological data.
- Familiarity with adversarial robustness, red-teaming, or machine learning safety evaluation.
- At least 8 years of hands-on experience in life sciences, with deep expertise in areas such as molecular biology, drug discovery, or computational biology.
- Experience leading complex technical projects across multiple stakeholder groups.
Education and Experience
- Minimum education: Bachelor's degree or an equivalent combination of education, training, and experience.
- Required field of study: A field relevant to the role, as demonstrated through coursework, training, or professional experience.
- Minimum years of experience will correlate with the internal job level requirements for the position.
Compensation
The annual salary range is $300,000–$405,000 USD.
Benefits and Logistics
- Hybrid policy: Staff are expected to work from one of Anthropic's offices at least 25% of the time, although some roles may require more office time.
- Anthropic sponsors visas and makes reasonable efforts to obtain visas for candidates who receive an offer, with assistance from an immigration lawyer.
- Anthropic offers competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office space for collaboration.
More jobs at Anthropic
Research Scientist, Takeoff Intel
Anthropic · San Francisco, United States
USD 350,000-850,000 per year
Technical Documentation and Content Engineer, Claude Docs
Anthropic · San Francisco, United States, New York City, United States
USD 270,000-320,000 per year
Staff Software Engineer, Code RL
Anthropic · San Francisco, United States, New York City, United States, Seattle, United States
USD 405,000-625,000 per year
IT Support Engineer, Executive Support
Anthropic · San Francisco, United States
USD 230,000-265,000 per year
Staff+ Software Engineer, Account Compromise
Anthropic · London, United Kingdom
GBP 325,000-390,000 per year
Similar jobs
Member of Technical Staff (Software Engineer, Applied AI)
Perplexity AI · Palo Alto, United States, San Francisco, United States, New York City, United States
USD 220,000-405,000 per year
Data Operations Manager, Human Data
Anthropic · San Francisco, United States, New York City, United States
USD 270,000-365,000 per year
Technical Cyber Threat Investigator
Anthropic · San Francisco, United States, Washington, United States
USD 230,000-290,000 per year
Technical CBRN-E Threat Investigator
Anthropic · Washington, United States, San Francisco, United States
USD 230,000-290,000 per year
Senior Software Engineer, Quantized Inference
Nvidia · Redmond, United States
USD 152,000-287,500 per year
Senior Data Engineer, Engineering Data Analytics
Nvidia · Santa Clara, United States
USD 168,000-270,200 per year
Senior Software Engineer, World Model Systems Engineering - Autonomous Vehicles
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Principal Software Engineer, E2E Performance and Goodput — CSP Engagements
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year