Used Tools & Technologies
Machine Learning LLMRequired Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Communication @ 3
AI @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Anthropic is building reliable, interpretable, and steerable AI systems. The Beneficial Deployments team ensures AI reaches and benefits communities that need it most by partnering with nonprofits, governments, and mission-driven organizations to deploy Claude in education, global health, economic mobility, and life sciences.
This role owns the clinical AI research and evaluation agenda for Anthropic’s global health work. You will define and lead validation frameworks and clinical evaluations for LLMs in low- and middle-income country (LMIC) contexts, work closely with research, evals, and product teams to translate frontline clinical realities into evaluations, safeguards, and product improvements, and build/man-age research partnerships and engagements with regulatory and normative bodies.
Responsibilities
- Own the clinical research and evaluation agenda for global health — define what must be proven, to what standard, and with which partners, and drive execution.
- Design clinical evaluations and validation frameworks for large language models (LLMs) in LMIC contexts, covering accuracy, safety, multilingual performance, and real-world conditions.
- Develop theories of change and outcome metrics connecting model capability to care quality, health-worker performance, and patient outcomes.
- Build and manage global research partnerships; engage with relevant regulatory and normative bodies (WHO, national authorities, research-ethics bodies).
- Partner with internal research, evals, and product teams to improve Claude for clinical use cases in low-resource settings; ensure tools and evaluations reflect how care is delivered on the ground in LMICs.
- Contribute across the broader global health portfolio, help set strategy, and act as a thought partner across adjacent workstreams.
Requirements
Minimum qualifications
- Medical training and clinical practice (MD, GP, MBBS, DO, or equivalent) with direct experience delivering care in low-resource settings; ability to reason from real-world diagnosis, triage, treatment, and referral workflows in LMICs.
- Concrete, on-the-ground understanding of clinical and care-delivery workflows in LMICs and their implications for AI tool design and evaluation.
- Direct experience evaluating or validating clinical AI/ML tools; familiarity with gaps between benchmark performance and real-world clinical safety.
- Deep expertise in clinical research and evidence generation for digital health or AI tools; clear view of credible evidence for clinical safety and effectiveness.
- Strong command of the regulatory and normative landscape for clinical AI, including WHO processes, national regulatory authorities in LMICs, and research ethics.
- Track record of building research partnerships with academic and in-country researchers, treating local partners as scientific collaborators.
- High agency, team orientation, comfort with ambiguity, and willingness to work across lanes.
- Commitment to maximizing impact for underserved communities and willingness to travel regularly to research and partner sites (~25%).
Preferred qualifications
- Hands-on experience building or shaping AI/ML products or tooling (e.g., eval harnesses, agentic scaffolding, grounding and guardrails, clinical decision-support workflows).
- Publication record in digital health, clinical AI evaluation, or implementation science.
- Experience at a healthtech or AI company in clinical validation, clinical quality, or medical affairs.
- Experience working with philanthropic funders on evidence generation or research strategy.
- Direct clinical experience in a low- or middle-income country, including with humanitarian or global-health delivery organizations.
Compensation
- Annual salary range: $215,000 - $300,000 USD.
Logistics
- Minimum education: Bachelor’s degree or equivalent combination of education, training, and/or experience.
- Location-based hybrid policy: staff expected to be in one of Anthropic’s offices at least 25% of the time.
- Visa sponsorship: Anthropic states they sponsor visas and will make reasonable efforts to obtain a visa for successful candidates.
- Expected travel to research and partner sites: approximately 25%.
How we work
Anthropic values collaboration on large-scale research efforts, communication skills, and impact-focused research. The global health team is small and cross-functional; team members are expected to contribute outside narrow lanes and partner closely with research and product teams to ensure safe, effective deployments of Claude in clinical settings.