Researcher, Safety Oversight

Details

The Safety Oversight Research team advances capabilities for maintaining oversight over frontier AI models and ensuring deployed models are safe and beneficial. The work involves machine learning research in human-AI collaboration, reasoning, robustness, scalable oversight, and methods for identifying and mitigating AI misuse and misalignment.

Responsibilities

• Develop and refine AI monitor models to detect and mitigate known and emerging patterns of misuse and misalignment.
• Set research directions and strategies to make AI systems safer, more aligned, and more robust.
• Evaluate and design red-teaming pipelines to examine the end-to-end robustness of safety systems and identify areas for improvement.
• Conduct research to improve models' ability to reason about human values and apply these improvements to practical safety challenges.
• Coordinate and collaborate with cross-functional teams, including trust and safety, legal, policy, and research teams, to ensure products meet high safety standards.

Requirements

• Enthusiasm for AI safety and dedication to enhancing the safety of cutting-edge AI models for real-world use.
• 4+ years of experience in AI safety, particularly in areas such as reinforcement learning from human feedback (RLHF), human-AI collaboration, fairness, and bias.
• Ph.D. or another degree in computer science, machine learning, or a related field.
• Experience working with large-scale AI systems.
• 4+ years of research engineering experience.
• Proficiency in Python or similar programming languages.
• Alignment with OpenAI's mission of building safe, universally beneficial AGI.

Benefits

• Equity, performance-related bonuses for eligible employees, and comprehensive benefits.
• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax accounts for health and dependent care expenses, as well as commuter expenses.
• 401(k) retirement plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, company holidays, office closures, and paid sick or safe time.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Daily office meals and eligible meal delivery credits.
• Relocation support for eligible employees.
• Additional benefits may include charitable donation matching and wellness stipends.