Researcher, Synthetic RL

Details

The Synthetic RL team develops reinforcement learning methods that leverage synthetic data, environments, and feedback to train and evaluate frontier AI models. The team explores self-play, simulators, and other synthetic evaluations to improve model capability, generalization, and alignment beyond prevailing methodologies.

As a Research Scientist on the Synthetic RL team, you will develop novel reinforcement learning techniques using synthetic environments and feedback to improve large-scale models. You will work with researchers to design experiments, analyze learning dynamics, and translate research insights into training approaches used in production systems. This role is suited to researchers who enjoy open-ended problems, fast iteration, and having their work directly influence how frontier models are trained.

The role is based in San Francisco, California, with a hybrid work model requiring three days in the office per week.

Responsibilities

• Research and develop reinforcement learning algorithms.
• Design and run experiments to study training dynamics and model behavior at scale.
• Collaborate with engineers and researchers to integrate successful approaches into model training pipelines.

Requirements

• Strong background in reinforcement learning, machine learning research, or related fields.
• Strong engineering and statistical analysis skills.
• Interest in exploring problem spaces where data, objectives, and evaluation are imperfect or evolving.
• Motivation to see research ideas influence real-world AI systems.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. The company develops and deploys AI systems with safety and human needs at the core.

Benefits

• Base salary range of $295,000–$445,000 per year, plus equity.
• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax accounts for health and dependent care expenses, as well as commuter expenses.
• 401(k) retirement plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, company holidays, office closures, and paid sick or safe time as required by law.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Daily office meals and eligible meal delivery credits.
• Relocation support for eligible employees.
• Additional benefits may include charitable donation matching and wellness stipends.