Researcher, Synthetic RL

Details

The Synthetic RL team develops reinforcement learning methods that leverage synthetic data, environments, and feedback to train and evaluate frontier AI models. The team explores approaches such as self-play, simulators, and other synthetic evaluations to push model capability, generalization, and alignment beyond what is possible with the current prevailing methodology.

About the Role

As a Research Scientist on the Synthetic RL team, you will develop novel reinforcement learning techniques that use synthetic environments and feedback to improve large-scale models. You will work closely with other researchers to design experiments, analyze learning dynamics, and translate research insights into training approaches used in production systems.

This role is based in San Francisco, CA. The team uses a hybrid work model of 3 days in the office per week and the company offers relocation assistance to new employees.

Responsibilities

• Research and develop reinforcement learning algorithms
• Design and run experiments to study training dynamics and model behavior at scale
• Collaborate with engineers and researchers to integrate successful approaches into model training pipelines

Requirements / You might thrive in this role if you:

• Have a strong background in reinforcement learning, machine learning research, or related fields
• Have strong engineering and statistical analysis skills
• Enjoy exploring new problem spaces where data, objectives, and evaluation are imperfect or evolving
• Are motivated by seeing research ideas influence real-world AI systems

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. The company seeks to safely deploy AI systems and values diverse perspectives and experiences. OpenAI is an equal opportunity employer and provides reasonable accommodations to applicants with disabilities. Background checks will be administered in accordance with applicable law.

Compensation & Benefits

• Base salary range: $310,000 - $460,000 (offers equity)
• In addition to base pay, total compensation may include equity, performance-related bonuses (for eligible employees), and other benefits
• Medical, dental, and vision insurance with employer contributions to Health Savings Accounts
• Pre-tax accounts (Health FSA, Dependent Care FSA, commuter expenses)
• 401(k) retirement plan with employer match
• Paid parental leave and medical/caregiver leave
• Paid time off (flexible PTO for exempt employees; up to 15 days annually for non-exempt employees)
• 13+ paid company holidays and additional company office closures
• Mental health and wellness support
• Employer-paid basic life and disability coverage
• Annual learning and development stipend
• Daily meals in offices and meal delivery credits as eligible
• Relocation support for eligible employees
• Additional taxable fringe benefits (charitable donation matching, wellness stipends, etc.)

Additional Notes

• The base pay offered may vary depending on market location, job-related knowledge, skills, and experience.
• More details about benefits and compensation are available to candidates during the hiring process.