Researcher, Training

Details

OpenAI's Training team produces the large language models that power its research and products. The team combines research into model architectures, datasets, and optimization techniques with long-term work to improve the efficiency and capability of future model generations. It also integrates these techniques into model artifacts used across the company, including GPT-4-Turbo, GPT-4o, and o1-mini.

As a member of the architecture team, you will advance architecture development for OpenAI's flagship models by improving intelligence, efficiency, and capabilities. Ideal candidates have a deep understanding of large language model architectures, sophisticated knowledge of model inference, and a hands-on empirical approach.

Responsibilities

• Design, prototype, and scale new architectures to improve model intelligence.
• Execute and analyze experiments autonomously and collaboratively.
• Study, debug, and optimize model and computational performance.
• Contribute to training and inference infrastructure.
• Evaluate and improve deep learning architectures.
• Support the safe deployment of large language models in the real world.

Requirements

• Experience contributing to major LLM training runs.
• Ability to thoroughly evaluate and improve deep learning architectures in a self-directed manner.
• Strong understanding of LLM architectures and model inference.
• Knowledge of state-of-the-art transformer modifications for efficiency.
• Interest in safely deploying LLMs in real-world applications.

Benefits

• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax Flexible Spending Accounts and commuter benefits.
• 401(k) retirement plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, company holidays, and office closures.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Daily office meals and eligible meal delivery credits.
• Relocation support for eligible employees.
• Equity, performance-related bonuses for eligible employees, and additional taxable fringe benefits.

The role is based in San Francisco and follows a hybrid work model requiring three days in the office per week. OpenAI is an equal opportunity employer and provides reasonable accommodations to applicants with disabilities. Background checks are administered in accordance with applicable law.