Engineering Manager, Model Flywheel

Details

The ChatGPT Model Flywheel team transforms model advancements into user experiences through reliable serving, rapid experimentation, safe deployment, and continuous improvement. The role focuses on AI infrastructure, model experimentation, deployment, measurement, and engineering team leadership.

Team Focus Areas

• Model experimentation: Enable rapid, safe model validation for ChatGPT and Codex through experiment automation and lifecycle management.
• Model deployment: Ensure safe, scalable deployment of model capabilities with robust rollout and operational tooling. Automate capacity management and incorporate platform-wide health monitors.
• Model measurement: Build comprehensive evaluation and measurement systems for model quality, including user signals and launch scorecards. Improve end-to-end feedback loops for continual model improvement.

Key Partnerships

Collaborate cross-functionally with Model Measurement Data Science, Research, Codex, Fleet, Inference, and API teams.

Responsibilities

• Elevate and consolidate ChatGPT’s harness, context management, and system prompt frameworks.
• Drive the expansion and improvement of multi-tier model experiences.
• Support and scale self-service experiment capabilities and automated guardrails.
• Lead model rollout automation, capacity management, and health monitoring.
• Shape end-to-end measurement systems, including evaluations, grader signals, and user feedback.
• Lead engineering teams in complex, cross-functional environments.
• Collaborate directly with engineering, research, and product stakeholders.

Requirements

• Proven experience leading engineering teams in complex, cross-functional environments.
• Demonstrated success shipping production systems at scale, ideally for AI or large backend services.
• Deep understanding of model-driven product development, deployment lifecycles, and measurement tooling.
• Excellent communication and collaboration skills.
• Experience with large language models, distributed infrastructure, or experimentation platforms is a plus.

Benefits

• Base salary range of $293,000–$385,000 per year, plus equity and performance-related bonuses for eligible employees.
• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax Flexible Spending Accounts and commuter benefits.
• 401(k) retirement plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, company holidays, office closures, and paid sick or safe time.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Daily office meals and eligible meal delivery credits.
• Relocation support for eligible employees.
• Additional benefits may include charitable donation matching and wellness stipends.