Engineering Manager, ChatGPT Search Infrastructure

Details

The ChatGPT Search Infrastructure team builds foundational systems that power search experiences across ChatGPT. The team develops infrastructure connecting models with search systems and other real-time information sources, enabling timely, relevant, and trustworthy answers.

The work sits at the intersection of product engineering, AI, and large-scale infrastructure. The team builds shared platforms and abstractions that allow product teams to develop, evaluate, and launch search-powered experiences independently, with guardrails, testing, observability, and rollout controls to protect reliability, scalability, quality, and latency.

The team partners with Post-Training on model launches, experimentation, and prompt optimization; Search product verticals on new user experiences; Inference on GPU efficiencies; Indexing and Retrieval on relevant information systems; and the Capacity/Fleet team on regionalized GPU and CPU provisioning.

Responsibilities

• Define and drive the technical strategy, architecture, and roadmap for ChatGPT Search Infrastructure across search orchestration, APIs, model and prompt integration, serving, experimentation, evaluation, observability, and product integrations.
• Lead and develop a team of experienced engineers, create ownership opportunities, and foster an inclusive, high-trust culture with clear accountability and high standards.
• Partner with Post-Training on model launches, A/B experiments, search-behavior evaluation, and prompt optimization, translating model improvements into production-ready experiences.
• Build reusable platforms that enable Search product verticals to independently implement, test, and launch features with automated guardrails protecting reliability, scalability, quality, and latency.
• Partner with Inference, Indexing, and Retrieval teams to evolve end-to-end Search architecture, adapt serving optimizations, and improve product outcomes.
• Define and uphold service objectives of at least 99.9% availability, sub-second latency where required by the user experience, and the scalability needed to support continued growth.
• Establish engineering practices covering system design, testability, observability, experimentation, capacity planning, rollout safety, operational readiness, and incident prevention.
• Lead multiple complex workstreams, remove technical and organizational bottlenecks, and build alignment across product, research, and infrastructure teams in ambiguous and rapidly changing environments.

Requirements

• Experience managing senior engineers and leading teams responsible for complex, high-scale infrastructure, online serving, or distributed systems.
• Significant technical depth in backend infrastructure, platform engineering, APIs, low-latency serving, experimentation platforms, or AI-powered product development.
• Understanding of how models, prompts, inference systems, search orchestration, indexing, retrieval, and infrastructure work together to deliver an end-to-end user experience.
• Experience partnering with research or Post-Training teams to launch models, run controlled experiments, evaluate model behavior, or optimize prompts in production.
• Experience building shared platforms that allow engineering teams to independently develop and launch features within reliability, scalability, quality, and performance guardrails.
• Experience shaping architectures with demanding availability, latency, and scale requirements, including testability, observability, safe rollout, and operational excellence.
• Ability to move between technical depth, product strategy, organizational leadership, and people management while exercising sound judgment in ambiguous environments.
• Strong cross-functional partnership, people development, and inclusive team-culture skills.

Benefits

• Equity, performance-related bonuses for eligible employees, and benefits including medical, dental, and vision insurance.
• Health Savings Accounts, pre-tax flexible spending and commuter accounts, and a 401(k) retirement plan with employer match.
• Paid parental, medical, caregiver, sick, and safe leave.
• Flexible paid time off for exempt employees and up to 15 paid days annually for non-exempt employees.
• Paid company holidays and coordinated office closures.
• Mental health and wellness support, employer-paid basic life and disability coverage, and an annual learning and development stipend.
• Daily office meals and eligible meal delivery credits.
• Relocation support for eligible employees.

OpenAI is an equal opportunity employer. Background checks and reasonable accommodations are handled in accordance with applicable law.