Technical Program Manager, Global Infrastructure Planning

Details

The Compute Infrastructure team operates the GPU fleet and large compute clusters supporting research, ChatGPT, and the API. The team works across GPUs, CPUs, storage, networking, and cloud infrastructure to train and serve models at scale.

This role owns CPU capacity planning and management across Research and Compute. It leads integrated planning for CPU, storage, and network capacity across OpenAI's global fleet, connecting workload demand and GPU deployment plans with the foundational resources required for pretraining, research, and application infrastructure. The role works across infrastructure engineering, network deployment, Finance, cloud providers, workload owners, and other stakeholders, covering AWS, GCP, Azure, and OCI.

The role is based in San Francisco, California, and follows a hybrid model requiring three days per week in the office.

Responsibilities

• Lead CPU demand planning across Research, Compute, and application infrastructure, including foundational services, data acquisition, container platforms, robotics, and services supporting GPU clusters.
• Maintain forecasts covering workload growth, regional and hardware requirements, timing, and acceptable alternatives.
• Translate workload growth and GPU fleet plans into integrated CPU, storage, and network requirements, including capacity, throughput, bandwidth, connectivity, and placement.
• Reconcile supply with demand, model constrained scenarios, and drive allocation and prioritization decisions.
• Lead CPU allocation planning and fulfillment, including quota transfers, rebalancing, and reclaims.
• Partner with network engineering and deployment teams on bandwidth, connectivity plans, ordering inputs, delivery milestones, and CPU and network allocations.
• Understand workload architecture and performance requirements well enough to challenge assumptions and influence decisions involving resource sizing, regional placement, data movement, storage choices, and constrained-supply alternatives.
• Drive fleet efficiency programs involving unused-capacity reclamation, workload rightsizing, infrastructure modernization, placement, and resource sharing.
• Measure released capacity and cost improvements while preserving workload performance and reliability.
• Scale integrated capacity planning across CPU, storage, and network by improving demand intake, forecasts, scenario models, inventory and allocation records, and workflow automation.
• Partner with cloud providers, Finance, Procurement, and engineering on capacity orders, commitments, renewals, regional availability, delivery lead times, cost, technical fit, and supply gaps.
• Align capacity plans with cluster and application deployment milestones and resolve infrastructure dependency gaps.
• Provide teams and leadership with clear views of demand, supply, allocation tradeoffs, forecast changes, and risks, turning competing needs into decisions and executable plans.

Requirements

• 5+ years of experience in technical program management, capacity planning, capacity engineering, or infrastructure management, including ownership of complex programs at scale.
• Experience managing demand forecasting, supply planning, allocations, and capacity operations for CPU or cloud compute infrastructure.
• Understanding of forecasts, inventory, quotas, delivery schedules, and utilization as they relate to capacity decisions.
• Technical depth in one or more infrastructure domains and the ability to reason across CPUs, GPUs, storage, and networks.
• Understanding of how workload architecture affects CPU and memory needs, storage capacity and throughput, network bandwidth and latency, and regional placement.
• Experience working across multiple cloud providers and understanding provider capabilities, quotas, regional constraints, and commercial commitments.
• Experience building or improving capacity planning tools, data models, or automation.
• Ability to work directly with data to validate assumptions, model scenarios, and measure outcomes.
• Experience delivering measurable infrastructure utilization or cost improvements through reclaims, rightsizing, modernization, workload placement, or similar efficiency programs.
• Ability to lead decisions across engineering, research, product, Finance, and external providers while balancing technical requirements, delivery risk, and cost.
• Clear communication with both working teams and leadership, resourcefulness in ambiguous environments, ownership of outcomes, and an interest in the impacts of AGI.

Benefits

• Base salary range of $207,000–$285,000 per year, plus equity and performance-related bonuses for eligible employees.
• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax Flexible Spending Accounts and commuter benefits.
• 401(k) plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, paid company holidays, office closures, and sick or safe time.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Daily office meals and eligible meal delivery credits.
• Relocation support for eligible employees.
• Additional benefits may include charitable donation matching and wellness stipends.