Token-as-a-Service Technical Program Manager

at OpenAI
USD 226,000-285,000 per year
SENIOR
✅ Hybrid
✅ Relocation

Tech Stack

AI @ 4 Communication @ 7 Distributed Systems @ 4 GPU @ 4 Networking @ 4 Planning @ 3 Security

Details

OpenAI’s Stargate and 3P Engineering teams build and scale the external infrastructure ecosystem that powers advanced AI systems. The team works across hyperscalers, colocation providers, cloud partners, and strategic third-party operators to turn contracted capacity into production-ready compute.

The role leads delivery of external compute capacity that directly serves OpenAI model workloads. It owns complex cross-functional programs that transform third-party infrastructure into usable tokens at scale, partnering with engineering, capacity planning, networking, hardware, finance, product, and external providers.

This position is based in San Francisco, California, with a hybrid work model requiring three days in the office per week. Relocation assistance is available.

Responsibilities

  • Lead end-to-end delivery programs that convert external infrastructure capacity into production-ready token supply.
  • Own readiness across compute, storage, networking, security, and operational dependencies for third-party environments.
  • Build integrated plans across internal engineering teams and external partners, including milestones, owners, risks, and critical paths.
  • Drive launch execution for new partner regions, clusters, and capacity expansions.
  • Create operating mechanisms that measure deployed capacity against usable token output.
  • Identify and resolve bottlenecks affecting token generation, including network constraints, hardware readiness, software enablement, and partner delays.
  • Coordinate with capacity planning and finance teams to prioritize high-return capacity opportunities.
  • Establish executive-level reporting on delivery status, risks, and token ramp forecasts.
  • Improve the repeatability of partner onboarding, technical integration, and scaling processes.
  • Manage escalations across internal and external stakeholders during high-severity delivery issues.
  • Translate ambiguous infrastructure constraints into clear execution plans.
  • Help define the long-term operating model for Token-as-a-Service across Stargate and 3P ecosystems.

Requirements

  • 8+ years of experience in Technical Program Management, Engineering Program Management, or infrastructure delivery.
  • Experience leading large-scale technical programs involving cloud, data centers, networking, hardware, or distributed systems.
  • Strong understanding of compute infrastructure, clusters, networking, storage, and production systems.
  • Proven ability to drive cross-functional execution across engineering, operations, finance, and external vendors.
  • Experience managing executive stakeholders and communicating complex tradeoffs clearly.
  • Strong analytical skills, including the ability to reason about utilization, throughput, capacity, and operational metrics.
  • Comfort operating in ambiguous, fast-scaling environments.
  • Strong written and verbal communication skills.
  • High ownership mentality with a bias toward action.
  • Experience working with external providers, strategic partners, or hyperscalers is highly preferred.

Preferred Skills

  • Experience with GPU clusters, AI infrastructure, or large-scale model-serving environments.
  • Familiarity with token economics, inference capacity planning, or workload scheduling.
  • Experience scaling global infrastructure through third-party providers.
  • Background in systems engineering, networking, or hardware deployment programs.
  • Experience building new operational models in high-growth environments.

Benefits

  • Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses.
  • 401(k) retirement plan with employer match.
  • Paid parental, medical, and caregiver leave.
  • Paid time off, company holidays, office closures, and paid sick or safe time as required by law.
  • Mental health and wellness support.
  • Employer-paid basic life and disability coverage.
  • Annual learning and development stipend.
  • Daily office meals and eligible meal delivery credits.
  • Relocation support for eligible employees.
  • Equity, performance-related bonuses for eligible employees, and additional benefits may be provided.

More jobs at OpenAI

Similar jobs