Software Engineer, Caching Infrastructure

Details

At OpenAI, the Caching Infrastructure team builds a high-availability, multi-tenant caching layer that supports critical use cases across inference, identity, quota, and product experiences. The platform is designed to scale automatically with workload, minimize tail latency, and support diverse use cases.

The team is seeking an experienced engineer to help design and scale this infrastructure, with expertise in distributed caching systems, networking fundamentals, and Kubernetes-based service orchestration.

Responsibilities

• Design, build, and operate OpenAI's multi-tenant caching platform.
• Define the long-term vision and roadmap for caching as a core infrastructure capability, balancing performance, durability, and cost.
• Collaborate with infrastructure teams, including networking, observability, and databases, as well as product teams, to ensure the caching platform meets their needs.

Requirements

• 5+ years of experience building and scaling distributed systems, with a strong focus on caching, load balancing, or storage systems.
• Deep expertise with Redis, Memcached, or similar solutions, including clustering, durability configurations, client-side connection patterns, and performance tuning.
• Production experience with Kubernetes, service meshes such as Envoy, and autoscaling systems.
• Ability to rigorously evaluate latency, reliability, throughput, and cost when designing platform capabilities.
• Ability to work in a fast-paced environment while balancing pragmatic engineering with long-term technical excellence.

Benefits

• Equity, performance-related bonuses for eligible employees, and comprehensive benefits.
• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax accounts for health, dependent care, and commuter expenses.
• 401(k) retirement plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, company holidays, office closures, and paid sick or safe time as required by applicable law.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Daily meals in offices and eligible meal delivery credits.
• Relocation support for eligible employees.
• Additional benefits may include charitable donation matching and wellness stipends.

OpenAI is an equal opportunity employer and provides reasonable accommodations to applicants with disabilities. Background checks are administered in accordance with applicable law.