Software Engineer, Hardware

Details

OpenAI’s Hardware organization develops AI-native silicon and system-level solutions for advanced AI workloads. The Scaling team builds and optimizes the low-level stack that orchestrates computation and data movement across OpenAI’s supercomputing clusters.

The role involves designing high-performance runtimes, building custom kernels, contributing to compiler infrastructure, and developing scalable simulation systems to validate and optimize distributed training workloads. You will work at the intersection of systems programming, machine learning infrastructure, and high-performance computing, balancing ergonomic developer APIs and introspection with stability and performance across an evolving hardware fleet.

This role is based in San Francisco, California, with a hybrid work model requiring three days per week in the office.

Responsibilities

• Design and build APIs and runtime components to orchestrate computation and data movement across heterogeneous machine learning workloads.
• Contribute to compiler infrastructure, including optimizations and compiler passes supporting evolving hardware.
• Engineer and optimize compute and data kernels for correctness, high performance, and portability across simulation and production environments.
• Profile and optimize system bottlenecks involving I/O, memory hierarchy, and interconnects at local and distributed scales.
• Develop simulation infrastructure to validate runtime behaviors, test training stack changes, and support early-stage hardware and system development.
• Rapidly deploy runtime and compiler updates to new supercomputing builds in collaboration with hardware and research teams.
• Work across a diverse technology stack, primarily using Rust and Python, and influence architecture decisions across the training framework.

Requirements

• Deep curiosity about large-scale systems and an interest in making them faster, simpler, and more reliable.
• Proficiency in systems programming, such as Rust or C++, and scripting languages such as Python.
• Experience in one or more of the following areas: compiler development, kernel authoring, accelerator programming, runtime systems, distributed systems, or high-performance simulation.
• Ability to work in a fast-paced, highly collaborative environment with evolving hardware and machine learning system requirements.
• Commitment to engineering excellence, technical leadership, and thoughtful system design.

Benefits

• Base salary of $225,000–$455,000 per year, plus equity.
• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax accounts for health, dependent care, and commuter expenses.
• 401(k) retirement plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, company holidays, office closures, and paid sick or safe time as required by applicable law.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Daily office meals and eligible meal delivery credits.
• Relocation support for eligible employees.
• Additional benefits may include charitable donation matching and wellness stipends.

OpenAI is an equal opportunity employer committed to reasonable accommodations and compliance with applicable employment and privacy laws.