Software Engineer, Agent Infrastructure

Details

The Agent Infrastructure team builds systems for training and deploying highly useful AI agents. This includes environments where AI models can execute code, debug issues, and develop software, as well as the production platform powering products such as Codex, Operator, tool use in ChatGPT, and future agentic products.

The role involves working closely with research and product teams to build and scale infrastructure for training complex agentic models and launching agents to hundreds of millions of users. Responsibilities include developing new infrastructure and integrations, scaling capabilities to large compute clusters, and maintaining the production platform on which agents run.

Responsibilities

• Contribute to an in-house container orchestration platform designed to scale beyond systems such as Kubernetes.
• Develop and maintain FastAPI and gRPC APIs for agentic infrastructure used in training and production.
• Use Terraform to provision and evolve complex research and production infrastructure.
• Collaborate with research teams to establish and optimize systems for novel AI training runs and experimental applications.
• Identify bottlenecks and engineer performance improvements for large-scale machine learning infrastructure.
• Build systems from 0-to-1 and scale them to large production environments.
• Optimize globally distributed systems, virtualization efficiency, and runtime performance.

Requirements

• Deep experience working on large-scale machine learning infrastructure.
• Experience reasoning about training at scale and optimizing system performance in training environments.
• Experience building and scaling systems for complex, ambiguous technical problems.
• Knowledge of cloud platforms and infrastructure-as-code technologies such as Terraform.
• Deep technical expertise in virtualization and containerization technologies, such as Kata, Firecracker, gVisor, or Sysbox.
• Passion for optimizing runtime performance.

Benefits

• Base salary of $230,000–$385,000 per year.
• Equity, performance-related bonuses for eligible employees, and comprehensive benefits.
• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax accounts for health, dependent care, parking, and transit expenses.
• 401(k) retirement plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, company holidays, and paid office closures.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Office meals and eligible meal delivery credits.
• Relocation support for eligible employees.