Software Engineer, Inference - Multi Modal

Details

OpenAI’s Inference team powers deployment of advanced models (including GPT models, image generation, and Whisper) across platforms. The team focuses on making models available, performant, and scalable in production while partnering closely with Research. This role focuses on expanding into multimodal inference to serve image, audio, and other non-text modalities at scale.

Responsibilities

• Design and implement inference infrastructure for large-scale multimodal models.
• Optimize systems for high-throughput, low-latency delivery of image and audio inputs and outputs.
• Enable experimental research workflows to transition into reliable production services.
• Collaborate closely with researchers, infra teams, and product engineers to deploy state-of-the-art capabilities.
• Contribute to system-level improvements including GPU utilization, tensor parallelism, and hardware abstraction layers.

Requirements

• Experience building and scaling inference systems for LLMs or multimodal models.
• Experience with GPU-based ML workloads and understanding of performance dynamics of large models, especially with complex data like images or audio.
• Comfortable working on systems spanning networking, distributed compute, and high-throughput data handling.
• Familiarity with inference tooling such as vLLM, TensorRT-LLM, or custom model parallel systems.
• Ability to own problems end-to-end and operate in ambiguous, fast-moving spaces; willingness to collaborate closely with research and product teams.

Nice to Have

• Experience working with image generation or audio synthesis models in production.
• Exposure to distributed ML training or system-efficient model design.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring general-purpose artificial intelligence benefits all of humanity. The company values diverse perspectives and is an equal opportunity employer. Background checks will be administered in accordance with applicable law.

Benefits

• Base pay range listed for the role; total compensation may include equity and performance-related bonuses.
• Medical, dental, and vision insurance with employer contributions to Health Savings Accounts.
• Pre-tax accounts (Health FSA, Dependent Care FSA, commuter benefits).
• 401(k) retirement plan with employer match.
• Paid parental leave, paid medical and caregiver leave.
• Flexible PTO and paid holidays; paid sick/safe time as required by law.
• Mental health and wellness support; employer-paid basic life and disability coverage.
• Annual learning and development stipend; daily meals in offices and meal delivery credits as eligible.
• Relocation support for eligible employees.

(Extracted from the original job posting.)