Machine Learning Engineer, Multimodal Perception and Authentication

Details

The Future of Computing Research team is an applied research team within OpenAI’s Consumer Devices group. The team studies how AI systems perceive people and their surroundings and turns that research into capabilities for future products. Its work spans machine learning, sensing, and hardware, with a focus on systems that work beyond controlled environments.

The role focuses on multimodal perception and authentication, bringing together signals from cameras, microphones, and other sensors. The machine learning engineer will work with specialized perception models and larger multimodal models, partnering with hardware, firmware, software, and product teams to bring research into real-world systems.

This role is based in San Francisco. The team works in the office three days per week.

Responsibilities

• Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals.
• Explore how specialized perception models and larger multimodal models can work together.
• Design data, training, and evaluation approaches that improve performance in real-world conditions.
• Study model behavior, robustness, and failure modes across sensing, data, and deployment environments.
• Integrate and validate new capabilities in real-time or resource-constrained systems.
• Work with hardware, firmware, software, and product teams to turn research into working systems.

Requirements

• Strong background in computer vision, audio or speech machine learning, multimodal learning, or sensing.
• Experience developing specialized machine learning models, larger multimodal models, or both.
• Experience bringing research ideas into practical systems, prototypes, or products.
• Knowledge of experiment design, evaluation development, and model behavior investigation.
• Experience with sensing hardware, real-time systems, or other deployment constraints.
• Proficiency in Python and PyTorch, with familiarity with C++ or systems integration.
• Experience with authentication, biometrics, or other privacy-sensitive applications.
• Interest in working across disciplines on research problems that are still taking shape.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. The company develops AI systems and seeks to safely deploy them through its products, with safety and human needs at the core.

OpenAI is an equal opportunity employer and does not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristics. Background checks are administered in accordance with applicable law. Reasonable accommodations are available to applicants with disabilities.

Compensation And Benefits

• Base salary of $342,000–$399,000 per year.
• Equity, performance-related bonuses for eligible employees, and additional benefits.
• Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
• Pre-tax accounts for health, dependent care, and commuter expenses.
• 401(k) retirement plan with employer match.
• Paid parental, medical, and caregiver leave.
• Paid time off, paid holidays, office closures, and paid sick or safe time as required by applicable law.
• Mental health and wellness support.
• Employer-paid basic life and disability coverage.
• Annual learning and development stipend.
• Daily meals in offices and eligible meal delivery credits.
• Relocation support for eligible employees.
• Additional taxable fringe benefits may be provided.