Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI
API @ 1
Agentic AI
Agentic Systems @ 3
Communication @ 6
LLM
NLP @ 3
Observability @ 3
Python @ 6
SQL @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
OpenAI’s Platform team powers how millions of developers and enterprises build with its models, providing APIs and agentic solutions used by global startups and Fortune 500 companies. The team works closely with product, engineering, design, and go-to-market teams to build a platform that advances AI capabilities.
As a Data Scientist on the Platform team, you will drive a data-driven culture for OpenAI’s API and B2B solutions. You will define metrics for developer success and enterprise value, measure the impact of new models and features, and partner with product managers and engineers to improve model quality, reliability, latency, and cost. Your work will shape how thousands of products adopt agentic AI.
This role is based in San Francisco, California. OpenAI uses a hybrid work model requiring three days in the office per week and offers relocation assistance to new employees.
Responsibilities
- Embed with the Platform product team as a trusted partner, identifying ways to improve developer experience, reliability, and usage growth.
- Define north-star metrics across the developer funnel, including activation, retention, and growth, as well as latency and cost guardrails for new features and models.
- Design and interpret A/B tests and controlled rollouts for new model versions, pricing and limits, API features, and B2B products.
- Build source-of-truth dashboards and self-serve data tools for product, engineering, and go-to-market teams.
- Translate product learnings into actionable feedback for Research, including failure modes, evaluation gaps, and model response quality.
Requirements
- 5+ years of experience in a quantitative role in ambiguous, high-growth environments; experience with platforms, APIs, or B2B products is a plus.
- Deep knowledge of SQL and Python, with experience proposing, designing, and running rigorous experiments.
- Experience defining and operationalizing metrics from scratch, including reliability, latency, cost, and safety metrics.
- Strong cross-functional communication skills with product managers, engineers, and executives.
- Strategic thinking beyond p-values, with the ability to evaluate tradeoffs and business impact.
Preferred Qualifications
- Background in developer platforms, observability, or usage-based pricing and quotas.
- Experience connecting offline evaluations to online product impact.
- Prior work in NLP, large language models, agentic systems, or enterprise analytics for B2B products.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. The company is an equal opportunity employer and provides reasonable accommodations to applicants with disabilities. Background checks are administered in accordance with applicable law.
Benefits
- Medical, dental, and vision insurance with employer contributions to Health Savings Accounts.
- Pre-tax accounts for health and dependent care expenses, as well as commuter expenses.
- 401(k) retirement plan with employer match.
- Paid parental, medical, and caregiver leave.
- Paid time off, company holidays, office closures, and paid sick and safe time.
- Mental health and wellness support.
- Employer-paid basic life and disability coverage.
- Annual learning and development stipend.
- Daily office meals and eligible meal delivery credits.
- Relocation support for eligible employees.
- Additional benefits may include charitable donation matching and wellness stipends.