Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI
Codex
LLM
NLP @ 4
Product Management @ 6
Python @ 6
SQL @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Codex is OpenAI’s first-party developer product focused on agentic software engineering. The team builds tools that help engineers design, write, test, and ship code faster, safely, and at scale, working closely with research and product teams to translate model advances into developer productivity.
As a Data Scientist on Codex, you will measure and accelerate product-market fit for AI developer tools. You will define developer productivity for the product, run experiments on coding models and user experience, and identify where models help or hurt across programming languages and tasks. Your insights will directly influence how software is built.
This role is based in San Francisco, California, and follows a hybrid work model requiring three days in the office per week.
Responsibilities
- Embed with the Codex product team to discover opportunities that improve developer outcomes and growth.
- Design and interpret A/B tests and staged rollouts of new coding models and product features.
- Define and operationalize metrics such as suggestion acceptance, edit distance, compile and test pass rates, task completion, latency, and session productivity.
- Build dashboards and analyses that help teams answer product questions independently across programming language, framework, repository size, and task type.
- Diagnose failure modes and partner with Research on targeted improvements involving model quality signals, user feedback, and evaluations.
Requirements
- Five or more years of experience in a quantitative role at a developer-facing or high-growth product.
- Fluency in SQL and Python.
- Comfort with experiment design and causal inference.
- Experience defining product metrics tied to user value.
- Ability to communicate clearly with Product Management, Engineering, and Design, and influence product direction.
Preferred Qualifications
- Strong programming background, including the ability to prototype, run simulations, and reason about code quality.
- Familiarity with IDE or extension telemetry and developer tooling analytics.
- Prior experience with NLP, large language models, code models, or evaluations for generative coding.
Benefits
- Base salary of $230,000–$385,000 per year, plus equity.
- Medical, dental, and vision insurance with employer contributions to Health Savings Accounts.
- Pre-tax accounts for health, dependent care, and commuter expenses.
- 401(k) retirement plan with employer match.
- Paid parental, medical, and caregiver leave.
- Paid time off, paid company holidays, office closures, and sick and safe time.
- Mental health and wellness support.
- Employer-paid basic life and disability coverage.
- Annual learning and development stipend.
- Daily office meals and eligible meal delivery credits.
- Relocation support for eligible employees.
- Additional benefits may include charitable donation matching and wellness stipends.
OpenAI is an equal opportunity employer committed to providing reasonable accommodations to applicants with disabilities. Background checks are administered in accordance with applicable law.