Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI
Data Engineering @ 3
Data Pipelines @ 3
Data Science
Machine Learning @ 3
Python @ 5
SQL @ 5
Software Development @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
OpenAI’s mission is to ensure that general-purpose artificial intelligence benefits all of humanity. The Protection Science Engineering team supports this mission by identifying and investigating misuse of OpenAI products, enabling partner teams to develop data-backed product policies and scaled safety mitigations.
This interdisciplinary role combines data science, machine learning, investigation, and policy and protocol development. Within Integrity and Investigations, the role is responsible for designing and building systems to proactively identify and enforce against abuse on OpenAI products. This includes implementing abuse monitoring for new products, sustaining monitoring for existing products, and prototyping and incubating defenses against high-risk harms.
The role also responds to and investigates critical escalations that are not detected by existing safety systems. This requires expert understanding of OpenAI products and data, cross-functional collaboration with Product, Policy, Operations, Investigative, and Engineering teams, and participation in an on-call rotation involving urgent escalations outside normal working hours. Some investigations may involve sensitive content, including sexual, violent, or otherwise disturbing material.
Responsibilities
- Scope and implement abuse monitoring requirements for new product launches.
- Improve processes for sustaining monitoring operations for existing products, including automating monitoring subtasks.
- Prototype and mature production systems for abuse detection, review, and enforcement involving major harms.
- Work with Product, Policy, Operations, and Investigative teams to understand key risks and appropriate mitigations.
- Work with Engineering teams to ensure sufficient data and scalable tooling.
- Respond to and investigate critical escalations, including abuse not detected by existing safety systems.
Requirements
- At least 4 years of experience performing technical analysis and detection, particularly using SQL and Python.
- Experience in trust and safety, or experience working closely with policy, enforcement, and engineering teams.
- An investigative mindset.
- Experience with basic data engineering, such as building core tables or writing production data pipelines.
- Understanding and practical application of machine learning principles.
- Basic software development skills are a plus, as the role involves writing productionized code.
- Experience scaling and automating processes, especially with language models.
Benefits
- Base salary range of $198,000–$425,000 per year, plus equity.
- Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
- Pre-tax accounts for health, dependent care, and commuter expenses.
- 401(k) retirement plan with employer match.
- Paid parental, medical, and caregiver leave.
- Paid time off, company holidays, office closures, and paid sick or safe time.
- Mental health and wellness support.
- Employer-paid basic life and disability coverage.
- Annual learning and development stipend.
- Daily office meals and eligible meal delivery credits.
- Relocation support for eligible employees.
- Additional benefits may include charitable donation matching and wellness stipends.
OpenAI is an equal opportunity employer and provides reasonable accommodations to applicants with disabilities. Background checks are administered in accordance with applicable law.