Data Engineer, People Innovation Labs

at OpenAI

📍 San Francisco, United States

USD 293,000-325,000 per year

SENIOR

✅ Hybrid

✅ Relocation

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

AI @ 4 Airflow @ 6 Communication @ 4 Compliance Dagster @ 6 Data Engineering @ 7 Data Pipelines Data Science @ 4 Databricks @ 4 ETL @ 6 Fivetran @ 6 Flink @ 4 Hadoop @ 4 Java @ 6 Python @ 6 Scala @ 6 Security Snowflake @ 4 Spark @ 4

Details

People Innovation Labs is an engineering team embedded in the People organization, focused on building systems and products that improve recruiting, culture, talent retention, and productivity. The team develops products such as OpenHouse, an internal knowledge and communication hub, along with AI-powered automations and scalable recruiting tools.

The Data Engineer will build data-intensive systems that power internal People products and enable the People Analytics function. This includes data pipelines backed by business systems of record and data systems for ongoing people data analytics.

Responsibilities

Design, build, and manage people data pipelines, ensuring seamless integration into the Databricks warehouse.
Develop canonical datasets to track key people metrics and People Innovation Labs product metrics.
Collaborate with Data Platform, Data Science, People Analytics, Compensation, and Equity teams to understand data needs and provide solutions.
Implement robust and fault-tolerant systems for data ingestion and processing.
Participate in data architecture and engineering decisions as the primary data engineering expert on the team.
Ensure data security, integrity, and compliance according to industry and company standards.
Work with People Innovation Labs leadership, software engineers, and the People Analytics team to build the data systems supporting internal products.

Requirements

3+ years of experience as a data engineer and 8+ years of software engineering experience, including data engineering.
Proficiency in at least one programming language commonly used in data engineering, such as Python, Scala, or Java.
Experience with data warehousing technologies such as Databricks and Snowflake.
Expertise with ETL schedulers such as Fivetran, Airflow, Dagster, Prefect, or similar tools.
Experience with distributed processing technologies and frameworks such as Spark, Hadoop, or Flink.
Experience with distributed storage systems such as HDFS or S3.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. OpenAI is an equal opportunity employer and provides reasonable accommodations to applicants with disabilities. Background checks are administered in accordance with applicable law.

Benefits

Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
Pre-tax accounts for health, dependent care, and commuter expenses.
401(k) retirement plan with employer match.
Paid parental, medical, and caregiver leave.
Paid time off, company holidays, office closures, and sick or safe time.
Mental health and wellness support.
Employer-paid basic life and disability coverage.
Annual learning and development stipend.
Daily office meals and eligible meal delivery credits.
Relocation support for eligible employees.
Equity and performance-related bonuses for eligible employees.