Staff Software Engineer, Data Catalog

at Airbnb
USD 212,000-265,000 per year
SENIOR
✅ Remote

Tech Stack

Airflow @ 4 Communication @ 6 Flink @ 4 Hive @ 4 Java @ 7 KubeFlow @ 4 Machine Learning Python @ 7 SQL @ 4 Scala @ 7 Spark @ 4 Trino @ 4

Details

Airbnb is seeking a Staff Software Engineer to join its Data Infrastructure organization and lead the development of Data Catalog infrastructure products across Airbnb’s Data Ecosystem. The role focuses on building infrastructure, tooling, standards, and processes to ensure that data assets are cataloged, discoverable, and governed.

Responsibilities

  • Develop and implement data catalog products supporting data discovery, metadata management, data quality, and data lineage.
  • Develop and implement metadata infrastructure for data governance, including ownership management, data classification, data privacy, access control, and data retention.
  • Build an end-to-end data lineage product across online, offline, machine learning, metrics, visualizations, and third-party datasets.
  • Collaborate with cross-functional teams to ensure datasets are cataloged, governed, and aligned with business goals and regulatory requirements.
  • Define and ensure metadata quality and metadata governance requirements.
  • Work with data infrastructure framework teams to design and build metadata integrations for each data system.
  • Build infrastructure tooling and processes for scalable metadata onboarding and integrations.
  • Develop and implement metadata-driven data policies and procedures to support data governance requirements.

Requirements

  • BS, MS, or PhD in Computer Science or a related field, or equivalent work experience.
  • 9+ years of software engineering experience, with a focus on data infrastructure.
  • Experience with data storage and distributed processing technologies such as Hive, Spark, Trino, Flink, or SQL databases.
  • Strong programming skills in one or more of Java, Python, or Scala.
  • Experience with data catalog products, metadata infrastructure, metadata management, metadata integration frameworks and tooling, and metadata-driven data management.
  • Experience with workflow orchestration solutions such as Apache Airflow, Prefect, or Kubeflow.
  • Strong knowledge of data governance frameworks, policies, and processes, including data classification, data lineage, data quality, data privacy, and retention.
  • Excellent communication, analytical, and problem-solving skills.
  • Ability to collaborate with cross-functional teams and work in areas outside of the usual comfort zone.

Location

This position is US remote eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed with the manager. Candidates must live in a state where Airbnb, Inc. has a registered entity; certain states may be excluded.

Compensation

The base pay range is $212,000–$265,000 USD. The role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.

More jobs at Airbnb

Similar jobs