Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Airflow @ 4
Communication @ 6
Flink @ 4
Hive @ 4
Java @ 7
KubeFlow @ 4
Machine Learning
Python @ 7
SQL @ 4
Scala @ 7
Spark @ 4
Trino @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Airbnb is seeking a Staff Software Engineer to join its Data Infrastructure organization and lead the development of Data Catalog infrastructure products across Airbnb’s Data Ecosystem. The role focuses on building infrastructure, tooling, standards, and processes to ensure that data assets are cataloged, discoverable, and governed.
Responsibilities
- Develop and implement data catalog products supporting data discovery, metadata management, data quality, and data lineage.
- Develop and implement metadata infrastructure for data governance, including ownership management, data classification, data privacy, access control, and data retention.
- Build an end-to-end data lineage product across online, offline, machine learning, metrics, visualizations, and third-party datasets.
- Collaborate with cross-functional teams to ensure datasets are cataloged, governed, and aligned with business goals and regulatory requirements.
- Define and ensure metadata quality and metadata governance requirements.
- Work with data infrastructure framework teams to design and build metadata integrations for each data system.
- Build infrastructure tooling and processes for scalable metadata onboarding and integrations.
- Develop and implement metadata-driven data policies and procedures to support data governance requirements.
Requirements
- BS, MS, or PhD in Computer Science or a related field, or equivalent work experience.
- 9+ years of software engineering experience, with a focus on data infrastructure.
- Experience with data storage and distributed processing technologies such as Hive, Spark, Trino, Flink, or SQL databases.
- Strong programming skills in one or more of Java, Python, or Scala.
- Experience with data catalog products, metadata infrastructure, metadata management, metadata integration frameworks and tooling, and metadata-driven data management.
- Experience with workflow orchestration solutions such as Apache Airflow, Prefect, or Kubeflow.
- Strong knowledge of data governance frameworks, policies, and processes, including data classification, data lineage, data quality, data privacy, and retention.
- Excellent communication, analytical, and problem-solving skills.
- Ability to collaborate with cross-functional teams and work in areas outside of the usual comfort zone.
Location
This position is US remote eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed with the manager. Candidates must live in a state where Airbnb, Inc. has a registered entity; certain states may be excluded.
Compensation
The base pay range is $212,000–$265,000 USD. The role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.
More jobs at Airbnb
Senior Manager, Technical Education
Airbnb · United States
USD 192,000-237,000 per year
Senior Manager, Platform Management (Payments)
Airbnb · United States
USD 232,000-282,000 per year
Staff UX Writer (Host)
Airbnb · United States
USD 180,000-223,000 per year
Staff Platform Manager - GTM & Ops Tooling
Airbnb · United States
USD 200,000-240,000 per year
Localization Manager, Italian
Airbnb · Milan, Italy
EUR 55,000-65,000 per year
Similar jobs
Staff Software Engineer, Product Risk
Stripe · Canada, Toronto, Canada, South San Francisco, United States, Seattle, United States
USD 224,000-336,000 per year
Staff Software Engineer, Business Data
Stripe · Canada, Toronto, Canada, South San Francisco, United States, Seattle, United States
USD 224,000-336,000 per year
Staff Software Engineer, Data Quality and Governance
Stripe · Canada, Toronto, Canada, South San Francisco, United States, Seattle, United States
USD 224,000-336,000 per year
Engineering Manager, Data Transformation
Stripe · New York City, United States, Seattle, United States
USD 203,400-305,200 per year
Senior Data Management Professional - Data Engineering - Entities
Bloomberg · Princeton, United States
USD 110,000-190,000 per year
Senior Data Management Professional - Data Engineering - Entities
Bloomberg · New York City, United States
USD 110,000-190,000 per year
Software Engineer - X Data
SpaceXAI · Palo Alto, United States
USD 125,000-400,000 per year
Senior Machine Learning Engineer, Relevance and Personalization (Query Intelligence)
Airbnb · United States
USD 200,000-235,000 per year