Senior Data Engineer, Enterprise Core Datasets, Tech Foundations
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 1
API @ 4
Automated Testing
Communication @ 7
Data Engineering @ 4
Data Modeling @ 7
Data Pipelines
Jira
Observability @ 4
Payments @ 1
Python @ 7
SQL @ 7
Scala @ 7
Spark @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Airbnb's Enterprise Core Datasets team builds technical data foundations that support business decisions, product innovation, and operational efficiency. The team works on datasets related to AI adoption, usage and cost; Unit Economics; enterprise applications such as Jira; and company metrics including Gross Booking Value and Revenue.
The Senior Data Engineer will design, build, and operate dependable, reusable datasets and pipelines across diverse business domains. The role involves owning complex data engineering projects from requirements gathering and technical design through implementation, validation, production operations, and ongoing reliability.
Responsibilities
- Design, build, and operate data pipelines for AI usage and cost, Unit Economics, enterprise applications, and critical financial metrics.
- Partner with stakeholders to define how AI adoption, consumption, and spending are measured and implement consistent data models.
- Evolve Unit Economics datasets to connect revenue and diverse cost drivers for product profitability and resource-efficiency analysis.
- Build ingestion and transformation pipelines for non-platform systems such as Jira and other BizTech enterprise applications.
- Translate complex requirements into source contracts, reusable fact and dimension models, and practical technical designs.
- Develop configurable pipelines and shared components for onboarding new data sources, products, and business requirements.
- Implement automated testing, reconciliation, anomaly detection, and monitoring to protect data accuracy, completeness, and availability.
- Plan and execute migrations and historical backfills through dependency analysis, validation, controlled cutovers, and recovery planning.
- Optimize distributed processing, storage, and query performance to improve freshness and reduce compute costs.
- Own production reliability through on-call participation, incident response, and improvements to systems and runbooks.
- Contribute to technical planning and design reviews, mentor fellow engineers, and improve Airbnb's Data Engineering Paved Path.
Requirements
- 5+ years of relevant industry experience and a Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
- Experience independently delivering complex data engineering projects from requirements and technical design through implementation and sustained production ownership.
- Strong SQL and programming skills in Python or Scala, with experience building maintainable and well-tested data systems.
- Hands-on experience with distributed processing technologies such as Apache Spark and large-scale analytical storage systems.
- Strong data modeling skills, including fact and dimension design, slowly changing dimensions, incremental processing, and historical data management.
- Experience integrating heterogeneous sources, including APIs, enterprise applications, event data, and transactional systems, while managing schema changes and source reliability.
- Ability to build reliable pipelines and execute migrations and backfills while preserving correctness and downstream compatibility.
- Experience implementing data quality controls, observability, lineage, and governance practices, and troubleshooting production data issues.
- Ability to diagnose performance bottlenecks and optimize distributed computation, storage, and query execution.
- Strong collaboration and communication skills, including clarifying requirements with business partners, explaining technical tradeoffs, and coordinating delivery across teams.
- Experience contributing to design and code reviews, sharing knowledge, and supporting the development of other engineers.
- Curiosity and sound judgment when learning new domains and balancing delivery needs with long-term system health.
- Experience with AI usage or cost measurement, cloud cost attribution, Unit Economics, enterprise application data, or financial and payments datasets is a plus.
- Familiarity with workflow orchestration, SQL transformation frameworks, and modern table formats such as Apache Iceberg is valuable.
Location
US remote eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed with the manager. Candidates must live in a state where Airbnb, Inc. has a registered entity.
Compensation
The base pay range is $196,000-$230,000 USD per year. The role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.
Inclusion and Accommodations
Airbnb is committed to inclusion, belonging, equal employment opportunity, and providing reasonable accommodations throughout the recruitment process for applicants with disabilities.