Staff Software Engineer, Online Database Infrastructure - Ingestion
at Airbnb
USD 204,000-255,000 per year
SCRAPED
Used Tools & Technologies
Not specified
Required Skills & Competences ?
Kafka @ 3 Kubernetes @ 4 Python @ 4 Scala @ 4 Spark @ 3 GCP @ 4 Java @ 4 Airflow @ 4 Distributed Systems @ 7 Flink @ 4 Hiring @ 4 Leadership @ 4 AWS @ 4 Communication @ 7 Technical Leadership @ 4Details
Airbnb seeks an experienced engineer to join the Ingestion team within the Online Database Infrastructure org. The team's mission is to provide a managed, reliable, performant and scalable platform for exporting data out of Airbnb’s online databases for offline processing. The team builds and operates solutions for near real-time change data capture (CDC) and periodic mutation and full-table snapshots.
Responsibilities
- Act as an expert in building and operating a data ingestion system enabling offline access and processing of online data (DB snapshots, near real-time CDC events).
- Be hands-on: design, code, test, and operate production systems.
- Collaborate with cross-team partners (internal customers, dependencies, leadership) to deliver multi-month projects on schedule.
- Lead a team of developers on multi-quarter, cross-functional projects.
- Evaluate and incorporate new technologies and methodologies to improve ingestion architecture and solutions.
- Influence long-term roadmap and strategy for the team and organization.
- Mentor and coach team members to raise technical standards.
- Identify, debug, and fix operational issues; participate in on-call rotation for the Ingestion team.
Requirements
- 9+ years of experience building and operating large-scale core backend distributed systems.
- Hands-on experience building and operating large-scale online distributed databases and offline data ingestion pipelines to export data from underlying storage. Familiarity with internals of distributed databases and offline data warehouse systems is required.
- Strong cross-team collaboration and excellent written and verbal communication skills; ability to influence stakeholders and convey complex technical concepts effectively.
- Proven technical leadership, mentorship, and ability to guide teams on best practices around data ingestion systems.
- Ability to own and dive deeply into complex code bases; write clean, readable, testable, and maintainable code.
- Considerable experience in one or more of: Java, Scala, or Python.
- Familiarity with Apache Spark and Kafka.
- Strong ownership and ability to plan and deliver multi-month projects.
Nice to Haves
- Experience with AWS and/or GCP.
- Experience with Apache Flink, Kubernetes (K8s), Airflow, AWS Aurora, or TiDB.
- Experience working with Apache Iceberg and generating incremental Iceberg DB snapshots.
Location & Work Policy
- This position is US - Remote Eligible. Role may include occasional work at an Airbnb office or attendance at offsites as agreed with manager.
- Candidate must live in a U.S. state where Airbnb, Inc. has a registered entity (some states excluded).
Compensation & Benefits
- Base pay range: $204,000 — $255,000 USD.
- Role may be eligible for bonus, equity, benefits, and Employee Travel Credits.
Inclusion & Accessibility
- Airbnb is committed to inclusive hiring and provides disability-inclusive application and interview processes; reasonable accommodations are available by contacting [email protected].