Staff Software Engineer, Online Database Infrastructure - Ingestion

Details

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.

Responsibilities

• Build and operate a data ingestion system that enables offline accessing and processing of online data at Airbnb such as database snapshots and near real time change data capture (CDC) events.
• Collaborate with cross-team partners including internal customers, dependencies and leadership to deliver multi-month projects.
• Lead a team of developers for multi-quarter cross-functional projects.
• Stay updated on latest developments in data ingestion systems and improve existing architecture.
• Influence long-term roadmap and strategy of the team and organization.
• Mentor and coach team members to enhance skills and technical standards.
• Identify, debug, and fix operational issues; participate in on-call rotation for the Ingestion team.

Requirements

• 9+ years of experience building and operating large scale core backend distributed systems.
• Hands-on experience with large scale online distributed databases and offline data ingestion pipelines; familiarity with distributed database internals and offline data warehouse systems.
• Strong communication and collaboration skills; ability to influence stakeholders and explain complex technical concepts.
• Technical leadership and mentorship capabilities.
• Ability to manage and deeply understand complex codebases producing clean, testable, maintainable code.
• Considerable experience in Java, Scala, or Python; familiarity with SPARK and Kafka.
• Proven project planning and timely delivery skills.

Nice to Haves

• Experience with AWS and/or GCP.
• Experience with Flink, Kubernetes, Airflow, AWS Aurora or TiDB.
• Experience working with Iceberg and generating incremental Iceberg DB snapshots.

Benefits

• The role offers eligibility for bonus, equity, benefits, and Employee Travel Credits.
• This position is US – Remote Eligible but requires living in a state where Airbnb has a registered entity.
• Occasional onsite work or attendance at offsites may be needed based on agreement with manager.

Inclusion

Airbnb is committed to diversity, equity, and inclusion and encourages all qualified individuals to apply. Applicants with disabilities may request accommodations during the recruitment process.