Senior Software Engineer, Workflow Orchestration

Details

Airbnb's Workflow Orchestration team builds and maintains the data workflow orchestration solution used across the company for offline analytics, experiments, and AI/ML model development and training. The team has deep experience with orchestration systems (including being founding contributors to Apache Airflow) and focuses on scalable, reliable, and highly available solutions to support data use cases across Airbnb.

Responsibilities

• Architect, design, and implement scalable, reliable, and highly available data infrastructure solutions to support workflow orchestration across the company.
• Develop and maintain automation tools to streamline deployment and management of the workflow orchestration platform.
• Collaborate with infrastructure engineers, data engineers, and other users of the data warehouse to ensure efficient integration and smooth operation of the platform with other systems and services.
• Conduct performance testing and optimize the orchestration platform to meet evolving internal needs.
• Manage and prioritize multiple projects and tasks, and communicate progress and status with key stakeholders.
• Participate in technical discussions, code reviews, and pair programming sessions to foster knowledge-sharing and team growth.
• Provide input on best practices to improve scalability, reliability, and usability of the data platform.

Requirements

• 5+ years of experience in software engineering, with a focus on data infrastructure or supporting data engineers and/or data scientists.
• Strong programming skills in one or more of: Java, Python.
• Experience building data applications that provide higher-level abstractions on top of lower-level data infrastructure to simplify complex data operations, improve scalability, and enhance performance.
• Experience with data modeling, database design, and various SQL dialects.
• Experience with containerization technologies such as Docker and Kubernetes.
• Extensive background in workflow orchestration solutions such as Apache Airflow, Luigi, Azkaban, Oozie, Prefect, or Kubeflow.
• Ability to utilize Data Engineering experience to optimize processes and introduce ideas and technologies that enhance data capabilities.
• Excellent communication, analytical, and problem-solving skills.
• BS/MS/PhD in Computer Science or a related field, or equivalent work experience preferred.

Location & Work Policy

• This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed with your manager.
• Candidates must live in a U.S. state where Airbnb, Inc. has a registered entity (some states may be excluded).

Compensation & Benefits

• Base pay range: $191,000 — $225,000 USD.
• Role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.

Inclusion

• Airbnb is committed to inclusion and belonging and encourages applications from a diverse talent pool. Reasonable accommodations are available for candidates with disabilities during the application and interview process ([email protected]).