Staff Data Platform Engineer, Community Support Platform

at Airbnb
πŸ“ United States
USD 204,000-255,000 per year
SENIOR
βœ… Hybrid

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Kafka @ 4 MySQL @ 4 SQL @ 4 Spark @ 4 ETL @ 4 Airflow @ 4 CI/CD @ 4 Flink @ 4 Leadership @ 4 AWS @ 4 Communication @ 7 Data Engineering @ 4 PostgreSQL @ 4 API @ 4 LLM @ 4

Details

Airbnb's Community Support Platform (CS Data Platform) provides the trusted data foundation and metrics for offline and online consumption that empower operations, analytics, engineering, product, and leadership teams.

This role sits at the intersection of platform and data engineering: you will design and build scalable, testable, observable data products, guardrails and automation (CI/CD), and enable data practitioners to author and ship consistent data products across multiple frameworks and serving layers β€” including support for Generative AI and LLM flows.

Responsibilities

  • Partner with core data engineering, data services, and product engineering teams to understand productivity and data-authoring pain points and build scalable, flexible solutions.
  • Deeply understand logging and data processing frameworks and collaborate with data infrastructure teams to evolve integration of data flows across different frameworks and serving layers (ML and non-ML).
  • Own problems end-to-end: architecture/design, implementation, testing, deployment, and on-call operations.
  • Design, build, and maintain robust and efficient data pipelines and APIs that collect, process, and serve data from various sources (including backend events logged as part of LLM flows, customer interactions across channels, CS agents, LLM evaluations, etc.).
  • Develop, automate, and standardize logging, enrichment, serving data for ML training and inference, benchmarking, monitoring (anomaly detection, safe deploys), and other capabilities to support next-generation Generative AI products.
  • Enable data engineers and analytics engineers to author reliable data products by providing abstractions, guardrails, automation, and CI/CD workflows.
  • Mentor and inspire teammates; promote code quality, operational excellence, and shared learning.

Requirements

  • 9+ years of industry experience at the intersection of platform data engineering and software engineering; BS, MS, or PhD in Computer Science or similar.
  • Proven ability to build data processing pipelines and to design abstractions and guardrails that scale and reduce operational toil.
  • Deep experience building distributed batch and streaming pipelines and working with distributed storage.
  • Experience with orchestration and ETL tools.
  • Strong knowledge of data warehousing, relational databases, and columnar stores.
  • Skilled in SQL and data processing (batch and streaming); track record of analyzing large datasets to surface gaps and insights.
  • Comfortable driving architectural discussions across services, repositories, and environments.
  • Strong collaboration and communication skills; able to influence technical direction across teams.

Technologies and concepts explicitly referenced in the role:

  • Distributed batch/streaming: Spark, Flink, Kafka
  • Distributed storage: HDFS, S3
  • ETL orchestration: Airflow, Luigi, AWS Glue
  • Relational DBs: PostgreSQL, MySQL
  • Columnar / data warehouse: Redshift, BigQuery, ClickHouse, HBase
  • SQL, CI/CD, monitoring and anomaly detection, data contracts, data pipelines, APIs
  • ML & Generative AI: serving data for ML training/inference, LLM flows and evaluations

Benefits & Other Details

  • This role may be eligible for bonus, equity, benefits, and Employee Travel Credits.
  • Base pay range (subject to change): $204,000β€”$255,000 USD.
  • Location: US - Remote Eligible; may include occasional work at an Airbnb office or attendance at offsites (must live in a state where Airbnb, Inc. has a registered entity).
  • Airbnb is committed to inclusion and provides reasonable accommodations for candidates with disabilities.