Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
A/B Testing @ 7
AI @ 4
API @ 3
Airflow @ 4
Algorithms @ 3
Communication @ 6
Customer Support @ 4
Data Engineering @ 7
Data Pipelines @ 3
Experimentation
Fraud @ 4
Hive @ 4
Java @ 7
Kafka @ 4
Kotlin @ 7
Kubernetes @ 4
LLM @ 4
Machine Learning @ 7
Mathematics @ 6
NLP
PyTorch @ 4
Python @ 7
Spark @ 4
Statistics @ 6
System Architecture @ 3
TensorFlow @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
The Assistance Engineering team builds tools for Airbnb's global network of support agents. Within Assistance Engineering, Assistance Foundations develops shared platforms for case management, agent workspaces, quality and coaching systems, money tooling, data services, agent routing, provisioning and training, and reliability.
Airbnb is forming a dedicated Machine Learning Engineering group to build reusable intelligence across support. Current initiatives include LLM-based quality evaluation, AI coaching, simulation environments for agent training, and natural language search and chat tools.
Responsibilities
- Hire, manage, mentor, and grow a team of machine learning engineers.
- Define the machine learning roadmap across Assistance Foundations, including LLM evaluation, quality and coaching intelligence, retrieval, routing and matching, capacity forecasting, and decision support.
- Own end-to-end delivery of batch and real-time machine learning and LLM-based systems, from experimentation through production, A/B testing, and operation at scale.
- Partner with platform, backend, and frontend engineers, data scientists, product managers, and support operations and quality teams.
- Evaluate technical trade-offs and make decisions based on experiments and measurable business impact.
- Lead design and architecture reviews and uphold machine learning best practices, including rigorous offline and online evaluation, minimizing training/serving skew, feature and model selection, and incremental, test-driven delivery.
Requirements
- 8+ years of industry experience building and shipping applied machine learning systems.
- 3+ years managing machine learning engineers or applied scientists.
- Bachelor's, master's, or doctoral degree in Computer Science, Mathematics, Statistics, or a related technical field.
- Depth in Natural Language Processing and LLM-based systems, including hands-on experience taking models to production.
- Strong programming skills in Python, Java, or Kotlin, along with data engineering skills.
- Experience with at least three of TensorFlow, PyTorch, Kubernetes, Spark, Airflow or equivalent, Kafka or equivalent, and a data warehouse such as Hive.
- Experience building end-to-end machine learning infrastructure and productionizing models for batch and real-time use cases.
- Strong understanding of machine learning best practices, including offline metrics, human labeling, LLM-as-judge evaluation, training/serving skew minimization, A/B testing, feature engineering, and feature and model selection.
- Familiarity with large-scale system architecture, well-designed APIs, high-volume data pipelines, and efficient algorithms.
- Track record of test-driven development, incremental delivery, and safe deployment.
- Excellent written and verbal communication skills, with the ability to work with stakeholders at every level and navigate ambiguity.
Nice to Have
- Experience with LLMs in production, including evaluation, grounding, guardrails, and alignment techniques such as SFT, RLHF, and DPO.
- Experience with ranking, matching, forecasting, or optimization systems, such as search, recommendations, routing, or capacity planning.
- Experience applying AI to customer support, quality assurance, workforce tooling, trust and safety, or fraud.
Location
This position is US remote eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed with the manager. Candidates must live in a state where Airbnb, Inc. has a registered entity.
Compensation and Benefits
The base pay range is $220,000–$265,000 USD. The role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.
Airbnb is committed to inclusion and belonging, equal employment opportunity, and providing reasonable accommodations throughout the recruitment process.