Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Airflow
Communication @ 7
Distributed Systems @ 4
ETL
Hadoop
Java @ 7
Kubernetes @ 6
Machine Learning
NoSQL @ 3
Observability
Presto @ 6
SQL @ 3
Scala @ 7
Spark @ 6
Trino @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Airbnb's Data Warehouse Infrastructure team builds and operates foundational big data infrastructure used by hundreds of engineers to collect, manage, and analyze data at scale. The team uses open source technologies including Hadoop, Spark, Trino, Iceberg, and Airflow.
Responsibilities
- Design and build the next generation of big data compute platforms for data ETL, analytics, and machine learning at Airbnb.
- Operate, manage, and improve the reliability, performance, observability, and cost efficiency of the platform.
- Write maintainable, self-documenting code and perform code reviews.
- Work on and contribute to open source software with industry impact.
Requirements
- BS, MS, or PhD in Computer Science, a related field, or equivalent work experience preferred.
- 10+ years of experience working with data infrastructure, with a focus on big data technologies.
- Proficiency in big data technologies such as Spark, Presto/Trino, and Kubernetes.
- Strong programming skills in languages such as Java and Scala.
- Extensive experience designing, building, and maintaining scalable, fault-tolerant distributed systems.
- Demonstrated expertise in multithreading and concurrency programming.
- Familiarity with database systems, both SQL and NoSQL.
- Proven ability to collaborate with other teams to define system requirements, identify potential solutions, and test and integrate systems.
- Ability to troubleshoot and resolve complex data infrastructure problems.
- Strong written and verbal communication skills.
- Ability to work effectively in a team environment.
Location
This position is US remote eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed with the manager. Employees must live in a state where Airbnb, Inc. has a registered entity, subject to Airbnb's current list of excluded states.
Compensation
The base pay range is $212,000–$265,000 USD per year. The role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.
Inclusion and Accommodations
Airbnb encourages qualified individuals to apply and is committed to an inclusive application and interview process. Reasonable accommodations are available for candidates with disabilities.