Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 5
API @ 6
Data Engineering
Data Science @ 3
Debugging
Distributed Systems @ 3
Experimentation
Machine Learning @ 3
Observability
Statistics @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
About the Team
The Applied AI team builds classification and evaluation systems that give post-training and research teams fast, reliable feedback on model behavior. The team combines machine learning and production engineering to develop accurate, efficient capabilities at scale, helping researchers assess changes and improve models and products.
The work spans real-time systems, data engineering, model serving, and experimentation tools, with a focus on performance, reliability, and privacy. The team works closely with researchers and data scientists and has broad ownership of the software that makes these capabilities available.
About the Role
This role involves building and evolving a classification and evaluation platform. You will develop services, online and offline pipelines, and tools that help researchers and data scientists turn ideas into working measurements and iterate quickly.
The position combines software and data engineering with hands-on production ownership. You will shape the architecture, deliver new capabilities, improve inference efficiency, and maintain system dependability as workloads and requirements evolve.
Responsibilities
- Design and build software services and APIs for configuring, running, and managing classifiers and evaluations.
- Build and operate online and offline classification pipelines that support reliable and efficient execution at scale.
- Improve model-serving performance, including throughput, latency, concurrency, and compute utilization.
- Build tools that simplify experimentation, debugging, and iteration for researchers and data scientists.
- Own production reliability, observability, and incident response, and reduce the operational burden of running the platform.
- Partner with machine learning engineers to bring new classification capabilities into production.
- Work closely with post-training researchers and data scientists to understand their workflows, identify high-impact improvements, and shape the product.
Requirements
- Experience designing, building, and operating software services or distributed systems at scale.
- Strong fundamentals in API design, concurrency, caching, performance, and failure recovery.
- Ability to investigate complex production problems and make sound architectural tradeoffs.
- A track record of owning software from initial design through deployment and ongoing operation.
- Strong product judgment and an interest in working directly with technical users.
- Comfort with ambiguous problems and broad ownership across multiple parts of a system.
- Fluency in using AI agents to move quickly across multiple workstreams in a fast-paced environment.
- Interest in machine learning, data science, and statistics.
- Experience with model serving, ML platforms, or inference optimization is a plus.
Benefits
- Base salary of $347,000–$445,000 per year, plus equity.
- Medical, dental, and vision insurance, with employer contributions to Health Savings Accounts.
- Pre-tax Flexible Spending Accounts and commuter benefits.
- 401(k) retirement plan with employer match.
- Paid parental, medical, and caregiver leave.
- Paid time off, paid company holidays, and paid office closures.
- Mental health and wellness support.
- Employer-paid basic life and disability coverage.
- Annual learning and development stipend.
- Daily office meals and eligible meal delivery credits.
- Relocation support for eligible employees.
- Additional benefits may include charitable donation matching and wellness stipends.