Used Tools & Technologies
Not specified
Required Skills & Competences ?
Machine Learning @ 3 TensorFlow @ 3 API @ 3 LLM @ 2 PyTorch @ 3Details
You will help build large-scale deployment of machine learning models for both research and inference.
Responsibilities
- Develop APIs for AI inference that will be used by both internal and external customers
- Help set up our infrastructure and deploy efficiently and reliably.
- Benchmark and reduce bottlenecks throughout our inference stack
- Improve the reliability and observability of our systems and respond to system outages
Requirements
- Experience with ML systems and some deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
- High level familiarity with LLM architecture, and the key pieces (Multi-Head, Multi/Grouped-Query, as well as common Layers)
- Experience with deploying reliable, distributed, real-time systems at scale
Benefits
- Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.
- Equity is part of the total compensation package.