Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Apache Beam
Communication @ 7
Data Structures
GCP @ 7
GPU @ 4
IaC
Kubernetes @ 7
MLFlow @ 4
MLOps @ 4
Machine Learning @ 6
Profiling @ 4
PyTorch @ 6
Python @ 6
Spark
TensorFlow @ 6
Terraform @ 7
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Reddit's Machine Learning Platform team owns the infrastructure powering recommendations, content discovery, user and content quantification, and other machine learning initiatives across Growth, Ads, Feeds, and Core Machine Learning.
As a Senior ML Infrastructure Engineer, you will lead development of a platform for large-scale machine learning models at Reddit.
Responsibilities
- Design end-to-end model lifecycle patterns and MLOps capabilities to improve development velocity for ML engineers, including data preparation, model management, and experiment tracking.
- Develop and support a graph machine learning codebase and platform that abstracts common patterns and enables greater model scalability and iteration.
- Collaborate with ML engineers on performance tuning, including improving model training time, efficiency, and GPU training costs in a large, distributed ML training environment.
- Optimize batch data processing within a data warehouse using tools such as Apache Beam, Apache Spark, and Ray Data.
- Architect pipelines to build and maintain massive graph data structures on the order of billions of nodes and tens of billions of edges.
Requirements
- 5+ years of experience in ML infrastructure, including model training and model deployments.
- Hands-on experience with ML optimization, including memory and GPU profiling.
- Deep experience with cloud technologies supporting an ML platform, including GCP BigQuery, Google Cloud Storage, and infrastructure as code with Terraform.
- Hands-on experience administering and integrating MLOps tools for experiment tracking, model serving, and model registries, such as MLflow or Weights & Biases.
- Proficiency with common machine learning programming languages and frameworks, including Python, PyTorch, and TensorFlow.
- Deep experience with distributed training frameworks, including Ray and Kubernetes.
- Strong focus on scalability, reliability, performance, and ease of use, with a strong understanding of the machine learning development lifecycle.
- Strong organizational and communication skills.
- Experience with graph databases such as Neo4j, JanusGraph, or TigerGraph is a plus.
- Experience with graph neural networks and graph ML frameworks such as PyTorch Geometric or Deep Graph Library is a plus.
Compensation And Benefits
The base salary range is $216,700–$303,400 USD per year. The role is also eligible for equity in the form of restricted stock units and, depending on the position offered, may be eligible for a commission. U.S.-based employee benefits include medical, dental, and vision insurance, a 401(k) program with employer match, vacation time, and parental leave.
Reddit is an equal opportunity employer committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans.