Senior Machine Learning Systems Engineer

at Reddit
USD 216,700-303,400 per year
SENIOR
✅ Remote

Tech Stack

Apache Beam Communication @ 7 Data Structures GCP @ 7 GPU @ 4 IaC Kubernetes @ 7 MLFlow @ 4 MLOps @ 4 Machine Learning @ 6 Profiling @ 4 PyTorch @ 6 Python @ 6 Spark TensorFlow @ 6 Terraform @ 7

Details

Reddit's Machine Learning Platform team owns the infrastructure powering recommendations, content discovery, user and content quantification, and other machine learning initiatives across Growth, Ads, Feeds, and Core Machine Learning.

As a Senior ML Infrastructure Engineer, you will lead development of a platform for large-scale machine learning models at Reddit.

Responsibilities

  • Design end-to-end model lifecycle patterns and MLOps capabilities to improve development velocity for ML engineers, including data preparation, model management, and experiment tracking.
  • Develop and support a graph machine learning codebase and platform that abstracts common patterns and enables greater model scalability and iteration.
  • Collaborate with ML engineers on performance tuning, including improving model training time, efficiency, and GPU training costs in a large, distributed ML training environment.
  • Optimize batch data processing within a data warehouse using tools such as Apache Beam, Apache Spark, and Ray Data.
  • Architect pipelines to build and maintain massive graph data structures on the order of billions of nodes and tens of billions of edges.

Requirements

  • 5+ years of experience in ML infrastructure, including model training and model deployments.
  • Hands-on experience with ML optimization, including memory and GPU profiling.
  • Deep experience with cloud technologies supporting an ML platform, including GCP BigQuery, Google Cloud Storage, and infrastructure as code with Terraform.
  • Hands-on experience administering and integrating MLOps tools for experiment tracking, model serving, and model registries, such as MLflow or Weights & Biases.
  • Proficiency with common machine learning programming languages and frameworks, including Python, PyTorch, and TensorFlow.
  • Deep experience with distributed training frameworks, including Ray and Kubernetes.
  • Strong focus on scalability, reliability, performance, and ease of use, with a strong understanding of the machine learning development lifecycle.
  • Strong organizational and communication skills.
  • Experience with graph databases such as Neo4j, JanusGraph, or TigerGraph is a plus.
  • Experience with graph neural networks and graph ML frameworks such as PyTorch Geometric or Deep Graph Library is a plus.

Compensation And Benefits

The base salary range is $216,700–$303,400 USD per year. The role is also eligible for equity in the form of restricted stock units and, depending on the position offered, may be eligible for a commission. U.S.-based employee benefits include medical, dental, and vision insurance, a 401(k) program with employer match, vacation time, and parental leave.

Reddit is an equal opportunity employer committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans.

More jobs at Reddit

Similar jobs