Staff Software Engineer, Observability

at Reddit
USD 217,000-303,900 per year
SENIOR
✅ Remote

Tech Stack

ClickHouse @ 1 Communication @ 6 Distributed Systems @ 3 Grafana @ 1 Kubernetes @ 4 Observability @ 1 OpenTelemetry @ 1 Prometheus @ 1 Thanos @ 1

Details

Reddit's Observability team is looking for an engineer who thrives at the intersection of infrastructure and software development. The team owns a suite of tools that help engineers understand and operate their systems, primarily using open-source solutions at scale. The team actively uses and contributes to Prometheus, Thanos, and other open-source projects.

The role is fully remote and spans monitoring, logging, and distributed tracing. Reddit's monitoring stack processes billions of data points per minute using large-scale Prometheus and Thanos deployments. Its logging platform, based on Vector and ClickHouse, processes millions of logs per day. Distributed tracing is based on OpenTelemetry, ClickHouse, and Grafana and processes tens of millions of events.

Responsibilities

  • Work collaboratively with software engineers to create and maintain the foundational platform for running Reddit's infrastructure.
  • Deliver software that improves the availability, scalability, latency, and efficiency of observability components.
  • Contribute feedback to the technical and strategic direction of eventing at Reddit.
  • Automate critical aspects of the event-driven development process.
  • Share on-call responsibilities.
  • Contribute upstream changes to the open-source projects used by Reddit.

Requirements

  • 7+ years of experience developing internet-scale software, preferably in infrastructure.
  • Familiarity with distributed systems development.
  • Familiarity with observability tools such as Prometheus, Thanos, Grafana, Vector, ClickHouse, OpenTelemetry, or Loki is a bonus.
  • Experience developing on Kubernetes or similar distributed systems.
  • Kubernetes controller or operator development experience is a significant plus.
  • Strong troubleshooting capabilities across systems and software.
  • Experience engineering large systems, tracking work, and acting as a self-starter on projects.
  • Excellent communication skills for collaborating with a service-oriented team and company.

Benefits

  • Comprehensive healthcare benefits and income replacement programs.
  • 401(k) with employer match.
  • Global benefits programs covering workspace, professional development, caregiving support, and other needs.
  • Family planning support.
  • Gender-affirming care.
  • Mental health and coaching benefits.
  • Flexible vacation and paid volunteer time off.
  • Generous paid parental leave.

Compensation

The base salary range is $217,000–$303,900 USD. The role is also eligible for equity in the form of restricted stock units and, depending on the position offered, may be eligible for commission. Reddit provides additional benefits to U.S.-based employees, including medical, dental, and vision insurance, a 401(k) program with employer match, vacation, and parental leave.

More jobs at Reddit

Similar jobs