Senior DevOps Engineer - Product Metrics

Details

We are the company behind the popular open-source, high performance columnar OLAP database management system for real-time analytics. ClickHouse works 100-1000x faster than traditional approaches. By offering a true column-based DBMS, it allows for systems to generate reports from petabytes of raw data with sub-second latencies. With an amazing community already adopting our open-source technology, we are now embracing our journey in delivering Cloud first solutions to delight our customers.

With top adopters such as Lyft, Cisco, and eBay - not only do our products work at lightning speed, so do we.

We are an open and collaborative company. Our colleagues are curious, engaged and excited about what they do. If you want to work in an environment where you can learn, grow, be an agent of change and have your voice heard - then please read on!

The Observability team owns the observability platform that monitors internal services of ClickHouse Cloud as well as the customers' ClickHouse instances. As a part of the team you will be responsible for designing, building, operating and maintaining components of the petabyte-scale platform that stores trillions of events and processes tens of millions new events every second, owning its reliability, performance and availability. Our stack is built with open source technologies, such as OpenTelemetry and Grafana and of course based on ClickHouse.

In addition to the core responsibilities, the Observability team also manages the Product Metrics component of the platform. This function is essential for gathering and processing data for the internal billing and accounting system as well as customer-facing dashboards that provide our customers with immediate insights and analytics. The Product Metrics system is specifically designed to prioritize delivery guarantees, precision, and accuracy in handling extensive data volumes. Its primary goal is to provide data that is both prompt and accurate, supporting reliable operational decisions and enhancing the overall customer experience.

We are looking for highly skilled software and site reliability engineers to join our team.

Responsibilities

• Take an active part in determining the roadmap for the Product Metrics component
• Work closely within the team to deliver new features, iterate and improve them
• Design, build, operate, and maintain business-critical petabyte-scale systems
• Be responsible for the performance, reliability, availability and cost-efficiency of the Product Metrics component
• Mentor and support other team members, participate in design discussions and collaborate with the team
• Be a part of on-call rotation and take ownership of the services you're running
• Educate and lead efforts to improve observability among all engineering teams

Requirements

• 5+ years of relevant software development industry experience building and operating scalable, fault-tolerant, distributed systems
• Solid experience with at least one programming language. We use Go, but if you have familiarity with Python, C, C++, Rust or similar that translates well
• Experience with at least one of the major Cloud Service Providers such as AWS, GCP or Azure
• Experience with data streaming/message brokering systems such as Kafka, RedPanda or similar
• Experience with technologies such as Kubernetes, Helm, ArgoCD, Temporal as well as infrastructure-as-code tools such as Terraform

Bonus Points:

• Experience with ClickHouse
• Familiarity with open source or enterprise observability technologies; familiarity with solutions in metrics, logs, and tracing domains