Senior Backend Engineer - Data Ingestion (ClickPipes)
at ClickHouse
USD 133,400-197,200 per year
SCRAPED
Used Tools & Technologies
Not specified
Required Skills & Competences ?
Software Development @ 6 GCP @ 4 ETL @ 4 Java @ 1 Distributed Systems @ 4 AWS @ 4 Azure @ 4 Communication @ 4 Microservices @ 4 Debugging @ 7 OLAP @ 4Details
ClickHouse is an open-source column-oriented OLAP database focused on delivering very fast analytical queries at scale. The ClickPipes Platform is responsible for onboarding and integrating data from diverse sources into ClickHouse. This role involves working at petabyte scale and in high-velocity environments to build reliable, scalable data ingestion infrastructure.
Responsibilities
- Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores.
- Continuously improve systems based on operational metrics, customer feedback, and business requirements.
- Drive technical discussions and contribute to architectural decisions impacting platform scalability and resilience.
- Participate in on-call rotations and respond to production incidents to ensure system reliability.
Requirements
- 5+ years of relevant software development experience building data-intensive software solutions.
- Strong knowledge of Golang and experience with its ecosystem. (Experience with Java is a plus.)
- Experience with distributed systems and microservices architecture.
- Ability to design and build robust ETL/data pipelines that handle large volumes of data reliably and efficiently.
- Understanding of data replication methodologies such as Change Data Capture (CDC).
- Practical experience with cloud-native architecture and at least one major cloud provider (AWS, GCP, Azure, etc.).
- Excellent communication skills and ability to collaborate across engineering teams.
- Strong problem-solving and production debugging skills.
Compensation
- For United States-based roles, the job lists typical starting salary ranges depending on location. For general US remote roles the posted range is $133,450 - $197,200 USD. Other location-specific ranges (NY/SF, LA/DC) are also provided.
Perks & Benefits
- Flexible work environment; company is globally distributed and remote-friendly.
- Employer contributions towards healthcare.
- Equity (stock options) for new employees.
- Flexible time off in the US and generous entitlement in other countries.
- $500 home office setup for remote employees.
- Global company gatherings / offsites.
Culture & Equal Opportunity
- New employees will help shape company culture as part of the first 500 employees.
- ClickHouse provides equal employment opportunities and prohibits discrimination based on protected characteristics.