Senior Backend Engineer - Data Ingestion (ClickPipes)
SCRAPED
Used Tools & Technologies
Not specified
Required Skills & Competences ?
Software Development @ 6 SQL @ 4 GCP @ 4 ETL @ 4 Java @ 1 Distributed Systems @ 4 AWS @ 4 Azure @ 4 Communication @ 4 Microservices @ 4 Debugging @ 7 OLAP @ 4Details
Established in 2009, ClickHouse leads the industry with its open-source column-oriented database system, driven by the vision of becoming the fastest OLAP database globally. The company empowers users to generate real-time analytical reports through SQL queries, emphasizing speed in managing escalating data volumes. Enterprises globally, including Lyft, Sony, IBM, GitLab, Twilio, HubSpot, and many more, rely on ClickHouse Cloud. It is available through open-source or on AWS, GCP, Azure, and Alibaba.
About the Team
The ClickPipes Platform plays a critical role in driving the growth of our company and ensuring the success of our clients by seamlessly onboarding and integrating data from diverse data sources into ClickHouse. Working at a petabyte scale and in high-velocity environments, this role offers an exceptional opportunity to solve challenging technical problems, operate with significant autonomy, and make a measurable impact.
Responsibilities
- Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores.
- Continuously improve systems based on operational metrics, customer feedback, and evolving business requirements.
- Drive technical discussions and contribute to architectural decisions that impact the platform's scalability and resilience.
- Participate in on-call rotations to ensure system reliability and respond to production incidents.
Requirements
- 5+ years of relevant software development industry experience building data-intensive software solutions.
- Strong knowledge of Golang and experience with its ecosystem. Experience with Java is a plus.
- Experience with distributed systems and microservices architecture.
- Ability to design and build robust ETL data pipelines that handle large volumes of data reliably and efficiently.
- Understanding of data replication methodologies like change data capture (CDC).
- Good knowledge of cloud-native architecture and practical experience with at least one major cloud service provider.
- Excellent communication skills and ability to collaborate across engineering teams.
- Strong problem-solving and production debugging skills.
Benefits
- Flexible work environment; ClickHouse is globally distributed and remote-friendly with operations in 20 countries.
- Employer contributions towards healthcare.
- Equity in the company via stock options.
- Flexible time off in the US and generous leave entitlements globally.
- $500 home office setup allowance for remote employees.
- Opportunities to engage in global company-wide offsites fostering in-person connections.
Culture
- Contribution to shaping company culture as part of the first 500 employees.
Compensation
- Salary range varies by location within the US, reflecting candidate experience, qualifications, skills, business requirements, and geography.
- Example salary ranges include:
- New York Area / San Francisco Area: $157,000 - $232,000 USD
- General US Remote: $133,450 - $197,200 USD
- Los Angeles, CA / Washington, DC: $141,300 - $208,800 USD
ClickHouse is an equal opportunity employer committed to diversity and privacy.