Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AWS @ 4
Azure @ 4
Communication @ 6
Flink @ 3
GCP @ 4
Kafka @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
About the Role
We are a team of passionate engineers who love solving complex distributed storage systems and infrastructure problems. Through the Tableflow project, we are building the next generation of storage solutions for Kora, transforming it into a true multi-modal storage engine. Our goal is to enable streaming data to be consumed both as a table and as a stream seamlessly.
As a Senior Software Engineer on the team, you will focus on advancing key layers of the Tableflow project, including its multi-tenant, highly available compute infrastructure, and the core components responsible for table materialization and background maintenance. You will tackle challenges such as developing strategies for efficient table materialization and maintenance at massive scale across all of Confluent Cloud, ensuring high availability and scalability for background storage tasks.
Responsibilities
- Storage Engine Development: Design and implement innovative strategies for table schematization, materialization, and compaction at massive scale.
- Platform Engineering: Build and maintain multi-tenant, highly available infrastructure that powers background computational tasks for Kora’s long-term storage. Ensure that the platform is optimized for scalability, reliability, and resilience, in alignment with organizational objectives.
- Cross-Functional Collaboration: Collaborate with product management, design, and other engineering teams to ensure seamless integration of storage features and infrastructure with the broader organization.
Requirements
- BS, MS, or PhD in computer science or a related field, or equivalent work experience
- Excellent communication and collaboration skills, with the ability to influence and guide stakeholders at all levels.
What Gives You an Edge
- Familiarity with or has experience contributing to the following open-source technologies: Apache Kafka, Apache Iceberg, Apache Flink
- Experience/knowledge with public clouds (AWS, Azure or GCP)