Senior Software Engineer - Apache Kafka Infrastructure

USD 160,000-240,000 per year

SENIOR

✅ On-site

Tech Stack
Tag name is followed by "@" symbol and proficiency level value. About proficiency levels:

1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;

3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;

7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;

10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.

API @ 4 Agile @ 4 Algorithms @ 7 Communication @ 7 Data Structures @ 7 Distributed Systems @ 7 Docker @ 4 Go @ 6 Java @ 4 JavaScript @ 4 Jenkins @ 4 Kafka @ 4 Kubernetes @ 4 Linux @ 4 Networking @ 4 OpenStack @ 4 Python @ 4 Scala @ 6

Details

The Bloomberg Managed Services (BMS) Streaming team provides streaming solutions on the BMS Platform powered by Apache Kafka and its ecosystem. The team builds and integrates middleware and data-store instances into an easy-to-use platform that is used widely across Bloomberg engineering.

Responsibilities

Collaborate within an Agile, multi-disciplinary team
Develop code around the Apache Kafka broker, client libraries (C/C++, Java, Python), and ecosystem frameworks (Kafka Connect, Kafka Streams, Cruise Control, Burrow)
Work on Open Source projects within the Kafka ecosystem and contribute changes upstream
Develop an end-to-end full-stack user experience for platform users
Pick up new frameworks, experiment, and build software that works seamlessly across environments
Anticipate engineering needs, collaborate with product owners and application teams to understand requirements, conduct feature demos, and provide system design consultations
Identify feature gaps and work with the open source community and vendors to co-design and co-develop features and bug fixes

Requirements

4+ years experience programming in Java, C++, Python, Go, Scala or similar in a production environment
Degree in Computer Science, Engineering or similar field, or equivalent work experience
Strong communication and collaboration skills
Strong understanding of distributed systems, data structures, algorithms and system design
Experience designing and implementing low-latency, high-volume, and high-availability distributed systems
Commitment to writing meaningful unit tests and integration tests

Technologies & Tools Mentioned

Apache Kafka and Kafka ecosystem (Kafka Connect, Kafka Streams, Cruise Control, Burrow)
Docker, Kubernetes, OpenStack
Java, Scala, C++, Python, JavaScript, Go
Jenkins, Docker-based unit testing, API documentation standards
TCP/IP, Unix networking, Linux kernel performance
Monitoring and evolving systems at scale

Nice-to-haves

Passion for distributed systems and large-scale data systems
Familiarity with Apache Kafka, Kubernetes and Docker
Java programming experience
Experience maintaining and contributing to large Open Source projects
Experience evolving and monitoring systems at scale
Deep understanding of TCP/IP and Unix networking, Linux kernel performance

Compensation

Salary Range: 160,000 - 240,000 USD Annual + Benefits + Bonus

About the Team & Culture

The team values an open and inclusive culture and looks for engineers passionate about writing reusable, efficient solutions to complex problems. For more on the team's work and challenges, the posting references a Kafka Summit talk: https://www.confluent.io/resources/kafka-summit-2020/fully-managed-multi-tenant-kafka-clusters-tips-tricks-and-tools/