Senior Software Engineer - Apache Kafka Infrastructure

USD 160,000-240,000 per year
SENIOR
✅ On-site

Used Tools & Technologies

Not specified

Required Skills & Competences

Docker @ 4 Go @ 6 Jenkins @ 4 Kafka @ 4 Kubernetes @ 4 Linux @ 4 Python @ 4 Scala @ 6 Java @ 4 Algorithms @ 7 Data Structures @ 7 Distributed Systems @ 7 Communication @ 7 JavaScript @ 4 Networking @ 4 OpenStack @ 4 API @ 4 Agile @ 4

Details

The Bloomberg Managed Services (BMS) Streaming team provides streaming solutions on the BMS Platform powered by Apache Kafka and its ecosystem. The team builds and integrates middleware and data-store instances into an easy-to-use platform that is used widely across Bloomberg engineering.

Responsibilities

  • Collaborate within an Agile, multi-disciplinary team
  • Develop code around the Apache Kafka broker, client libraries (C/C++, Java, Python), and ecosystem frameworks (Kafka Connect, Kafka Streams, Cruise Control, Burrow)
  • Work on Open Source projects within the Kafka ecosystem and contribute changes upstream
  • Develop an end-to-end full-stack user experience for platform users
  • Pick up new frameworks, experiment, and build software that works seamlessly across environments
  • Anticipate engineering needs, collaborate with product owners and application teams to understand requirements, conduct feature demos, and provide system design consultations
  • Identify feature gaps and work with the open source community and vendors to co-design and co-develop features and bug fixes

Requirements

  • 4+ years experience programming in Java, C++, Python, Go, Scala or similar in a production environment
  • Degree in Computer Science, Engineering or similar field, or equivalent work experience
  • Strong communication and collaboration skills
  • Strong understanding of distributed systems, data structures, algorithms and system design
  • Experience designing and implementing low-latency, high-volume, and high-availability distributed systems
  • Commitment to writing meaningful unit tests and integration tests

Technologies & Tools Mentioned

  • Apache Kafka and Kafka ecosystem (Kafka Connect, Kafka Streams, Cruise Control, Burrow)
  • Docker, Kubernetes, OpenStack
  • Java, Scala, C++, Python, JavaScript, Go
  • Jenkins, Docker-based unit testing, API documentation standards
  • TCP/IP, Unix networking, Linux kernel performance
  • Monitoring and evolving systems at scale

Nice-to-haves

  • Passion for distributed systems and large-scale data systems
  • Familiarity with Apache Kafka, Kubernetes and Docker
  • Java programming experience
  • Experience maintaining and contributing to large Open Source projects
  • Experience evolving and monitoring systems at scale
  • Deep understanding of TCP/IP and Unix networking, Linux kernel performance

Compensation

Salary Range: 160,000 - 240,000 USD Annual + Benefits + Bonus

About the Team & Culture

The team values an open and inclusive culture and looks for engineers passionate about writing reusable, efficient solutions to complex problems. For more on the team's work and challenges, the posting references a Kafka Summit talk: https://www.confluent.io/resources/kafka-summit-2020/fully-managed-multi-tenant-kafka-clusters-tips-tricks-and-tools/