Used Tools & Technologies
Not specified
Required Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Ansible @ 4
Jenkins @ 4
Linux @ 4
Spark @ 4
Java @ 6
Airflow @ 4
Distributed Systems @ 4
Communication @ 7
Jira @ 4
Hadoop @ 4
Hive @ 4
Maven @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Bloomberg's Hadoop Infrastructure team provides a multi-tenant, observable, and highly available infrastructure backed by Apache Hadoop (HDFS, HBase, Hive, Oozie, YARN/Spark, etc.) to support large-scale data applications across Bloomberg. The team manages clusters handling tens of petabytes of storage across thousands of servers, serving hundreds of billions of requests per day and running tens of thousands of jobs.
Responsibilities
- Advance how tenants from multiple product domains leverage Hadoop Infrastructure services.
- Provide and improve capabilities to migrate and support a massive data and compute footprint (10s of PB) to newer versions.
- Improve tenants' user experience when securely interacting with underlying infrastructure frameworks.
- Understand and improve the usability, reliability, and scalability of open-source Apache Hadoop services to optimize for Bloomberg application teams.
Requirements
- 4+ years of experience with an object-oriented programming language (Java) and associated technologies (e.g., Spring, JMX, JDBC).
- 3+ years of experience in the Hadoop ecosystem and related technologies (HBase, Hive 3, HDFS, Spark, Oozie).
- Degree in Computer Science, Engineering or similar field of study, or equivalent work experience.
- Knowledge of modern development methodologies and tools (Jenkins, Maven, Jira).
- Solid understanding of Linux, shell scripting, and OS troubleshooting.
- Strong problem-solving and communication skills.
Preferred
- Experience working with open-source software/community.
- Experience with distributed systems architecture and system design.
- Knowledge of Ansible.
- Experience with workflow automation tools like Airflow, Argo.
Compensation & Benefits
- Salary Range: 160000 - 240000 USD annually, plus benefits and bonus.
- Bloomberg offers a comprehensive benefits plan that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) with match, life insurance, and wellness programs. (The Company does not provide benefits directly to contingent workers/contractors and interns.)