Used Tools & Technologies
RDBMSRequired Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Security @ 4
Ansible @ 4
Docker @ 4
Kafka @ 7
Kubernetes @ 4
DevOps @ 4
Python @ 4
Scala @ 4
Spark @ 4
GCP @ 4
ETL @ 4
Java @ 4
CI/CD @ 4
Hiring @ 4
Azure @ 4
Communication @ 4
Data Engineering @ 4
Microservices @ 6
ELT @ 4
Hadoop @ 7
Azure DevOps @ 4
Compliance @ 4
Agile @ 4
Data Pipelines @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
ING Hubs Poland is hiring!
The expected salary for this position: 13000 - 28000 PLN
The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.
Requirements
- Hands-on experience with the Hadoop ecosystem and related tools, with strong proficiency in Confluent Kafka for real-time data streaming.
- Expertise in Java/Scala, Python and Ansible for data engineering and platform development.
- Experience building batch and streaming data pipelines using Apache NiFi and Spark.
- Proficient in building microservices and event-driven architecture.
- Proven experience designing and implementing highly available, scalable, and fault-tolerant data platforms.
- Ability to define and implement infrastructure for optimal loading of data from a wide variety of data sources using big data technologies.
- Experience working in a DevOps environment (CI/CD with Azure DevOps, test automation, Docker/Kubernetes).
- Good understanding of CI/CD concepts and Elastic-based monitoring solutions.
- Knowledge of relational database concepts, design and performance tuning.
- Knowledge of data security, access management and risk compliance.
- Understanding of data governance practices including lineage, retention, quality and cataloging.
Extra Points
- Exposure to public cloud platforms like GCP or Azure.
- Excellent communication skills and stakeholder management.
- Ability to translate functional and non-functional requirements (e.g. Security, High Availability, Performance).
- Understanding of Agile – Scrum methodology is considered a plus.
Responsibilities
- Work with a wide spectrum of technology from ETL/ELT pipelines, Data Warehouses, batch and event processing, and more.
- Contribute to strategy and lifecycle management of Data Lake implementation.
- Assess efficiency of end-to-end processes by identifying and mitigating risks.
- Collaborate closely with an international team made of Chapter Leads, Product Owners, DevOps engineers and Infrastructure Specialists.
- Stay up to date with the latest industry standards and trends in Data Management.
Information about the squad
As a senior-level professional, you will be responsible for designing, implementing, and maintaining an on-premises Cloudera Hadoop-based data platform. You will collaborate with other senior engineers to define, propose, and build core capabilities that elevate the platform to the next level. This is a hands-on role, where you will work as part of a team of Big Data engineers to help our client develop and deliver data-driven products.
The role naming convention in the global ING job architecture will be “Engineer IV”.
The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.