Senior Data Engineer

at ING
📍 Katowice, Poland
PLN 156,000-336,000 per year
SENIOR
✅ On-site
✅ Visa Sponsorship

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Security @ 4 Ansible @ 4 Docker @ 4 Kafka @ 7 Kubernetes @ 4 DevOps @ 4 Python @ 4 Scala @ 4 Spark @ 4 GCP @ 4 ETL @ 4 Java @ 4 CI/CD @ 4 Hiring @ 4 Azure @ 4 Communication @ 4 Data Engineering @ 4 Microservices @ 6 ELT @ 4 Hadoop @ 4 Azure DevOps @ 4 Compliance @ 4 Agile @ 4

Details

ING Hubs Poland is hiring!

Salary

The expected salary for this position: 13000 - 28000 PLN

The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.

Summary

We are looking for a senior-level Data Engineer to design, implement and maintain an on-premises Cloudera Hadoop-based data platform, and to build and evolve batch and streaming data pipelines and platform capabilities. This is a hands-on role working with a team of Big Data engineers, Chapter Leads, Product Owners, DevOps engineers and Infrastructure Specialists.

Responsibilities

  • Build and maintain ETL/ELT pipelines, Data Warehouses, batch and event processing systems.
  • Contribute to strategy and lifecycle management of Data Lake implementation.
  • Design and implement highly available, scalable, and fault-tolerant data platforms.
  • Define and implement infrastructure required for optimal loading of data from a wide variety of data sources using big data technologies.
  • Assess the efficiency of end-to-end processes by identifying and mitigating risks.
  • Collaborate closely with international teams (Chapter Leads, Product Owners, DevOps, Infrastructure).
  • Keep up to date with latest industry standards and trends in Data Management.

Requirements / Skills & Technologies

  • Hands-on experience with Hadoop ecosystem and related tools; experience with on-premises Cloudera Hadoop platforms.
  • Strong proficiency in Confluent Kafka for real-time data streaming.
  • Expertise in Java and/or Scala, and Python.
  • Experience with Ansible for data engineering and platform development.
  • Experience building batch and streaming data pipelines using Apache NiFi and Apache Spark.
  • Proficient in building microservices and event-driven architectures.
  • Proven experience designing and implementing highly available, scalable, fault-tolerant data platforms.
  • Experience in DevOps environments: CI/CD (Azure DevOps), Test Automation, Docker, Kubernetes.
  • Good understanding of CI/CD concepts and Elastic-based monitoring solutions.
  • Knowledge of relational database concepts, design and performance tuning.
  • Knowledge of data security, access management and risk compliance.
  • Understanding of data governance practices including lineage, retention, quality and cataloging.

Nice to have / Extra points

  • Exposure to public cloud platforms like GCP or Azure.
  • Excellent communication skills and stakeholder management.
  • Ability to translate functional and non-functional requirements (Security, High Availability, Performance).
  • Understanding of Agile / Scrum methodology.

Information about the squad

As a senior-level professional (role naming: "Engineer IV" in the global ING job architecture), you will design, implement and maintain the on-premises Cloudera Hadoop-based platform and work with other senior engineers to define and build core capabilities that elevate the platform.

Notes

The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.