Senior Data Engineer

at Eneco

📍 Rotterdam, Netherlands

€78,000-108,000 per year

SENIOR
✅ Hybrid

🕙 32-40 hours per week

SCRAPED

Used Tools & Technologies

Not specified

Required Skills & Competences ?

Kafka @ 6 Kubernetes @ 4 Python @ 6 Scala @ 6 SQL @ 6 Spark @ 6 dbt @ 6 Java @ 6 CI/CD @ 4 Flink @ 6 Azure @ 4 Parquet @ 4 SRE @ 3 Debugging @ 4 Databricks @ 4 Snowflake @ 4

Details

Work with our energy trading team to build data and ML products.

Responsibilities

  • Enable forecasting processes by ensuring that the necessary data is made available in a timely and efficient manner.
  • Utilize tech and data to simplify, automate, and streamline complex trading processes.
  • Setting up projects and leading technical decisions involving Snowflake Snowpipe and Databricks Autoloader.
  • Architecting and implementing a platform to efficiently handle, store, process, and utilize data from various sources, such as customer data, smart meters, wind turbines, solar panels, power plants, and IoT devices.
  • Ensuring our solutions are robust, scalable, and ready to meet future challenges.
  • Empowering other departments by making data accessible and usable, driving Eneco’s digital innovations forward.

Requirements

Must-have:

  • 3+ years of experience with distributed data processing: Apache Spark, Beam, Flink, Kafka.
  • Hands-on experience with Databricks Autoloader and Snowflake Snowpipe.
  • Understanding of data management, including schema evolution and storage formats like Parquet, Delta, or Iceberg.
  • Proficiency in a programming language (Java, Python, Scala, etc.).
  • Knowledge of software engineering best practices: code reviews, version control, testing, and CI/CD.

Nice-to-have:

  • Experience deploying applications to Kubernetes, with skills in monitoring and debugging.
  • Experience with a cloud provider (e.g., Azure).
  • Familiarity with SRE principles.
  • Proficiency in SQL and dbt.

Benefits

  • Gross annual salary between €78,000 and €108,000, including FlexBudget, 8% holiday allowance, and depending on your role, a bonus or collective profit sharing.
  • FlexBudget allows you to have it paid out, buy extra holiday days, or save it up for something nice.
  • Personal and professional growth opportunities.
  • Hybrid working model, allowing you to work 40% at the office and 40% at home. The remaining day is flexible.
  • Work-life balance with a flexible schedule.