Vacancy is archived. Applications are no longer accepted.
Used Tools & Technologies
Not specified
Required Skills & Competences ?
Kafka @ 6 Kubernetes @ 4 Python @ 6 Scala @ 6 SQL @ 6 Spark @ 6 dbt @ 6 Java @ 6 CI/CD @ 4 Flink @ 6 Azure @ 4 Data Engineering @ 4 Parquet @ 4 SRE @ 3 Debugging @ 4 Databricks @ 4 Snowflake @ 4Details
As a Senior Data Engineer, you will play a crucial role in setting up and leading technical decisions for our cloud-based data platform. We are specifically looking for someone with senior-level expertise in Databricks and Snowflake, with hands-on experience using Snowflake Snowpipe and Databricks Autoloader.
Responsibilities
- Setting up projects and leading technical decisions involving Snowflake Snowpipe and Databricks Autoloader.
- Architecting and implementing a platform to efficiently handle, store, process, and utilize data from various sources, such as customer data, smart meters, wind turbines, solar panels, power plants, and IoT devices.
- Ensuring our solutions are robust, scalable, and ready to meet future challenges.
- Empowering other departments by making data accessible and usable, driving Eneco’s digital innovations forward.
Requirements
Must-have:
- 3+ years of experience with distributed data processing: Apache Spark, Beam, Flink, Kafka.
- Hands-on experience with Databricks Autoloader and Snowflake Snowpipe.
- Understanding of data management, including schema evolution and storage formats like Parquet, Delta, or Iceberg.
- Proficiency in a programming language (Java, Python, Scala, etc.).
- Knowledge of software engineering best practices: code reviews, version control, testing, and CI/CD.
Nice-to-have:
- Experience deploying applications to Kubernetes, with skills in monitoring and debugging.
- Experience with a cloud provider (e.g., Azure).
- Familiarity with SRE principles.
- Proficiency in SQL and dbt.
Benefits
- Gross annual salary between €78,000 and €108,000, including FlexBudget, 8% holiday allowance, and depending on your role, a bonus or collective profit sharing.
- FlexBudget allows you numerous options such as getting it paid out, using it to buy extra holiday days, or saving it up.
- Personal and professional growth, with commitment to support your development.
- Hybrid working, allowing you to work both at home and in the office.