Sebastian: persist meteringpoint events in blob

Energinet-DataHub / ARCHIVED-geh-aggregations

This project aims to create an engine that is able to do calculations on billions of metering points and deliver the results within minutes

Apache License 2.0

2 stars 0 forks source link

Closed lasrinnil closed 2 years ago

lasrinnil commented 2 years ago

We need to move the metering point events from the event hub in a blob so spark can get ahold of them we want to start an aggregation.

AC1: we can store the created and connected events from the event hub

[ ] Setup docker container for Spark / data bricks development
[ ] Setup pipelines for the deployment of spark jobs to Databricks ... More will come :)