Use Raspberry PI to run dagster. In dagster we fetch the data from tankerkoenig (we keep a local copy of the repository data on the raspberry and copy it into the container, so fetching does not take as long). After fetching we create a update the duckdb incrementally and delete older entries
[ ] Create docker img to start dagster
[ ] Checkout and run container on raspberry
[ ] Fetch data from tankerkoenig and load it into duckdb
[ ] Optimize fetching by only fetching diffs and loading only the missing days
Concept:
Use Raspberry PI to run dagster. In dagster we fetch the data from tankerkoenig (we keep a local copy of the repository data on the raspberry and copy it into the container, so fetching does not take as long). After fetching we create a update the duckdb incrementally and delete older entries