unicef / magasin

Cloud native open-source end-to-end data / AI / ML platform
https://unicef.github.io/magasin/
Apache License 2.0
5 stars 3 forks source link

Install dagster within the installer #24

Open merlos opened 8 months ago

merlos commented 8 months ago

Dagster is a very agile product and the newer versions may not be compatible with the older ones. To ensure that the correct version of dagster is installed this can be somehow managed by the setup.

The version can be obtained by running

helm list --all-namespaces | grep magasin-dagster | awk '{print $10}'

Where magasin-dagster is the namespace for the dagster component within the realm magasin

Then the package can be setup using

pip install dagster==<version>

Alternatively, dagster could be a dependency within the setup.py of the CLI. So that by installing the mag client it is also installed dagster.