search

earthcube / scheduler

Scheduling approaches related to gleaner tooling
Apache License 2.0
0 stars 0 forks source link

Many changes Services, Configs, Multiple Workflows dagster 1.42 #58

Closed valentinedwv closed 11 months ago

valentinedwv commented 11 months ago

Upgrade to 1.42, now using dagster-webserver instead of dagit

45 does services, so we can use CONFIGS. No more upload config to s3. It's a docker config now

46 can do multiple workflows. docker config workflow controls this.

42 Pulls images

52 Code now is in separate containers so that it can be updated without disturbing running workflows