search

earthcube / scheduler

Scheduling approaches related to gleaner tooling
Apache License 2.0
0 stars 0 forks source link

customize docker compose so we can add just custom per project workflows (aka ecrr workflow) #46

Closed valentinedwv closed 1 year ago

valentinedwv commented 1 year ago

This is going to be a custom workflow for now. Need to figure out how to add just a wf for one organization. Probably an override of the volume mounts with a docker compose override file, and use docker compose -f file1 -f file2 config to create combined compose files for projects

Really need to rework the ops, so that they can be shared

valentinedwv commented 1 year ago

There is a new 'Definitions' API that means we treat things that were repositories more like python modules. So for each module there would be a 'Definition'

Not fully sure.

valentinedwv commented 1 year ago

figured it out, on branch https://github.com/earthcube/scheduler/tree/dev_dagster142