search

earthcube / scheduler

Scheduling approaches related to gleaner tooling
Apache License 2.0
0 stars 0 forks source link

Gleaner/Nabu Container start/stop #33

Closed valentinedwv closed 1 year ago

valentinedwv commented 1 year ago

We need to look at the Dagster DockerRunLauncher.

https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-docker/dagster_docker/docker_run_launcher.py

Here is the docker op that we might base off of

python docker library, creditianials helper

might even be simpler: https://docs.docker.com/engine/api/v1.43/#section/Authentication

{ "identitytoken": "9cbaf023786cd7..." }

valentinedwv commented 1 year ago

it's really and op, so we may have to just understand that stuff may need to be stopped and reran but docker.py and portainer can play mostly nicely. https://github.com/earthcube/scheduler/blob/be641bab84a8f21a3bade4d5388ec28f64935ef2/dagster/implnets/templates/v1/implnet_ops_SOURCEVAL.py#L177

valentinedwv commented 1 year ago

Docker.py integration Complete with workarounds for for issues where the libraries interact poorly