search

earthcube / scheduler

Scheduling approaches related to gleaner tooling
Apache License 2.0
0 stars 0 forks source link

Use a loop and a timeout on docker wait, upload intermediate logs #62

Closed valentinedwv closed 11 months ago

valentinedwv commented 11 months ago

Seems like containers getting lost. Assuming that it might be better to loop with a long timeout in containers.wait(timeout=(30 minutes))

then when the timeout happens, use archive endpoint to pull logs, and upload the logs to scheduler/latest/...

ylyangtw commented 11 months ago

this issue is marked as Done. should we close it?

valentinedwv commented 11 months ago

Not yet reviewed, or merged.. or even setup a pull request... just marinating to see that I think it is right