NHMDenmark / DaSSCo-Integration

This Repo will include integration of dassco storage from northtec
0 stars 0 forks source link

Create logic for each unpause mode depending on which module they belong to #118

Open Baeist opened 3 months ago

Baeist commented 3 months ago

We want to automate attempts at unpausing that could be caused by various things that may fix themselves over time. This could be connection or erda delay related. It could also be a us throttling the pipeline. It could be another service that needed a fix or a job queue on hpc that is clogged up.

For different modules there are different things we probably want to do to start or check when to start the process of unpausing.

Current modules are: Ndrive (3 services) Asset file handler (1 service) Ssh hpc(4 services) Storage updater (7 services) - started work on this

Note this does not contain any rest apis.

The micro service config file contains information that is used for the pause/unapusing.

Baeist commented 2 months ago

I dont think mixing the pause due to errors and the pause due to throttling is good. Will keep those separate.