ORNL / DataFed

A Federated Scientific Data Management System
https://ornl.github.io/DataFed/
Other
19 stars 14 forks source link

Add pipeline serializer and gitlab job, stage and resource group #987

Closed JoshuaSBrown closed 2 months ago

JoshuaSBrown commented 2 months ago

Description

GitLab does not provide a mechanism for ensuring one pipeline is complete before starting another. This is necessary in our case because end to end tests involve coordination between several runners which are each running different services. Because we have a limited number of runners we cannot launch multiple pipelines. This will allow us to finish a pipeline before having additional jobs in a different pipeline interfere with running tests.