search

MatterMiners / tardis

Transparent Adaptive Resource Dynamic Integration System
https://cobald-tardis.readthedocs.io
MIT License
15 stars 20 forks source link

Quota parameter for each machine type #341

Open swozniewski opened 3 months ago

swozniewski commented 3 months ago

It can be necessary to specify individual quotas per machine type, e.g. to use only 50% of nodes with local disk but more of other nodes in the same cluster. This can be solved by defining two separate sites in the config but a (optional) quota per machine type would be more intuitive and save lines in the config.

giffels commented 3 months ago

Thank you for opening the ticket. @swozniewski and team offered to help with the implementation. I will take a look in the code mid of the week and come up with some instructions how it could be realized. However, please keep in mind that at some point we will potentially stop the support to manage more than one pool in one TARDIS instance. But we did not finally concluded if that affects only multiple sites or also the different machine types of a site.

swozniewski commented 3 months ago

Concerning the future config layout: I guess we would keep the global (wrt site) quota parameter and add the possibility to override it by optional quota parameters in the machine types? (for backwards-compatibility and flexibility reasons)

giffels commented 3 months ago

The global parameter will correspond to the global quota for all machine types, which can be used or not. In addition, there might be quota entries for each of the machine types itself.