Open panta-123 opened 1 year ago
These are nice ideas, and we welcome PR ! The input data resolution being based on plugins, it should not be too difficult for you to extend. You should find a good starting point here https://dirac.readthedocs.io/en/latest/AdministratorGuide/Systems/WorkloadManagement/InputDataResolution.html?highlight=inputdatapolicy Also, what you offer seems generic enough, and would probably benefit to other communities, so please consider implementing this in vanilla DIRAC. Let us know if you need more guidance.
Some additional flexibility will be good to add.
Choose InputDataResolution policy according to
jobType
specified in CS. -> Lets say i want onlyUser
job to useInputDataByProtocol
and other job to useDownloadInputData
If there is no locol protcol that we want to use for streaming fallback to download policy. -> Curently for streaming p[rotocols we can specify Local and Remote protocols as:
Lets say if the
Remote
part is empty and no local protocol available, then use the default policy.(i.e.DownloadInputData
)