dmwm / WMCore

Core workflow management components for CMS.
Apache License 2.0
46 stars 107 forks source link

[MS] Perform RelVal data cleanup using a different account in Rule Cleaner #10881

Open amaltaro opened 2 years ago

amaltaro commented 2 years ago

Impact of the new feature MSRuleCleaner

Is your feature request related to a problem? Please describe. This is a follow up of #10253 , which will start creating input rules under a different account, thus it needs to be accounted in MSRuleCleaner as well.

Describe the solution you'd like The MSRuleCleaner code needs to be adapted to properly work with the new feature implemented in #10253. In short:

the rest of the logic should remain all the same.

Describe alternatives you've considered None

Additional context None

todor-ivanov commented 2 years ago

Hi @amaltaro . Given the emergency of the situation with the T2_CH_CERN being out of space and the possibility of RelVals being blocked because of this, I am going to take over that issue. Hopefully we can also converge more swiftly on https://github.com/dmwm/WMCore/issues/10253 too

FYI @nsmith-

amaltaro commented 2 years ago

@todor-ivanov we are still not ready to perform input data placement - and data location - with a separate account for Release Validation workflows. I have the MSTransferor changes mostly done here (still to be tested though): https://github.com/dmwm/WMCore/pull/10880 but data location in global and local queue is still pending, this is the initial placeholder: https://github.com/dmwm/WMCore/pull/10889

So, until we have those 2 fully implemented, tested and deployed, we should not change how rules deletion are performed in MSRuleCleaner.