search

dmwm / WMCore

Core workflow management components for CMS.
Apache License 2.0
46 stars 107 forks source link

WM modeling: Tradeoff analysis of event throughput and disk needs given different strategies for processing multi-step workflows in a heterogeneous environment #11605

Open khurtado opened 1 year ago

khurtado commented 1 year ago

Impact of the new feature WM in general

Is your feature request related to a problem? Please describe. This is a meta issue related to the CDR: #11408 and is specific to the pending tasks to come up with a modeling of the workflow management (gdoc), discussed in a June 2023 meeting.

Challenge: Tradeoff analysis of event throughput and disk needs given different strategies for processing multi-step workflows in a heterogeneous environment

Processing Options:

Describe the solution you'd like Finish the following pending tasks:

Deliverable:

Describe alternatives you've considered None

Additional context This is a meta issue related to the CDR: #11408

amaltaro commented 1 year ago

@khurtado Kenyi, can you please apply to this - and the other tickets you have created - one of the provided issue templates (for this, the feature request would be the best)? Thanks!

khurtado commented 1 year ago

@amaltaro done

khurtado commented 1 year ago

@amaltaro It seems we completed all sub-tasks in this issue. Should we close it?

khurtado commented 1 year ago

@amaltaro Given the fact that all pending tasks are completed, should we organize another meeting with David Lange? Or, if he was still analyzing the input we provided in the document, should we put this ticket in Waiting until we come back to it for the final part of the issue?

amaltaro commented 1 year ago

Yes, I was thinking the same! Maybe the two of us could have a brainstorm on the metrics collected so far and try to have something more solid to discuss with David next week or so(?) In parallel, we can already contact him over email and try to arrange the next meeting (let me get it done).

khurtado commented 1 year ago

@amaltaro Thanks! Sounds good to me, let talk about this next week then.

amaltaro commented 12 months ago

@khurtado Kenyi, given that this activity is being carried out with David L., I think we should keep it going in Q4 and try to complete it instead of staling it for a quarter. Said that, I am moving it to Q4. But please let me know if you have concerns and/or if we have to move other things further in 2024.