search

dmwm / PHEDEX

CMS data-placement suite
8 stars 18 forks source link

Increase number of priority level to 10 #670

Closed ericvaandering closed 10 years ago

ericvaandering commented 10 years ago

Original Savannah ticket 67593 reported by None on Tue May 18 07:58:59 2010.

Dear all,

recently it became apparent again that 3 priority levels are not enough to guarantee efficient transfer operation. We need more levels to distinguish different data types (custodial data, non-custodial data, high priority MC, MC, etc.) and even prioritize between different sample categories.

We therefore would like to have 10 instead of 3 priority levels in PhEDEx, preferrably the 5 highest ones not accessible to normal users and only to DataOps and AnaOps.

Thanks,

OLI

ericvaandering commented 10 years ago

Comment by latb on Tue May 18 08:04:51 2010

I think this request is very important in particular for the Fermilab Tier-1 (speaking in my parochial role of US CMS S&C manager), to ensure that Fermilab can get not just the highest-priority Tier-0 data, but also any other data sets that we'd like to receive, like non-custodial data or any kind of SD or PD (e.g. when we no longer store complete datasets at each side of the Atlantic).

Given that the size of the transfer buffer is a global parameter, Fermilab is particularly "disadvantaged" given its size and the amount of data requested to be transferred there reliably.

ericvaandering commented 10 years ago

Closed by wildish on Fri Nov 4 11:54:32 2011

ericvaandering commented 10 years ago

Comment by wildish on Fri Nov 4 11:54:32 2011

we increased the size of the queues not too long ago, so I don't think this is an issue anymore.

Certainly increasing the number of priorities is not a good idea, we would multiply the work the central agents have to do by a corresponding factor. We know that will not work well.