Improvements to ReqMgr assignment page

[sfoulkes]

Assignment regions Filters Select custodial site. If only a single site is selected to run at default that as the custodial site. Dashboard activity - distinct values

Both bulk and single assignment.

[drsm79]

metson: Milestone OpsPriority_August2011 deleted

[DMWMBot]

rickw: What are assignment regions? What is a custodial site?

[sfoulkes]

sfoulkes: Pushing this back since it isn't going to happen in August.

Custodial site is the site that is tasked with storing the primary copy of a given dataset. We'll have to query PhEDEx for this information.

I'm a little fuzzy on the assignment regions, Oli will have to comment. I think we'll need to setup a map between a region (PIC region) for example and the actual sites in that region. The ReqMgr would resolve the region to a list of sites and add those to the site white list in the workload.

[evansde77]

evansde: IMO, Region definitions would be more suited to something like SiteDB than ReqMgr....

[drsm79]

metson: Replying to [comment:4 evansde]:

IMO, Region definitions would be more suited to something like SiteDB than ReqMgr....

Agreed, and there's already a concept of that (child/parent sites), though that's not something DataOps currently exploits (e.g. data made in Bristol might be archived at FNAL, despite Bristol being closer in every way to RAL).

[gutsche]

gutsche: The whole concept of MC production regions close to the archival T1 will get less and less important. The resources are not geographically distributed according to the tape pledges of the respective T1 sites. And also the full mesh of transfer links gives us a much bigger flexibility on how to use the resources. So I think a more flexible way for us to define groups of T2 sites which we would like to use for the assignment would be better than a strict link in SiteDB. Unfortunately we are not there yet to just say, run at all resources available. I definitely would like to get there.

[DMWMBot]

mnorman: cmsweb deployment took priority this month - shifting due date.

[spinoso]

spinoso: When assigning a request to sites in the mc scenario, we usually assign to one T1 plus N T2s:

1. the choice of the T1 is mandatory, it should be the one to which the data will be subscribed to (=custodial T1);
2. the choice of the T2 falls into the set of those sites that have uplinks to that T1 in PhEDEx:

https://cmsweb.cern.ch/phedex/prod/Components::Links?from_filter=T2_.*&andor=and&to_filter=T1_.*&Update=Update#

We mantain a page for this selection:

http://spinoso.web.cern.ch/spinoso/whitelist.html

but it would be great if we could have the ReqMgr page show:

• a way to select the custodial T1;
• a way to select T2s from the set of T2s "uplinked" to that T1.

[DMWMBot]

mnorman: There are four different tickets in this ticket. Have any of them been touched? I noticed that there is some custodial site stuff in the code base, but I'm not sure how well that got propagated.

[DMWMBot]

mnorman: Nobody seems to know, so it's quite possible that this ticket will be closed in order to force a re-opening.

[DMWMBot]

mnorman: As promised, closing. Will see if this gets re-opened in proper ticket form later.