search

dmwm / PHEDEX

CMS data-placement suite
8 stars 18 forks source link

BlockAllocator updating priority of some blocks on every cycle #633

Closed ericvaandering closed 11 years ago

ericvaandering commented 11 years ago

Original Savannah ticket 63863 reported by magini on Thu Mar 4 05:29:53 2010.

Hello,

the BlockAllocator central agent is changing the priority for a list of blocks on every single cycle:

2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#ce1ad9ac-7965-4160-9f8d-fe40177cc1af at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#b504c401-cedb-418c-8693-20554741536a at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#b3d85e7d-573f-411b-81ca-ac24f43a4963 at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#9be1280e-dce4-471d-b120-119dfa8621e6 at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#24587d5e-0d1c-42be-8cc0-3a7bb6da16a3 at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#4e1e1801-db57-4333-89ae-951aee940ffb at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#9a8e1c9a-40a1-4efb-9dcc-857602065f46 at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#c415ec3b-634b-4b3d-8da3-37ce54cad4e9 at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#9881ede3-3499-41d2-a230-439dbef533c3 at T2_US_Purdue 2010-03-04 11:20:53: BlockAllocator[29233]: updating priority of /QCD_Mu_Pt50to80/Summer09-MC_31X_V3_7TeV-v1/GEN-SIM-RECO#b09fe775-9844-4777-b448-f526bbc52e0c at T2_US_Purdue

According to Ricky, this is caused by the fact that there are two subscriptions with different priorities to T2_US_Purdue for these blocks (one at dataset level, the other at block level), and BlockAllocator is oscillating between the two priorities, instead of superceding the block-level subscription with the dataset-level sub.

http://cmsweb.cern.ch/phedex/prod/Data::Subscriptions?filter=%2FQCD_Mu_Pt50to80%2FSummer09-MC_31X_V3_7TeV-v1%2FGEN-SIM-RECO;rows=all;dbs=21;dbs=141;dbs=121;dbs=81;dbs=161;dbs=1;dbs=163;dbs=61;dbs=164;dbs=41;node=53;rcolumn=Name;nvalue=Node%20files

Cheers, Nicolo'

ericvaandering commented 11 years ago

Comment by magini on Wed Apr 20 05:58:51 2011

Hi,

this was fixed with the upgrade to PHEDEX_4_0_0 - now every block has a unique block-level subscription, and subsequent re-subscriptions (either at block or dataset level) will correctly supersede the parameters of the old subscription.

Cheers Nicolo'

ericvaandering commented 11 years ago

Closed by magini on Wed Apr 20 05:58:51 2011