dmwm / CRAB2

CRAB2
2 stars 11 forks source link

T1's are not blacklisted any more when using split by lumi #918

Closed ericvaandering closed 10 years ago

ericvaandering commented 10 years ago

Original Savannah ticket 102400 reported by belforte on Thu Aug 29 02:31:48 2013.

while they are when using split by event :-(

things work (no job created) if using split by event, which is what I have in my standard test config. So there's an annoying bug, where the annoying part refers to se b/w lista being handled differently in Crab2 for split by lumi and split by event, date since before "my time".

I will try to fix this. THere will be a crab_2_9_0_patch1

Stefano

On 08/28/2013 12:09 PM, Federica fanzago wrote: > HI all, > I'm finding a problem with the se_black_list. > I have created a task using the dataset > > /ZEE_TuneZ2star_14TeV_Eta4-pythia6/Summer13-UpgradePhase1Age0DES_DR61SLHCx_PU140Bx25_DES17_61_V5-v1/GEN-SIM-RECO > > > that is stored at > > T1_US_FNAL_MSS > T1_US_FNAL_Buffer > > in the creation message I see > crab: SE black list applied to data location: ['T1_DE', 'T1_ES', 'T1_FR', 'T1_IT', 'T1_TW', > 'T1_US', 'T3_US_Vanderbilt_EC2'] > > so I'm expected jobs will not be created > I know now jobs can run also in T1 site where disk is available, but ..is it the case? > > In the log I find > crab: Converted blacklist: cmssrm.fnal.gov, storm-fe-cms.cr.cnaf.infn.it, cmssrmdisk.fnal.gov, > srmcms.pic.es, ccsrm.in2p3.fr, cmssrm-fzk.gridka.de, se2.accre.vanderbilt.edu, srm2.grid.sinica.edu.tw > > and then > > crab: Job 1 Arguments: > 1/store/mc/Summer13/ZEE_TuneZ2star_14TeV_Eta4-pythia6/GEN-SIM-RECO/UpgradePhase1Age0DES_DR61SLHCx_PU140Bx25_DES17_61_V5-v1/10000/D4155DC9-26E4-E211-88A1-00248C55CC7F.root,/store/mc/Summer13/ZEE_TuneZ2star_14TeV_Eta4-pythia6/GEN-SIM-RECO/UpgradePhase1Age0DES_DR61SLHCx_PU140Bx25_DES17_61_V5-v1/10000/AE95D04B-13E4-E211-BCDE-003048678F8A.root,/store/mc/Summer13/ZEE_TuneZ2star_14TeV_Eta4-pythia6/GEN-SIM-RECO/UpgradePhase1Age0DES_DR61SLHCx_PU140Bx25_DES17_61_V5-v1/10000/52976F61-4AE4-E211-84D3-00304867C1BC.root > -1 0 1:1-1:3,1:96,1:200,1:380 > /ZEE_TuneZ2star_14TeV_Eta4-pythia6/Summer13-UpgradePhase1Age0DES_DR61SLHCx_PU140Bx25_DES17_61_V5-v1/GEN-SIM-RECO#365477dc-e408-11e2-b4e6-00221959e72f > > > Destination: ['cmssrm.fnal.gov'] CMSDestination: ['cmssrm.fnal.gov'] <--------------- > > > crab: Creating 167 jobs, please wait... > crab: Creation Time: 4.42675590515 > crab: Total of 167 jobs created. > > > and the task is also submitted. > > > Cheers > Federica

ericvaandering commented 10 years ago

Comment by belforte on Fri Aug 30 11:37:08 2013

also split by event seems not to work as expected. I need to fully review all this mess.

ericvaandering commented 10 years ago

Comment by belforte on Thu Sep 5 09:43:17 2013

tentatively fixed /local/reps/CMSSW/COMP/CRAB/python/Splitter.py,v <-- Splitter.py new revision: 1.61; previous revision: 1.60

extensive testing is needed, since there are so many possibilities

belforte commented 10 years ago

fix released in CRAB_2_9_1