search

CMSDAS / pre-exercises

1 stars 0 forks source link

Ex. 2 Question 7.3 #13

Open slaurila opened 4 years ago

slaurila commented 4 years ago

I suggest that the files root://cmseos.fnal.gov//store/user/cmsdas/2020/pre_exercises/Set2/DYJetsToLL.root root://cmseos.fnal.gov//store/user/cmsdas/2020/pre_exercises/Set2/DoubleMuon.root are moved from FNAL EOS to CERN EOS to make them accessible from lxplus.

lecriste commented 4 years ago

Our folder on lxplus is /afs/cern.ch/cms/Tutorials/CMSDASatCERN20/

Shall we create one also on EOS to make the files accessible remotely too? Feel free to update the twikis accordingly.

slaurila commented 4 years ago

I think it would make sense to collect all code in the Tutorials/CMSDASatCERN20 AFS directory (or github if you prefer) and all input ROOT files to a separate EOS directory. This would be a bit more "realistic" and consistent with how it is done at FNAL.

4quarks commented 4 years ago

I tried to copy the files to /afs/cern.ch/cms/Tutorials/CMSDASatCERN20/ but it don't have enough memory available

$ xrdcp -f root://cmseos.fnal.gov//store/user/cmsdas/2020/pre_exercises/Set2/DoubleMuon.root /afs/cern.ch/cms/Tutorials/CMSDASatCERN20/

Run: [ERROR] Server responded with an error: [3021] Disk quota exceeded (destination)

mulders commented 4 years ago

is it possible/easy to get a cmsdas/2020 folder on eos? I would rather store largish data files there than in the AFS tutorial directory, even though some others have abused it with several GB of root files

4quarks commented 4 years ago

We could create a user DAS2020 and store all the information at "/eos/cms/store/user/DAS2020". I tried to write on different paths but it seems that you need admin permissions. I will continue to investigate if there's a better way to do it but this could be an option

slaurila commented 4 years ago

As @clelange suggested in Discord, we should probably ask for a group EOS storage space. Did someone do it already? But since reading from FNAL works also fine (it just can be slow sometimes), we don't need to wait for our EOS before announcing the pre-exercises, right? But for short and long exercises, having our own group EOS space will surely be useful in any case.

4quarks commented 4 years ago

I would use FNAL and work on this eos migration in parallel. Then, for the long exercises we would be able to have everything already up to date

4quarks commented 4 years ago

I have copied all the files from FNAL to "/eos/user/c/cmsdas/2020". The ones that I could not are the ones listed here below. It seems that the files are not there anymore... I have to investigate a bit

$ xrdcp -f root://cmseos.fnal.gov//store/user/keanet/DoubleMuon/crab_CMSDAS_Data_analysis_test0/191016_035156/0000/slimMiniAOD_data_MuEle_2.root /eos/user/c/cmsdas/2020/ [0B/0B][100%][==================================================][0B/s]
Run: [ERROR] Server responded with an error: [3011] Unable to open file /eos/uscms/store/user/keanet/DoubleMuon/crab_CMSDAS_Data_analysis_test0/191016_035156/0000/slimMiniAOD_data_MuEle_2.root; No such file or directory (source)

3rd set:

4th set:

4quarks commented 4 years ago

The files of the 3rd set are not there anymore: $ xrdfs cmseos.fnal.gov:1094 ls -l /store/user/keanet/ dr-x 2019-04-09 14:59:59 17141454783 /store/user/keanet/CMS_Sim_DelphesTest dr-x 2020-05-13 21:08:31 138997767 /store/user/keanet/CondorOutput dr-x 2019-02-20 18:55:01 334351040984 /store/user/keanet/Delphes_root dr-x 2018-07-18 20:55:52 63717339 /store/user/keanet/MinBias dr-x 2019-06-13 15:18:01 10 /store/user/keanet/Test dr-x 2020-03-31 15:31:03 4983758855 /store/user/keanet/schannel dr-x 2020-07-08 19:17:38 62804013816 /store/user/keanet/tchannel

4quarks commented 4 years ago

I cannot access to the 4th set of files because they are using local file name. Thus, it is only reachable from the worker nodes

lecriste commented 4 years ago

I have copied all the files from FNAL to "/eos/user/c/cmsdas/2020". The ones that I could not are the ones listed here below. It seems that the files are not there anymore... I have to investigate a bit

3rd set:

  • root://cmseos.fnal.gov//store/user/keanet/DoubleMuon/crab_CMSDAS_Data_analysis_test0/191016_035156/0000/slimMiniAOD_data_MuEle_1.root
  • root://cmseos.fnal.gov//store/user/keanet/DoubleMuon/crab_CMSDAS_Data_analysis_test0/191016_035156/0000/slimMiniAOD_data_MuEle_2.root

These files are meant to be replaced with the ones produced by the student, we can state it explicitly in the twiki.

4th set:

  • file:/afs/cern.ch/work/d/dmoon/public/CMSDAS_Files/Exe4/slimMiniAOD_data_MuEle_1.root
  • file:/cmsdas/data/pre_exercises/Exe4/slimMiniAOD_data_MuEle_1.root
  • file:/pnfs/desy.de/cms/tier2/store/user/your_username/DoubleMuon/crab_CMSDAS_Data_analysis_test0/160718_090558/0000/slimMiniAOD_data_MuEle_1.root

Same for these. If these example files are not available any longer, we can replace them with those produced by any of us who has run this exercise.

4quarks commented 4 years ago

I updated the files by the ones I created when running the exercise as Leonardo proposed:

https://cmsweb.cern.ch/das/request?instance=prod/phys03&input=file+dataset%3D%2FDoubleMuon%2Fpcutrina-crab_CMSDAS_Data_analysis_test1-dfbd2918d11fceef1aa67bdee18b8002%2FUSER

I updated the Twiki with the new files.

What I didn't do is to modify the prints of the commands with my information. I think that the students understand that they are only guidelines.