search

SBNSoftware / icarus-production

The repository is intended to support ICARUS production activities
GNU General Public License v3.0
0 stars 0 forks source link

Investigate missing compressed files on disk #65

Open mt82 opened 3 weeks ago

mt82 commented 3 weeks ago

Hi @Mateus F. Carneiro, we started to replicate compressed files at CNAF. We started with run 9435. We found that only 1013 out of 1081 files have been compressed.

samweb list-files "run_number = 9435 and data_tier = raw and file_name like data%" | wc -l
1081
samweb list-files "run_number = 9435 and data_tier = raw and file_name like compressed%" | wc -l
1013

This is understandable since the compression process probably failed. But then, only 902 are physically on disk. The others are declared but not present on the disk. Is this expected?

for f in $(samweb list-files "run_number = 9435 and data_tier = raw and file_name like compressed%"); do if [ ! -f $(samweb get-file-access-url --schema=srm $f | sed 's,srm://fndcadoor.fnal.gov:8443/srm/managerv
2?SFN=/pnfs/fnal.gov/usr,/pnfs,g') ]; then echo $f; fi; done
compressed_data_dl5_fstrmBNBMAJORITY_run9435_16_20230130T135826.root
compressed_data_dl6_fstrmBNBMAJORITY_run9435_16_20230130T140607.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_16_20230130T133818.root
compressed_data_dl10_fstrmBNBMAJORITY_run9435_14_20230130T124050.root
compressed_data_dl11_fstrmBNBMAJORITY_run9435_15_20230130T124101.root
compressed_data_dl5_fstrmBNBMAJORITY_run9435_15_20230130T130004.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_15_20230130T132350.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_15_20230130T132303.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_15_20230130T132435.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_16_20230130T142825.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_17_20230130T155209.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_16_20230130T142628.root
compressed_data_dl10_fstrmBNBMAJORITY_run9435_16_20230130T144715.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_16_20230130T142807.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_16_20230130T141427.root
compressed_data_dl9_fstrmBNBMAJORITY_run9435_15_20230130T132823.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_14_20230130T125315.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_17_20230130T153204.root
compressed_data_dl9_fstrmBNBMAJORITY_run9435_16_20230130T143100.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_18_20230130T160253.root
compressed_data_dl10_fstrmBNBMAJORITY_run9435_15_20230130T134407.root
compressed_data_dl9_fstrmBNBMAJORITY_run9435_14_20230130T123729.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_17_20230130T142147.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_15_20230130T125006.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_14_20230130T122428.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_14_20230130T121655.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_14_20230130T122203.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_17_20230130T153036.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_15_20230130T134550.root
compressed_data_dl11_fstrmBNBMAJORITY_run9435_16_20230130T133021.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_18_20230130T151702.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_15_20230130T131358.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_16_20230130T143457.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_14_20230130T122518.root
compressed_data_dl6_fstrmBNBMAJORITY_run9435_17_20230130T145338.root
compressed_data_dl6_fstrmBNBMAJORITY_run9435_15_20230130T130048.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_14_20230130T123658.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_15_20230130T132951.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_17_20230130T150932.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_16_20230130T145806.root
compressed_data_dl11_fstrmBNBMAJORITY_run9435_17_20230130T142832.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_18_20230130T163831.root
compressed_data_dl10_fstrmBNBMAJORITY_run9435_17_20230130T155111.root
compressed_data_dl9_fstrmBNBMAJORITY_run9435_17_20230130T154023.root
compressed_data_dl5_fstrmBNBMAJORITY_run9435_17_20230130T151723.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_18_20230130T164152.root
compressed_data_dl11_fstrmBNBMAJORITY_run9435_18_20230130T153014.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_18_20230130T164135.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_17_20230130T152812.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_17_20230130T152604.root
compressed_data_dl9_fstrmBNBMAJORITY_run9435_19_20230130T174902.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_19_20230130T173818.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_18_20230130T165751.root
compressed_data_dl10_fstrmBNBMAJORITY_run9435_18_20230130T170535.root
compressed_data_dl6_fstrmBNBMAJORITY_run9435_19_20230130T171222.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_19_20230130T175105.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_20_20230130T183646.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_19_20230130T173318.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_19_20230130T175843.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_18_20230130T163818.root
compressed_data_dl9_fstrmBNBMAJORITY_run9435_18_20230130T164727.root
compressed_data_dl5_fstrmBNBMAJORITY_run9435_19_20230130T173445.root
compressed_data_dl10_fstrmBNBMAJORITY_run9435_19_20230130T175758.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_20_20230130T175928.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_19_20230130T175206.root
compressed_data_dl5_fstrmBNBMAJORITY_run9435_20_20230130T184419.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_4_20230130T020531.root
compressed_data_dl10_fstrmBNBMAJORITY_run9435_20_20230130T190636.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_19_20230130T164249.root
compressed_data_dl5_fstrmBNBMAJORITY_run9435_18_20230130T163442.root
compressed_data_dl6_fstrmBNBMAJORITY_run9435_18_20230130T155123.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_19_20230130T173932.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_20_20230130T185314.root
compressed_data_dl9_fstrmBNBMAJORITY_run9435_20_20230130T190209.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_21_20230130T194750.root
compressed_data_dl11_fstrmBNBMAJORITY_run9435_20_20230130T175414.root
compressed_data_dl11_fstrmBNBMAJORITY_run9435_19_20230130T164902.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_20_20230130T184558.root
compressed_data_dl6_fstrmBNBMAJORITY_run9435_20_20230130T181337.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_20_20230130T182754.root
compressed_data_dl6_fstrmBNBMAJORITY_run9435_21_20230130T191301.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_21_20230130T192412.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_20_20230130T185031.root
compressed_data_dl11_fstrmBNBMAJORITY_run9435_22_20230130T195737.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_21_20230130T190525.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_20_20230130T185854.root
compressed_data_dl6_fstrmBNBMAJORITY_run9435_22_20230130T195708.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_22_20230130T201015.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_21_20230130T194656.root
compressed_data_dl11_fstrmBNBMAJORITY_run9435_21_20230130T185432.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_23_20230130T205845.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_22_20230130T205800.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_21_20230130T194437.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_22_20230130T200937.root
compressed_data_dl5_fstrmBNBMAJORITY_run9435_21_20230130T195958.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_21_20230130T195140.root
compressed_data_dl5_fstrmBNBMAJORITY_run9435_22_20230130T205102.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_22_20230130T205403.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_22_20230130T204232.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_23_20230130T215315.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_22_20230130T211301.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_23_20230130T215206.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_24_20230130T214651.root
compressed_data_dl12_fstrmBNBMAJORITY_run9435_23_20230130T210813.root
compressed_data_dl7_fstrmBNBMAJORITY_run9435_25_20230131T001125.root
compressed_data_dl1_fstrmBNBMAJORITY_run9435_25_20230131T001131.root
compressed_data_dl8_fstrmBNBMAJORITY_run9435_25_20230130T235736.root
compressed_data_dl4_fstrmBNBMAJORITY_run9435_25_20230131T000230.root
compressed_data_dl2_fstrmBNBMAJORITY_run9435_21_20230130T201358.root
compressed_data_dl3_fstrmBNBMAJORITY_run9435_26_20230131T000314.root
compressed_data_dl10_fstrmBNBMAJORITY_run9435_25_20230131T001451.root
mt82 commented 3 weeks ago

Mateus F. Carneiro Aug 30th at 4:24 PM Hi Matteo, it's not expected but I can imagine my code failing in copying the files to the correct location. Or some other failure mode. I think @Promita Roy also came across this issue with job failing for the same reason. I will investigate.