search

iris-hep / idap-200gbps

MIT License
3 stars 4 forks source link

clean zstd_files.json #12

Closed btovar closed 5 months ago

btovar commented 5 months ago

removed 3 datasets with no valid files removed other files that could not be processed

oshadura commented 5 months ago

@btovar it is hard to see diff, could you please post which datasets you have removed?

btovar commented 5 months ago

This is replacing the repo file with the one from xrdcp, so there are tons of additions. From the xrdcp there are the datasets removed:

fileset /TTJets_SingleLeptFromT_TuneCP5_13TeV-madgraphMLM-pythia8\/RunIISummer20UL17NanoAODv9-106X_mc2017_realistic_v9-v1/NANOAODSIM has no good files!
fileset /QCD_Pt_80to120_TuneCP5_13TeV_pythia8\/RunIISummer20UL17NanoAODv9-20UL17JMENano_106X_mc2017_realistic_v9-v1/NANOAODSIM has no good files!
fileset /SMS-T5qqqqHg_TuneCP5_13TeV-madgraphMLM-pythia8\/RunIISummer20UL18NanoAODv9-FSUL18_FSUL18_106X_upgrade2018_realistic_v16_L1v1-v1/NANOAODSIM has no good files!

They were the last three datasets in the file. The json file in the pr was generated from the results of a preprocessing step, so there could be other files removed. I can check if needed.