Unit tests + Freeze of ggF Offline

[lucalavezzo]

• added unit tests for the ntuple maker
• pushing the latest notebooks for the AN and paper plots for ggF offline
• fixed bug in jet corrections met for scouting to fix unit test
• fixed PSWeights correction to be compatible with all analyses
• there was an unnecessary copying in pandas_utils.py of the out.hdf5 to condor_out.hdf5 which had some compatibility issues between the analyses, so I removed it.

[lucalavezzo]

Example output for the unit tests:

(SUEP) [lavezzo@submit01 SUEPCoffea_dask]$ python unit_tests/test_ntuplemaker.py
Running test for run ggF-Offline ...
Found 2 options to test for run ggF-Offline
Executing command: singularity exec /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest python condor_SUEP_WS.py --infile root://xrootd.cmsaf.mit.edu//store/user/paus/nanosu/A02/QCD_Pt_800to1000_TuneCP5_13TeV_pythia8+RunIISummer20UL18MiniAODv2-106X_upgrade2018_realistic_v16_L1v1-v1+MINIAODSIM//FFAB73E1-5B63-0B43-867E-B35DB3C75E60.root --isMC 1 --era 2018 --doSyst 1 > ggF-Offline.out 2> ggF-Offline.err
PASSED! Output file for run ggF-Offline exists and is not empty.
Executing command: singularity exec /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest python condor_SUEP_WS.py --infile root://xrootd.cmsaf.mit.edu//store/user/paus/nanosu/A02/JetHT+Run2018C-UL2018_MiniAODv2-v1+MINIAOD//FFE35F7A-1786-BE4F-8AF4-66DEA58012F3.root --isMC 0 --era 2018 --doSyst 1 > ggF-Offline.out 2> ggF-Offline.err
PASSED! Output file for run ggF-Offline exists and is not empty.
All tests passed for run ggF-Offline
The test for run ggF-Offline was a SUCCESS. Time to take the ggF-Offline test: 458.7590537071228 seconds
Running test for run ggF-Scouting ...
Found 2 options to test for run ggF-Scouting
Executing command: python condor_Scouting.py --infile root://xrootd.cmsaf.mit.edu//store/user/paus/nanosc/E07/QCD_HT700to1000_TuneCP5_13TeV-madgraphMLM-pythia8+RunIISummer20UL18RECO-106X_upgrade2018_realistic_v11_L1v1-v2+AODSIM//FFEBDF0B-33D5-F84A-B899-0F8EF89FA734.root --isMC 1 --era 2018 --doSyst 1 > ggF-Scouting.out 2> ggF-Scouting.err
PASSED! Output file for run ggF-Scouting exists and is not empty.
Executing command: python condor_Scouting.py --infile root://xrootd.cmsaf.mit.edu//store/user/paus/nanosc/E08/ScoutingPFCommissioning+Run2016B-v2+RAW//FAF17B72-201D-E611-BA11-02163E012571.root --isMC 0 --era 2018 --doSyst 1 > ggF-Scouting.out 2> ggF-Scouting.err
PASSED! Output file for run ggF-Scouting exists and is not empty.
All tests passed for run ggF-Scouting
The test for run ggF-Scouting was a SUCCESS. Time to take the ggF-Scouting test: 57.724934339523315 seconds
Running test for run WH ...
Found 2 options to test for run WH
Executing command: singularity exec /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest python condor_SUEP_WH.py --infile root://xrootd.cmsaf.mit.edu//store/user/paus/nanosu/A02/QCD_Pt_800to1000_TuneCP5_13TeV_pythia8+RunIISummer20UL18MiniAODv2-106X_upgrade2018_realistic_v16_L1v1-v1+MINIAODSIM//FFAB73E1-5B63-0B43-867E-B35DB3C75E60.root --isMC 1 --era 2018 --doSyst 1 > WH.out 2> WH.err
PASSED! Output file for run WH exists and is not empty.
Executing command: singularity exec /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest python condor_SUEP_WH.py --infile root://xrootd.cmsaf.mit.edu//store/user/paus/nanosu/A02/JetHT+Run2018C-UL2018_MiniAODv2-v1+MINIAOD//FFE35F7A-1786-BE4F-8AF4-66DEA58012F3.root --isMC 0 --era 2018 --doSyst 1 > WH.out 2> WH.err
PASSED! Output file for run WH exists and is not empty.
All tests passed for run WH
The test for run WH was a SUCCESS. Time to take the WH test: 147.85839748382568 seconds

All tests were SUCCESSFUL!
Total time to take the tests: 664.3436179161072 seconds