Clean up the pixel track reconstruction code

Updated EDM access:

switched to consumes() scheme for event setup;
simplified some event data access.

Style fixes:

made class member private & fixed problematic cast;
format of comments for clang-tidy;
changed to enum class to avoid creating a namespace (usage becomes: pixelTrack::Quality::loose);
added article reference in comment (it was already further down in the file);
fixed member functions and classes capitalization;
fixed one letter or upper case variable names in formulas (trying to keep the naming from the reference article).

Avoided some code repetitions.

Validation summary

Reference release CMSSW_11_3_0_pre3 at 3220826ed091 Development branch cms-patatrack/CMSSW_11_3_X_Patatrack at 0972c2f697d2 Testing branch cms-patatrack/CMSSW_11_3_X_Patatrack at 0972c2f697d2 with PRs:

606 at 846ef39496bd

Validation plots

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

Validation plots (CPU vs GPU)

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

Throughput plots

/EphemeralHLTPhysics1/Run2018D-v1/RAW run=323775 lumi=53

logs and `nvprof`/`nvvp` profiles

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :heavy_check_mark: step3.py: log
development release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :heavy_check_mark: step3.py: log
development release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :heavy_check_mark: step3.py: log
development release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

Logs

The full log is available at https://patatrack.web.cern.ch/patatrack/validation/pulls/54e450da99f3748380b353d2bc5bd5377634fd91/log .

Validation summary

606 at 6252edd97b2a

Validation plots

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

Validation plots (CPU vs GPU)

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

Throughput plots

/EphemeralHLTPhysics1/Run2018D-v1/RAW run=323775 lumi=53

scan-136.885502.png zoom-136.885502.png scan-136.885512.png zoom-136.885512.png scan-136.885522.png zoom-136.885522.png

logs and `nvprof`/`nvvp` profiles

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :heavy_check_mark: step3.py: log
development release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.506
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.511
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :heavy_check_mark: step3.py: log
development release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.506
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.511
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :heavy_check_mark: step3.py: log
development release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.506
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.511
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.512
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

Logs

The full log is available at https://patatrack.web.cern.ch/patatrack/validation/pulls/dc4a33b2b9e027ca3e74a9414b31ab501444924b/log .

Validation summary

Reference release CMSSW_11_3_0_pre5 at 23fad57b764b Development branch cms-patatrack/CMSSW_11_3_X_Patatrack at f619c431302a Testing branch cms-patatrack/CMSSW_11_3_X_Patatrack at f619c431302a with PRs:

606 at 3641bc3cbbff

Validation plots

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

Validation plots (CPU vs GPU)

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

Throughput plots

/EphemeralHLTPhysics1/Run2018D-v1/RAW run=323775 lumi=53

scan-136.885502.png zoom-136.885502.png scan-136.885512.png zoom-136.885512.png scan-136.885522.png zoom-136.885522.png

logs and `nvprof`/`nvvp` profiles

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :x: step3.py: log
development release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :x: step3.py: log
testing release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :x: step3.py: log
development release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :x: step3.py: log
testing release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :x: step3.py: log
development release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :x: step3.py: log
testing release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

Logs

The full log is available at https://patatrack.web.cern.ch/patatrack/validation/pulls/ed18a8dc6db957143d019459de96d9e4345cfb4c/log .

@ericcano Commented out vertexing steps in config customization.

Don't do that, please. This PR will be merged into the Patatrack branch, and needs to have all functionality in place.

This kind of changes should be done only in the PR for upstream CMSSW.

@ericcano Commented out vertexing steps in config customization.

Don't do that, please. This PR will be merged into the Patatrack branch, and needs to have all functionality in place.

This kind of changes should be done only in the PR for upstream CMSSW.

OK. Pushed removed (-f) the commit from the branch.

Do you think the branch is in a good shape to be tested, merged in Patatrack, and for making the upstream PR ?

Do you think the branch is in a good shape to be tested, merged in Patatrack, and for making the upstream PR ?

I just found the bug in the simplification/refactoring of work division (* instead of +). I will quickly test it and push.

Besides, the only thing left is remarks about pixHits.ipynb cleanup in: https://github.com/cms-sw/cmssw/pull/31722#pullrequestreview-560047687

Validation summary

606 at a11a73b9b1b1

Validation plots

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflow 11634.5
tracking validation plots and summary for workflow 11634.501
tracking validation plots and summary for workflow 11634.505
tracking validation plots and summary for workflow 11634.502
tracking validation plots and summary for workflow 11634.506

Validation plots (CPU vs GPU)

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

tracking validation plots and summary for workflows 11634.502 and 11634.501
tracking validation plots and summary for workflows 11634.506 and 11634.505

Throughput plots

/EphemeralHLTPhysics1/Run2018D-v1/RAW run=323775 lumi=53

scan-136.885502.png zoom-136.885502.png scan-136.885512.png zoom-136.885512.png scan-136.885522.png zoom-136.885522.png

logs and `nvprof`/`nvvp` profiles

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :x: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :x: step3.py: log
development release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :x: step3.py: log
testing release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :x: step3.py: log
development release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
development release, workflow 11634.521
- :x: step3.py: log
development release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :x: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :x: step3.py: log
testing release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :x: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) found no CUDA-MEMCHECK results
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

reference release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.5
- :heavy_check_mark: step3.py: log
development release, workflow 11634.501
- :heavy_check_mark: step3.py: log
development release, workflow 11634.505
- :heavy_check_mark: step3.py: log
development release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
development release, workflow 11634.511
- :x: step3.py: log
development release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
development release, workflow 11634.521
- :heavy_check_mark: step3.py: log
development release, workflow 11634.522
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
development release, workflow 136.885502
development release, workflow 136.885512
development release, workflow 136.885522
testing release, workflow 11634.5
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.501
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.505
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.502
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.506
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 11634.511
- :x: step3.py: log
testing release, workflow 11634.512
- :x: step3.py: log
- :x: profile.py: log, profile and summary are missing, see the full log for more information
- :warning: cuda-memcheck --tool initcheck did not run
- :warning: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
- :warning: cuda-memcheck --tool synccheck did not run
testing release, workflow 11634.521
- :heavy_check_mark: step3.py: log
testing release, workflow 11634.522
- :heavy_check_mark: step3.py: log
- :heavy_check_mark: profile.py: log
- :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
- :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
testing release, workflow 136.885502
testing release, workflow 136.885512
testing release, workflow 136.885522

Logs

The full log is available at https://patatrack.web.cern.ch/patatrack/validation/pulls/3f53ecdcf234509ddf078f779ca533b121dc9111/log .

The failures in the .511 and .512 workflows are due to using an older global tag, which is lacking the correct payloads for the ECAL reconstruction. Since this PR does not touch it, they can be ignored for the time being.

The physics results are unchanged, as expected.

The throughput seems to have a minor regression with 10-12 threads, which is unexpected but also within the uncertainty of the measurement.

We can merge the PR as is, to move forward with the integration work, but @ericcano could you run a manual comparison of the throughput before/after this PR, to confirm that the changes are not significant ?

could you run a manual comparison of the throughput before/after this PR, to confirm that the changes are not significant ?

in fact I realised only now that these throughput results are not reliable: they are done with a single job, which has a maximum I/O throughput around 1100 ev/s - so the throughput of the job that does the event processing is so close to that to be useless.

Re-running by hand with 2 jobs each with 10 threads, I get:

before: 1234.6 ± 5.9 ev/s
after: 1233.2 ± 4.4 ev/s

So there is no impact on the throughput as well (as expected).

cms-patatrack / cmssw