move to int32 for hit indices

[fwyzard]

Validation summary

Reference release CMSSW_11_2_0_pre10 at 6c149b2963ee Development branch cms-patatrack/master at 47423b3df7e0 Testing branch cms-patatrack/master at 47423b3df7e0 with PRs:

• 583 at 7877d3a93f9d

Validation plots

/RelValTTbar_14TeV/CMSSW_11_2_0_pre7-PU_112X_mcRun3_2021_realistic_v8-v1/GEN-SIM-DIGI-RAW

• tracking validation plots and summary for workflow 11634.5
• :warning: tracking validation plots and summary for workflow 11634.501 are missing
• tracking validation plots and summary for workflow 11634.502
• :warning: tracking validation plots and summary for workflow 11634.505 are missing
• tracking validation plots and summary for workflow 11634.506

/RelValZMM_14/CMSSW_11_2_0_pre7-112X_mcRun3_2021_realistic_v8-v2/GEN-SIM-DIGI-RAW

• tracking validation plots and summary for workflow 11634.5
• tracking validation plots and summary for workflow 11634.501
• tracking validation plots and summary for workflow 11634.502
• tracking validation plots and summary for workflow 11634.505
• tracking validation plots and summary for workflow 11634.506

/RelValZEE_14/CMSSW_11_2_0_pre7-112X_mcRun3_2021_realistic_v8-v1/GEN-SIM-DIGI-RAW

• tracking validation plots and summary for workflow 11634.5
• tracking validation plots and summary for workflow 11634.501
• tracking validation plots and summary for workflow 11634.502
• tracking validation plots and summary for workflow 11634.505
• tracking validation plots and summary for workflow 11634.506

Validation plots (CPU vs GPU)

/RelValTTbar_14TeV/CMSSW_11_2_0_pre7-PU_112X_mcRun3_2021_realistic_v8-v1/GEN-SIM-DIGI-RAW

• :warning: tracking validation plots and summary for workflows 11634.502 and 11634.501 are missing
• :warning: tracking validation plots and summary for workflows 11634.506 and 11634.505 are missing

/RelValZMM_14/CMSSW_11_2_0_pre7-112X_mcRun3_2021_realistic_v8-v2/GEN-SIM-DIGI-RAW

• tracking validation plots and summary for workflows 11634.502 and 11634.501
• tracking validation plots and summary for workflows 11634.506 and 11634.505

/RelValZEE_14/CMSSW_11_2_0_pre7-112X_mcRun3_2021_realistic_v8-v1/GEN-SIM-DIGI-RAW

• tracking validation plots and summary for workflows 11634.502 and 11634.501
• tracking validation plots and summary for workflows 11634.506 and 11634.505

Throughput plots

/EphemeralHLTPhysics1/Run2018D-v1/RAW run=323775 lumi=53

logs and nvprof/nvvp profiles

/RelValTTbar_14TeV/CMSSW_11_2_0_pre7-PU_112X_mcRun3_2021_realistic_v8-v1/GEN-SIM-DIGI-RAW

• reference release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.501
  • :x: step3.py: log
• development release, workflow 11634.502
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 11634.505
  • :x: step3.py: log
• development release, workflow 11634.506
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 11634.511
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.512
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
• development release, workflow 11634.521
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.522
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 136.885502
• development release, workflow 136.885512
• development release, workflow 136.885522
• testing release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.501
  • :x: step3.py: log
• testing release, workflow 11634.502
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 11634.505
  • :x: step3.py: log
• testing release, workflow 11634.506
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 11634.511
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.512
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
• testing release, workflow 11634.521
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.522
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 136.885502
• testing release, workflow 136.885512
• testing release, workflow 136.885522

/RelValZMM_14/CMSSW_11_2_0_pre7-112X_mcRun3_2021_realistic_v8-v2/GEN-SIM-DIGI-RAW

• reference release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.501
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.502
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 11634.505
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.506
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 11634.511
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.512
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
• development release, workflow 11634.521
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.522
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 136.885502
• development release, workflow 136.885512
• development release, workflow 136.885522
• testing release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.501
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.502
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 11634.505
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.506
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 11634.511
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.512
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
• testing release, workflow 11634.521
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.522
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 136.885502
• testing release, workflow 136.885512
• testing release, workflow 136.885522

/RelValZEE_14/CMSSW_11_2_0_pre7-112X_mcRun3_2021_realistic_v8-v1/GEN-SIM-DIGI-RAW

• reference release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.501
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.502
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 11634.505
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.506
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 11634.511
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.512
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
• development release, workflow 11634.521
  • :heavy_check_mark: step3.py: log
• development release, workflow 11634.522
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• development release, workflow 136.885502
• development release, workflow 136.885512
• development release, workflow 136.885522
• testing release, workflow 11634.5
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.501
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.502
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 11634.505
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.506
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 11634.511
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.512
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :x: cuda-memcheck --tool synccheck (report, log) found no CUDA-MEMCHECK results
• testing release, workflow 11634.521
  • :heavy_check_mark: step3.py: log
• testing release, workflow 11634.522
  • :heavy_check_mark: step3.py: log
  • :heavy_check_mark: profile.py: log
  • :heavy_check_mark: cuda-memcheck --tool initcheck (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
  • :heavy_check_mark: cuda-memcheck --tool synccheck (report, log) did not find any errors
• testing release, workflow 136.885502
• testing release, workflow 136.885512
• testing release, workflow 136.885522

Logs

The full log is available at https://patatrack.web.cern.ch/patatrack/validation/pulls/13a7a77294b8e32b503b6abf63fcf96c22939c56/log .

[fwyzard]

The impact on the throughput for quadruplets is around 1-2%.

No effect on the physics results, as expected.

[fwyzard]

I understand the change in data type. What does hitToTuple do ?

[VinInn]

kernel_checkOverflows is not run in standard wf hitToTuple is just a oneToMany association between hits and ntuple; it tells in which tuple a hit is. It is used mainly (only?) by the infamous shred-hit--cleaner (see #552)

in kernel_checkOverflows is just used to count (and eventually identify) the doublets that do not share any hit with an already built tracks (as requested by you in case lepton reconstruction would require them)

It is experimental code. This is why I suggested to start from #545 for the hit size issue

[fwyzard]

Throughput re-checked by hand:

Running 3 times over 4100 events with 1 jobs, each with 8 threads, 8 streams and 1 GPUs

master

• quadruplets: 1136.7 ± 6.4 ev/s
• triplets: 671.7 ± 2.9 ev/s

master + #583

• quadruplets: 1132.5 ± 4.5 ev/s

• triplets: 667.6 ± 1.6 ev/s

  In both cases the drop is less than 1%.