search

cms-sw / cmssw

CMS Offline Software
http://cms-sw.github.io/
Apache License 2.0
1.07k stars 4.29k forks source link

Non-reproducibility in 29634.911 #45505

Open makortel opened 2 months ago

makortel commented 2 months ago

The comparisons of workflow 29634.911 show differences randomly.

makortel commented 2 months ago

assign geometry, upgrade

cmsbuild commented 2 months ago

New categories assigned: geometry,upgrade

@Dr15Jones,@civanch,@bsunanda,@makortel,@mdhildreth,@srimanob,@subirsarkar you have been requested to review this Pull request/Issue and eventually sign? Thanks

cmsbuild commented 2 months ago

cms-bot internal usage

cmsbuild commented 2 months ago

A new Issue was created by @makortel.

@Dr15Jones, @antoniovilela, @makortel, @mandrenguyen, @rappoccio, @sextonkennedy, @smuzaffar can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

makortel commented 2 months ago

The non-reproducibility is present even after https://github.com/cms-sw/cmssw/pull/45442 was merged, I noticed it in https://github.com/cms-sw/cmssw/pull/45443#issuecomment-2237237306

srimanob commented 1 month ago

After adding 24834.911 back to the PR test, I see that 24834.911 seems to be stable. In addition, the issues seems to show up only in Tracking, EGamma, BTag, so it seems to me that it relates to geometry, and the issue just comes to the surface when we fix HGCal initialization, and rule out the issue from HGCal failure in PR test.

Issue may come from Tracker part which is also changed between D98 and D110.

perrotta commented 1 month ago

Also observed in https://github.com/cms-sw/cmssw/pull/45699