search

plctlab / llvm-ci

https://lnt.rvperf.org
4 stars 2 forks source link

Regressions Report [rv64gc-O3-thinlto] April 13th 2023, 6:43:05 am #117

Closed github-actions[bot] closed 1 year ago

github-actions[bot] commented 1 year ago

Metadata

b356cd70a27dd5be2cbcc72e9f1ac56f1fb788cb [hwasan] remove requirment for PIE 246f8d4be521924ce94755a712cc473ee4e68e14 [NFC][IRCE] Remove meaningless local variable 1290d0ddce55bba97d142dd769bbf2364d765e33 [NFC][m68k] Remove the lingering codebeads-related part in M68kInstrFormats.td bb5befefc6e76330120d8fe3e6f4f27f9e0989f0 Revert "[CodeGen][ShrinkWrap] Split restore point" 6530bd3030d3708fb5eeaecda352448912e6d647 [BranchRelaxation] Correct JumpToFT value d093d34c33d5ba2faa5430d88d1698304e102da7 [IRCE][NFC] Remove unused variable IsSigned 3974ecb7ec05ce63e8075b7bc8de921dd135823a [mlir][affine] SuperVectorizer only widen ops with valid types aea2a147363197f3cef140ebcd27b534fd41877b [LoopUnroll] Prevent LoopFullUnrollPass to perform partial/runtime unrolling 18bfc92aac4fc382ca41c235dea3b61481996171 [JITLink] Remove a stale comment.

Regressions (Size)

Name Baseline MD5 Current MD5 Baseline Size Current Size Ratio
MultiSource/Applications/kimwitu++/kc e2bdcc3f2de9524110f2b7889b6cc4d2 609f1601702366dd97ffe6a34a7cf765 395754 396090 1.001

Regressions (Time)

Name Baseline MD5 Current MD5 Baseline Time Current Time Ratio
MultiSource/Benchmarks/Olden/health/health 7a41ae8e5b2d9592e09ef948061c54e9 58480d50fbbe1d1571f96078da5b5603 0.736307114 0.92076911 1.251
MultiSource/Benchmarks/McCat/17-bintr/bintr a17b040fcd6ec4c536378e0d51b810be b2018279e57ec3031a90111f9ed95e07 0.141117066 0.162694406 1.153
MultiSource/Benchmarks/Olden/bisort/bisort 5555dd56b01e2f9848b6ee52d00d10cf 961455708b79a1a2097af45340c2368d 1.180128227 1.189565411 1.008
MultiSource/Applications/SPASS/SPASS 25e046fecf66f5aae7bc7e1d95e3d4d6 471e980c5624fc39c55129687e0b94b3 13.29321303 13.357390476 1.005
SingleSource/Benchmarks/Misc-C++/stepanov_container b02dce415791deb446c27e132829b8a5 843057ee20a98d8e85981fb24ee665c4 5.151900403 5.162248915 1.002
MultiSource/Applications/sqlite3/sqlite3 5a913142c642354fdb9e9f559f9fbeea 959487f8ff579f47e0d6a4702a8ef2b1 18.372325127 18.382121909 1.001
MultiSource/Benchmarks/Olden/voronoi/voronoi dbcc26ebae4bad6f6eaf96724f85c0a2 8909e62a62acac878a4afb2b227cde0f 1.218784164 1.219308452 1.000
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 b6b6ca7ecf1bdc1a7826b0e8a9f836a6 f4ed75b26a6c868641d8c2065acf05d3 1.057698073 1.057729785 1.000
MultiSource/Benchmarks/lzbench/lzbench c048b1898d56084a9ebb92433b283993 0cd196683ec140961a32ba9b6a0c4526 483.933606247 483.93653709 1.000
MultiSource/Benchmarks/DOE-ProxyApps-C++/miniFE/miniFE a0415ede1ea28e13ad030e1cb137bcf7 c9c21cfb21b323f0f4b1d7861e0d098b 21.731563538 21.731662398 1.000
MicroBenchmarks/LoopInterchange/LoopInterchange f26a2d5d1754a4a423268dadfbe920ab bb019721a7a01a4fd6fb763cab11ab73 1.197671644 1.197673644 1.000
MicroBenchmarks/MemFunctions/MemFunctions f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 158.501482896 158.501683132 1.000
MultiSource/Benchmarks/VersaBench/dbms/dbms 0d881c2b0070b8ce1ffe8195af3ff934 65d7d5ad485d8be9ae3afcd3497cb23e 3.728825094 3.728829574 1.000
MultiSource/Benchmarks/DOE-ProxyApps-C++/CLAMR/CLAMR 08c1233b2e674ed4450f59c95432ac04 b699841740cdf3b0508d0783ad9a7c94 7.148274929 7.148282147 1.000
MicroBenchmarks/SLPVectorization/SLPVectorizationBenchmarks e4f807ed8d4086e6a0e67e673e54b4d3 a0cbf0d705f43bdcdcf0634a3a2e688b 18.818853155 18.818867577 1.000
MicroBenchmarks/LoopVectorization/LoopVectorizationBenchmarks d004e181c0a9145e41aec75890379ada cdb1b55f2f5e48a49b89d3ab0d0f6a86 158.449107157 158.449213925 1.000
MicroBenchmarks/ImageProcessing/BilateralFiltering/BilateralFilter ede1082c055e40f0b45e31574da7fb48 bda8d736c270cacdf0fc2561901624b7 5.546285274 5.546288814 1.000
MicroBenchmarks/ImageProcessing/Dilate/Dilate ddcb6cb609c0f32f8e6dfc6c4ce12905 f960aba36aebac9b871fb4da14c736e8 4.785853455 4.785856255 1.000
MicroBenchmarks/RNG/RandomGeneratorBenchmarks 7f25c6386a188a70a01358bc7827b73a 38a85bea67cc6bc3da51bc313d7039f2 12.927100198 12.927106681 1.000
MicroBenchmarks/ImageProcessing/AnisotropicDiffusion/AnisotropicDiffusion 163ec284ce974188b728e5cc806119b1 83a1e14bd3c6fdf736aa2dd6ec43419d 5.045642412 5.045644918 1.000

Differences (Size)

Name Baseline MD5 Current MD5 Baseline Size Current Size Ratio
MultiSource/Applications/kimwitu++/kc e2bdcc3f2de9524110f2b7889b6cc4d2 609f1601702366dd97ffe6a34a7cf765 395754 396090 1.001
MultiSource/Benchmarks/Olden/health/health 7a41ae8e5b2d9592e09ef948061c54e9 58480d50fbbe1d1571f96078da5b5603 4740 4744 1.001
MultiSource/Applications/lambda-0.1.3/lambda cebac6d137d3731b1b40d744bfb7f356 f445700359dfc611e1ea5587bbc2af67 19660 19662 1.000
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset 889e1216cceb0f7ca27e498bdcf0bb6f bcf2409c38d38c4bc0fc698be3147560 489572 489580 1.000
MicroBenchmarks/Builtins/Int128/Builtins 7a6cd71a598b9707484ba146c399fe28 70b7599afe662feb46077858ccfb1cdf 196306 196306 1.000
MicroBenchmarks/ImageProcessing/AnisotropicDiffusion/AnisotropicDiffusion 163ec284ce974188b728e5cc806119b1 83a1e14bd3c6fdf736aa2dd6ec43419d 193818 193818 1.000
MicroBenchmarks/ImageProcessing/BilateralFiltering/BilateralFilter ede1082c055e40f0b45e31574da7fb48 bda8d736c270cacdf0fc2561901624b7 193874 193874 1.000
MicroBenchmarks/ImageProcessing/Blur/blur 8713d22ef729dfb9e1b4121e54b5693a 9977fbfc4e5e02d078d125e4515a073f 198246 198246 1.000
MicroBenchmarks/ImageProcessing/Dilate/Dilate ddcb6cb609c0f32f8e6dfc6c4ce12905 f960aba36aebac9b871fb4da14c736e8 198474 198474 1.000
MicroBenchmarks/ImageProcessing/Dither/Dither 2731b4460f5b28e514dcc4bc2bc8ef2b 9e38bed288a0f3fc6a24d34069cea3e3 203234 203234 1.000
MicroBenchmarks/ImageProcessing/Interpolation/Interpolation 59fa4a35de834efffcf2e5bb0b76c93c 055052f72fcb6b8e186de2bc4a26eb8b 195302 195302 1.000
MicroBenchmarks/LCALS/SubsetALambdaLoops/lcalsALambda fca960dbcba8b8be518746f3f440d65f b97e12ce9c46db8bfa820358e3bf4f9c 401430 401430 1.000
MicroBenchmarks/LCALS/SubsetARawLoops/lcalsARaw ad98d839c2eb59f283d91eca79b80856 fd596ba86838df5e0f1d6e0f88f9a046 401346 401346 1.000
MicroBenchmarks/LCALS/SubsetBLambdaLoops/lcalsBLambda 2402690ebe822d5b580c449b73e6c8bc ce07400712ea58a351d8a6465762092b 394302 394302 1.000
MicroBenchmarks/LCALS/SubsetBRawLoops/lcalsBRaw 58a8f0ec7753d64d7ae049b6fbc93540 6dc4cf7e1fcc2a11439d3af30321b14f 393862 393862 1.000
MicroBenchmarks/LCALS/SubsetCLambdaLoops/lcalsCLambda d078385d0167573f92f2a74c89dbddb8 fc908782b29b017edc7e0ca6d9a66428 420034 420034 1.000
MicroBenchmarks/LCALS/SubsetCRawLoops/lcalsCRaw f4434eaeabf5185c013dd1acb29ff74a b0277fe5960f3048e1794fdef3276137 419766 419766 1.000
MicroBenchmarks/LoopInterchange/LoopInterchange f26a2d5d1754a4a423268dadfbe920ab bb019721a7a01a4fd6fb763cab11ab73 189570 189570 1.000
MicroBenchmarks/LoopVectorization/LoopVectorizationBenchmarks d004e181c0a9145e41aec75890379ada cdb1b55f2f5e48a49b89d3ab0d0f6a86 313842 313842 1.000
MicroBenchmarks/MemFunctions/MemFunctions f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 357890 357890 1.000
MultiSource/Benchmarks/Prolangs-C/bison/mybison 8cdbb66216658f61b8985124c236ae99 ce69379d094d82faa18477cce2f254f2 68694 68694 1.000
MultiSource/Benchmarks/Ptrdist/bc/bc 2fc36f0906b1c8ca0cbd4bed4e324b3c 8ad11b9e118114c779e83dbf2bea23e9 63358 63358 1.000
MultiSource/Benchmarks/Rodinia/pathfinder/pathfinder 0de223a56f4cdfd30b77d7b930eca4b9 fedb778079076e74f07340d089704019 3654 3654 1.000
MultiSource/Benchmarks/SciMark2-C/scimark2 8872b6c44aaa2f895ba9df8134ed416a b32577f85da6db629002df6f569361d3 45106 45106 1.000
MultiSource/Benchmarks/VersaBench/dbms/dbms 0d881c2b0070b8ce1ffe8195af3ff934 65d7d5ad485d8be9ae3afcd3497cb23e 19574 19574 1.000
MultiSource/Benchmarks/mafft/pairlocalalign 52f1c1fea89bebebfaa73b8f29c7612d d53bd6b45b905f8cef69c7e606633b1c 298766 298766 1.000
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg b5906b204cf9558933de8a23da5498db 4c42a382131073829e1dc840e10f73a9 88926 88926 1.000
MultiSource/Benchmarks/nbench/nbench 205e6ce068742263c9b2214d178bba29 46fe5bb4c406a4ae615c6df6374fe8c4 86460 86460 1.000
SingleSource/Benchmarks/Misc-C++/stepanov_container b02dce415791deb446c27e132829b8a5 843057ee20a98d8e85981fb24ee665c4 20536 20536 1.000
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 b6b6ca7ecf1bdc1a7826b0e8a9f836a6 f4ed75b26a6c868641d8c2065acf05d3 881572 881568 1.000
MultiSource/Benchmarks/lzbench/lzbench c048b1898d56084a9ebb92433b283993 0cd196683ec140961a32ba9b6a0c4526 3464072 3464048 1.000
MultiSource/Benchmarks/7zip/7zip-benchmark 7dc1267955f67cbf899ddf43405460a9 b7518c0f543e268ada130dbb81ded60a 1079186 1079178 1.000
MultiSource/Applications/lua/lua 20464160785aef97a49321c0c51c4b81 0a2cee4a8e370e32772c1c116354ae5b 263456 263452 1.000
MultiSource/Applications/ClamAV/clamscan 347243928d1e98a393242f5ea426bfa9 4fa2037dfc9fec3f51ac6e3f7298c81b 569210 569198 1.000
MultiSource/Applications/oggenc/oggenc 9f5a5726fb3c985640f3a2e5a0d9ca5f e18ad5009ac8d17873921ad57597344a 188944 188940 1.000
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 3030e310f1ec4155c58d9d01cc70bc05 464fbf4c92ec1f0a09789c3e6dc7940b 185124 185120 1.000
MultiSource/Applications/SPASS/SPASS 25e046fecf66f5aae7bc7e1d95e3d4d6 471e980c5624fc39c55129687e0b94b3 543674 543654 1.000
MultiSource/Applications/sqlite3/sqlite3 5a913142c642354fdb9e9f559f9fbeea 959487f8ff579f47e0d6a4702a8ef2b1 463200 463172 1.000
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame 733d1ee5bb249e55e94458db29fe7be1 b0252c0ca437a29594cc05c12a2742a1 178042 178030 1.000
MultiSource/Benchmarks/DOE-ProxyApps-C/Pathfinder/PathFinder 0be62084080f4791e995390b8e3fc937 14a1b1f2b035a88bc16d2ded6573e9ba 23480 23472 1.000
GeoMeans N/A N/A 233225.800 233244.566 1.000

Differences (Time)

Name Baseline MD5 Current MD5 Baseline Time Current Time Ratio
MultiSource/Benchmarks/Olden/health/health 7a41ae8e5b2d9592e09ef948061c54e9 58480d50fbbe1d1571f96078da5b5603 0.736307114 0.92076911 1.251
MultiSource/Benchmarks/McCat/17-bintr/bintr a17b040fcd6ec4c536378e0d51b810be b2018279e57ec3031a90111f9ed95e07 0.141117066 0.162694406 1.153
MultiSource/Benchmarks/Olden/bisort/bisort 5555dd56b01e2f9848b6ee52d00d10cf 961455708b79a1a2097af45340c2368d 1.180128227 1.189565411 1.008
MultiSource/Applications/SPASS/SPASS 25e046fecf66f5aae7bc7e1d95e3d4d6 471e980c5624fc39c55129687e0b94b3 13.29321303 13.357390476 1.005
SingleSource/Benchmarks/Misc-C++/stepanov_container b02dce415791deb446c27e132829b8a5 843057ee20a98d8e85981fb24ee665c4 5.151900403 5.162248915 1.002
MultiSource/Applications/sqlite3/sqlite3 5a913142c642354fdb9e9f559f9fbeea 959487f8ff579f47e0d6a4702a8ef2b1 18.372325127 18.382121909 1.001
MultiSource/Benchmarks/Olden/voronoi/voronoi dbcc26ebae4bad6f6eaf96724f85c0a2 8909e62a62acac878a4afb2b227cde0f 1.218784164 1.219308452 1.000
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 b6b6ca7ecf1bdc1a7826b0e8a9f836a6 f4ed75b26a6c868641d8c2065acf05d3 1.057698073 1.057729785 1.000
MultiSource/Applications/kimwitu++/kc e2bdcc3f2de9524110f2b7889b6cc4d2 609f1601702366dd97ffe6a34a7cf765 0.083412672 0.083413656 1.000
MultiSource/Benchmarks/lzbench/lzbench c048b1898d56084a9ebb92433b283993 0cd196683ec140961a32ba9b6a0c4526 483.933606247 483.93653709 1.000
MultiSource/Benchmarks/DOE-ProxyApps-C++/miniFE/miniFE a0415ede1ea28e13ad030e1cb137bcf7 c9c21cfb21b323f0f4b1d7861e0d098b 21.731563538 21.731662398 1.000
MicroBenchmarks/LoopInterchange/LoopInterchange f26a2d5d1754a4a423268dadfbe920ab bb019721a7a01a4fd6fb763cab11ab73 1.197671644 1.197673644 1.000
MicroBenchmarks/MemFunctions/MemFunctions f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 158.501482896 158.501683132 1.000
MultiSource/Benchmarks/VersaBench/dbms/dbms 0d881c2b0070b8ce1ffe8195af3ff934 65d7d5ad485d8be9ae3afcd3497cb23e 3.728825094 3.728829574 1.000
MultiSource/Benchmarks/DOE-ProxyApps-C++/CLAMR/CLAMR 08c1233b2e674ed4450f59c95432ac04 b699841740cdf3b0508d0783ad9a7c94 7.148274929 7.148282147 1.000
MicroBenchmarks/SLPVectorization/SLPVectorizationBenchmarks e4f807ed8d4086e6a0e67e673e54b4d3 a0cbf0d705f43bdcdcf0634a3a2e688b 18.818853155 18.818867577 1.000
MicroBenchmarks/LoopVectorization/LoopVectorizationBenchmarks d004e181c0a9145e41aec75890379ada cdb1b55f2f5e48a49b89d3ab0d0f6a86 158.449107157 158.449213925 1.000
MicroBenchmarks/ImageProcessing/BilateralFiltering/BilateralFilter ede1082c055e40f0b45e31574da7fb48 bda8d736c270cacdf0fc2561901624b7 5.546285274 5.546288814 1.000
MicroBenchmarks/ImageProcessing/Dilate/Dilate ddcb6cb609c0f32f8e6dfc6c4ce12905 f960aba36aebac9b871fb4da14c736e8 4.785853455 4.785856255 1.000
MultiSource/Applications/ClamAV/clamscan 347243928d1e98a393242f5ea426bfa9 4fa2037dfc9fec3f51ac6e3f7298c81b 0.459570964 0.459571212 1.000
MicroBenchmarks/MemFunctions/MemFunctions.test:BM_MemCmp<8, LessThanZero, None> f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 47108.009489199285 47108.009489198324 1.000
MicroBenchmarks/MemFunctions/MemFunctions.test:BM_MemCmp<31, LessThanZero, Mid> f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 15738.003170106822 15738.0031701065 1.000
MicroBenchmarks/LCALS/SubsetALambdaLoops/lcalsALambda.test:BM_PRESSURE_CALC_LAMBDA/5001 fca960dbcba8b8be518746f3f440d65f b97e12ce9c46db8bfa820358e3bf4f9c 120.67902878814118 120.67902878813871 1.000
MicroBenchmarks/LCALS/SubsetCRawLoops/lcalsCRaw.test:BM_MAT_X_MAT_RAW/44217 f4434eaeabf5185c013dd1acb29ff74a b0277fe5960f3048e1794fdef3276137 262547.1096666748 262547.1096666653 1.000
MicroBenchmarks/MemFunctions/MemFunctions.test:BM_MemCmp<63, LessThanZero, First> f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 2867.0005774949304 2867.0005774948145 1.000
MicroBenchmarks/LCALS/SubsetCLambdaLoops/lcalsCLambda.test:BM_FIND_FIRST_MIN_LAMBDA/44217 d078385d0167573f92f2a74c89dbddb8 fc908782b29b017edc7e0ca6d9a66428 486.3881000694987 486.388100069479 1.000
MicroBenchmarks/LCALS/SubsetCRawLoops/lcalsCRaw.test:BM_HYDRO_2D_RAW/5001 f4434eaeabf5185c013dd1acb29ff74a b0277fe5960f3048e1794fdef3276137 2456.9170701754542 2456.9170701753546 1.000
MicroBenchmarks/LCALS/SubsetCRawLoops/lcalsCRaw.test:BM_FIND_FIRST_MIN_RAW/5001 f4434eaeabf5185c013dd1acb29ff74a b0277fe5960f3048e1794fdef3276137 55.00801155206368 55.00801155206145 1.000
MicroBenchmarks/LoopVectorization/LoopVectorizationBenchmarks.test:benchForTruncOrZextVecWithAddInLoopWithVW16From_uint32_t_To_uint64t d004e181c0a9145e41aec75890379ada cdb1b55f2f5e48a49b89d3ab0d0f6a86 42006.00864138269 42006.008641380984 1.000
MicroBenchmarks/MemFunctions/MemFunctions.test:BM_MemCmp<64, EqZero, Mid> f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 5124.001032120334 5124.001032120126 1.000
MicroBenchmarks/MemFunctions/MemFunctions.test:BM_MemCmp<64, LessThanZero, None> f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 5316.001070794091 5316.001070793875 1.000
MicroBenchmarks/LCALS/SubsetCLambdaLoops/lcalsCLambda.test:BM_GEN_LIN_RECUR_LAMBDA/44217 d078385d0167573f92f2a74c89dbddb8 fc908782b29b017edc7e0ca6d9a66428 729.5991845672763 729.5991845672467 1.000
MicroBenchmarks/LCALS/SubsetCRawLoops/lcalsCRaw.test:BM_PIC_2D_RAW/171 f4434eaeabf5185c013dd1acb29ff74a b0277fe5960f3048e1794fdef3276137 10.353002248088623 10.353002248088202 1.000
MicroBenchmarks/LCALS/SubsetCRawLoops/lcalsCRaw.test:BM_PIC_1D_RAW/171 f4434eaeabf5185c013dd1acb29ff74a b0277fe5960f3048e1794fdef3276137 9.712002497364198 9.712002497363803 1.000
MicroBenchmarks/LCALS/SubsetCRawLoops/lcalsCRaw.test:BM_IMP_HYDRO_2D_RAW/5001 f4434eaeabf5185c013dd1acb29ff74a b0277fe5960f3048e1794fdef3276137 481.34921045392724 481.3492104539077 1.000
MicroBenchmarks/LoopVectorization/LoopVectorizationBenchmarks.test:benchForTruncOrZextVecInLoopWithVW8From_uint32_t_To_uint64t d004e181c0a9145e41aec75890379ada cdb1b55f2f5e48a49b89d3ab0d0f6a86 21606.00444471957 21606.004444718692 1.000
MicroBenchmarks/LoopVectorization/LoopVectorizationBenchmarks.test:benchForTruncOrZextVecInLoopFrom_uint32_t_To_uint64t d004e181c0a9145e41aec75890379ada cdb1b55f2f5e48a49b89d3ab0d0f6a86 21606.00444471957 21606.004444718692 1.000
MicroBenchmarks/MemFunctions/MemFunctions.test:BM_MemCmp<32, EqZero, None> f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 8324.001676695343 8324.001676695005 1.000
MicroBenchmarks/MemFunctions/MemFunctions.test:BM_MemCmp<63, GreaterThanZero, Mid> f55d958ff715df0a140b1be5af987ffa fdfc7c57bbfc0a47f9475f00b1dbe58b 8404.001692799076 8404.001692798733 1.000
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame 733d1ee5bb249e55e94458db29fe7be1 b0252c0ca437a29594cc05c12a2742a1 0.777409726 0.77693624 0.999
GeoMeans N/A N/A 1214.132 1216.316 1.002
dtcxzyw commented 1 year ago

Duplicate of #119