UTSASRG / Scaler

GNU General Public License v2.0
4 stars 0 forks source link

Compare with perf vtune based on invocation count #82

Closed GammaPi closed 1 year ago

GammaPi commented 1 year ago

Vtune does cannot report call count. https://community.intel.com/t5/Analyzers/Counting-function-calls/m-p/1186254

We estimated call count using perf script, the results are as follows:

/media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.blackscholes_0/Perf-Artifects/script.txt |   |   |   |   |   -- | -- | -- | -- | -- | -- LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 11 | 0.00005970894603 | 0.00005970894603 /lib/x86_64-linux-gnu/libc-2.27.so | 20000021 | 0.003984067762 | 63421 | 0.3442546424 | 0.3402705746 /lib/x86_64-linux-gnu/libm-2.27.so | 5000000124 | 0.9960159193 | 120273 | 0.6528521878 | 0.3431637315 /lib/x86_64-linux-gnu/libpthread-2.27.so | 65 | 0.00000001294820663 | 522 | 0.002833460893 | 0.002833447945 Mean |   |   |   |   | 0.1715818658 Max |   |   |   |   | 0.3431637315   |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.bodytrack_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 24 | 0.0001593784241 | 0.0001593784241 /lib/x86_64-linux-gnu/libc-2.27.so | 531735540 | 0.2388169818 | 24015 | 0.1594780357 | 0.07933894615 /lib/x86_64-linux-gnu/libm-2.27.so | 1688207580 | 0.7582202215 | 67510 | 0.4483182256 | 0.3099019959 /lib/x86_64-linux-gnu/libpthread-2.27.so | 6596682 | 0.002962750403 | 58934 | 0.391367002 | 0.3884042516 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 103 | 0.00000004626011857 | 102 | 0.0006773583026 | 0.0006773120425 Mean |   |   |   |   | 0.1556963768 Max |   |   |   |   | 0.3884042516   |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.canneal_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 18 | 0.0001608895404 | 0.0001608895404 /lib/x86_64-linux-gnu/libc-2.27.so | 13658357 | 0.02055329539 | 41783 | 0.3734693148 | 0.3529160194 /lib/x86_64-linux-gnu/libm-2.27.so | 85918675 | 0.1292916788 | 6917 | 0.06182627505 | 0.06746540378 /lib/x86_64-linux-gnu/libpthread-2.27.so | 384194 | 0.0005781407506 | 22998 | 0.2055632028 | 0.204985062 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 564572453 | 0.849576885 | 40162 | 0.3589803178 | 0.4905965672 Mean |   |   |   |   | 0.2232247884 Max |   |   |   |   | 0.4905965672   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.dedup_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 12 | 0.0000255109091 | 0.0000255109091 /lib/x86_64-linux-gnu/libc-2.27.so | 5781625 | 0.4839955107 | 289011 | 0.6144111126 | 0.1304156019 /lib/x86_64-linux-gnu/libm-2.27.so | 385 | 0.00003222939426 | 1 | 0.000002125909092 | 0.00003010348517 /lib/x86_64-linux-gnu/libpthread-2.27.so | 6163607 | 0.51597226 | 181363 | 0.3855612506 | 0.1304110093 Mean |   |   |   |   | 0.0652205564 Max |   |   |   |   | 0.1304156019   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.facesim_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 27 | 0.00002553022495 | 0.00002553022495 /lib/x86_64-linux-gnu/libc-2.27.so | 26675 | 0.000006102789267 | 216699 | 0.2049027488 | 0.204896646 /lib/x86_64-linux-gnu/libm-2.27.so | 4313540575 | 0.9868651967 | 211884 | 0.2003498586 | 0.7865153381 /lib/x86_64-linux-gnu/libpthread-2.27.so | 39473013 | 0.00903075839 | 628308 | 0.5941053547 | 0.5850745963 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 17911909 | 0.004097942118 | 652 | 0.0006165076543 | 0.003481434463 Mean |   |   |   |   | 0.315998709 Max |   |   |   |   | 0.7865153381   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.ferret_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 9 | 0.00003938179336 | 0.00003938179336 /lib/x86_64-linux-gnu/libc-2.27.so | 6769268 | 0.003118021685 | 79013 | 0.3457415154 | 0.3426234937 /lib/x86_64-linux-gnu/libm-2.27.so | 2164119046 | 0.9968241933 | 88389 | 0.3867685926 | 0.6100556007 /lib/x86_64-linux-gnu/libpthread-2.27.so | 125452 | 0.00005778498597 | 61121 | 0.2674505102 | 0.2673927252 Mean |   |   |   |   | 0.3050278004 Max |   |   |   |   | 0.6100556007   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.fluidanimate_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 163 | 0.0002078784663 | 0.0002078784663 /lib/x86_64-linux-gnu/libc-2.27.so | 143 | 0.00000001060041153 | 1319 | 0.001682157651 | 0.001682147051 /lib/x86_64-linux-gnu/libm-2.27.so | 2942388840 | 0.2181156125 | 48338 | 0.06164680556 | 0.1564688069 /lib/x86_64-linux-gnu/libpthread-2.27.so | 10538163802 | 0.7811809305 | 733740 | 0.9357591773 | 0.1545782468 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 9489523 | 0.0007034464966 | 552 | 0.0007039810639 | 0.0000005345673703 Mean |   |   |   |   | 0.06258752276 Max |   |   |   |   | 0.1564688069   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.freqmine_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 21 | 0.00354071826 | 0.00354071826 /lib/x86_64-linux-gnu/libc-2.27.so | 259580127 | 0.3935388625 | 1659 | 0.2797167425 | 0.1138221199 /lib/x86_64-linux-gnu/libpthread-2.27.so | 1 | 0.000000001516059288 | 3 | 0.0005058168943 | 0.0005058153782 /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0 | 4694 | 0.000007116382297 | 4237 | 0.7143820604 | 0.714374944 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 17474 | 0.00002649162 | 11 | 0.001854661946 | 0.001828170326 /usr/lib/x86_64-linux-gnu/libXmu.so.6.2.0 | 400002515 | 0.606427528 | 0 | 0 | 0.606427528 Mean |   |   |   |   | 0.240083216 Max |   |   |   |   | 0.714374944   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.raytrace_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 28 | 0.0003284842797 | 0.0003284842797 /lib/x86_64-linux-gnu/libc-2.27.so | 75445706 | 0.07821648753 | 51429 | 0.6033435007 | 0.5251270132 /lib/x86_64-linux-gnu/libm-2.27.so | 839025459 | 0.8698390913 | 7529 | 0.08832707649 | 0.7815120148 /lib/x86_64-linux-gnu/libpthread-2.27.so | 103986 | 0.0001078049382 | 3196 | 0.03749413421 | 0.03738632927 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 50000329 | 0.05183661625 | 23058 | 0.2705068043 | 0.2186701881 Mean |   |   |   |   | 0.3126048059 Max |   |   |   |   | 0.7815120148   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.streamcluster_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 31 | 0.00000857596158 | 0.00000857596158 /lib/x86_64-linux-gnu/libc-2.27.so | 128127214 | 0.7339685325 | 4964 | 0.001373260428 | 0.732595272 /lib/x86_64-linux-gnu/libm-2.27.so | 273 | 0.000001563863001 | 6 | 0.000001659863532 | 0.00000009600053079 /lib/x86_64-linux-gnu/libpthread-2.27.so | 46439462 | 0.2660254813 | 3609751 | 0.9986156738 | 0.7325901925 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 772 | 0.000004422352515 | 3 | 0.0000008299317658 | 0.000003592420749 Mean |   |   |   |   | 0.2930395458 Max |   |   |   |   | 0.732595272   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.swaptions_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 17 | 0.00002566630482 | 0.00002566630482 /lib/x86_64-linux-gnu/libc-2.27.so | 96002323 | 0.02564341567 | 21120 | 0.03188660928 | 0.006243193618 /lib/x86_64-linux-gnu/libm-2.27.so | 3647739127 | 0.9743565338 | 428083 | 0.6463122804 | 0.3280442534 /lib/x86_64-linux-gnu/libpthread-2.27.so | 65 | 0.00000001736230923 | 213127 | 0.321775444 | 0.3217754266 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 124 | 0.00000003312194375 | 0 | 0 | 0.00000003312194375 Mean |   |   |   |   | 0.1312177146 Max |   |   |   |   | 0.3280442534   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.vips_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 11 | 0.0001651378901 | 0.0001651378901 /lib/x86_64-linux-gnu/libc-2.27.so | 5211768 | 0.9794534887 | 14987 | 0.224992869 | 0.7544606197 /lib/x86_64-linux-gnu/libm-2.27.so | 108230 | 0.02033978701 | 21 | 0.0003152632448 | 0.02002452377 /lib/x86_64-linux-gnu/libpthread-2.27.so | 969 | 0.0001821052723 | 51592 | 0.7745267298 | 0.7743446245 /lib/x86_64-linux-gnu/libdl-2.27.so | 131 | 0.00002461897902 | 0 | 0 | 0.00002461897902 Mean |   |   |   |   | 0.309803905 Max |   |   |   |   | 0.7743446245   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.benchmarksuite.parsec.parsec3_0.x264_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 12 | 0.001074210008 | 0.001074210008 /lib/x86_64-linux-gnu/libc-2.27.so | 195399 | 0.7638711342 | 9429 | 0.8440605138 | 0.08018937963 /lib/x86_64-linux-gnu/libpthread-2.27.so | 59316 | 0.2318833781 | 1730 | 0.1548652762 | 0.07701810193 /lib/x86_64-linux-gnu/libm-2.27.so | 1086 | 0.004245487703 | 0 | 0 | 0.004245487703 Mean |   |   |   |   | 0.04063179482 Max |   |   |   |   | 0.08018937963   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.db.memcached.memcached_1_6_17_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 7 | 0.00001429846618 | 0.00001429846618 /lib/x86_64-linux-gnu/libc-2.27.so | 17219438 | 0.1656247899 | 137577 | 0.2810200117 | 0.1153952218 /lib/x86_64-linux-gnu/libpthread-2.27.so | 86742649 | 0.8343322828 | 330813 | 0.6757312133 | 0.1586010695 /usr/lib/x86_64-linux-gnu/libevent-2.1.so.6.0.2 | 4463 | 0.00004292726843 | 21166 | 0.04323447646 | 0.04319154919 Mean |   |   |   |   | 0.07930053474 Max |   |   |   |   | 0.1586010695   |   |   |   |   |     |   |   |   |   |   /media/umass/datasystem/steven/Downloads/performancetest20221124/2022-11-27_19-31-45-Perf-4000/Application.db.mysql.mysql_8_0_31_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 54 | 0.0001544246965 | 0.0001544246965 /lib/x86_64-linux-gnu/libc-2.27.so | 79838904 | 0.6868002965 | 67365 | 0.1926448089 | 0.4941554876 /lib/x86_64-linux-gnu/libgcc_s.so.1 | 536 | 0.000004610846849 | 10 | 0.00002859716602 | 0.00002398631917 /lib/x86_64-linux-gnu/libm-2.27.so | 55396 | 0.0004765344627 | 53 | 0.0001515649799 | 0.0003249694828 /lib/x86_64-linux-gnu/libpthread-2.27.so | 22745979 | 0.1956683313 | 216391 | 0.6188169352 | 0.4231486039 /lib/x86_64-linux-gnu/libdl-2.27.so | 2 | 0.00000001720465242 | 0 | 0 | 0.00000001720465242 /lib/x86_64-linux-gnu/librt-2.27.so | 2235414 | 0.01922976044 | 0 | 0 | 0.01922976044 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 | 7433319 | 0.06394383486 | 21703 | 0.06206442942 | 0.001879405447 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 | 128 | 0.000001101097755 | 0 | 0 | 0.000001101097755 /usr/lib/x86_64-linux-gnu/libssl.so.1.1 | 928594 | 0.007988068505 | 12222 | 0.03495145631 | 0.02696338781 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.29 | 3009354 | 0.02588744479 | 31887 | 0.09118778329 | 0.0653003385 Mean |   |   |   |   | 0.2234325794 Max |   |   |   |   | 0.7865153381   |   |   |   |   |     |   |   |   |   |   /2022-11-27_19-31-45-Perf-4000/Application.db.redis.redis_7_0_4_0/Perf-Artifects/script.txt |   |   |   |   |   LibraryName | Scaler | Perf Count | Percentage | Count | Percentage | Abs Diff /lib/x86_64-linux-gnu/ld-2.27.so | 0 | 0 | 11 | 0.00009630959156 | 0.00009630959156 /lib/x86_64-linux-gnu/libc-2.27.so | 473364804 | 0.9794285612 | 42329 | 0.3706080637 | 0.6088204974 /lib/x86_64-linux-gnu/libm-2.27.so | 5630898 | 0.0116507655 | 1 | 0.000008755417415 | 0.01164201008 /lib/x86_64-linux-gnu/libpthread-2.27.so | 4311425 | 0.008920673334 | 71874 | 0.6292868713 | 0.6203661979 Mean |   |   |   |   | 0.3102312538 Max |   |   |   |   | 0.6203661979
GammaPi commented 1 year ago

We further need to find several bugs that is inspired by counting data. Since sampling-based profiler cannot precisely report counting data they cannot find such bugs.