github-actions[bot]
commented
1 year ago Benchmark results
Nexmark
- 1 out of 21 queries have regressed :exclamation:
- Compared results from 70e30f0 (main) with c944bf7 (PR) No benchmark results found for current main revision, compared against 70e30f0c21eeab8a83a6d44ddeb53a14cfb83826
| name | main~5 [kOp/s] | PR [kOp/s] | Tput change [%] | Assessment | Peak RSS diff |
|---|---|---|---|---|---|
| q0 | 3955.61 | 5466.93 | 38 | :evergreen_tree: | -2.2 MB |
| q1 | 3955.03 | 5671.88 | 43 | :evergreen_tree: | 4.0 MB |
| q2 | 3944.88 | 5646.16 | 43 | :evergreen_tree: | 14.5 MB |
| q3 | 3940.33 | 5650.3 | 43 | :evergreen_tree: | 2.7 MB |
| q4 | 3019.47 | 3367.84 | 12 | :evergreen_tree: | 14.1 MB |
| q5 | 3920.58 | 5418.28 | 38 | :evergreen_tree: | 14.1 MB |
| q6 | 3201.48 | 3737.09 | 17 | :evergreen_tree: | -189.4 MB |
| q7 | 3311.8 | 2649.73 | -20 | :small_red_triangle_down: | 4.0 GB |
| q8 | 3858.48 | 5372.39 | 39 | :evergreen_tree: | 4.0 GB |
| q9 | 595.675 | 615.329 | 3 | :heavy_check_mark: | -55.0 MB |
| q12 | 3700.73 | 5083.18 | 37 | :evergreen_tree: | -55.0 MB |
| q13 | 2676.72 | 2612.67 | -2 | :heavy_check_mark: | -55.0 MB |
| q14 | 3959.89 | 5699.34 | 44 | :evergreen_tree: | -55.0 MB |
| q15 | 3974.09 | 5246.18 | 32 | :evergreen_tree: | -55.0 MB |
| q16 | 1035.15 | 1034.3 | 0 | :heavy_check_mark: | -55.0 MB |
| q17 | 3172.77 | 3086.39 | -3 | :heavy_check_mark: | -55.0 MB |
| q18 | 863.819 | 865.261 | 0 | :heavy_check_mark: | -113.4 MB |
| q19 | 976.503 | 990.265 | 1 | :heavy_check_mark: | -113.4 MB |
| q20 | 1067.14 | 1097.84 | 3 | :heavy_check_mark: | -113.4 MB |
| q21 | 3898.52 | 5001.83 | 28 | :evergreen_tree: | -113.4 MB |
| q22 | 3953.25 | 5650.33 | 43 | :evergreen_tree: | -113.4 MB |
Galen
- Compared results from 70e30f0 (main) with c944bf7 (PR) No benchmark results found for current main revision, compared against 70e30f0c21eeab8a83a6d44ddeb53a14cfb83826
| name | main~5 [s] | PR [s] | Runtime change [%] | Assessment |
|---|---|---|---|---|
| galen | 28.0386 | 28.5209 | 2 | :heavy_check_mark: |
LDBC
- 2 out of 4 queries have regressed :exclamation:
- Compared results from 70e30f0 (main) with c944bf7 (PR) No benchmark results found for current main revision, compared against 70e30f0c21eeab8a83a6d44ddeb53a14cfb83826
| algorithm | dataset | threads | main~5 [kEVPS] | PR [kEVPS] | Tput change [%] | Assessment | Peak RSS diff |
|---|---|---|---|---|---|---|---|
| bfs | graph500-22 | 1 | 1928.1 | 1822.16 | -5 | :small_red_triangle_down: | 73.7 kB |
| bfs | datagen-8_4-fb | 6 | 7349.72 | 8050.01 | 10 | :evergreen_tree: | 92.7 MB |
| pagerank | graph500-22 | 1 | 689.058 | 687.766 | 0 | :heavy_check_mark: | -163.8 kB |
| pagerank | datagen-8_4-fb | 6 | 1942.89 | 1765.17 | -9 | :small_red_triangle_down: | -72.8 MB |
Nexmark (with Persistence)
- 2 out of 21 queries have regressed :exclamation:
- Compared results from 70e30f0 (main) with c944bf7 (PR) No benchmark results found for current main revision, compared against 70e30f0c21eeab8a83a6d44ddeb53a14cfb83826
| name | main~5 [kOp/s] | PR [kOp/s] | Tput change [%] | PR DRAM [kOp/s] | DRAM diff [%] | Assessment |
|---|---|---|---|---|---|---|
| q0 | 2431.49 | 2463.07 | 1 | 2377.22 | 4 | :heavy_check_mark: |
| q1 | 1721.28 | 1744.39 | 1 | 1695.86 | 3 | :heavy_check_mark: |
| q2 | 2449.58 | 2165.88 | -12 | 2370 | -9 | :small_red_triangle_down: |
| q3 | 2038.26 | 1850.57 | -9 | 2277 | -19 | :small_red_triangle_down: |
| q4 | 366.764 | 361.146 | -2 | 1400.14 | -74 | :heavy_check_mark: |
| q5 | 2056.88 | 2030.7 | -1 | 2269.4 | -11 | :heavy_check_mark: |
| q6 | 338.324 | 331.829 | -2 | 1377.37 | -76 | :heavy_check_mark: |
| q7 | 257.515 | 258.52 | 0 | 1271.49 | -80 | :heavy_check_mark: |
| q8 | 2152.45 | 2142.46 | 0 | 2236.68 | -4 | :heavy_check_mark: |
| q9 | 33.4863 | 33.1514 | -1 | 379.508 | -91 | :heavy_check_mark: |
| q12 | 879.989 | 851.34 | -3 | 1796.26 | -53 | :heavy_check_mark: |
| q13 | 442.696 | 447.497 | 1 | 996.955 | -55 | :heavy_check_mark: |
| q14 | 1681.35 | 1685.95 | 0 | 1692.07 | 0 | :heavy_check_mark: |
| q15 | 199.394 | 198.342 | -1 | 1191.65 | -83 | :heavy_check_mark: |
| q16 | 26.9479 | 27.2317 | 1 | 289.059 | -91 | :heavy_check_mark: |
| q17 | 83.5887 | 81.4237 | -3 | 796.782 | -90 | :heavy_check_mark: |
| q18 | 60.8776 | 60.7841 | 0 | 804.361 | -92 | :heavy_check_mark: |
| q19 | 68.601 | 68.1344 | -1 | 676.921 | -90 | :heavy_check_mark: |
| q20 | 169.917 | 168.742 | -1 | 942.132 | -82 | :heavy_check_mark: |
| q21 | 1524.89 | 1518.08 | 0 | 1505.65 | 1 | :heavy_check_mark: |
| q22 | 2122.34 | 2096.42 | -1 | 1999.83 | 5 | :heavy_check_mark: |
Codecov Report
Additional details and impacted files
[](https://codecov.io/gh/vmware/database-stream-processor/pull/331?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #331 +/- ## ======================================= Coverage 77.76% 77.76% ======================================= Files 166 166 Lines 32646 32646 ======================================= Hits 25386 25386 Misses 7260 7260 ``` [see 2 files with indirect coverage changes](https://codecov.io/gh/vmware/database-stream-processor/pull/331/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)