vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
225 stars 20 forks source link

Upgrade SQL compiler. #345

Closed ryzhyk closed 1 year ago

codecov[bot] commented 1 year ago

Codecov Report

Merging #345 (4272b1e) into main (832ce0c) will decrease coverage by 6.14%. The diff coverage is 59.99%.

Additional details and impacted files [![Impacted file tree graph](https://codecov.io/gh/vmware/database-stream-processor/pull/345/graphs/tree.svg?width=650&height=150&src=pr&token=0wZcmD11gt&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #345 +/- ## ========================================== - Coverage 79.37% 73.24% -6.14% ========================================== Files 167 227 +60 Lines 33521 46120 +12599 ========================================== + Hits 26608 33781 +7173 - Misses 6913 12339 +5426 ``` | [Impacted Files](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | Coverage Δ | | |---|---|---| | [crates/dataflow-jit/src/dataflow/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvZGF0YWZsb3cvbW9kLnJz) | `60.51% <ø> (ø)` | | | [crates/dbsp/src/lib.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL2xpYi5ycw==) | `100.00% <ø> (ø)` | | | [crates/dbsp/src/operator/time\_series/range.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL29wZXJhdG9yL3RpbWVfc2VyaWVzL3JhbmdlLnJz) | `78.28% <0.00%> (-2.07%)` | :arrow_down: | | [crates/dbsp/src/time/nested\_ts32.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RpbWUvbmVzdGVkX3RzMzIucnM=) | `72.52% <ø> (+1.09%)` | :arrow_up: | | [crates/dbsp/src/trace/layers/erased/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy9lcmFzZWQvbW9kLnJz) | `0.00% <0.00%> (ø)` | | | [crates/dbsp/src/trace/layers/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy9tb2QucnM=) | `35.71% <ø> (ø)` | | | [crates/dbsp/src/trace/layers/ordered/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy9vcmRlcmVkL21vZC5ycw==) | `74.08% <ø> (ø)` | | | [crates/dbsp/src/utils/dyn\_vec.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3V0aWxzL2R5bl92ZWMucnM=) | `53.00% <ø> (ø)` | | | [crates/dbsp/src/utils/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3V0aWxzL21vZC5ycw==) | `35.29% <ø> (-61.49%)` | :arrow_down: | | [crates/nexmark/src/generator/strings.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL25leG1hcmsvc3JjL2dlbmVyYXRvci9zdHJpbmdzLnJz) | `100.00% <ø> (ø)` | | | ... and [59 more](https://codecov.io/gh/vmware/database-stream-processor/pull/345?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | | ... and [19 files with indirect coverage changes](https://codecov.io/gh/vmware/database-stream-processor/pull/345/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)
github-actions[bot] commented 1 year ago

Benchmark results

Nexmark

name main~69 [kOp/s] PR [kOp/s] Tput change [%] Assessment Peak RSS diff
q0 5478.79 4738.05 -14 :small_red_triangle_down: 10.2 MB
q1 5398.75 5574.12 3 :heavy_check_mark: 3.5 MB
q2 5630.96 5498.08 -2 :heavy_check_mark: 4.3 MB
q3 5504.96 5481.89 0 :heavy_check_mark: -23.5 MB
q4 3341.37 3252.18 -3 :heavy_check_mark: -20.1 MB
q5 5543.82 5363.6 -3 :heavy_check_mark: -20.1 MB
q6 3697.7 3358.09 -9 :small_red_triangle_down: -160.0 MB
q7 2908 2959.97 2 :heavy_check_mark: -1.5 GB
q8 5260.06 4770.41 -9 :small_red_triangle_down: -1.5 GB
q9 627.889 600.688 -4 :heavy_check_mark: -77.5 MB
q12 4913.17 5030.72 2 :heavy_check_mark: -77.5 MB
q13 2697.28 3518.6 30 :evergreen_tree: -77.5 MB
q14 5659.87 4693.02 -17 :small_red_triangle_down: -77.5 MB
q15 5302.63 5220.43 -2 :heavy_check_mark: -77.5 MB
q16 1038.06 1038.71 0 :heavy_check_mark: -77.5 MB
q17 3140.32 3072.87 -2 :heavy_check_mark: -77.5 MB
q18 871.812 861.462 -1 :heavy_check_mark: 521.7 MB
q19 1025.09 1001.21 -2 :heavy_check_mark: 521.7 MB
q20 1069.96 1070.51 0 :heavy_check_mark: 521.7 MB
q21 5468.41 5320.45 -3 :heavy_check_mark: 521.7 MB
q22 5234.71 5461.17 4 :heavy_check_mark: 521.7 MB

Galen

name main~69 [s] PR [s] Runtime change [%] Assessment
galen 27.7409 28.0078 1 :heavy_check_mark:

LDBC

algorithm dataset threads main~69 [kEVPS] PR [kEVPS] Tput change [%] Assessment Peak RSS diff
bfs graph500-22 1 1755.93 1762.94 0 :heavy_check_mark: -65.5 kB
bfs datagen-8_4-fb 6 7705.23 7033.28 -9 :small_red_triangle_down: 147.7 MB
pagerank graph500-22 1 688.825 644.966 -6 :small_red_triangle_down: 8.2 kB
pagerank datagen-8_4-fb 6 2050.74 1883.41 -8 :small_red_triangle_down: 266.5 MB

Nexmark (with Persistence)

name main~69 [kOp/s] PR [kOp/s] Tput change [%] PR DRAM [kOp/s] DRAM diff [%] Assessment
q0 2374.54 2431.8 2 2403.5 1 :heavy_check_mark:
q1 1682.87 1707.3 1 1694.18 1 :heavy_check_mark:
q2 2357.63 2382.29 1 2374.95 0 :heavy_check_mark:
q3 1989.03 1984.88 0 2272.82 -13 :heavy_check_mark:
q4 360.36 360.377 0 1389.44 -74 :heavy_check_mark:
q5 2006.19 2009.94 0 2260.61 -11 :heavy_check_mark:
q6 333.035 335.363 1 1330.58 -75 :heavy_check_mark:
q7 258.051 254.506 -1 1303.64 -80 :heavy_check_mark:
q8 2067 2139.05 3 2213.74 -3 :heavy_check_mark:
q9 32.9563 33.1631 1 383.878 -91 :heavy_check_mark:
q12 829.501 845.625 2 1772.28 -52 :heavy_check_mark:
q13 440.688 443.995 1 992.338 -55 :heavy_check_mark:
q14 1701.72 1691.72 -1 1684.14 0 :heavy_check_mark:
q15 196.648 196.269 0 1184.47 -83 :heavy_check_mark:
q16 26.8666 26.9758 0 287.548 -91 :heavy_check_mark:
q17 80.9823 80.695 0 797.95 -90 :heavy_check_mark:
q18 60.4819 60.4788 0 802.655 -92 :heavy_check_mark:
q19 67.9337 68.384 1 659.462 -90 :heavy_check_mark:
q20 169.217 169.925 0 929.685 -82 :heavy_check_mark:
q21 1479.42 1503.34 2 1490.76 1 :heavy_check_mark:
q22 2034.39 1991.71 -2 1987.5 0 :heavy_check_mark: