search

vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
225 stars 20 forks source link

Kubernetes and container workflow improvements #378

Closed lalithsuresh closed 1 year ago

lalithsuresh commented 1 year ago
codecov[bot] commented 1 year ago

Codecov Report

Merging #378 (ba8a38e) into main (f463b48) will decrease coverage by 0.49%. The diff coverage is 37.90%.

:exclamation: Current head ba8a38e differs from pull request most recent head cb95de8. Consider uploading reports for the commit cb95de8 to get more accurate results

Additional details and impacted files [![Impacted file tree graph](https://codecov.io/gh/vmware/database-stream-processor/pull/378/graphs/tree.svg?width=650&height=150&src=pr&token=0wZcmD11gt&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #378 +/- ## ========================================== - Coverage 72.23% 71.75% -0.49% ========================================== Files 233 234 +1 Lines 48316 48834 +518 ========================================== + Hits 34903 35040 +137 - Misses 13413 13794 +381 ``` | [Impacted Files](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | Coverage Δ | | |---|---|---| | [crates/dataflow-jit/src/codegen/intrinsics.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvY29kZWdlbi9pbnRyaW5zaWNzLnJz) | `70.53% <0.00%> (-3.96%)` | :arrow_down: | | [crates/dataflow-jit/src/codegen/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvY29kZWdlbi9tb2QucnM=) | `52.75% <0.00%> (-0.41%)` | :arrow_down: | | [crates/dataflow-jit/src/dataflow/nodes.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvZGF0YWZsb3cvbm9kZXMucnM=) | `57.14% <0.00%> (-1.69%)` | :arrow_down: | | [crates/dataflow-jit/src/facade.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvZmFjYWRlLnJz) | `0.00% <0.00%> (ø)` | | | [crates/dataflow-jit/src/ir/exprs/select.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvZXhwcnMvc2VsZWN0LnJz) | `61.53% <0.00%> (ø)` | | | [crates/dataflow-jit/src/ir/nodes/join.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvam9pbi5ycw==) | `42.48% <0.00%> (ø)` | | | [crates/dataflow-jit/src/ir/nodes/subgraph.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvc3ViZ3JhcGgucnM=) | `62.50% <0.00%> (ø)` | | | [crates/dataflow-jit/src/ir/visit.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvdmlzaXQucnM=) | `17.54% <0.00%> (-0.43%)` | :arrow_down: | | [crates/dataflow-jit/src/lib.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvbGliLnJz) | `100.00% <ø> (ø)` | | | [crates/pipeline\_manager/src/config.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL3BpcGVsaW5lX21hbmFnZXIvc3JjL2NvbmZpZy5ycw==) | `0.00% <ø> (ø)` | | | ... and [33 more](https://codecov.io/gh/vmware/database-stream-processor/pull/378?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | | ... and [1 file with indirect coverage changes](https://codecov.io/gh/vmware/database-stream-processor/pull/378/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)
github-actions[bot] commented 1 year ago

Benchmark results

Nexmark

name main~8 [kOp/s] PR [kOp/s] Tput change [%] Assessment Peak RSS diff
q0 5357.91 5476.27 2 :heavy_check_mark: -69.6 MB
q1 5567.31 5668.5 2 :heavy_check_mark: -31.1 MB
q2 5536.42 4453.83 -20 :small_red_triangle_down: -8.5 MB
q3 5520.36 5622.97 2 :heavy_check_mark: -29.6 MB
q4 4913.33 4482.1 -9 :small_red_triangle_down: -14.9 MB
q5 5340.56 4628.57 -13 :small_red_triangle_down: -14.9 MB
q6 4824.6 4523.48 -6 :small_red_triangle_down: 162.7 MB
q7 3490 3256.58 -7 :small_red_triangle_down: 658.8 MB
q8 5023.55 4146.95 -17 :small_red_triangle_down: 658.8 MB
q9 865.627 852.388 -2 :heavy_check_mark: 1.1 MB
q12 4829.01 4422.36 -8 :small_red_triangle_down: 1.1 MB
q13 3664.9 3676.81 0 :heavy_check_mark: 1.1 MB
q14 5626.87 4363.46 -22 :small_red_triangle_down: 1.1 MB
q15 5345.81 5118.82 -4 :heavy_check_mark: 1.1 MB
q16 1044.73 1041.38 0 :heavy_check_mark: 1.1 MB
q17 3059.13 3095.94 1 :heavy_check_mark: 64.4 MB
q18 1423.5 1415.77 -1 :heavy_check_mark: -301.6 MB
q19 1387.41 1427.57 3 :heavy_check_mark: -301.6 MB
q20 1547.04 1557.5 1 :heavy_check_mark: -301.6 MB
q21 5331.58 4542.51 -15 :small_red_triangle_down: -301.6 MB
q22 5407.58 5621.14 4 :heavy_check_mark: -301.6 MB

Galen

name main~8 [s] PR [s] Runtime change [%] Assessment
galen 28.6804 28.654 0 :heavy_check_mark:

LDBC

algorithm dataset threads main~8 [kEVPS] PR [kEVPS] Tput change [%] Assessment Peak RSS diff
bfs graph500-22 1 1763.09 1765.85 0 :heavy_check_mark: -98.3 kB
bfs datagen-8_4-fb 6 7650.87 7844.1 3 :heavy_check_mark: 382.0 MB
pagerank graph500-22 1 679.98 688.476 1 :heavy_check_mark: -77.8 kB
pagerank datagen-8_4-fb 6 2032.02 2016.98 -1 :heavy_check_mark: -1.2 GB

Nexmark (with Persistence)

name main~8 [kOp/s] PR [kOp/s] Tput change [%] PR DRAM [kOp/s] DRAM diff [%] Assessment
q0 2472.44 2457.42 -1 2475.87 -1 :heavy_check_mark:
q1 1716.38 1711.71 0 1753.31 -2 :heavy_check_mark:
q2 2429.77 2431.38 0 2450.4 -1 :heavy_check_mark:
q3 2054.16 2096.25 2 2257.9 -7 :heavy_check_mark:
q4 361.191 365.269 1 1411.32 -74 :heavy_check_mark:
q5 2035.6 2052.01 1 2325.36 -12 :heavy_check_mark:
q6 332.213 337.423 2 1351.78 -75 :heavy_check_mark:
q7 621.676 625.725 1 1316.6 -52 :heavy_check_mark:
q8 2168.78 2192.45 1 2295.84 -5 :heavy_check_mark:
q9 79.2736 79.927 1 387.768 -79 :heavy_check_mark:
q12 863.033 857.546 -1 1822.36 -53 :heavy_check_mark:
q13 410.199 438.743 7 1008.19 -56 :evergreen_tree:
q14 1725.24 1736.44 1 1659.94 5 :heavy_check_mark:
q15 197.394 196.385 -1 1199.99 -84 :heavy_check_mark:
q16 25.4308 25.7211 1 286.048 -91 :heavy_check_mark:
q17 80.3398 80.8889 1 787.022 -90 :heavy_check_mark:
q18 124.953 124.993 0 800.013 -84 :heavy_check_mark:
q19 180.853 183.332 1 650.495 -72 :heavy_check_mark:
q20 516.055 498.537 -3 976.283 -49 :heavy_check_mark:
q21 1511.52 1537.63 2 1532.83 0 :heavy_check_mark:
q22 2021.17 2045.97 1 2037.5 0 :heavy_check_mark: