search

vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
225 stars 20 forks source link

Refactor PgEmbed usage #384

Closed lalithsuresh closed 1 year ago

lalithsuresh commented 1 year ago
codecov[bot] commented 1 year ago

Codecov Report

Merging #384 (bba3d22) into main (dbe4663) will increase coverage by 0.13%. The diff coverage is 70.09%.

Additional details and impacted files [![Impacted file tree graph](https://codecov.io/gh/vmware/database-stream-processor/pull/384/graphs/tree.svg?width=650&height=150&src=pr&token=0wZcmD11gt&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #384 +/- ## ========================================== + Coverage 72.99% 73.12% +0.13% ========================================== Files 237 237 Lines 49568 50156 +588 ========================================== + Hits 36180 36675 +495 - Misses 13388 13481 +93 ``` | [Impacted Files](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | Coverage Δ | | |---|---|---| | [crates/dataflow-jit/src/codegen/intrinsics.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvY29kZWdlbi9pbnRyaW5zaWNzLnJz) | `61.60% <0.00%> (-8.93%)` | :arrow_down: | | [crates/dataflow-jit/src/dataflow/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvZGF0YWZsb3cvbW9kLnJz) | `49.88% <0.00%> (-10.08%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/function/passes.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvZnVuY3Rpb24vcGFzc2VzLnJz) | `52.57% <ø> (ø)` | | | [crates/dataflow-jit/src/ir/ids.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvaWRzLnJz) | `61.29% <0.00%> (-2.05%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/nodes/aggregate.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvYWdncmVnYXRlLnJz) | `10.48% <ø> (-0.40%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/nodes/constant.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvY29uc3RhbnQucnM=) | `47.74% <ø> (+1.25%)` | :arrow_up: | | [crates/dataflow-jit/src/ir/nodes/differentiate.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvZGlmZmVyZW50aWF0ZS5ycw==) | `17.18% <ø> (+1.47%)` | :arrow_up: | | [crates/dataflow-jit/src/ir/nodes/filter\_map.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvZmlsdGVyX21hcC5ycw==) | `41.62% <ø> (+0.32%)` | :arrow_up: | | [crates/dataflow-jit/src/ir/nodes/flat\_map.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvZmxhdF9tYXAucnM=) | `81.13% <ø> (-1.02%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/nodes/index.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvaW5kZXgucnM=) | `57.57% <ø> (-1.85%)` | :arrow_down: | | ... and [41 more](https://codecov.io/gh/vmware/database-stream-processor/pull/384?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | | ... and [3 files with indirect coverage changes](https://codecov.io/gh/vmware/database-stream-processor/pull/384/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)
github-actions[bot] commented 1 year ago

Benchmark results

Nexmark

name main~15 [kOp/s] PR [kOp/s] Tput change [%] Assessment Peak RSS diff
q0 5262.63 5396.07 3 :heavy_check_mark: 2.9 MB
q1 5429.6 5386.13 -1 :heavy_check_mark: 4.1 MB
q2 5361.6 5381.73 0 :heavy_check_mark: -3.6 MB
q3 5321.94 5290.19 -1 :heavy_check_mark: 28.2 MB
q4 4802.55 4832.96 1 :heavy_check_mark: -329.7 MB
q5 5378.33 5284.93 -2 :heavy_check_mark: -329.7 MB
q6 4880.13 4799.99 -2 :heavy_check_mark: -184.4 MB
q7 2559.31 2855.92 12 :evergreen_tree: -1.2 GB
q8 5161.2 5203.35 1 :heavy_check_mark: -1.2 GB
q9 875.448 884.805 1 :heavy_check_mark: -5.9 MB
q12 4910.28 4949.29 1 :heavy_check_mark: -5.9 MB
q13 3645.17 2789.64 -23 :small_red_triangle_down: -5.9 MB
q14 5481.43 5415.94 -1 :heavy_check_mark: -5.9 MB
q15 4895.11 5417.9 11 :evergreen_tree: -5.9 MB
q16 1045.16 1046.76 0 :heavy_check_mark: -5.9 MB
q17 3134.56 3161.79 1 :heavy_check_mark: 53.4 MB
q18 1440.13 1436.34 0 :heavy_check_mark: 1.2 GB
q19 1435.15 1420.83 -1 :heavy_check_mark: 1.2 GB
q20 1500.83 1558.97 4 :heavy_check_mark: 1.2 GB
q21 5117.36 5254.3 3 :heavy_check_mark: 1.2 GB
q22 5356.59 5420.18 1 :heavy_check_mark: 1.2 GB

Galen

name main~15 [s] PR [s] Runtime change [%] Assessment
galen 28.6952 28.755 0 :heavy_check_mark:

LDBC

algorithm dataset threads main~15 [kEVPS] PR [kEVPS] Tput change [%] Assessment Peak RSS diff
bfs graph500-22 1 1835.7 1797.89 -2 :heavy_check_mark: -213.0 kB
bfs datagen-8_4-fb 6 8173.61 7667.11 -6 :small_red_triangle_down: -22.4 MB
pagerank graph500-22 1 681.655 697.612 2 :heavy_check_mark: 69.6 kB
pagerank datagen-8_4-fb 6 1994.79 2055.81 3 :heavy_check_mark: -79.2 MB

Nexmark (with Persistence)

name main~15 [kOp/s] PR [kOp/s] Tput change [%] PR DRAM [kOp/s] DRAM diff [%] Assessment
q0 2399.23 2482.98 3 2401.16 3 :heavy_check_mark:
q1 1713.93 1686.1 -2 1683.39 0 :heavy_check_mark:
q2 2407.67 2445.9 2 2347.67 4 :heavy_check_mark:
q3 2036.93 2074.79 2 2248.06 -8 :heavy_check_mark:
q4 360.256 362.443 1 1407.34 -74 :heavy_check_mark:
q5 2015.3 2064.37 2 2250.84 -8 :heavy_check_mark:
q6 332.421 337.455 2 1327.47 -75 :heavy_check_mark:
q7 639.584 671.523 5 1309.32 -49 :heavy_check_mark:
q8 2171.19 2263.23 4 2230.05 1 :heavy_check_mark:
q9 79.0764 79.6782 1 384.983 -79 :heavy_check_mark:
q12 838.481 873.33 4 1785.09 -51 :heavy_check_mark:
q13 443.491 453.723 2 1002.01 -55 :heavy_check_mark:
q14 1697.52 1696.67 0 1679.52 1 :heavy_check_mark:
q15 198.112 197.639 0 1195.3 -83 :heavy_check_mark:
q16 25.5771 26.1254 2 285.129 -91 :heavy_check_mark:
q17 81.4521 81.2814 0 791.462 -90 :heavy_check_mark:
q18 124.763 125.052 0 787.564 -84 :heavy_check_mark:
q19 182.489 181.27 -1 649.988 -72 :heavy_check_mark:
q20 505.761 508.185 0 936.528 -46 :heavy_check_mark:
q21 1489.8 1512.76 2 1512.2 0 :heavy_check_mark:
q22 2102.89 2028.14 -4 2057.76 -1 :heavy_check_mark: