search

vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
225 stars 20 forks source link

Add a schema parameter to the ProjectDesc. #324

Closed gz closed 1 year ago

gz commented 1 year ago

The schema is generated by the compiler using -js and contains info about tables and views in the SQL program.

codecov[bot] commented 1 year ago

Codecov Report

Merging #324 (d62309c) into main (d8b98f4) will decrease coverage by 0.06%. The diff coverage is 36.06%.

Additional details and impacted files [![Impacted file tree graph](https://codecov.io/gh/vmware/database-stream-processor/pull/324/graphs/tree.svg?width=650&height=150&src=pr&token=0wZcmD11gt&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #324 +/- ## ========================================== - Coverage 77.81% 77.75% -0.06% ========================================== Files 166 166 Lines 32600 32645 +45 ========================================== + Hits 25367 25383 +16 - Misses 7233 7262 +29 ``` | [Impacted Files](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | Coverage Δ | | |---|---|---| | [crates/adapters/src/server/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2FkYXB0ZXJzL3NyYy9zZXJ2ZXIvbW9kLnJz) | `44.30% <ø> (ø)` | | | [crates/pipeline\_manager/src/compiler.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL3BpcGVsaW5lX21hbmFnZXIvc3JjL2NvbXBpbGVyLnJz) | `0.00% <0.00%> (ø)` | | | [crates/pipeline\_manager/src/config.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL3BpcGVsaW5lX21hbmFnZXIvc3JjL2NvbmZpZy5ycw==) | `0.00% <0.00%> (ø)` | | | [crates/pipeline\_manager/src/db.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL3BpcGVsaW5lX21hbmFnZXIvc3JjL2RiLnJz) | `0.00% <0.00%> (ø)` | | | [crates/pipeline\_manager/src/runner.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL3BpcGVsaW5lX21hbmFnZXIvc3JjL3J1bm5lci5ycw==) | `0.00% <0.00%> (ø)` | | | [crates/adapters/src/transport/kafka/input.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2FkYXB0ZXJzL3NyYy90cmFuc3BvcnQva2Fma2EvaW5wdXQucnM=) | `69.69% <100.00%> (+1.22%)` | :arrow_up: | | [crates/adapters/src/transport/kafka/output.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2FkYXB0ZXJzL3NyYy90cmFuc3BvcnQva2Fma2Evb3V0cHV0LnJz) | `62.09% <100.00%> (+2.96%)` | :arrow_up: | | [crates/dbsp/src/circuit/dbsp\_handle.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL2NpcmN1aXQvZGJzcF9oYW5kbGUucnM=) | `91.96% <0.00%> (-0.41%)` | :arrow_down: | | [crates/dbsp/src/trace/spine\_fueled.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL3NwaW5lX2Z1ZWxlZC5ycw==) | `80.57% <0.00%> (-0.18%)` | :arrow_down: | | ... and [1 more](https://codecov.io/gh/vmware/database-stream-processor/pull/324?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | |
github-actions[bot] commented 1 year ago

Benchmark results

Nexmark

name main~16 [kOp/s] PR [kOp/s] Tput change [%] Assessment Peak RSS diff
q0 3917.87 3944.81 1 :heavy_check_mark: -7.2 MB
q1 3961.08 3946.46 0 :heavy_check_mark: -8.4 MB
q2 3947.23 3967.7 1 :heavy_check_mark: 7.4 MB
q3 3914.4 3960.41 1 :heavy_check_mark: -13.3 MB
q4 2942.08 3009.44 2 :heavy_check_mark: -50.0 MB
q5 3892.7 3847.98 -1 :heavy_check_mark: -50.0 MB
q6 3181.85 3174.86 0 :heavy_check_mark: -28.2 MB
q7 2692.51 3323.91 23 :evergreen_tree: -2.5 GB
q8 3779.36 3804.32 1 :heavy_check_mark: -2.5 GB
q9 591.907 598.115 1 :heavy_check_mark: 81.0 MB
q12 3688.17 3662.61 -1 :heavy_check_mark: 81.0 MB
q13 3197.91 3168.26 -1 :heavy_check_mark: 81.0 MB
q14 3952.13 3116.22 -21 :small_red_triangle_down: 81.0 MB
q15 3979.16 3976.41 0 :heavy_check_mark: 81.0 MB
q16 1039.56 1037.43 0 :heavy_check_mark: 81.0 MB
q17 3124.86 2820.17 -10 :small_red_triangle_down: 81.0 MB
q18 882.48 890.201 1 :heavy_check_mark: 461.6 MB
q19 982.635 997.721 2 :heavy_check_mark: 461.6 MB
q20 1099.08 1126.04 2 :heavy_check_mark: 461.6 MB
q21 3895.77 3932.68 1 :heavy_check_mark: 461.6 MB
q22 3940.57 3969.01 1 :heavy_check_mark: 461.6 MB

Galen

name main~16 [s] PR [s] Runtime change [%] Assessment
galen 28.3098 28.0061 -1 :heavy_check_mark:

LDBC

algorithm dataset threads main~16 [kEVPS] PR [kEVPS] Tput change [%] Assessment Peak RSS diff
bfs graph500-22 1 1910.53 1915.85 0 :heavy_check_mark: 114.7 kB
bfs datagen-8_4-fb 6 7924.87 8247.3 4 :heavy_check_mark: -36.6 MB
pagerank graph500-22 1 677.401 683.611 1 :heavy_check_mark: -69.6 kB
pagerank datagen-8_4-fb 6 1934.06 2049.02 6 :evergreen_tree: -139.5 MB

Nexmark (with Persistence)

name main~16 [kOp/s] PR [kOp/s] Tput change [%] PR DRAM [kOp/s] DRAM diff [%] Assessment
q0 2440.88 2400.77 -2 2386.56 1 :heavy_check_mark:
q1 1710.69 1721.39 1 1697.59 1 :heavy_check_mark:
q2 2439.29 2454.89 1 2397.73 2 :heavy_check_mark:
q3 2033.27 2049.02 1 2291.34 -11 :heavy_check_mark:
q4 363.604 364.218 0 1410.65 -74 :heavy_check_mark:
q5 2018.73 2058.52 2 2288.89 -10 :heavy_check_mark:
q6 337.041 338.162 0 1355.44 -75 :heavy_check_mark:
q7 258.968 259.394 0 1302.69 -80 :heavy_check_mark:
q8 2139.46 2150.25 1 2260.98 -5 :heavy_check_mark:
q9 33.3495 33.2184 0 387.657 -91 :heavy_check_mark:
q12 885.122 887.242 0 1804.34 -51 :heavy_check_mark:
q13 439.402 446.672 2 996.069 -55 :heavy_check_mark:
q14 1676.11 1672.14 0 1714.02 -2 :heavy_check_mark:
q15 199.161 199.812 0 1190.81 -83 :heavy_check_mark:
q16 27.0979 26.7586 -1 287.492 -91 :heavy_check_mark:
q17 83.1951 83.522 0 812.033 -90 :heavy_check_mark:
q18 61.0489 61.1424 0 801.508 -92 :heavy_check_mark:
q19 68.6324 68.8494 0 656.519 -90 :heavy_check_mark:
q20 169.373 170.043 0 940.156 -82 :heavy_check_mark:
q21 1519.32 1518.11 0 1503.41 1 :heavy_check_mark:
q22 2107.89 2098.4 0 1998.28 5 :heavy_check_mark: