vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
225 stars 20 forks source link

Have a one-liner to run Docker without building from sources #327

Closed lalithsuresh closed 1 year ago

lalithsuresh commented 1 year ago

We'll need to do a release to get a container pushed for the one liner to work, but the set up is in place to do so. I tested it from a fork.

Also uses GITHUB_TOKEN to not have to set up secrets in the repo.

We can also consider having a script that checks if docker is installed before running compose.

codecov[bot] commented 1 year ago

Codecov Report

Merging #327 (aa5e28c) into main (70e30f0) will not change coverage. The diff coverage is n/a.

:exclamation: Current head aa5e28c differs from pull request most recent head c6d6fe9. Consider uploading reports for the commit c6d6fe9 to get more accurate results

Additional details and impacted files [![Impacted file tree graph](https://codecov.io/gh/vmware/database-stream-processor/pull/327/graphs/tree.svg?width=650&height=150&src=pr&token=0wZcmD11gt&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)](https://codecov.io/gh/vmware/database-stream-processor/pull/327?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #327 +/- ## ======================================= Coverage 77.76% 77.76% ======================================= Files 166 166 Lines 32646 32646 ======================================= Hits 25386 25386 Misses 7260 7260 ``` [see 2 files with indirect coverage changes](https://codecov.io/gh/vmware/database-stream-processor/pull/327/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)
github-actions[bot] commented 1 year ago

Benchmark results

Nexmark

name main [kOp/s] PR [kOp/s] Tput change [%] Assessment Peak RSS diff
q0 3955.61 4849.68 23 :evergreen_tree: 7.5 MB
q1 3955.03 5092.06 29 :evergreen_tree: 17.6 MB
q2 3944.88 5628.07 43 :evergreen_tree: 14.4 MB
q3 3940.33 4362.17 11 :evergreen_tree: -21.4 MB
q4 3019.47 3490.98 16 :evergreen_tree: 71.6 MB
q5 3920.58 5057.32 29 :evergreen_tree: 71.6 MB
q6 3201.48 3609.33 13 :evergreen_tree: -343.4 MB
q7 3311.8 4064.98 23 :evergreen_tree: 399.2 MB
q8 3858.48 4641.06 20 :evergreen_tree: 399.2 MB
q9 595.675 593.032 0 :heavy_check_mark: -53.3 MB
q12 3700.73 5169.11 40 :evergreen_tree: -53.3 MB
q13 2676.72 3491.78 30 :evergreen_tree: -53.3 MB
q14 3959.89 4551.19 15 :evergreen_tree: -53.3 MB
q15 3974.09 4895.25 23 :evergreen_tree: -53.3 MB
q16 1035.15 1031.36 0 :heavy_check_mark: -53.3 MB
q17 3172.77 3109.47 -2 :heavy_check_mark: -53.3 MB
q18 863.819 910.601 5 :evergreen_tree: 63.1 MB
q19 976.503 989.514 1 :heavy_check_mark: 63.1 MB
q20 1067.14 1121.54 5 :evergreen_tree: 63.1 MB
q21 3898.52 5502.9 41 :evergreen_tree: 63.1 MB
q22 3953.25 5656.02 43 :evergreen_tree: 63.1 MB

Galen

name main [s] PR [s] Runtime change [%] Assessment
galen 28.0386 28.4495 1 :heavy_check_mark:

LDBC

algorithm dataset threads main [kEVPS] PR [kEVPS] Tput change [%] Assessment Peak RSS diff
bfs graph500-22 1 1928.1 1808.07 -6 :small_red_triangle_down: -200.7 kB
bfs datagen-8_4-fb 6 7349.72 8026.05 9 :evergreen_tree: 39.1 MB
pagerank graph500-22 1 689.058 685.436 -1 :heavy_check_mark: 69.6 kB
pagerank datagen-8_4-fb 6 1942.89 2013.86 4 :heavy_check_mark: 167.0 MB

Nexmark (with Persistence)

name main [kOp/s] PR [kOp/s] Tput change [%] PR DRAM [kOp/s] DRAM diff [%] Assessment
q0 2431.49 2409.26 -1 2416.56 0 :heavy_check_mark:
q1 1721.28 1724.4 0 1711.44 1 :heavy_check_mark:
q2 2449.58 2365.54 -3 2362.8 0 :heavy_check_mark:
q3 2038.26 2017.66 -1 2263.56 -11 :heavy_check_mark:
q4 366.764 356.085 -3 1397.66 -75 :heavy_check_mark:
q5 2056.88 2026.67 -1 2263.07 -10 :heavy_check_mark:
q6 338.324 335.312 -1 1363.03 -75 :heavy_check_mark:
q7 257.515 257.241 0 1282 -80 :heavy_check_mark:
q8 2152.45 2132.47 -1 2221.11 -4 :heavy_check_mark:
q9 33.4863 33.5015 0 384.388 -91 :heavy_check_mark:
q12 879.989 854.448 -3 1786.73 -52 :heavy_check_mark:
q13 442.696 445.879 1 994.382 -55 :heavy_check_mark:
q14 1681.35 1686.42 0 1687.69 0 :heavy_check_mark:
q15 199.394 197.995 -1 1183.13 -83 :heavy_check_mark:
q16 26.9479 26.9078 0 283.16 -90 :heavy_check_mark:
q17 83.5887 81.1126 -3 798.608 -90 :heavy_check_mark:
q18 60.8776 60.7772 0 802.073 -92 :heavy_check_mark:
q19 68.601 67.806 -1 655.727 -90 :heavy_check_mark:
q20 169.917 167.782 -1 939.815 -82 :heavy_check_mark:
q21 1524.89 1518.75 0 1514.61 0 :heavy_check_mark:
q22 2122.34 2097.26 -1 1982.79 6 :heavy_check_mark: