vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
225 stars 20 forks source link

Add instructions and infrastructure for running Nexmark benchmark on … #343

Closed blp closed 1 year ago

blp commented 1 year ago

…Flink.

I had some difficulty getting the Nexmark benchmarks for Flink running. These instructions and Docker infrastructure made it easier for me.

codecov[bot] commented 1 year ago

Codecov Report

Merging #343 (266b811) into main (0705657) will increase coverage by 0.98%. The diff coverage is 96.82%.

Additional details and impacted files [![Impacted file tree graph](https://codecov.io/gh/vmware/database-stream-processor/pull/343/graphs/tree.svg?width=650&height=150&src=pr&token=0wZcmD11gt&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #343 +/- ## ========================================== + Coverage 77.79% 78.78% +0.98% ========================================== Files 166 167 +1 Lines 32747 33261 +514 ========================================== + Hits 25475 26204 +729 + Misses 7272 7057 -215 ``` | [Impacted Files](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | Coverage Δ | | |---|---|---| | [crates/dbsp/src/operator/filter\_map.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL29wZXJhdG9yL2ZpbHRlcl9tYXAucnM=) | `89.22% <ø> (ø)` | | | [crates/dbsp/src/operator/time\_series/window.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL29wZXJhdG9yL3RpbWVfc2VyaWVzL3dpbmRvdy5ycw==) | `98.62% <ø> (ø)` | | | [crates/dbsp/src/operator/trace.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL29wZXJhdG9yL3RyYWNlLnJz) | `84.55% <ø> (ø)` | | | [crates/dbsp/src/trace/layers/unordered.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy91bm9yZGVyZWQucnM=) | `0.00% <0.00%> (ø)` | | | [crates/dbsp/src/trace/layers/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy9tb2QucnM=) | `35.71% <20.00%> (+13.21%)` | :arrow_up: | | [crates/dbsp/src/trace/layers/ordered\_leaf.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy9vcmRlcmVkX2xlYWYucnM=) | `57.89% <76.19%> (+57.89%)` | :arrow_up: | | [crates/dbsp/src/trace/layers/ordered/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy9vcmRlcmVkL21vZC5ycw==) | `74.08% <87.09%> (+4.69%)` | :arrow_up: | | [crates/dbsp/src/trace/layers/column\_layer/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy9jb2x1bW5fbGF5ZXIvbW9kLnJz) | `91.63% <98.07%> (+0.76%)` | :arrow_up: | | [crates/dbsp/src/operator/aggregate/average.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL29wZXJhdG9yL2FnZ3JlZ2F0ZS9hdmVyYWdlLnJz) | `86.16% <100.00%> (+0.44%)` | :arrow_up: | | [...tes/dbsp/src/trace/layers/column\_layer/builders.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2Ric3Avc3JjL3RyYWNlL2xheWVycy9jb2x1bW5fbGF5ZXIvYnVpbGRlcnMucnM=) | `97.18% <100.00%> (+18.15%)` | :arrow_up: | | ... and [1 more](https://codecov.io/gh/vmware/database-stream-processor/pull/343?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | | ... and [5 files with indirect coverage changes](https://codecov.io/gh/vmware/database-stream-processor/pull/343/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)
blp commented 1 year ago

wow, this is a lot of work to run a benchmark

Yeah, exactly why I didn't want to figure it out again later :-)