Add xz2 and zstd stream compressor.

[Licenser]

Pull request

Description

Add xz2 and zstd stream compressor.

Checklist

• [x] The RFC, if required, has been submitted and approved
• [x] Any user-facing impact of the changes is reflected in docs.tremor.rs
• [x] The code is tested
• [x] Use of unsafe code is reasoned about in a comment
• [x] Update CHANGELOG.md appropriately, recording any changes, bug fixes, or other observable changes in behavior
• [x] The performance impact of the change is measured (see below)

Performance

-/-

[codecov[bot]]

Codecov Report

Attention: Patch coverage is 85.28184% with 141 lines in your changes missing coverage. Please review.

Project coverage is 91.29%. Comparing base (c8dace1) to head (8fe3f31).

Additional details and impacted files

[](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) ```diff @@ Coverage Diff @@ ## main #2593 +/- ## ========================================== - Coverage 91.31% 91.29% -0.03% ========================================== Files 308 309 +1 Lines 60137 60862 +725 ========================================== + Hits 54917 55562 +645 - Misses 5220 5300 +80 ``` | [Flag](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | Coverage Δ | | |---|---|---| | [e2e-command](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `11.09% <0.00%> (-0.15%)` | :arrow_down: | | [e2e-integration](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `51.97% <60.68%> (+0.13%)` | :arrow_up: | | [e2e-unit](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `12.29% <0.00%> (-0.16%)` | :arrow_down: | | [e2etests](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `54.26% <60.68%> (+0.10%)` | :arrow_up: | | [tremorapi](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `14.19% <4.33%> (-0.15%)` | :arrow_down: | | [tremorcodec](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `62.94% <ø> (ø)` | | | [tremorcommon](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `63.04% <ø> (ø)` | | | [tremorconnectors](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `29.05% <50.42%> (+0.46%)` | :arrow_up: | | [tremorconnectorsaws](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `11.46% <10.61%> (-0.03%)` | :arrow_down: | | [tremorconnectorsazure](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `4.95% <3.75%> (-0.08%)` | :arrow_down: | | [tremorconnectorsgcp](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `21.08% <29.66%> (-0.08%)` | :arrow_down: | | [tremorconnectorsobjectstorage](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `0.06% <4.04%> (+0.06%)` | :arrow_up: | | [tremorconnectorsotel](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `12.52% <0.00%> (-0.16%)` | :arrow_down: | | [tremorconnectorstesthelpers](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `60.56% <ø> (ø)` | | | [tremorinflux](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `87.72% <ø> (ø)` | | | [tremorinterceptor](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `54.33% <61.65%> (+0.60%)` | :arrow_up: | | [tremorpipeline](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `31.05% <ø> (ø)` | | | [tremorruntime](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `46.46% <16.87%> (-0.38%)` | :arrow_down: | | [tremorscript](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `54.26% <ø> (ø)` | | | [tremorsystem](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `5.75% <ø> (ø)` | | | [tremorvalue](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `70.24% <ø> (+0.02%)` | :arrow_up: | | [unittests](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | `88.27% <76.72%> (-0.10%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#carryforward-flags-in-the-pull-request-comment) to find out more. | [Files](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | Coverage Δ | | |---|---|---| | [src/system/flow.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=src%2Fsystem%2Fflow.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-c3JjL3N5c3RlbS9mbG93LnJz) | `94.13% <ø> (ø)` | | | [tremor-connectors-gcp/src/gbq/writer/sink.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors-gcp%2Fsrc%2Fgbq%2Fwriter%2Fsink.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtZ2NwL3NyYy9nYnEvd3JpdGVyL3NpbmsucnM=) | `93.25% <ø> (ø)` | | | [tremor-connectors-gcp/src/gbq/writer/sink/test.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors-gcp%2Fsrc%2Fgbq%2Fwriter%2Fsink%2Ftest.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtZ2NwL3NyYy9nYnEvd3JpdGVyL3NpbmsvdGVzdC5ycw==) | `99.08% <100.00%> (-0.04%)` | :arrow_down: | | [tremor-connectors-gcp/src/gcl/writer/sink.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors-gcp%2Fsrc%2Fgcl%2Fwriter%2Fsink.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtZ2NwL3NyYy9nY2wvd3JpdGVyL3NpbmsucnM=) | `88.94% <ø> (+5.52%)` | :arrow_up: | | [tremor-connectors-gcp/src/gcl/writer/sink/test.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors-gcp%2Fsrc%2Fgcl%2Fwriter%2Fsink%2Ftest.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtZ2NwL3NyYy9nY2wvd3JpdGVyL3NpbmsvdGVzdC5ycw==) | `86.13% <100.00%> (+1.25%)` | :arrow_up: | | [tremor-connectors-gcp/src/gcs/streamer.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors-gcp%2Fsrc%2Fgcs%2Fstreamer.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtZ2NwL3NyYy9nY3Mvc3RyZWFtZXIucnM=) | `98.99% <100.00%> (+<0.01%)` | :arrow_up: | | [tremor-connectors-otel/src/client.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors-otel%2Fsrc%2Fclient.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMtb3RlbC9zcmMvY2xpZW50LnJz) | `94.44% <ø> (-0.16%)` | :arrow_down: | | [tremor-connectors/src/impls/cb.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors%2Fsrc%2Fimpls%2Fcb.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMvc3JjL2ltcGxzL2NiLnJz) | `94.59% <ø> (ø)` | | | [tremor-connectors/src/impls/clickhouse.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors%2Fsrc%2Fimpls%2Fclickhouse.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMvc3JjL2ltcGxzL2NsaWNraG91c2UucnM=) | `98.23% <ø> (ø)` | | | [tremor-connectors/src/impls/discord.rs](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree&filepath=tremor-connectors%2Fsrc%2Fimpls%2Fdiscord.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs#diff-dHJlbW9yLWNvbm5lY3RvcnMvc3JjL2ltcGxzL2Rpc2NvcmQucnM=) | `2.67% <ø> (ø)` | | | ... and [30 more](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) | | ... and [3 files with indirect coverage changes](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) ------ [Continue to review full report in Codecov by Sentry](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?dropdown=coverage&src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs). Last update [c8dace1...8fe3f31](https://app.codecov.io/gh/tremor-rs/tremor-runtime/pull/2593?dropdown=coverage&src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=tremor-rs).