StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries.
In this pr, we introduce configable compression level for ZSTD compression type.
Valid level is 1-22, default level is 3 (which is same as before)
How to use:
CREATE TABLE t ( k BIGINT NOT NULL, v string COMMENT) ENGINE=OLAP
DUPLICATE KEY(k)
DISTRIBUTED BY HASH(k) BUCKETS 1
PROPERTIES ( \"compression\" = \"zstd(1)\" );
We can define the compression level for zstd using zstd(level) in CREATE TABLE STATEMENT
We load 10000000row from Clickbench dataset, using different level of zstd compression, result as following:
[x] Yes, this PR will result in a change in behavior.
[ ] No, this PR will not result in a change in behavior.
If yes, please specify the type of change:
[x] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[ ] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[ ] Miscellaneous: upgrade & downgrade compatibility, etc.
Checklist:
[x] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)
[ ] I have added documentation for my new feature or new function
[x] This is a backport pr
Bugfix cherry-pick branch check:
[x] I have checked the version labels which the pr will be auto-backported to the target branch
[ ] 3.3
[ ] 3.2
[ ] 3.1
[ ] 3.0
[ ] 2.5
This is an automatic backport of pull request #46976 done by Mergify.
In this pr, we introduce configable compression level for ZSTD compression type.
Valid level is 1-22, default level is 3 (which is same as before)
How to use:
CREATE TABLE t ( k BIGINT NOT NULL, v string COMMENT) ENGINE=OLAP
DUPLICATE KEY(k)
DISTRIBUTED BY HASH(k) BUCKETS 1
PROPERTIES ( \"compression\" = \"zstd(1)\" );
We can define the compression level for zstd using zstd(level) in CREATE TABLE STATEMENT
We load 10000000row from Clickbench dataset, using different level of zstd compression, result as following:
In this pr, we introduce configable compression level for ZSTD compression type. Valid level is 1-22, default level is 3 (which is same as before)
How to use: CREATE TABLE t ( k BIGINT NOT NULL, v string COMMENT) ENGINE=OLAP DUPLICATE KEY(k) DISTRIBUTED BY HASH(k) BUCKETS 1 PROPERTIES ( \"compression\" = \"zstd(1)\" );
We can define the compression level for zstd using zstd(level) in CREATE TABLE STATEMENT
Fixes https://github.com/StarRocks/starrocks/issues/46839
What type of PR is this:
Does this PR entail a change in behavior?
If yes, please specify the type of change:
Checklist:
Bugfix cherry-pick branch check:
This is an automatic backport of pull request #46976 done by Mergify. In this pr, we introduce configable compression level for ZSTD compression type. Valid level is 1-22, default level is 3 (which is same as before)
How to use: CREATE TABLE t ( k BIGINT NOT NULL, v string COMMENT) ENGINE=OLAP DUPLICATE KEY(k) DISTRIBUTED BY HASH(k) BUCKETS 1 PROPERTIES ( \"compression\" = \"zstd(1)\" );
We can define the compression level for zstd using zstd(level) in CREATE TABLE STATEMENT
Fixes https://github.com/StarRocks/starrocks/issues/46839
What type of PR is this:
Does this PR entail a change in behavior?
If yes, please specify the type of change:
Checklist: