search

luben / zstd-jni

JNI binding for Zstd
Other
854 stars 168 forks source link

Reference multiple dictionaries in decompression context #261

Closed Alex1OPS closed 1 year ago

Alex1OPS commented 1 year ago

Is there any plan to support setting ZSTD_d_refMultipleDDicts and enabling the usage of multiple dictionaries in a decompression context? It seems like a very useful feature in production, taking into account the evolution of the dictionary over time.

Currently, we're using a workaround using getDictIdFromFrame and getDictIdFromDict to select the correct dictionary from a hashmap for a particular message, but the zstd itself seems to support such functionality through ZSTD_DCtx_selectFrameDDict link.

Alex1OPS commented 1 year ago

I have some intermediate results that I can bring and finalise as a PR if it is useful.

luben commented 1 year ago

Looks like a useful functionality to have. I am open to PRs.

Alex1OPS commented 1 year ago

Here is a PR which enables multiple dict references #262.

luben commented 1 year ago

@Alex1OPS , just released v1.5.5-3 with this change included