This issue is created out of opensearch-project/OpenSearch#9422. Technical discussions around the merits and tradeoffs of users choosing ZStd codec have been discussed. We need to make sure this doesn't get lost in the noise of how to react to the potential demotion of the ZStd module to a plugin. I'm opening this issue here to capture those merits and tradeoffs until we can get them into proper documentation.
ZStd Pros:
better / faster compression
cost savings
Cons:
force killed nodes
wildcard loadLibrary security hole
no rolling upgrade
libc portability issues
This is a "living" issue and the list will likely be updated as more information is learned and new protection mechanisms are injected.
This issue is created out of opensearch-project/OpenSearch#9422. Technical discussions around the merits and tradeoffs of users choosing ZStd codec have been discussed. We need to make sure this doesn't get lost in the noise of how to react to the potential demotion of the ZStd module to a plugin. I'm opening this issue here to capture those merits and tradeoffs until we can get them into proper documentation.
ZStd Pros:
Cons:
This is a "living" issue and the list will likely be updated as more information is learned and new protection mechanisms are injected.