search

wurstmeister / kafka-docker

Dockerfile for Apache Kafka
http://wurstmeister.github.io/kafka-docker/
Apache License 2.0
6.92k stars 2.73k forks source link

ZSTD compression in version 0.10.2.2 #705

Open mosespx opened 2 years ago

mosespx commented 2 years ago

Hi, We're using kafka docker in version 0.10.2.2 with gzip compression type, and I tried to change it to zstd and got the following error:

$KAFKA_HOME/bin/kafka-configs.sh --zookeeper ${KAFKA_ZOOKEEPER_CONNECT} --alter --add-config compression.type=zstd --entity-name zstd-tests --entity-type topics

Error while executing config command Invalid value zstd for configuration compression.type: String must be one of: uncompressed, snappy, lz4, gzip, producer
org.apache.kafka.common.config.ConfigException: Invalid value zstd for configuration compression.type: String must be one of: uncompressed, snappy, lz4, gzip, producer

due to some limitations with the scala version, we're currently unable to upgrade kafka. Is there an option to add zstd to this current version? Is there a docker image with zstd compression support?

Thanks.

mosespx commented 2 years ago

?

OneCricketeer commented 2 years ago

Your Scala version shouldn't dictate what version of the Broker (or container) you can use.

Zstd simply isn't available in that version of Kafka, and this container shouldn't be modified to backport Kafka features.