search

IBMStreams / streamsx.messagehub

Repository to provide easy integration with IBM MessageHub Bluemix Service
https://ibmstreams.github.io/streamsx.messagehub/
Apache License 2.0
1 stars 6 forks source link

New compression.type setting potentially breaks existing non-Streams consumers #75

Closed ghost closed 5 years ago

ghost commented 5 years ago

Since toolkit version 1.6, the default compression type for the MessageHubProducer is lz4 to increase the throughput to the broker.

To enable non-Streams application consuming published messages, they must use the lz4 Java library, i.e. have it in their classpath. The lz4 compression is not part of the Kafka client library. It must be installed separately (same is valid for snappy compression/decompression). Applications that have not yet installed the lz4 library are broken.

Thats why the default setting for compression.type producer config must be either none, or gzip if this works out of the box.

Workaround: Use the producer config compression.type=none.

ghost commented 5 years ago

Should be corrected in the Kafka toolkit.

ghost commented 5 years ago

fixed in release v1.7.3

ghost commented 5 years ago

Forgotten to mention the fix: No default compression.type, use Kafka's default, which is none.