RuckusWirelessIL / pentaho-kafka-producer

Apache Kafka producer step plug-in for Pentaho Kettle.
Apache License 2.0
45 stars 33 forks source link

compression.codec property is not working #21

Open spaluri opened 7 years ago

spaluri commented 7 years ago

tried setting compression.codec to 2 snappy , but we still see msg is not being compressed. also added topic name to compression.topic property, we could see msg in plain text, not sure why its not compressing

spektom commented 7 years ago

Hi @spaluri Kafka consumer transparently decompresses messages. How do you know it's not internally compressed?

spaluri commented 6 years ago

hi @spektom , we tried setting compression.codec to 2 in the properties, and publish msg , i would not publish anything to brokers, as soon we unset the property to default it publishes msg to broker. seems like msgs are not even making it to broker.

spaluri commented 6 years ago

pentaho-kafka-prod kafka-pentaho-ex-result

screenshot of the config