search

divolte / divolte-collector

Divolte Collector
https://divolte.io/
Apache License 2.0
283 stars 78 forks source link

Divolte-clickStream-kafka-KSQL #464

Open mbsj6962 opened 3 years ago

mbsj6962 commented 3 years ago

i'm trying to connect divolte to kafka but it always tels me : ERROR Unknown error when running consumer: (kafka.tools.ConsoleConsumer$:46) org.apache.kafka.common.errors.SerializationException: Unknown magic byte! and i can not parse key and value of divolte message

josephwibowo commented 3 years ago

if you're using Kafka from Confluent, you need to use the Schema Registry in order to deserialize the Avro messages.

OneCricketeer commented 3 years ago

Schema Registry can be used with any Kafka, not only the one provided by Confluent Platform, but yes, the error is related to incorrect usage of some serializer/deserializer combo