search

apache / pulsar

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org/
Apache License 2.0
14.14k stars 3.57k forks source link

Kafka Sink Connector: support non-String keys #9848

Open eolivelli opened 3 years ago

eolivelli commented 3 years ago

Currently the Kafka Sink Connector is able to support only keys with a String value.

We should support the generic byte[] key, as it is in Kafka. Also we should support other data types and possibly may the generic key/value pair of Kafka to a KeyValue Pulsar schema

eolivelli commented 3 years ago

@sijie comment in #9448

we need to make the key as pure bytes because that's the default behavior from Kafka.

KafkaAbstractSource -> KafkaAbstractStringKeySource -> KafkaStringSource KafkaAbstractSource -> KafkaAbstractBytesKeySource -> KafkaBytesSource

codelipenghui commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.

pcyan commented 2 months ago

It seems that the latest version has already supported the generic byte[] key, should this issue be closed?