search

apache / pulsar

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org/
Apache License 2.0
14.28k stars 3.59k forks source link

Pulsar support for Apache Avro library as published by Apache #13096

Open aditya7k opened 2 years ago

aditya7k commented 2 years ago

Is your enhancement request related to a problem? Please describe.

We have a requirement to use both Kafka and Pulsar with Apache Avro Schemas. This is not possible currently as Pulsar uses it's own shaded (masked) version of apache avro implementation, which looks identical to Apache Avro.

Describe the solution you'd like

The enhancement is for Pulsar to work directly with Apache's Avro implementation.

Describe alternatives you've considered

Currently we are defining Schema's using Apache Avro Generic Record and then writing conversions to work with Pulsar's shaded version.

Additional context

Add any other context or screenshots about the feature request here.

We have written converters to allow schemas which serialize to org.apache.avro.generic.GenericRecord to allow serialization to org.apache.pulsar.shade.org.apache.avro.generic.GenericRecord.

sijie commented 2 years ago

@adityaIndexlabs if you use pulsar-client-original library, you will not use the shaded library.

sollecitom commented 2 years ago

@sijie does pulsar-client-original have a org.apache.pulsar.client.api.Schema<org.apache.avro.generic.GenericRecord>? That's what's needed to support native Avro records.

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.