Aiven-Open / cloud-storage-connectors-for-apache-kafka

Repository containing Cloud Storage Connectors for Apache Kafka®
Apache License 2.0
9 stars 13 forks source link

AvroConverter class not found #266

Open ram-venket36 opened 3 weeks ago

ram-venket36 commented 3 weeks ago

While trying to configure AvroConverter for value converted as mentioned in details, we see the class not found error. Appears to be the confluent Avro converter is not with the connector package. Is it something consuming clients need to add as per need ?

io.confluent.connect.avro.AvroConverter

muralibasani commented 3 weeks ago

@ram-venket36 If you are not using confluent hub, you may have to add the library manually. You can download from confluent repos/mvn.

ram-venket36 commented 3 weeks ago

@muralibasani Thanks. I am using event streams kafka platform. In that case I will add the necessary jars manually and try it out. Also I see there are no configuration specifically provided to key in schema registry url. How does it deserialize the events which are in avro format in topics while storing in s3 ?

muralibasani commented 3 weeks ago

@ram-venket36 you might want to add this config https://docs.confluent.io/platform/current/schema-registry/connect.html#avro like

key.converter.schema.registry.url=http://localhost:8081
value.converter.schema.registry.url=http://localhost:8081