search

confluentinc / kafka-connect-bigquery

A Kafka Connect BigQuery sink connector
Apache License 2.0
3 stars 1 forks source link

Kafka Connect Avro Converter jars not ship in v2.0.0 #85

Open mehd-io opened 3 years ago

mehd-io commented 3 years ago

Hi there! When upgrading from 1.6.6 to 2.0.0 using confluent-hub CLI, I faced the issue : io.confluent.connect.avro.AvroConverter Class not found I realize that the jars for Avro Converter (avro-1.9.2.jar, kafka-avro-serializer-5.5.0.jar,...) were not anymore ship through kafka connect bigquery plugin.

I solved it by installing the kafka connect plugin kafka-connect-avro-converter:5.5.3.

It sounds definitely cleaner to have it this way but would be nice I guess to update the documentation somewhere? I followed this section .

Side note : I also had to change schemaRetriever to com.wepay.kafka.connect.bigquery.retrieve.IdentitySchemaRetriever

C0urante commented 3 years ago

@SajanaW, can you take a look at this? Seems like we might have room for improvement with the 2.0.0 docs.

C0urante commented 3 years ago

@SajanaW can you review our docs for this when you have a moment?