search

tchiotludo / akhq

Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...
https://akhq.io/
Apache License 2.0
3.28k stars 637 forks source link

Missing Kafka Connect Configuration - Debezium Specific #1685

Open Argonus opened 3 months ago

Argonus commented 3 months ago

Overview

Some of the Debezium Kafka Connect configurations are missing in AKHQ. It looks like all missing entries are the ones that have been added as breaking changes between versions v1.4 and v2.4

Setup

Debezium Version: v2.4 Kafka Connect Version: v7.4.2 AKHQ Version: v0.24.0

Example Missing Entries

It looks like they all are from topic group. 

  topic.heartbeat.prefix (renamed from heartbeat.topics.prefix)
  topic.creation.enabled
  topic.creation.default.partitions
  topic.creation.default.replication.factor

Help

I can help with adding new missing config options, but I can't find any configuration in this repo. Shouldn't it be autoloaded somehow, as the older custom Debezium configuration is working?

AlexisSouquiere commented 3 months ago

I'm not really familiar with the connect definitions feature but for me yes all the metadata are loaded automatically here: https://github.com/tchiotludo/akhq/blob/81933caf28c081a38a6e69b88f8528b5801c63e8/src/main/java/org/akhq/repositories/ConnectRepository.java#L72-L75

I don't have time on my side but maybe you should try with the dev branch where the connect client has been updated

Argonus commented 1 month ago

Thank you, will take a look at it in next few weeks, as I' finally moved to work on Kafka at my current workplace :)