when i used mirrormaker2 to sync, if the topic count is small, no issues,
but if topic count is 200+, connect.log shows
Request cannot contain more than 5 topics.
[2023-04-20 10:05:42,382] WARN [MirrorSourceConnector|worker] Could not create topic S17_inner_transcode_response. (org.apache.kafka.connect.mirror.MirrorSourceConnector:371)
java.util.concurrent.CompletionException: org.apache.kafka.common.errors.InvalidRequestException: Request cannot contain more than 5 topics.
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607)
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
at org.apache.kafka.common.internals.KafkaCompletableFuture.kafkaCompleteExceptionally(KafkaCompletableFuture.java:49)
at org.apache.kafka.common.internals.KafkaFutureImpl.completeExceptionally(KafkaFutureImpl.java:130)
at org.apache.kafka.clients.admin.KafkaAdminClient$1.handleResponse(KafkaAdminClient.java:1616)
at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.handleResponses(KafkaAdminClient.java:1255)
at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.processRequests(KafkaAdminClient.java:1408)
at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1331)
at java.lang.Thread.run(Thread.java:750)
Caused by: org.apache.kafka.common.errors.InvalidRequestException: Request cannot contain more than 5 topics.
[2023-04-20 10:05:42,382] WARN [MirrorSourceConnector|worker] Could not create topic N9M_0_MEDIASTREAMMODEL_MEDIATASKSTART. (org.apache.kafka.connect.mirror.MirrorSourceConnector:371)
when i used mirrormaker2 to sync, if the topic count is small, no issues, but if topic count is 200+, connect.log shows Request cannot contain more than 5 topics. [2023-04-20 10:05:42,382] WARN [MirrorSourceConnector|worker] Could not create topic S17_inner_transcode_response. (org.apache.kafka.connect.mirror.MirrorSourceConnector:371) java.util.concurrent.CompletionException: org.apache.kafka.common.errors.InvalidRequestException: Request cannot contain more than 5 topics. at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607) at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) at org.apache.kafka.common.internals.KafkaCompletableFuture.kafkaCompleteExceptionally(KafkaCompletableFuture.java:49) at org.apache.kafka.common.internals.KafkaFutureImpl.completeExceptionally(KafkaFutureImpl.java:130) at org.apache.kafka.clients.admin.KafkaAdminClient$1.handleResponse(KafkaAdminClient.java:1616) at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.handleResponses(KafkaAdminClient.java:1255) at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.processRequests(KafkaAdminClient.java:1408) at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1331) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.kafka.common.errors.InvalidRequestException: Request cannot contain more than 5 topics. [2023-04-20 10:05:42,382] WARN [MirrorSourceConnector|worker] Could not create topic N9M_0_MEDIASTREAMMODEL_MEDIATASKSTART. (org.apache.kafka.connect.mirror.MirrorSourceConnector:371)