search

shmoli / ccloud_metrics_source

Kafka connect source connector to grab runtime metrics from Confluent Cloud and publish into Kafka.
Apache License 2.0
9 stars 3 forks source link

Connector should query for multiple cluster IDs in batch #2

Open sirianni opened 4 years ago

sirianni commented 4 years ago

Hi @shmoli - it would be more efficient to query for multiple cluster IDs in batch instead of instantiating a connector per cluster ID.

https://github.com/shmoli/ccloud_metrics_source/blob/c59ce4cd49fa3e61ef14dc3548a993ca4e702e30/src/main/java/com/github/shmoli/kafka/connect/source/metricsapi/MetricsAPIHttpClient.java#L225-L231

shmoli commented 4 years ago

Ok I can change that - do you thin I need to set the limit in the query?