search

redpanda-data / console

Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
https://redpanda.com
3.83k stars 351 forks source link

Be more precise with the reported topic metrics #397

Open weeco opened 2 years ago

weeco commented 2 years ago

Some metrics such as the topic size are ambiguous to users. The size could either refer to the unique size without replicated bytes or to the total size across all brokers. We should make it clearer in the UI so that users do not have to ask us about what exactly it means.

jrkinley commented 1 year ago

It should be clear whether the topic size includes tiered storage. It will be tricky to calculate the precise size because there will be some degree of overlap between the segments cached on local disk and stored in S3. Maybe it is better to present two size metrics (one for local disk and another for S3)?

weeco commented 1 year ago

@jrkinley Currently this is not possible, because this information is not yet available via any API.

jrkinley commented 1 year ago

@weeco, this is blocked by https://github.com/redpanda-data/redpanda/issues/6929.