redpanda-data / console

Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
https://redpanda.com
3.81k stars 348 forks source link

Set default compression type & reuse old messages #1405

Open anhnmt opened 2 months ago

anhnmt commented 2 months ago

image

Is there any way I can leave the default Compress type as UNCOMPRESSED? I'm testing old programs and having to select UNCOMPRESSED every time is inconvenient

weeco commented 2 months ago

We could store the last selection in the frontend. That would be relatively easy to add, do you want to give it a shot?

anhnmt commented 2 months ago

@weeco Of course, I really need this feature. Also, if you can do a message recall feature, it would be even better.

image

Sometimes I want to reuse old messages, this will help save more time

weeco commented 2 months ago

What do you mean by a recall feature? Reproducing an existing message and possibly editing it along the way?

anhnmt commented 2 months ago

@weeco Sorry I don't know what to call this function, I just want to copy the old message and push it to the end of the topic with all the information from before.

oaklandcorp-jkaiser commented 1 month ago

Either remembering the previous selection or allowing a default value to be configured at a system level would be very helpful. Just discovered today that the default value of SNAPPY causes a consumer in a local cluster I'm working on to become completely stuck without error. I now known to explicitly select UNCOMPRESSED to avoid this but having to remember it every time I test something means I'm likely to forget in the future and block up a working system.

real-mday commented 1 week ago

This issue is currently causing us to get spikes of >1 million messages over the course of hours on our development cluster when a test message is created and our software currently is not able to recover from trying to read a compressed message