alibaba / fluss

Fluss is a streaming storage built for real-time analytics.
https://alibaba.github.io/fluss-docs
Apache License 2.0
701 stars 155 forks source link

[Feature] Log format support CompatedRow #64

Open swuferhong opened 2 days ago

swuferhong commented 2 days ago

Search before asking

Motivation

Currently, Log format only support INDEXED and ARROW format. For the future index lookup, we hope log also support CompatedRow. Doing this has two benefits: first, by using the same format as kv, it reduces the serialization overhead when generating CDC; second, it can decrease the storage space required for some of the logs.

Solution

No response

Anything else?

No response

Willingness to contribute