`fluvio cluster upgrade` add extended logic for upgrade of metadata when it changes

infinyon / fluvio

Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.

https://www.fluvio.io/

Apache License 2.0

3.88k stars 489 forks source link

`fluvio cluster upgrade` add extended logic for upgrade of metadata when it changes #4137

Closed digikata closed 2 months ago

digikata commented 3 months ago

fluvio cluster upgrade should update local cluster metadata storage data so that a fluvio cluster resume with a the current of fluvio will run and be compatible

Currently common cases for this are handled, but this issue is to cover more intense cases with larger changes (which would also require extra handling w/ k8s)

fraidev commented 2 months ago

With https://github.com/infinyon/fluvio/pull/4138 we're checking first if we can read all the metadata, if we can, we can also update them.