search

infinyon / fluvio

Lean and mean distributed stream processing system written in rust and web assembly.
https://www.fluvio.io/
Apache License 2.0
2.77k stars 199 forks source link

[Bug] Replicas are not being syncing on kubernetes #4084

Closed fraidev closed 5 days ago

fraidev commented 5 days ago

Scenario

Creating a topic with 3 partitions and 3 replicas on a Kubernetes cluster with 3 SPUs with:

fluvio topic create my-topic1 -p 3 -r 3

Then, the offset replicas are not being syncing with -1 HW and -1 LEO.

  TOPIC      PARTITION  LEADER  MIRROR  REPLICAS  RESOLUTION  SIZE  HW  LEO  LRS  FOLLOWER OFFSETS                                                                                       
  my-topic1  0          2               [1, 0]    Online      0 B   0   0    0    1                 [ReplicaStatus { spu: 0, hw: -1, leo: -1 }, ReplicaStatus { spu: 1, hw: 0, leo: 0 }] 
  my-topic1  1          2               [1, 0]    Online      0 B   0   0    0    1                 [ReplicaStatus { spu: 0, hw: -1, leo: -1 }, ReplicaStatus { spu: 1, hw: 0, leo: 0 }] 
  my-topic1  2          0               [1, 2]    Online      0 B   0   0    0    2                 [ReplicaStatus { spu: 1, hw: 0, leo: 0 }, ReplicaStatus { spu: 2, hw: 0, leo: 0 }]

This works fine on local cluster.

fraidev commented 5 days ago

https://github.com/infinyon/fluvio/pull/4083 solves it.