I'm trying settup a Nats Streaming cluster with three nodes on local kubernetes following the operator docs and I'm getting continuos connection fail from same pods.
As you can see, stan-cluster-poc-1 became cluster leader.
However, it fails on establish connection with one or more nodes depending of cluster nodes number (e.g.):
[1] 2020/07/06 19:34:45.125722 [WRN] STREAM: raft: failed to contact: server-id="stan-cluster-poc-3" time=1.000833233s
[1] 2020/07/06 19:34:46.071788 [WRN] STREAM: raft: failed to contact: server-id="stan-cluster-poc-3" time=1.946740647s
[1] 2020/07/06 19:34:46.413845 [ERR] STREAM: raft: failed to heartbeat to: peer=stan-cluster-poc."stan-cluster-poc-3".stan-cluster-poc error="nats: timeout"
[1] 2020/07/06 19:34:54.349017 [ERR] STREAM: raft: failed to appendEntries to: peer="{Voter "stan-cluster-poc-3" stan-cluster-poc."stan-cluster-poc-3".stan-cluster-poc}" error="natslog: read timeout"
On stan-cluster-poc-2 I received the warning bellow:
[1] 2020/07/06 19:25:33.240858 [WRN] STREAM: raft: failed to get previous log: previous-index=4 last-index=0 error="log not found"
On stan-cluster-poc-3 I received the warning bellow:
[1] 2020/07/06 19:25:34.340570 [WRN] STREAM: raft: failed to get previous log: previous-index=5 last-index=0 error="log not found"
Context
OSX version 10.14.6
docker 19.03.8
kubernetes version 1.16.5
persistent volume with storageClassName “local-storage” and ReadWriteOnce mode
nats operator 0.7.2
nats-server version 2.1.7
nats streaming operator 0.3.0-v1alpha1
nats-streaming-server version 0.18.0
I'm trying settup a Nats Streaming cluster with three nodes on local kubernetes following the operator docs and I'm getting continuos connection fail from same pods.
As you can see,
stan-cluster-poc-1
became cluster leader.However, it fails on establish connection with one or more nodes depending of cluster nodes number (e.g.):
On
stan-cluster-poc-2
I received the warning bellow:On
stan-cluster-poc-3
I received the warning bellow:Context
OSX version 10.14.6 docker 19.03.8 kubernetes version 1.16.5 persistent volume with storageClassName “local-storage” and ReadWriteOnce mode nats operator 0.7.2 nats-server version 2.1.7 nats streaming operator 0.3.0-v1alpha1 nats-streaming-server version 0.18.0