search

jetstack / navigator

Managed Database-as-a-Service (DBaaS) on Kubernetes
Apache License 2.0
271 stars 31 forks source link

Error: mapped nodes must be a superset of Live and Unreachable nodes #331

Closed wallrj closed 6 years ago

wallrj commented 6 years ago

This results in existing healthy nodes failing their readiness probe when new nodes are added to the cluster.

I think this is a mistake in my understanding of these fields. I assumed that a node must be one of Live or Unreachable,

And that all the nodes are listed in the mapped array.

But in the example below, the "live" node 10.192.3.19 does not appear in the mapped list.

E0412 13:45:01.694417       1 listen.go:25] Error while running Check function for probe on port 12000: mapped nodes must be a superset of Live and Unreachable nodes. Live: map[10.192.3.18:{} 10.192.3.19:{} 10.192.2.8:{} 10.192.3.15:{} 10.192.3.16:{} 10.192.3.17:{} 10.192.2.6:{} 10.192.2.7:{} 10.192.2.9:{}], Unreachable: map[], Mapped: map[10.192.3.17:{} 10.192.2.6:{} 10.192.3.18:{} 10.192.3.15:{} 10.192.3.16:{} 10.192.2.8:{} 10.192.2.7:{} 10.192.2.9:{}]
Live:
map[
10.192.2.6:{}
10.192.2.7:{}
10.192.2.8:{}
10.192.2.9:{}
10.192.3.15:{}
10.192.3.16:{}
10.192.3.17:{}
10.192.3.18:{}
10.192.3.19:{}
],

Unreachable:
map[],

Mapped:

map[
10.192.2.6:{}
10.192.2.7:{}
10.192.2.8:{}
10.192.2.9:{}
10.192.3.15:{}
10.192.3.16:{}
10.192.3.17:{}
10.192.3.18:{}
]

I'll double check what the real nodetool does in this case.

/kind bug