In the E2E tests, we configure Cassandra nodes with hostpath volumes.
These work on minikube because it only creates a single node.
On a multi-node cluster such as created by kubeadm-dind-cluster, Cassandra Pods may get moved between nodes and in this case new (empty) hostpath volumes are created on each node and data appears to be lost.
Instead we could use persistent local storage PVs which will ensure that pods are only scheduled to nodes with the PV.
330 has some example code for creating persistent local volumes for E2E tests.
wallrj
commented
6 years ago
In the E2E tests, we configure Cassandra nodes with hostpath volumes. These work on minikube because it only creates a single node.
On a multi-node cluster such as created by kubeadm-dind-cluster, Cassandra Pods may get moved between nodes and in this case new (empty) hostpath volumes are created on each node and data appears to be lost.
Instead we could use persistent local storage PVs which will ensure that pods are only scheduled to nodes with the PV.
330 has some example code for creating persistent local volumes for E2E tests.
/kind bug