Closed etiennedi closed 3 years ago
The change successfully removed esvector and adds a statefulset for the weaviate pods. Etcd is still used by the contextionary and thus still kept around.
@etiennedi
pvc
for the weaviate statefulSet
is ReadWriteOnce
. However I assume this must be ReadWriteMany
once the chart should be horizontally scaleable. As far as I know gke is not supporting ReadWriteMany
out of the box so we probably still need to keep the indirect dependency to the NFS provisioner or a similar thing.Thanks!
ReadWriteOnce
is fine. When it becomes horizontally scalable in the future, each node/pod will have its own independent disk and Weaviate will - at a software level - take care of replication, etc. Similar to ES or Cassandra. So there won't be multiple pods trying to ever read or write from the same disk.
Good point, I'll check and get back to you.
Required Changes
weaviate
container was stateless and did not require local persistence. With standalone requiring disk access,weaviate
can no longer be aDeployment
, but needs to be aStatefulSet
esvector
etcd
(unless still required by the contextionary?)