search

pelias-deprecated / kubernetes

Tools for running Pelias services on kubernetes
MIT License
54 stars 47 forks source link

feat: allow pvc on placeholder - fix pvc interpolation #92

Closed Mokto closed 5 years ago

orangejulius commented 5 years ago

Looks good to me, thanks.

I'm curious, do you share PVs across pods with a ReadWriteMany or ReadOnlyMany access mode? If so what methods have worked well for you for managing the data?

The hard part of multiple pods using the same source of data is ensuring that data is always up to date and complete.

Mokto commented 5 years ago

Hi !

To be honest I'm pretty new with Pelias, and I don't know how this works internally.

Are those volumes only used to download the necessary data, when initing the container ? What about data update ?

And I haven't tried to scale the deployment with more than one pod! I've used ReadWriteMany with my efs storage class, just to be safe, and because that was the default in the values.yaml.

orangejulius commented 5 years ago

Ah yes, by default you'll run into issues if you have several pods all sharing the same EFS volume. Each one will try to download the data to the EFS volume simultaneously, and probably all fail.

It's not an impossible problem to solve but it does add complexity. In our experience at least, paying a little bit extra for duplicate storage for each pod, with the guarantee that there won't be any conflicts, has been worth it. It does feel inefficient though so it would be nice to have a well vetted solution that everyone using Pelias could take advantage of.