search

GoogleCloudPlatform / gcs-fuse-csi-driver

The Google Cloud Storage FUSE Container Storage Interface (CSI) Plugin.
Apache License 2.0
117 stars 29 forks source link

Fuse sidecar gets killed and health probe doesn't restart it #355

Open ashmeenkaur opened 2 days ago

ashmeenkaur commented 2 days ago

Side container just dies and the health6/liveness probe doesn't restart it

The following logs happen and out of the sudden it dies. I expect the container to fail in the liveness probe and restart but nothing happens and there is no way for me to know if there was an issue or not to take action automatically. The only way I detect this is that the main container produces an exception because it cannot access the volume.

Logs:

"Garbage collection succeeded after deleted 0 objects in 36.496406ms." E0928 09:11:14.903703 1 logger.go:60] gcsfuse exited with error: signal: killed

System & Version (please complete the following information):

The main question is not why it did (which is also an uncertainty) but how can we recover from this? the liveness probe (if any) should detect this and restart the container

ashmeenkaur commented 2 days ago

This issue was originally reported by @aecc in the GCSFuse repository, but it seems more relevant to the GCSFuse CSI driver repository. I've created a duplicate issue here to ensure it's addressed by the appropriate team.