hpe-storage / python-hpedockerplugin

HPE Native Docker Plugin
Apache License 2.0
36 stars 64 forks source link

Issue with global configuration parameters in hpe.conf, if updated in multiple backend then it damage plugin operations #659

Open virendra-sharma opened 5 years ago

virendra-sharma commented 5 years ago

Observation: - 1) Volume mount failing with timeout error, please find error below. 2) It is observed that after mount failure, volume, snapshot & clone creation also fails intermittently. 3) In case volume mount pass, it will fail to mount it's snap volume. 4) Failure error of mount says "volume name must be unique", it is inappropriate error message.

Steps: - 1) create block volume and mount it. 2) create snapshot of volume and mount snapshot. 3) create clone of volume and mount it.

Error: -

Mount error : "docker: Error response from daemon: create volume1: found reference to volume 'volume1' in driver 'hpe:latest', but got an error while checking the driver: error while checking if volume "volume1" exists in driver "hpe:latest": Post http://%2Frun%2Fdocker%2Fplugins%2Fa7b2a1f89860c5314c4229f14aff62787f79547ff23cc0922b386ce09b1f0f57%2Fhpe.sock/VolumeDriver.Get: net/http: request canceled (Client.Timeout exceeded while awaiting headers): volume name must be unique."

Volume create error: "Error response from daemon: create volume1_snap: Post http://%2Frun%2Fdocker%2Fplugins%2Fa7b2a1f89860c5314c4229f14aff62787f79547ff23cc0922b386ce09b1f0f57%2Fhpe.sock/VolumeDriver.Create: net/http: request canceled (Client.Timeout exceeded while awaiting headers)"

Mount log : - mount_fail.log

Volume log : - volume_fail.log

prablr79 commented 5 years ago

@imran-ansari any update on this ?

prablr79 commented 5 years ago

needs quick investigation

virendra-sharma commented 5 years ago

CI issue resolved after updating "3PAR_DEBUG=True" in default backend and keep false in all other backends. But still just updating parameter should not affect plugin behavior.

Also, Error message updated in above issue looks misleading, it will be good if we look into it as well.