search

intel / vck

Volume Controller for Kubernetes
https://ai.intel.com/kubernetes-volume-controller-kvc-data-management-tailored-for-machine-learning-workloads-in-kubernetes/
Apache License 2.0
67 stars 17 forks source link

Fail to fetch a "directory" in s3 with minio/mc #55

Open aisensiy opened 6 years ago

aisensiy commented 6 years ago

Kvc use the minio/mc to download files from s3 but there are some issues which will make kvc not working.

  1. No default --api parameter will make mc config add host failed. See #2422.
  2. Event make this work, the cp command of minio will still get error info which make the mc command return a non zero return. And this will make volumemanager show an failed status. See #2460.

For the first issue, another parameter s3Version is necessary if kvc want to support different s3 api version. See more info in minio client with shows that Google Cloud Storage use a different s3 version with others.