search

aws-samples / aws-eks-deep-learning-benchmark

Deep learning benchmark utility and optimization tips on EKS.
Apache License 2.0
48 stars 18 forks source link

Create PVC failed with 'CreateFileSystem failed: BadRequest: Access denied for import path.' #8

Open XiaoYangZhu opened 5 years ago

XiaoYangZhu commented 5 years ago

When follow the blog: https://aws.amazon.com/cn/blogs/opensource/optimizing-distributed-deep-learning-performance-amazon-eks/

I came across an issue when creating the PVC with the file documented here: 88e9fe843ac1:eks-deeplearning-tutorial xiaoyzhu$ kubectl describe pvc fsx-claim Name: fsx-claim Namespace: default StorageClass: fsx-sc Status: Pending Volume:
Labels: Annotations: kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"fsx-claim","namespace":"default"},"spec":{"accessMo... volume.beta.kubernetes.io/storage-provisioner: fsx.csi.aws.com Finalizers: [kubernetes.io/pvc-protection] Capacity:
Access Modes:
VolumeMode: Filesystem Events: Type Reason Age From Message

Warning ProvisioningFailed 10m fsx.csi.aws.com_fsx-csi-controller-0_4878c151-dec0-11e9-be0b-8a3cfe12f6b1 failed to provision volume with StorageClass "fsx-sc": rpc error: code = Internal desc = Could not create volume "pvc-654e797b-e26e-11e9-884f-0ae5ac2bc16c": CreateFileSystem failed: BadRequest: Access denied for import path. .... Warning ProvisioningFailed 83s fsx.csi.aws.com_fsx-csi-controller-0_4878c151-dec0-11e9-be0b-8a3cfe12f6b1 (combined from similar events): failed to provision volume with StorageClass "fsx-sc": rpc error: code = Internal desc = Could not create volume "pvc-654e797b-e26e-11e9-884f-0ae5ac2bc16c": CreateFileSystem failed: BadRequest: Access denied for import path. status code: 400, request id: f7e16469-015e-4fb8-97cd-395fb97ce2df Mounted By:

The worker nodes has already the required privileges recommended in the blog: image

Jeffwan commented 5 years ago

Hi @XiaoYangZhu Sorry for late response. The permission maybe changed recently. Can you go to https://github.com/kubernetes-sigs/aws-fsx-csi-driver to check it out?

I can help update it later this week.