aws-samples / amazon-eks-machine-learning-with-terraform-and-kubeflow

Distributed training using Kubeflow on Amazon EKS
Apache License 2.0
82 stars 42 forks source link

Change the directory for staging data on FSx for Lustre #33

Closed ajayvohra2005 closed 2 years ago

ajayvohra2005 commented 2 years ago

The current location for staging data on FSx for Lustre is /fsx. It needs to be updated to /fsx/mask-rcnn/eks/input so the data can be imported implicitly from the S3 bucket. After this update, there is no need to explicitly stage data on the FSx for Lustre. The data would still need to be explicitly staged on the EFS file-system using eks-cluster/stage-data.yaml.

ajayvohra2005 commented 2 years ago

Issue resolved.