awslabs / autonomous-driving-data-framework

ADDF is a collection of modules, deployed using the SeedFarmer orchestration tool. ADDF modules enable users to quickly bootstrap environments for the process and analysis of autonomous driving data.
Apache License 2.0
109 stars 45 forks source link

[FEATURE] Create mountpoint-s3 integration module #453

Open a13zen opened 5 months ago

a13zen commented 5 months ago

Is your feature request related to a problem? Please describe. The updated IDF EKS module now supports the Mountpoint CSI. However, there is no modules similar to the one for FSx that creates the Persistent volume + persistent volume claim for mountpoint.

https://github.com/awslabs/autonomous-driving-data-framework/blob/main/modules/integration/fsx-lustre-on-eks/stack_fsx_eks.py

Describe the solution you'd like A module that can be reused to deploy PV/PVCs into the EKS cluster that can be mounted directly into the application containers.

Here are some samples of how to create the PV/PVC: https://github.com/awslabs/mountpoint-s3-csi-driver/blob/main/examples/kubernetes/static_provisioning/static_provisioning.yaml

a13zen commented 1 month ago

@malachi-constant, bump on this one. Might be a better candidate for IDF

malachi-constant commented 1 month ago

@a13zen got it, will take it and start when i have bandwidth