awslabs / autonomous-driving-data-framework

ADDF is a collection of modules, deployed using the SeedFarmer orchestration tool. ADDF modules enable users to quickly bootstrap environments for the process and analysis of autonomous driving data.
Apache License 2.0
112 stars 44 forks source link

[FEATURE] Create mountpoint-s3 integration module #453

Open a13zen opened 6 months ago

a13zen commented 6 months ago

Is your feature request related to a problem? Please describe. The updated IDF EKS module now supports the Mountpoint CSI. However, there is no modules similar to the one for FSx that creates the Persistent volume + persistent volume claim for mountpoint.

https://github.com/awslabs/autonomous-driving-data-framework/blob/main/modules/integration/fsx-lustre-on-eks/stack_fsx_eks.py

Describe the solution you'd like A module that can be reused to deploy PV/PVCs into the EKS cluster that can be mounted directly into the application containers.

Here are some samples of how to create the PV/PVC: https://github.com/awslabs/mountpoint-s3-csi-driver/blob/main/examples/kubernetes/static_provisioning/static_provisioning.yaml

a13zen commented 2 months ago

@malachi-constant, bump on this one. Might be a better candidate for IDF

malachi-constant commented 2 months ago

@a13zen got it, will take it and start when i have bandwidth