aws / containers-roadmap

This is the public roadmap for AWS container services (ECS, ECR, Fargate, and EKS).
https://aws.amazon.com/about-aws/whats-new/containers/
Other
5.21k stars 317 forks source link

[EKS] [CEPH-CSI support]: Ceph-CSI support on EKS #1285

Open abhiniveshjain opened 3 years ago

abhiniveshjain commented 3 years ago

Community Note

Tell us about your request What do you want us to build? Ceph-CSI support on EKS Which service(s) is this request for? EKS and EKS on Outpost

Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard? What outcome are you trying to achieve, ultimately, and why is it hard/impossible to do right now? What is the impact of not having this problem solved? The more details you can provide, the better we'll be able to understand and solve the problem. I want to use local storage of my outpost using Ceph but I don't see any option of using ceph in EKS Are you currently working around this issue? How are you currently solving this problem? No solution Additional context Anything else we should know? Need help in exact location of documentation if this is already supported. Attachments If you think you might have additional information that you'd like to include via an attachment, please do - we'll take a look. (Remember to remove any personally-identifiable information.) No.

rmak-cpi commented 2 years ago

Support for ceph csi volume can potentially be achieved through Rook https://rook.io/, but unfortunately ceph requires the rbd module which is not compiled into the kernel on default EKS Amazon Linux 2 node image. This could be worked around by re-compiling the kernel with rbd or use Ubuntu image for EKS but either one of those options can incur substantial administrative overhead especially during cluster upgrade. Perhaps an issue can be raised to have the Amazon Linux 2 kernel include rbd module by default? (Let me know if there is a good place to raise that if not here)

rmak-cpi commented 2 years ago

I misspoke. It turns out that rbd has become a loadable module and I can actually enable it by running modprobe rbd from a privileged daemonset with /lib/modules mounted.