search

gluster / glusterdocs

This repo contains the source of official Gluster documentation rendered at https://docs.gluster.org
MIT License
353 stars 279 forks source link

Provide documentation with recomended way to integrate glusterfs with Kubernetes #526

Open stopsopa opened 4 years ago

stopsopa commented 4 years ago

Documentation doesn't seem to tell how to integrate glusterfs with Kubernetes which I think is one of main way how user will use it now any even more in near future.

It would be nice to have at least recommendation which external project use to achieve this.

sankarshanmukhopadhyay commented 4 years ago

The https://github.com/gluster/gluster-containers was originally designed to provide means to users (and operators) to enable Gluster with container runtimes.

In addition to the above, there is an additional upcoming project at https://github.com/kadalu/kadalu with the aim of easily provisioning PVs in a manner that is more native to kubernetes (k8s). The repository has a set of methods which would allow someone to get started quickly. If you'd prefer to deploy on a test environment to validate that it does meet with your requirements, @amarts and @aravindavk would be able to provide additional responses.

amarts commented 4 years ago

Adding notes here without a formal documentation. Will try to provide history and present situation.

GlusterFS is a distributed file system, which by itself, doesn't have any 'native' way of integration with external eco-system, and is managed by gluster CLI tool.

There is heketi project which helped to provide a REST API interface to gluster management layer, and integrated well with k8s eco-system. This was the only way gluster could be integrated with k8s, till version k8s-1.13.x. Heketi is still the widely used method to integrate glusterfs with k8s eco-system.

In 2018, gluster community tried to implement a native REST API based project, gd2, which had intentions of getting a native entry to k8s eco-system for gluster projects. That project is not under active development.

Then there were other approaches like gluster-subvol project, which solved the problem for very specific use-case.

In last 2 months, there is a new project, called kadalu, which could be used to natively integrate with kubernetes. It comes with its own operator, CSI driver etc.

You don't see much 'official' documentation on how to integrate glusterfs with kubernetes in glusterfs documentation because, as of now, there is no single way of doing it. And there are no projects under https://github.com/gluster org which solve the issue completely well.

Feedback welcome.

avarf commented 4 years ago

Hi, I am also looking for documentation on how to install and use GFS on K8s but I couldn't find any on the official documentation so I searched here.

I understand that at the moment there is no universal/official method to install and use GFS on K8s but it would be very helpful if you add exactly the same things that you wrote here to the official documentation.