search

cornelius-keller / ansible-coreos-kubernetes

My ansible playbooks to install coreos and kubernetes on bare metal servers.
48 stars 13 forks source link

Use rook? #13

Open khusseini opened 7 years ago

khusseini commented 7 years ago

I have worked a bit with your repository. Great work, but I couldn't get a storage class to work properly with this setup. I installed Rook and it worked pretty easily. Check it out.

https://github.com/rook/rook/blob/master/Documentation/kubernetes.md#deploy-rook

I removed all ceph related kubernetes resources and installed rook for it to work. else no modifications were needed.

cornelius-keller commented 7 years ago

Hello @khusseini ,

i just committed a branch https://github.com/cornelius-keller/ansible-coreos-kubernetes/tree/ceph-persistence . It will configure ceph + a storage class named ceph. For my tests it is working. I used a branch because it uses etcd3 and kubernetes 1.6.1 I also added suport for local testing with vagrant, so you test it with ansible-playbook -i inventory-vagrant-etcd3.ini

cornelius-keller commented 7 years ago

Rook currently has the same proplem as my ceph-cluster has: as soon as the osds loose their quorum, it will not recover without manual intervention. If all the monitors are down, both rook and my ceph setup will never recover. I will start switching to rook as soon as they solved this problem.