libresh / libre.sh

Moved to https://lab.libreho.st/libre.sh/compose.libre.sh
GNU Affero General Public License v3.0
188 stars 22 forks source link

kubernetes migration #161

Closed pierreozoux closed 6 years ago

pierreozoux commented 6 years ago

As k8s is taking over the world, it looks like dumb to continue develop our little hacks for this project. And nothing stop us to run k8s on a single node. Plus, the kubernetes ecosystem is more and more mature, and I think it is ready now for us:

We have all the building blocks to make a beautiful hosting platform that you can selfhost on baremetal without any cloud provider.

We need to get started somehow.

This is what I feel is the way to go, I'm sure you have other opinions, let me know :)

pierreozoux commented 6 years ago

@almereyda @jodumont @niktrix @michielbdejong @niktrix @edrex I'd love your feedback on this:

I think that if we are opiniated, the tool would be better and develop faster. If we are not opiniated, then well, we can also just drop libre.sh and tell people to install kubernetes the way they prefer and we collaborate on the helm packages.

If you know other people that would be interested in this discussion, please ping them :)

pierreozoux commented 6 years ago

Ok, so I just played with hetzner-kube, it is cool \o/.

I managed to deploy a cluster, add rook \o/ and rocket.chat. I just didn't manage the tls part, but I know it is doable, I'm tired :)

Here some cryptic notes for the future:

$ cat ing-values.yaml 
rbac:
  create: true
controller:
  kind: DaemonSet
  hostNetwork: true
  daemonset:
    useHostPorts: true
$ cat lego-values.yaml 
config:
  LEGO_EMAIL: *
  LEGO_URL: https://acme-v01.api.letsencrypt.org/directory
rbac:
  create: true
pierreozoux commented 6 years ago

the discussion continues at https://github.com/xetys/hetzner-kube/issues

edrex commented 6 years ago

You mentioned only supporting hetzner. Obviously for US-based folks like me, this isn't a good option. I want to be able to run an IndieHost/LibreHost on a CoreOS/Tectonic cluster deployed to an arbitrary cloud provider or bare metal. I guess others might like to run on GCE. To this end, I'd like to see two things:

Thoughts?

JOduMonT commented 6 years ago

Only CoreOS; only Hetzner ?

I don't get the question..
Also personally I don't use the libre.sh It's nice project but others projects like Cloudron do so much more, which BTW I don't use too ;)

So what I'm doing here ?

I respect the idea and love the initiative; and I'm sorry for the kitten (chatons) but I think, we play in another category here, which is fine because Framasoft never said they will be professional and their primary goal is to do mediatization and education around GAFAM alternatives. And also; Libre sh help to be start with docker. I still use, in a way the haproxy :)

Hetzner in US ?

@edrex OVH offer container for everyone : https://labs.ovh.com and they open datacenters in US.

Security perspective

Who is the target ?

pierreozoux commented 6 years ago

@edrex @jodumont I heard you! Thanks for the valuable feedback!

I start the migration now!

All libre.sh v1 repo related to docker-compose will be deprecated, and moved to git.indie.host. (If anybody want to takeover ownership, and continue this project, I'm fine with it too :) ) The migration will last for some months, so we'll continue the support for us during this period of time.

Regarding kubernetes, the goal will be to collaborate, there are already a lot of places to collaborate, especially: https://github.com/kubernetes/charts/

Then, I think this repo will just be documentation on how to install kubernetes in what we consider the reference implementation. This will be splitted in 2 parts:

I guess it will just become documentation, and collaboration will happen in other repos, but let's see!

edrex commented 6 years ago

Thanks for the update Pierre. I am interested in running indiehoster clusters in:

I will try to keep up with the techniques and conventions you are leveraging in the reference implementation, and contribute guides for those platforms where I am operating.

On Sat, Mar 24, 2018 at 6:03 AM Pierre Ozoux notifications@github.com wrote:

@edrex https://github.com/edrex @jodumont https://github.com/jodumont I heard you! Thanks for the valuable feedback!

I start the migration now!

All libre.sh v1 repo related to docker-compose will be deprecated, and moved to git.indie.host. (If anybody want to takeover ownership, and continue this project, I'm fine with it too :) ) The migration will last for some months, so we'll continue the support for us during this period of time.

Regarding kubernetes, the goal will be to collaborate, there are already a lot of places to collaborate, especially: https://github.com/kubernetes/charts/

Then, I think this repo will just be documentation on how to install kubernetes in what we consider the reference implementation. This will be splitted in 2 parts:

  • install kubernetes (hetzner-kube, tectonic...) links to documentation, or how we install it ourself.
  • install libre.sh on top (an opinionated vision on what to use for network, disks, monitoring, dns..)

I guess it will just become documentation, and collaboration will happen in other repos, but let's see!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/libresh/libre.sh/issues/161#issuecomment-375887883, or mute the thread https://github.com/notifications/unsubscribe-auth/AAA5F_wG62hRram66tL6YRmbcB_8OykEks5thkQygaJpZM4SQw-V .

edrex commented 6 years ago

Those boards actually wouldn't make good compute nodes since they only have two cores, still looking around for the right hardware.