jupyterhub / binderhub

Run your code in the cloud, with technology so advanced, it feels like magic!
https://binderhub.readthedocs.io
BSD 3-Clause "New" or "Revised" License
2.57k stars 390 forks source link

Write up a post about the Orsay Binder on OpenStack deployment #506

Closed choldgraf closed 3 years ago

choldgraf commented 6 years ago

At a recent meeting @minrk and I worked with @gouarin @nthiery and a bunch of others (please cc their github handles if anybody knows them) to deploy JupyterHub/BinderHub on OpenStack. We ran into several issues and made several workarounds for this.

I think it'd be great if we could write up this experience in a short blog post. I believe all of our scripts are here: https://plmlab.math.cnrs.fr/jupytercloud/kubernetes so perhaps this just means adding some context to them as well as a bit of narrative to help users make their way through the code (as well as a section on the particular issues we faced)

I think this could be a great way to provide a path forward for those who wish to deploy on OpenStack, and would also be a nice artifact to come out of our meeting.

arnim commented 6 years ago

There is also the kubernetes bare metal deployment @bitnik is working on

choldgraf commented 6 years ago

would love to hear more about this @bitnik - anywhere that you've got public artifacts we could look at? It'd be quite helpful to the community to have more resources on deploying k8s on bare metal

choldgraf commented 6 years ago

(and thanks for noting this, @arnim !)

arnim commented 6 years ago

@choldgraf: As part of the DFG project iLCM @bitnik is currently setting up http://notebooks.gesis.org/ . We have already asked @betatim to let us know when a european meetup (maybe in Zurich) will take place to learn more about bh. Our project is in the very early stages but we aim in the longer term to work on enabling named-servers jupyterhub/jupyterhub#1409 with persistent storage #377 for authenticated users #323 . Our institute is dedicated to open source and work will be committed back as fare as possible.

nthiery commented 6 years ago

For whatever it's worth, you may be interested by this blog post; kind of a personal wish list for our instance: http://opendreamkit.org/2018/03/15/jupyterhub-binder-convergence/

arnim commented 6 years ago

@nthiery thank you.

bitnik commented 6 years ago

@choldgraf the github repo is currently piravate. Because there are some data specific to our institute. But very soon we want to separate it and have a public one.

as @arnim mentioned, the website is https://notebooks.gesis.org/. There we have running JupyterHub and BinderHub separately.

bitnik commented 6 years ago

@choldgraf we made the github repo of GESIS Notebooks public: https://github.com/gesiscss/orc

psychemedia commented 6 years ago

@choldgraf Did a blog post / recipe / zeroToBinderhubOnOpenstack tutorial around this appear anywhere?

gouarin commented 6 years ago

@psychemedia not for now but the work is almost done.

We plan to write a blog post on Medium soon which will explain how to install jupyterhub using Kubernetes on OpenStack.

An other post will follow for binderhub installation.

psychemedia commented 6 years ago

@gouarin Thanks - looking forward to giving it a try...

choldgraf commented 6 years ago

@gouarin have you been in touch at all with people at Compute Canada? They've got a Kubernetes-on-openstack deployment of JupyterHub running as well. I can try to hunt down the URL to their configuration if it'd be helpful

gouarin commented 6 years ago

@choldgraf sorry for the delay.

We worked hard on that this week and we finally solved our issues with the MTU. So now, we have a jupyterhub and a binderhub up and running (we tried to deploy both).

I saw what they did at Compute Canada and it's really nice. Our goal is nevertheless different. We don't want to develop our own ansible and terraform scripts to deploy binderhub because we will not have time to maintain them. So the idea is to use community tools like kubespray and it works pretty well.

I can now write the blog post and we'll see if it's reproducible ;).

psychemedia commented 6 years ago

@gouarin I'm interested to see any guidance you have to see if I can get things to work with it...

gouarin commented 6 years ago

@psychemedia done!

https://blog.jupyter.org/how-to-deploy-jupyterhub-with-kubernetes-on-openstack-f8f6120d4b1

choldgraf commented 6 years ago

Wahoo! Way to @gouarin and team, thanks for sharing your experiences :-)

I think that before closing this issue, we should add a link to this blog in the known binderhub deployments page!

psychemedia commented 6 years ago

@gouarin Great - thanks... will give it a go...

manics commented 3 years ago

Closing as this is quite old now