search

jupyterhub / configurable-http-proxy

node-http-proxy plus a REST API
BSD 3-Clause "New" or "Revised" License
242 stars 130 forks source link

Scale the configurable-http-proxy to handle 1000 connections #465

Closed mainak24 closed 1 year ago

mainak24 commented 1 year ago

Hi team,

We have a use case where we have 1000+ concurrent connections to the proxy from the hub. How to add multiple configurable-http-proxy and have a Load Balancer to load balance connections to multiple proxy server

welcome[bot] commented 1 year ago

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! :hugs:
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively. welcome You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! :wave:
Welcome to the Jupyter community! :tada:

consideRatio commented 1 year ago

The routing is controlled by JupyterHub via a REST API, which only influences one instance - due to that, you can't have multiple replicas setup setup easily. This relates to a larger issue of making jupyterhub support being run in a "highly available" mode. See https://github.com/jupyterhub/jupyterhub/issues/1932 for more information.

Note that this is a community supported open source project where github issues in the jupyterhub github organization typically is meant to focus on representing actionable items, and https://discourse.jupyter.org is meant for most other questions etc.

I'll go for a close here since I see no direct action point we can take here for this long standing challenge of making JupyterHub and associated proxies HA. I think work in jupyterhub/traefik-proxy may be what makes us accomplish a HA setup in the end rather than here in this project.