dandi / dandi-hub

Infrastructure and code for the dandihub
https://hub.dandiarchive.org
Other
11 stars 23 forks source link

Optimize server start up time #155

Open kabilar opened 6 months ago

kabilar commented 6 months ago

Thanks @aranega for this suggestion.

It takes several minutes to pull the Docker images from Docker Hub when starting up a pod.

To reduce the server start up time, could we host a private registry with the Docker images on AWS in the same zone as the k8s cluster? These Docker images could be synced with the images on Docker Hub.

cc @vijayiyer05

asmacdo commented 4 months ago

We could host a private registry, however, that might be heavier than we need. Jupyterhub config allows us to prepull the images.

https://z2jh.jupyter.org/en/stable/administrator/optimization.html#pulling-images-before-users-arrive