Open bpfrd opened 11 months ago
I also get the below error while the spawner is loading:
2023-12-18T20:09:11.656075Z [Warning] 0/1 nodes are available: 1 Insufficient memory. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod..
2023-12-18T20:11:19Z [Normal] Stopping container notebook
Event log Server requested 2023-12-18T19:28:23.407289Z [Warning] 0/1 nodes are available: 1 Insufficient memory. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod.. 2023-12-18T19:55:28.733675Z [Warning] 0/1 nodes are available: persistentvolumeclaim "nbgrader-exchange" is being deleted. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.. 2023-12-18T20:06:51.675011Z [Normal] Successfully assigned default/jupyter-admin to master-01.novalocal 2023-12-18T20:06:52Z [Normal] Container image "bpfrd/nbgrader-student:latest" already present on machine 2023-12-18T20:06:52Z [Normal] Created container notebook 2023-12-18T20:06:52Z [Normal] Started container notebook 2023-12-18T20:11:19Z [Normal] Stopping container notebook
I was wondering how I can manage the resource parameters if I have 16Gi memory and 4 cpus and let's say 10 students
best regards,
Hey @bpfrd
0/1 nodes are available: persistentvolumeclaim "nbgrader-exchange" is being deleted. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling
While you were testing something, you probably tried to delete the PVC "nbgrader-exchange". The problem is, that when you do that, you also have to delete all the jobs/pods, that are tied to that PVC. Until then the PVC itself is not going to get deleted. Then you probably tried to start a new pod, which wants to mount the PVC, that is marked for deletion. If you are just testing, delete the PVC and also all the pods, that it's used by.
I was wondering how I can manage the resource parameters if I have 16Gi memory and 4 cpus and let's say 10 students
0/1 nodes are available: 1 Insufficient memory. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod
You will have to set the resources.limits (maximum resources, that could be allocated for each student) settings correctly. If you have only 10 students, then something like this should work for your setup:
resources:
limits:
cpu: 300m
memory: 1Gi
Have in mind, that you also have to modify the resource limits for the "hub" and "proxy" pods. The sum of the resource limits of all your pods (10 singleuser + hub + proxy + other (if you have)) should not exceed 4CPU & 16Gi memory.
Hello,
I noticed that the exchange volume is defined but never mounted on the students' countainers. Here is the result of
kubectl get pod/jupyter-student1 -o yaml
best regards