search

microsoft / PlanetaryComputer

Issues, discussions, and information about the Microsoft Planetary Computer
https://planetarycomputer.microsoft.com/
MIT License
185 stars 8 forks source link

Spawn failed: did not start in 900 seconds #224

Closed nadjagbr closed 6 months ago

nadjagbr commented 1 year ago

Hi:) I have issues with launching my server. I get following error message:

Spawn failed: pod prod/jupyter-nadja-2egebril-40myhsba-2ede did not start in 900 seconds!

Event log Server requested 2023-06-05T08:18:38.684859Z [Warning] 0/21 nodes are available: 1 node(s) had taint {ToBeDeletedByClusterAutoscaler: 1685952646}, that the pod didn't tolerate, 1 node(s) had taint {kubernetes.azure.com/scalesetpriority: spot}, that the pod didn't tolerate, 16 Insufficient cpu, 19 Insufficient memory. 2023-06-05T08:18:38.722050Z [Warning] 0/21 nodes are available: 1 node(s) had taint {ToBeDeletedByClusterAutoscaler: 1685952646}, that the pod didn't tolerate, 1 node(s) had taint {kubernetes.azure.com/scalesetpriority: spot}, that the pod didn't tolerate, 16 Insufficient cpu, 19 Insufficient memory. 2023-06-05T08:19:19.958579Z [Warning] 0/21 nodes are available: 1 node(s) had taint {ToBeDeletedByClusterAutoscaler: 1685952646}, that the pod didn't tolerate, 1 node(s) had taint {kubernetes.azure.com/scalesetpriority: spot}, that the pod didn't tolerate, 16 Insufficient cpu, 19 Insufficient memory. 2023-06-05T08:25:03.392815Z [Normal] Successfully assigned prod/jupyter-nadja-2egebril-40myhsba-2ede to aks-user-37927680-vmss00039w 2023-06-05T08:25:03Z [Warning] AttachVolume.Attach failed for volume "pvc-0cc03465-c578-48ae-aff8-ebe544a70512" : volume attachment is being deleted 2023-06-05T08:25:06Z [Warning] MountVolume.WaitForAttach failed for volume "pvc-0cc03465-c578-48ae-aff8-ebe544a70512" : volume attachment is being deleted 2023-06-05T08:27:06Z [Warning] Unable to attach or mount volumes: unmounted volumes=[volume-nadja-2egebril-40myhsba-2ede], unattached volumes=[volume-nadja-2egebril-40myhsba-2ede user-etc-singleuser dshm]: timed out waiting for the condition Spawn failed: pod prod/jupyter-nadja-2egebril-40myhsba-2ede did not start in 900 seconds!

TomAugspurger commented 1 year ago

If you email planetarycomputer@microsoft.com with the email address you used to sign up, I can take a look at what's going on.

bdkillo commented 6 months ago

Hello Tom. I am having similar launch issues. Giving me AttachVolume errors and timing out. I have sent you an email to the address noted above for help. Thanks.

TomAugspurger commented 6 months ago

We're currently facing an intermittent issue that's affecting all users. See https://github.com/microsoft/PlanetaryComputer/discussions/342 for more details.

bdkillo commented 6 months ago

Thanks Tom. The MS Planetary Computer hub worked great for me today. I appreciate the quick response.

Brian Killough

From: Tom Augspurger @.> Date: Wednesday, May 15, 2024 at 11:44 AM To: microsoft/PlanetaryComputer @.> Cc: Brian Killough @.>, Comment @.> Subject: Re: [microsoft/PlanetaryComputer] Spawn failed: did not start in 900 seconds (Issue #224)

We're currently facing an intermittent issue that's affecting all users. See #342https://github.com/microsoft/PlanetaryComputer/discussions/342 for more details.

— Reply to this email directly, view it on GitHubhttps://github.com/microsoft/PlanetaryComputer/issues/224#issuecomment-2112894609, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGLUKU42SFWSDBRJ3IJMWR3ZCN7FBAVCNFSM6AAAAAAY2UKJFGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMJSHA4TINRQHE. You are receiving this because you commented.Message ID: @.***>