microsoft / PlanetaryComputer

Issues, discussions, and information about the Microsoft Planetary Computer
https://planetarycomputer.microsoft.com/
MIT License
185 stars 9 forks source link

Hub notebook server not starting #267

Closed TomAugspurger closed 1 year ago

TomAugspurger commented 1 year ago

When logging into the Hub and selecting an environment, the logs seem stuck at "Server requested"

image

Looking into this now.

TomAugspurger commented 1 year ago

I've disabled the userScheduler. Pods seem to be being scheduled now:

image
mattsmiScientific commented 1 year ago

Thanks @TomAugspurger, mine scheduling too now, though getting interesting messages in the event log image

mattsmiScientific commented 1 year ago

@TomAugspurger Keep getting spawn failed due to server taking longer than 30 seconds to reply. I have quite a lot of data in my image - could it be an over-early timeout issue?

TomAugspurger commented 1 year ago

Taking a look. Users occasionally see an error like that when their home directory is full.

mattsmiScientific commented 1 year ago

That could be me. Please don't delete the data (I need to back up my notebooks, the actual data itself could be regenerated).


From: Tom Augspurger @.> Sent: 19 September 2023 15:15 To: microsoft/PlanetaryComputer @.> Cc: Matthew Smith @.>; Comment @.> Subject: Re: [microsoft/PlanetaryComputer] Hub notebook server not starting (Issue #267)

Taking a look. Users occasionally see an error like that when their home directory is full.

— Reply to this email directly, view it on GitHubhttps://github.com/microsoft/PlanetaryComputer/issues/267#issuecomment-1725694357, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AWJO2FKPG2UKS3U6K4TFG5TX3GSITANCNFSM6AAAAAA46JCLCU. You are receiving this because you commented.Message ID: @.***>

TomAugspurger commented 1 year ago

I just increased the size of your disk, if you want to try again.

BTW, https://planetarycomputer.microsoft.com/docs/overview/environment/#understanding-the-file-system recommends just storing code and notebooks in your home directory. Large outputs should go somewhere like Blob Storage.

And yes, backups are always a good idea :)

mattsmiScientific commented 1 year ago

Thanks @TomAugspurger yes that worked. Thanks. You are absolutely right about blob storage - I was obsessing about solving one problem and not seeing the other!

mattsmiScientific commented 1 year ago

Thanks for the incredible support @TomAugspurger :-)

gkenyon99 commented 9 months ago

Hi @TomAugspurger I think I am having the same issue and my directory is full. my username is sggkenyo@liverpool.ac.uk. Please could you help me get access today? I really need it for a journal deadline, thanks

gkenyon99 commented 9 months ago

sorry the username is g.e.kenyon@liverpool.ac.uk