rmattson1008 / ornet

Organellar segmentation, tracking, and network modeling.
MIT License
0 stars 0 forks source link

Can't get GPU on logan #27

Closed rmattson1008 closed 1 year ago

rmattson1008 commented 1 year ago

I can get on but cannot use gpu. I get No supported gpu backend found! when I try to use. Could it be affected by UGA system maintenance? It looks like a lot of stuff is being worked on this week - maintenance schedule. I was having no trouble this morning.

rmattson1008 commented 1 year ago

nvidia-smi asks me to install nvidia-smi, haha, torch.cuda.is_available() returns false

magsol commented 1 year ago

Entirely possible. I just got out of a meeting with Piotr in Franklin OIT, and he's still actively working on Logan because apparently there is some instability: occasionally Logan won't turn back on after a reboot, so he's looking into that. Precipitating the reboots are upgrades that may very well be the reason why you're getting that error message.

If you need a GPU, and if the process if feasible, we may want to temporarily relocate your work onto rocinante since there are plenty of GPUs available there @Micky774 .

rmattson1008 commented 1 year ago

Ok, thanks for the quick response - I can work on other/adjacent stuff for a day or so. If Piotr indicates it might be a longer disruption then I can look at moving to rocinante.

Micky774 commented 1 year ago

This should almost surely not fix it, but have you tried turning it off and back on again?

rmattson1008 commented 1 year ago

I'm working out of one of the AI Institute Machines. Totally fine for now, but happy to move back to Logan when Piotr is done with it.

magsol commented 1 year ago

According to Piotr, he's updating Logan sometime this week. I'll keep you apprised.

On Mon, Mar 20, 2023 at 12:02 PM rmattson1008 @.***> wrote:

I'm working out of on of the AI Institute Machines. Totally fine for now, but happy to move back to Logan when Piotr is done with it.

— Reply to this email directly, view it on GitHub https://github.com/rmattson1008/ornet/issues/27#issuecomment-1476512574, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABBB6M7UOGBNC3AYBHP3CTW5B5S7ANCNFSM6AAAAAAVS7LFRM . You are receiving this because you commented.Message ID: @.***>