search

lmstudio-ai / .github

34 stars 3 forks source link

LM studio unable to load Falcon-180b 6q_k GGUF #1

Open VincentJGeisler opened 9 months ago

VincentJGeisler commented 9 months ago

Failed to load model 'TheBloke • falcon chat 180B q6_k gguf' Error: Error loading model. Exit code: -36861

seems to be related to pytorch versions from a quick google search.

yagil commented 9 months ago

Thanks @VincentJGeisler. If you’re able to join the discord, I or someone from the community will help you debug further: https://discord.gg/aPQfnNkxGC

VincentJGeisler commented 9 months ago

Unfortunatly i am not, discord is forbidden in my corporate environment, is blocked at the firewall.

3rdeyemedia commented 8 months ago

Hey guys. I hope you are all doing great. Please can someone help me get on the right track. Error: Error loading model. Exit code: -36861 I would really appreciate some help, thank you.

yagil commented 8 months ago

@3rdeyemedia are you able to join discord? It’s by far the most effective way to get help.

3rdeyemedia commented 8 months ago

Hello, Thank you very much for the advice. I am on it now, but I can't send messages yet. I will try completing my page set up so I can chat with other users.