Closed AlexDenthanor closed 2 months ago
i just download Q5_K_M, but everything is fine. let me digging into LM studio any others error msg keyword can provider?
ask question to LM Studio here: https://discord.com/invite/aPQfnNkxGC
i need get the error happened, that i can debug.
maybe LLM model [[Preset]] choice wrong one. model info: https://huggingface.co/Lewdiculous/Eris_PrimeV4-Vision-32k-7B-GGUF-IQ-Imatrix model preset Recommended : https://huggingface.co/Lewdiculous/Eris_PrimeV4-Vision-32k-7B-GGUF-IQ-Imatrix/tree/main/sillytavern-presets-lewdicu-3.0.2-mistral-0.2 or just use Llama3v2 is fine
I cannot find this entire options bar anywhere on my end. I have no clue, I have clicked just about everywhere, lol. My version is 0.3.1. EDIT: Apparently in the newer versions of LMStudio the prompt format is now in my models but it's handled automatically from metadata in the model file, so I can't switch the preset like you can.
My switching the "Prompt Template" to Llama 3 I was able to get rid of the error and it works just fine now. I have posted the screenshots showing what I did for anyone else that may run into this issue into the future, caused by having the newer versions of LM Studio (0.3 and up).
I'm not sure why I keep getting this error, but I haven't the foggiest on how to fix it. I am using LM Studio.