xlinx / sd-webui-decadetw-auto-prompt-llm

sd-webui-auto-prompt-llm
MIT License
46 stars 8 forks source link

Only User & Support Roles Are Supported #8

Closed AlexDenthanor closed 2 months ago

AlexDenthanor commented 2 months ago

image

I'm not sure why I keep getting this error, but I haven't the foggiest on how to fix it. I am using LM Studio. image

xlinx commented 2 months ago

r1

i just download Q5_K_M, but everything is fine. let me digging into LM studio any others error msg keyword can provider?

  1. Auto1111-WEB-UI or FORGE
  2. LM Studio error Only User & Support Roles Are Supported
  3. LLM-TEXT or LLM-VISION or BOTH
  4. LM Studio version; which i use 0.2.29 in left bottom coner w/ LM Studio App
  5. ask question to LM Studio here: https://discord.com/invite/aPQfnNkxGC

    i need get the error happened, that i can debug.

xlinx commented 2 months ago

maybe LLM model [[Preset]] choice wrong one. model info: https://huggingface.co/Lewdiculous/Eris_PrimeV4-Vision-32k-7B-GGUF-IQ-Imatrix model preset Recommended : https://huggingface.co/Lewdiculous/Eris_PrimeV4-Vision-32k-7B-GGUF-IQ-Imatrix/tree/main/sillytavern-presets-lewdicu-3.0.2-mistral-0.2 or just use Llama3v2 is fine

螢幕擷取畫面 2024-08-27 051751

AlexDenthanor commented 2 months ago

image I cannot find this entire options bar anywhere on my end. I have no clue, I have clicked just about everywhere, lol. My version is 0.3.1. EDIT: Apparently in the newer versions of LMStudio the prompt format is now in my models but it's handled automatically from metadata in the model file, so I can't switch the preset like you can.

image

image

image

My switching the "Prompt Template" to Llama 3 I was able to get rid of the error and it works just fine now. I have posted the screenshots showing what I did for anyone else that may run into this issue into the future, caused by having the newer versions of LM Studio (0.3 and up).