LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.27k stars 360 forks source link

unknown model architecture: '' and SEGV while loading the model sdxl_lightning_4step.q8_0.gguf #1065

Closed yurivict closed 3 months ago

yurivict commented 3 months ago

koboldcpp fails to load this model:

llama_model_loader: loaded meta data with 0 key-value pairs and 2641 tensors from /disk-samsung/llama-cpp-experiments/models/sdxl_lightning_4step.q8_0.gguf (version GGUF V3 (latest))
llama_model_load: error loading model: error loading model architecture: unknown model architecture: ''
llama_load_model_from_file: failed to load model
Segmentation fault

Version: 1.72 clang-18 FreeBSD 14.1

LostRuins commented 3 months ago

You need to load stable diffusion models with --sdmodel instead of --model (or using the GUI, select it as "Image Model", not "Model")

yurivict commented 3 months ago

There's no such field "Image Model". There is the field "Stable Diffusion Model" on the "Image Gen" tab. But this model fails later:

Warning: KCPP text generation not initialized!

Output: 

This model is supposed to generate images.

LostRuins commented 3 months ago

There is the field "Stable Diffusion Model" on the "Image Gen" tab.

Yes that is correct.

I am confused. Do you not want to generate images? You don't prompt for text when you are generating images.

Instead, click and "Add Img" button image and then select "Custom Prompt" image and type your image prompt.

Alternatively, KoboldCpp also comes with an image gen SD UI http://localhost:5001/sdui which you may prefer

yurivict commented 3 months ago

This worked.

Thank you for your help!