LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.35k stars 364 forks source link

For some reason, Automatic generation is not working as expected. #1130

Open rylaix opened 2 months ago

rylaix commented 2 months ago

Seems Like it's my only Issue. For image gen I utilize sd next with preloaded settings. koboldcpp do not accurately automatically cathes information to generate art (same happens if load model through koboldcpp itself). Also, koboldcpp do not utilize json information from loaded character to auto generation at all (not sure if it's a proposit or not).

Additional Information: Windows 11, i9 11900K, RTX 4070 TI SUPER

LostRuins commented 2 months ago

The prompt is only gathered from the last 3 sentences or so. If the response is very long, it may not be very accurate.

Did you try the "Generate Image (Custom Prompt)", does that work well?

rylaix commented 2 months ago

Custom works well, but automatic (no matter what do i do), gives me a shitty and cartoonish images (even using heavy sdxl model). Do not know how can I exactly place a "generic prompt" (this could be useful as using this images can be a little bit related to the character at least) which will be added to the automatic prompt based on the text (and how to fix issue with generation quality itself)

LostRuins commented 2 months ago

Try adjust the style settings. The settings might not be ideal.

Replace the "default style" with the prompt tags to add to every image

Then, add "none" to the negative prompt to prevent the default negative prompt used.

image

rylaix commented 2 months ago

That's useful, but I've already tried it. Seems like the output image has some wrong setting (e.g resolution), this could explain poor result. Problem itself could be related with how SD Next manages some models.

rylaix commented 2 months ago

Closing issue. Found out, that with some models loboldcpp waorks extremely bad (in case is used external a1111), and with some is working fine

rylaix commented 2 months ago

Hum, seems like I'm wrong. Will make further research and submit here more information about issue.

Seems like issue is even deeper than I thought.