haofanwang / Lora-for-Diffusers

The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥
MIT License
739 stars 46 forks source link

prompt example being truncated #6

Open khimaros opened 1 year ago

khimaros commented 1 year ago

with stable-diffusion-v1-5, the default tokenizer only allows 77 tokens. are you having desired results with the prompt included in your wanostyle example? i'm seeing this warning and poor image results:

The following part of your input was truncated because CLIP can only handle sequences up to 77 tokens: ['_ offset : 1 >, closed shirt, anime screencap, scar under eye, ready to fight, black eyes']
haofanwang commented 1 year ago

This is the limitation of fixed CLIP text encoder. Try a more compact prompt.