search

kousw / experimental-consistory

MIT License
104 stars 6 forks source link

To use guidance scale > 1.0 #3

Open debasmitdas opened 9 months ago

debasmitdas commented 9 months ago

Any workaround to use guidance scale > 1.0. The code seems to break when guidance scale of > 1.0 is used.

kousw commented 9 months ago

As the documentation says, I currently only support cfg = 1.0 with lcm-lora. I did not prefer to handle cfg in batch parallel, which is often the case, because of self-attention across batches.

I'll look into cfg support when I have time.