search

kohya-ss / sd-scripts

Apache License 2.0
5.03k stars 842 forks source link

[Questions] Is this scripts applied pivotal tuning like cloneofsimo repo? #18

Open baejun10 opened 1 year ago

baejun10 commented 1 year ago

https://github.com/cloneofsimo/lora In this repository, they say applied dreambooth, textual inversion and pivotal tuning to lora.

Is Pivotal tuning working in this repo too?

kohya-ss commented 1 year ago

I didn't know about the pivotal tuning, so I read their repo. In my undersanting, it trains Textual Inversion for some steps, then stop Textual Inversion training and start LoRA training.

Unfortunately, this repo doesn't support TI training, so Pivotal tuning is also not supported.

If I make TI supporting in future, I will consider adding Pivotal tuning 😀

gigadeplex commented 1 year ago

bump

mariaWitch commented 11 months ago

@kohya-ss Any update on this now that WebUI has support for LoRA Bundled Embeddings?

kohya-ss commented 11 months ago

Thank you for letting me know. I'm working on the pivotal tuning, and will support LoRA bundled embeddings :)

Poiuytrezay1 commented 10 months ago

Is there a possibility to help you? This would be a fantastic feature, but I am afraid of the time it could take to implement.