synbol / Awesome-Parameter-Efficient-Transfer-Learning

Collection of awesome parameter-efficient fine-tuning resources.
485 stars 11 forks source link

Any paper for Prompt-Tuning of text-to-image diffusion models? #9

Open AHHHZ975 opened 2 months ago

AHHHZ975 commented 2 months ago

Hi, I have been looking for a simple example/script or even a paper that shows how I can use the prompt-tuning technique to fine-tune the text encoder of a stable diffusion model. But I could not find any. I also reviewed all the papers mentioned in this repository but it seems that there is no work in this specific field. Am I right? So, I was wondering if there is any work for this purpose that I am not aware of. Could you please introduce me if there is already one? If there is no implementation, I would appreciate any help/available resources that you are aware of for fine-tuning the text encoder with or without the PEFT library. Thanks!