openai / consistency_models

Official repo for consistency models.
MIT License
6.02k stars 409 forks source link

Specifying a specific image as supervisory information for the generated image? #22

Open YLBGHXTX opened 1 year ago

YLBGHXTX commented 1 year ago

Is it not possible to specify a corresponding image as supervisory information for the generated image during the generation process in the model code that was released? Please reply to me with relevant information. Thank you!

nekoshadow1 commented 1 year ago

I think you can refer to image-to-image diffusion models, such as Palette, to modify this code base to perform image-to-image task. You might need to modify the edm training, consistency distillation, and image sampling parts altogether to make it work. A potential helpful reference is: https://github.com/crosszamirski/guided-I2I