Open zhuang2002 opened 1 month ago
Hi, thank you for releasing the new model! I have a question: Can the brushnet weights and text_encoder weights from PowerPaint_v2 be used with any SD1.5 model? For example, runwayml/stable-diffusion-v1-5
or Lykon/DreamShaper
Hi, thank you for releasing the new model! I have a question: Can the brushnet weights and text_encoder weights from PowerPaint_v2 be used with any SD1.5 model? For example,
runwayml/stable-diffusion-v1-5
orLykon/DreamShaper
Yes, it should be feasible. In fact, we use SD 1.5 as the base model for training.
fwiw, the old PowerPaint model is not working on hugging face any more. Here's the error I'm getting:
@FlightsMonitor Your log shows that you are using Fantasy-Studio/Paint-by-Example
, not the powerpaint_v1 model.
Starting the Fantasy-Studio/Paint-by-Example
model with iopaint==1.0.0b10
indeed resulted in an error. It can be successfully started with iopaint==1.2.3
.
@Sanster any instructions for downloading and using the V2 PowerPaint model? excited to try it here!
We have recently developed a new version of PowerPaint, drawing inspiration from Brushnet. The Online Demo has been updated accordingly. In the coming days, we intend to make the model weights available as open source.
Feel free to try it out and give it a star!
The PowerPaint model possesses the ability to carry out diverse inpainting tasks, such as object insertion, object removal, shape-guided object insertion, and outpainting. Notably, we have retained the cross-attention layer that BrushNet had removed, which is essential for task prompt input.