search

open-mmlab / PowerPaint

[ECCV 2024] PowerPaint, a versatile image inpainting model that supports text-guided object inpainting, object removal, image outpainting and shape-guided object inpainting with only a single model. 一个高质量多功能的图像修补模型，可以同时支持插入物体、移除物体、图像扩展、形状可控的物体生成，只需要一个模型
https://powerpaint.github.io/
MIT License
364 stars 18 forks source link

Details preserve (Blend mode?) #46

Open dx777 opened 3 weeks ago

dx777 commented 3 weeks ago

Is there a possibility to preserve details during inpainting? Like the text for example. Brushnet has a "blended" flag, which I believe they use to just paste the input image on top of the result image, which in the case of powerpaint does not look good, since the shape is a bit mismatched.

zengyh1900 commented 1 week ago

Hi @dx777,

Thanks for your attention.

  1. Yes. PowerPaint can also paste the generated region back to the original image. However, a problem may raise that the generated content may show some color shift compared with the original image. We will try to solve it.
  2. As for the issue of 'mismatched shape', would you mind showing some results ?
lanson07 commented 1 week ago

Hi @dx777,

Thanks for your attention.

  1. Yes. PowerPaint can also paste the generated region back to the original image. However, a problem may raise that the generated content may show some color shift compared with the original image. We will try to solve it.
  2. As for the issue of 'mismatched shape', would you mind showing some results ?

Hi~ I encountered the same problem about color shift. Could u plz share some experience about the emergence of this problem and possible solutions？