Adding the ability to detect bubbles and color them

xulihang / ImageTrans-docs

Documentation of ImageTrans, a computer-aided image translation tool. ImageTrans的文档项目。ImageTrans是一款计算机辅助图片/漫画翻译软件。

https://imagetrans.readthedocs.io/

85 stars 7 forks source link

Adding the ability to detect bubbles and color them #742

Open NANAREDFISH opened 2 weeks ago

NANAREDFISH commented 2 weeks ago

is it possible to add a clean function based on the bubble and color it with the appropriate color instead of using a text mask? https://drive.google.com/file/d/1wun_d53Bp-aVneKkzpFuT_kJ4sH77vRe/view?usp=drive_link

NANAREDFISH commented 2 weeks ago

Also, in the video sent, a Photoshop action has been used that, in addition to colorization, utilizes some other Photoshop features, which result in the removal of text and prevent the pixelation around the bubble. I will also send you these actions so that you can test them in Photoshop. https://drive.google.com/file/d/1A1CQ4NVlngdboGrzTG9r9dD8lWCTtZ8-/view?usp=sharing

xulihang commented 2 weeks ago

Which mode do you prefer? To fill in the bubbles with a background color or restore the background?

Fill in with the background color.

Restore the background:

The latter one is called inpainting which ImageTrans supports. The first one is a bit difficult as I have to do bubble segmentation.

Check out this blog to know more about inpainting: https://www.basiccat.org/details-about-image-text-removal-using-imagetrans/

xulihang commented 2 weeks ago

@NANAREDFISH It is not normal that there are so many spam comments. You can unsubscribe this issue to avoid being notified.

NANAREDFISH commented 2 weeks ago

I did it. Also, I think it would be great if we could have both features together, and also have the ability to color the bubble with the background color.

NANAREDFISH commented 2 weeks ago

Of course, the results achieved by working on the inpainting feature are excellent, but it would be great if all the bubbles could easily turn white without worrying about which method's results might work better.

xulihang commented 2 weeks ago

I decided not to add this feature for now. You can use Photoshop to create the image with the balloon filled and then add "-original.jpg" to the files to use them in ImageTrans.

Example:

image.jpg
image.jpg-original.jpg