How does DeepMosaics recognize mosaics?

HypoX64 / DeepMosaics

Automatically remove the mosaics in images and videos, or add mosaics to them.

GNU General Public License v3.0

2.13k stars 441 forks source link

Open ramge132 opened 1 year ago

ramge132 commented 1 year ago

First of all, thank you very much for making a great project.

DeepMosaics seems to recognize the mosaic area and process only that part, so I wonder the way of recognize the mosaic area.

Please let me know if there are any codes or related documents that I need to see.

Thank you.

wywywywy commented 1 year ago

It uses a BiSeNet to get the mask. The checkpoint is the ./pretrained_models/mosaic/mosaic_position.pth

ferograd commented 1 year ago

Is there a way to refine it? And train it more?

Some of the mosaics are rather small, but would be really useful to get rid of regardless