GewelsJI / DGNet

Deep Gradient Network for Camouflaged Object Detection (MIR 2023). Our codebase supports PyTorch & Jittor & Huawei-Ascend platforms..
MIT License
100 stars 19 forks source link

Why is your model well generalized for different applications such as polyp/transparent segmentation? #4

Closed muraano closed 2 years ago

muraano commented 2 years ago

First of all, thanks for your great work for camouflaged object detection(COD). I know segmentation task, but I am very new to COD. I read your paper and am really surprised to your great result, but I have one question about polyp/transparent segmentation. I understood a key feature of your model is to learn an object texture as well as an object shape. If this understanding is correct, I'm not sure why this also improves the polyp/transparent segmentation accuracy because they don't seem to have a distinct texture.

GewelsJI commented 2 years ago

Hi, @muraano

Thank you for putting forward such an excellent discussion here.

Yes. In our early experiments, we excitingly found that our model could perform well in some similar tasks, such as polyp/transparent/surface anomaly objects. Similar to COD, these task scenes contain camouflaged patterns in Figure 9.

Notably, the excellent generalization ability may be an open issue here. We provide a dual-branch framework comprising object texture and object semantic learners. The former could excavate the gradient-wise perspective's abundant texture cues of candidate object(s). The latter receives the texture cues and takes further aggregation via GIT. This could be viewed as the holistic semantic understanding of the current scene along with the texture (whether distinct or non-distinct).

Happy to receive your interesting idea or understanding.

Best.

muraano commented 2 years ago

Thanks for your answer!