chenhaoxing / DiffusionInst

This repo is the code of paper "DiffusionInst: Diffusion Model for Instance Segmentation" (ICASSP'24).
Apache License 2.0
221 stars 12 forks source link

I don't find the code that adding gaussian noise to ground-truth instance kernel #1

Closed MaverickRen closed 1 year ago

MaverickRen commented 1 year ago

In the formula of the paper, you added gaussian noise to ground-truth kernel, but I did not find the generation of ground-truth kernel in the code, and the sampling process like DDPM, does this conform to the paradigm of diffusion model? The prediction of the bounding box offset in DiffusionDet can still be understood as denoising, but I found that in your code, the generation of the kernel is directly predicted with the ROI feature, and there is no denoising process. Maybe my understanding is wrong, I hope you can help me solve my doubts, Thank you.

zhangxgu commented 1 year ago

@MaverickRen Hi, in the caption of figure 2, we said "During training, we add random t step noise to the groundtruth boxes and pad them to predefined numbers. Instance-aware noisy filters are constructed by combining features and noisy boxes. " Actually, the noisy instance filter is generated by noisy boxes and features. Thus, the adding noise and DDIM are now all based on bounding boxes. It is like "adding noise to gt_Box for noisy instance diffusion scheme". We are now working on directly add noise to the instance itself. By now, we will add an equation from noisy boxes to noisy instances to fix this error and update arxiv in a few days.

MaverickRen commented 1 year ago

Thank you for your reply, and look forward to your further improvement

------------------ 原始邮件 ------------------ 发件人: "chenhaoxing/DiffusionInst" @.>; 发送时间: 2022年12月7日(星期三) 晚上6:16 @.>; @.**@.>; 主题: Re: [chenhaoxing/DiffusionInst] I don't find the code that adding gaussian noise to ground-truth instance kernel (Issue #1)

@MaverickRen Hi, in the caption of figure 2, we said "During training, we add random t step noise to the groundtruth boxes and pad them to predefined numbers. Instance-aware noisy filters are constructed by combining features and noisy boxes. " Actually, the noisy instance filter is generated by noisy boxes and features. Thus, the adding noise and DDIM are now all based on bounding boxes. It is like "adding noise to gt_Box for noisy instance diffusion scheme". We are now working on directly add noise to the instance itself. By now, we will add an equation from noisy boxes to noisy instances to fix this error and update arxiv in a few days.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>