search

ziqihuangg / Collaborative-Diffusion

Collaborative Diffusion (CVPR 2023)
https://ziqihuangg.github.io/projects/collaborative-diffusion.html
Other
389 stars 31 forks source link

details about dynamic diffuser and Influence Functions #35

Open CNGaoWenbo opened 2 months ago

CNGaoWenbo commented 2 months ago

Hi, in your paper seems no details about how dynamic diffuser works and how to get Influence Functions. can you provide more details? or the codes related to this part. Thank you

ziqihuangg commented 2 months ago

Hi, please see paper Section 3.2, and Supplementary File Section A.1 for details. Corresponding model definitions are available here: https://github.com/ziqihuangg/Collaborative-Diffusion/blob/master/ldm/models/diffusion/compose_modules.py Hope this clarifies.

CNGaoWenbo commented 2 months ago

thank you. From my understanding, the pre-trained seg_mask_unet outputs a generated picture at t, then feed this picture into the dynamic diffuser(seg_mask_confidence_predictor in codes). I understand that seg_mask_unet is trained, but the problem is I did not find how to train the seg_mask_confidence_predictor. Are seg_mask_confidence_predictor and seg_mask_unet the same unet model?