MC-E / DragonDiffusion

ICLR 2024 (Spotlight)
Apache License 2.0
717 stars 22 forks source link

Questions regarding the details of DragonDiffusion #6

Open Kyfafyd opened 1 year ago

Kyfafyd commented 1 year ago

Thanks for the great work! I am wondering how you obtain the mask of a specific object?

MC-E commented 1 year ago

You can manually draw these masks, or you can automatically obtain the object mask through segmentation algorithms (such as the recommended SAM https://github.com/facebookresearch/segment-anything).

ryanlu2240 commented 1 year ago

You can manually draw these masks, or you can automatically obtain the object mask through segmentation algorithms (such as the recommended SAM https://github.com/facebookresearch/segment-anything).

I also have question bout the mask. Do you use the same mask_gud (from SAM or manually drew) across all time step? also still not clear how you obtain mask_gen? thanks for the great work!