bcmi / Object-Shadow-Generation-Dataset-DESOBAv2

[CVPR 2024] The dataset, code, and model for our paper "Shadow Generation for Composite Image Using Diffusion Model", CVPR, 2024.
Apache License 2.0
84 stars 8 forks source link

Does it work with foreground, foreground mask, and background images? #10

Open MianWang123 opened 1 week ago

MianWang123 commented 1 week ago

Hi, there. Great job extending [Object-Shadow-Generation-Dataset-DESOBA]. Here's the situation, I got the foreground image, foreground mask, background image, can i use your method to generate shadow as it's realized in [Object-Shadow-Generation-Dataset-DESOBA]?

MianWang123 commented 1 week ago

I tried to fill the rest folders (e.g. background_object_masks, background_shadow_masks) with black images, the model ran successfully, only the output looked weird.

Narumi-Maria commented 1 week ago

If the scenes in your data are significantly different, you may need to retrain in your domain. For example, the results we generated for indoor scenes were not good.

MianWang123 commented 2 days ago

If the scenes in your data are significantly different, you may need to retrain in your domain. For example, the results we generated for indoor scenes were not good.

Just wanna make sure, "fg img + fg mask + bg img" are enough for the inputs, or these inputs are suitable for ur model