search

pablodawson / ldm3d-inpainting

Joint image and Depth inpainting, ldm3d
https://huggingface.co/pablodawson/ldm3d-inpainting
11 stars 0 forks source link

The result is bad #1

Open ThePassedWind opened 2 months ago

ThePassedWind commented 2 months ago

The rgb inpainting result is bad. Your code haven't used your unet, it is just 4 num_channels_unet but not 9 num_channels_unet.

unet = UNet2DConditionModel.from_pretrained("pablodawson/ldm3d-inpainting", cache_dir="cache", subfolder="unet")

Could you show how to use your unet correctly?

pablodawson commented 2 months ago

Could you share the results? It shouldn't matter, since it follows the config file of that model. Also where is that line from? Try with test.py or ldm3d_inpainting.ipynb

ThePassedWind commented 2 months ago

Thanks for your reply. I haven't found my results. What impressed me most is the channel number of Unet. I think 9 is correct to do inpainting task, but 4 in your code(not only test.py but also ldm3d_inpainting.ipynb).

The Unet (9 input channels) is defined by yourself, but you may not use it in your pipeline, where default Unet (4 input channels) is used

unet = UNet2DConditionModel.from_pretrained("pablodawson/ldm3d-inpainting", cache_dir="cache", subfolder="unet")