shariqfarooq123 / LooseControl

Lifting ControlNet for Generalized Depth Conditioning
MIT License
449 stars 28 forks source link

i am trying to reproduce the training, but how to use the NYU-Depth-v2 dataset properly? #20

Open qinghew opened 1 month ago

qinghew commented 1 month ago

NYU-Depth-v2 dataset labeled many objects. I only use 40 classes, but there are still too many bboxes. image After training, the test still produces an image with the same shape as the boxes. prompt: In the dense summer forest, two cats and a dog play while a monkey swings through the branches. image

qinghew commented 1 month ago

should i train the C1 and C2 modes in your paper together?

bigshuimu commented 3 weeks ago

@qinghew 请问您复现出来了吗?

qinghew commented 3 weeks ago

@qinghew 请问您复现出来了吗?

没,试了纯sam会把地板墙壁分割出来,nyudepth的分割标签是语义分割,有的类别连到一起了,不知道好不好