sha2nkt / deco

Estimate vertex-level 3D human-scene and human-object contacts across the full body mesh
https://deco.is.tue.mpg.de/
Other
58 stars 4 forks source link

Visualization of the scene segmentation maps #14

Closed ChrisChenYh closed 5 months ago

ChrisChenYh commented 5 months ago

Thanks for your sharing. I visualize the scene segmentation maps predicted by the model './checkpoints/Release_Checkpoint/deco_best.pth', but I find that the results seem weird, as shown in the picture, there are many wrong categories. I wonder if you could give some advice. Here is the code, which is mainly borrowed from mask2former. image image

sha2nkt commented 5 months ago

This is expected. The scene segmentation branch in DECO is only meant to add semantic context about the scene to help DECO reason about contact. It is not supposed to work well as a segmentation model.