search

monniert / differentiable-blocksworld

[NeurIPS 2023] Code for "Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitives"
https://www.tmonnier.com/DBW
MIT License
197 stars 10 forks source link

Indoor scene reconstruction #4

Closed zz7379 closed 1 year ago

zz7379 commented 1 year ago

I am wondering that is it possible to use this method for Indoor scene reconstruction?

monniert commented 1 year ago

Hi zz7379, thanks for the interest!

What do you mean by indoor scenes? In general, it would work for scenes where the desired content to reconstruct is close to the camera and the background is relatively farther from the camera so that it can be modeled by the background dome. For example, this is the case for the gundam, the multi cylinder or the campanile scenes. I think it would struggle for scenes like rooms from ScanNet where the desired content to reconstruct is the entire room. That said, it is worth trying with a very far background dome, the superquadrics may reconstruct the walls.

Hope this helps, feel free to reopen if you have questions!