search

thusiyuan / cooperative_scene_parsing

Code for NeurIPS 2018: Cooperative Holisctic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation
http://siyuanhuang.com/cooperative_parsing/main.html
MIT License
101 stars 19 forks source link

Test on images outside SUNRGBD dataset #5

Closed ZheC closed 5 years ago

ZheC commented 5 years ago

Hey, I test the model and it works well in the SUNRGBD dataset! Thank you for sharing it. Could you please give any hint about how to apply the model to images outside SUNRGBD dataset? Should I generate a pickle file following sunrgbd_process.py? Do we need any input other than the RGB image, e.g., the camera intrinsics?

thusiyuan commented 5 years ago

The inputs are only an RGB image and camera intrinsic matrix.

You should first detect 2D bounding boxes and feed the image patches and original image into LON and GGN to estimate the local objects and global geometry with attributes.

We may release the inference code in the future.

wellowdata commented 5 years ago

Hi, thank you for sharing this, it is a great project. Do you have any update on whether you will share the inference code?

Thanks