search

pengsongyou / openscene

[CVPR'23] OpenScene: 3D Scene Understanding with Open Vocabularies
https://pengsongyou.github.io/openscene
Apache License 2.0
635 stars 43 forks source link

How to conduct open-vocabulary 3D search? #74

Closed hanxunyu closed 4 months ago

hanxunyu commented 6 months ago

Thanks for your great work! But I want to know how to conduct 3D object search in this project. It seems that you only provide the function of 3D semantic segmentation but i don't know how to search 3D object by typing prompts. Thanks a lot.

pengsongyou commented 4 months ago

One can do the 3D object search in a manual check manner, since as shown in Table 6, there are many newly found objects in the Matterport3D dataset. What we did was simply use our interactive viewer, load all scenes, do the query, and see whether each corresponding highlighted object corresponds to the annotations in GT labels or not.